2023-04-14 13:55:38,374 INFO  [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks timeout: 13 mins
2023-04-14 13:55:38,745 WARN  [Time-limited test] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties
2023-04-14 13:55:38,881 INFO  [Time-limited test] metrics.MetricRegistriesLoader(60): Loaded MetricRegistries class org.apache.hadoop.hbase.metrics.impl.MetricRegistriesImpl
2023-04-14 13:55:38,956 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2023-04-14 13:55:38,964 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc.
2023-04-14 13:55:38,979 INFO  [Time-limited test] hbase.ResourceChecker(147): before: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnLargeClusterWithRacks Thread=10, OpenFileDescriptor=260, MaxFileDescriptor=60000, SystemLoadAverage=436, ProcessCount=208, AvailableMemoryMB=1922
2023-04-14 13:55:38,981 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2023-04-14 13:55:38,982 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=5000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=10000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc.
2023-04-14 13:55:39,147 INFO  [Time-limited test] balancer.BalancerTestBase(547): Mock Cluster : { srv1008613770:84 , srv1010742541:84 , srv1024622556:84 , srv1045989767:84 , srv1055825217:84 , srv1056024010:84 , srv108372261:84 , srv109595222:84 , srv109769348:84 , srv1129889006:84 , srv1143797053:84 , srv1156207697:84 , srv1164872171:84 , srv1239268705:84 , srv1251462785:84 , srv1251505925:84 , srv1285631950:84 , srv1348117311:84 , srv1385682506:84 , srv1400848406:84 , srv1414937495:84 , srv1425353700:84 , srv1431213372:84 , srv1464085557:84 , srv1466835786:84 , srv147646809:84 , srv1487280795:84 , srv1498621889:84 , srv1499411368:84 , srv1512369861:84 , srv1514938869:84 , srv153974636:84 , srv1557526779:84 , srv159487192:84 , srv1609094881:84 , srv1620675215:84 , srv1628491619:84 , srv1628934416:84 , srv1631123540:84 , srv1634751069:84 , srv1676818614:84 , srv1689375657:84 , srv168947954:84 , srv1713428277:84 , srv1771202816:84 , srv1781740622:84 , srv1805440317:84 , srv1806859528:84 , srv1811019454:84 , srv1854459090:84 , srv1876812807:84 , srv1880316063:84 , srv1908672910:84 , srv1959849697:84 , srv1962950093:84 , srv1981536466:84 , srv2007249272:84 , srv2007468433:84 , srv208413821:84 , srv215907271:84 , srv252870332:84 , srv27338155:84 , srv278488853:84 , srv293502275:84 , srv294128981:84 , srv305369098:84 , srv329061599:84 , srv392061615:84 , srv394117076:84 , srv398128577:84 , srv421788873:84 , srv438092760:84 , srv445952301:84 , srv462345037:84 , srv484517777:84 , srv501964800:84 , srv50527381:84 , srv509208445:84 , srv510569551:84 , srv550616864:84 , srv552769393:84 , srv610091480:84 , srv611582160:84 , srv613410911:84 , srv640566639:84 , srv714047869:84 , srv736035324:84 , srv738769146:84 , srv754303931:84 , srv759693806:84 , srv778701305:84 , srv802982724:84 , srv812285496:84 , srv813569376:84 , srv887078750:84 , srv904655829:84 , srv906894490:84 , srv922384391:84 , srv966854894:84 , srv2015638186:684 } [srvr=100 rgns=9000 avg=90.0 max=90 min=90]
2023-04-14 13:55:39,161 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-04-14 13:55:39,170 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1880316063=51, srv1806859528=47, srv1557526779=32, srv252870332=61, srv509208445=78, srv1164872171=12, srv2007468433=57, srv1400848406=19, srv1628491619=36, srv1008613770=0, srv398128577=70, srv462345037=74, srv552769393=81, srv421788873=71, srv1425353700=21, srv611582160=83, srv1251462785=14, srv1045989767=3, srv1676818614=40, srv329061599=67, srv1962950093=54, srv1129889006=9, srv1771202816=44, srv759693806=90, srv736035324=87, srv1487280795=26, srv1285631950=16, srv1431213372=22, srv1464085557=23, srv50527381=77, srv168947954=42, srv1251505925=15, srv109595222=7, srv1713428277=43, srv27338155=62, srv215907271=60, srv1466835786=24, srv1981536466=55, srv294128981=65, srv904655829=96, srv1348117311=17, srv1414937495=20, srv1805440317=46, srv887078750=95, srv1156207697=11, srv1631123540=38, srv208413821=59, srv1512369861=29, srv147646809=25, srv1628934416=37, srv714047869=86, srv1055825217=4, srv1689375657=41, srv1498621889=27, srv906894490=97, srv802982724=92, srv1143797053=10, srv1239268705=13, srv1620675215=35, srv1499411368=28, srv1854459090=49, srv966854894=99, srv1634751069=39, srv305369098=66, srv510569551=79, srv813569376=94, srv1385682506=18, srv1811019454=48, srv392061615=68, srv610091480=82, srv2007249272=56, srv640566639=85, srv1514938869=30, srv153974636=31, srv778701305=91, srv1908672910=52, srv501964800=76, srv1010742541=1, srv438092760=72, srv613410911=84, srv812285496=93, srv550616864=80, srv159487192=33, srv108372261=6, srv1609094881=34, srv278488853=63, srv484517777=75, srv1056024010=5, srv109769348=8, srv293502275=64, srv738769146=88, srv2015638186=58, srv1959849697=53, srv445952301=73, srv1876812807=50, srv754303931=89, srv1024622556=2, srv1781740622=45, srv922384391=98, srv394117076=69} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-04-14 13:55:39,270 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-04-14 13:55:39,270 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-04-14 13:55:39,271 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-04-14 13:55:39,271 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-04-14 13:55:39,271 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-04-14 13:55:39,271 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-04-14 13:55:39,271 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-04-14 13:55:39,271 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-04-14 13:55:39,271 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-04-14 13:55:39,271 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-04-14 13:55:39,271 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-04-14 13:55:39,271 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-04-14 13:55:39,272 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-04-14 13:55:39,272 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-04-14 13:55:39,272 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-04-14 13:55:39,272 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-04-14 13:55:39,272 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-04-14 13:55:39,272 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-04-14 13:55:39,272 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-04-14 13:55:39,273 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-04-14 13:55:39,273 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-04-14 13:55:39,273 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-04-14 13:55:39,273 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-04-14 13:55:39,273 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-04-14 13:55:39,273 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-04-14 13:55:39,273 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-04-14 13:55:39,274 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-04-14 13:55:39,274 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-04-14 13:55:39,274 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-04-14 13:55:39,274 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-04-14 13:55:39,274 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-04-14 13:55:39,274 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-04-14 13:55:39,274 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-04-14 13:55:39,275 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-04-14 13:55:39,275 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-04-14 13:55:39,275 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-04-14 13:55:39,275 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-04-14 13:55:39,275 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-04-14 13:55:39,275 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-04-14 13:55:39,275 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-04-14 13:55:39,275 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-04-14 13:55:39,275 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-04-14 13:55:39,275 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-04-14 13:55:39,276 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-04-14 13:55:39,276 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-04-14 13:55:39,276 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-04-14 13:55:39,276 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-04-14 13:55:39,276 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-04-14 13:55:39,276 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-04-14 13:55:39,276 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-04-14 13:55:39,276 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-04-14 13:55:39,276 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-04-14 13:55:39,276 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-04-14 13:55:39,277 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-04-14 13:55:39,277 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-04-14 13:55:39,277 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-04-14 13:55:39,277 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-04-14 13:55:39,277 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-04-14 13:55:39,277 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-04-14 13:55:39,277 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-04-14 13:55:39,278 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-04-14 13:55:39,278 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-04-14 13:55:39,278 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-04-14 13:55:39,278 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-04-14 13:55:39,278 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-04-14 13:55:39,278 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-04-14 13:55:39,278 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-04-14 13:55:39,278 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-04-14 13:55:39,278 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-04-14 13:55:39,278 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-04-14 13:55:39,279 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-04-14 13:55:39,279 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-04-14 13:55:39,279 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-04-14 13:55:39,279 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-04-14 13:55:39,279 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-04-14 13:55:39,279 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-04-14 13:55:39,279 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-04-14 13:55:39,279 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-04-14 13:55:39,279 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-04-14 13:55:39,279 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-04-14 13:55:39,279 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-04-14 13:55:39,279 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-04-14 13:55:39,280 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-04-14 13:55:39,280 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-04-14 13:55:39,280 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-04-14 13:55:39,280 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-04-14 13:55:39,280 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-04-14 13:55:39,280 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-04-14 13:55:39,280 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-04-14 13:55:39,280 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-04-14 13:55:39,280 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-04-14 13:55:39,280 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-04-14 13:55:39,280 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-04-14 13:55:39,281 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-04-14 13:55:39,281 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-04-14 13:55:39,281 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-04-14 13:55:39,281 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-04-14 13:55:39,281 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-04-14 13:55:39,281 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-04-14 13:55:39,281 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-04-14 13:55:39,282 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-04-14 13:55:39,526 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.06666666666666667, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-04-14 13:55:39,528 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-04-14 13:55:39,528 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.9909252140407105, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.06666666666666667, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-04-14 13:55:40,150 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 834 ms to try 5000 different iterations.  Found a solution that moves 4740 regions; Going from a computed imbalance of 0.9909252140407105 to a new imbalance of 0.1771952485710394. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.04051883244266206, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.053904767003706694, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.5266666666666666, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.04051883244266206, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.17266666666666666, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.23633333333333334, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-04-14 13:55:40,170 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv109595222:82 , srv1239268705:82 , srv294128981:82 , srv1348117311:83 , srv1498621889:83 , srv1512369861:83 , srv1628491619:83 , srv1634751069:83 , srv1959849697:83 , srv252870332:83 , srv438092760:83 , srv462345037:83 , srv50527381:83 , srv613410911:83 , srv906894490:83 , srv1055825217:84 , srv1129889006:84 , srv1285631950:84 , srv1628934416:84 , srv1981536466:84 , srv208413821:84 , srv278488853:84 , srv305369098:84 , srv484517777:84 , srv552769393:84 , srv802982724:84 , srv887078750:84 , srv922384391:84 , srv1024622556:85 , srv1164872171:85 , srv1385682506:85 , srv1464085557:85 , srv1466835786:85 , srv1499411368:85 , srv1689375657:85 , srv1771202816:85 , srv1806859528:85 , srv1811019454:85 , srv1962950093:85 , srv329061599:85 , srv394117076:85 , srv640566639:85 , srv1010742541:86 , srv109769348:86 , srv1143797053:86 , srv1251505925:86 , srv147646809:86 , srv1620675215:86 , srv1631123540:86 , srv1676818614:86 , srv1854459090:86 , srv2007249272:86 , srv501964800:86 , srv510569551:86 , srv714047869:86 , srv736035324:86 , srv1008613770:87 , srv1156207697:87 , srv1400848406:87 , srv1425353700:87 , srv1713428277:87 , srv1876812807:87 , srv1908672910:87 , srv2007468433:87 , srv215907271:87 , srv509208445:87 , srv813569376:87 , srv966854894:87 , srv1251462785:88 , srv1414937495:88 , srv1514938869:88 , srv159487192:88 , srv1805440317:88 , srv293502275:88 , srv398128577:88 , srv445952301:88 , srv738769146:88 , srv759693806:88 , srv778701305:88 , srv812285496:88 , srv904655829:88 , srv153974636:89 , srv1880316063:89 , srv421788873:89 , srv550616864:89 , srv610091480:89 , srv611582160:89 , srv754303931:89 , srv1045989767:90 , srv1557526779:90 , srv1609094881:90 , srv1056024010:91 , srv108372261:91 , srv1781740622:92 , srv1431213372:93 , srv1487280795:93 , srv168947954:93 , srv27338155:94 , srv392061615:94 , srv2015638186:450 }
2023-04-14 13:55:40,176 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-04-14 13:55:40,177 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1880316063=51, srv1806859528=47, srv1557526779=32, srv252870332=61, srv509208445=78, srv1164872171=12, srv2007468433=57, srv1400848406=19, srv1628491619=36, srv1008613770=0, srv398128577=70, srv462345037=74, srv552769393=81, srv421788873=71, srv1425353700=21, srv611582160=83, srv1251462785=14, srv1045989767=3, srv1676818614=40, srv329061599=67, srv1962950093=54, srv1129889006=9, srv1771202816=44, srv759693806=90, srv736035324=87, srv1487280795=26, srv1285631950=16, srv1431213372=22, srv1464085557=23, srv50527381=77, srv168947954=42, srv1251505925=15, srv109595222=7, srv1713428277=43, srv27338155=62, srv215907271=60, srv1466835786=24, srv1981536466=55, srv294128981=65, srv904655829=96, srv1348117311=17, srv1414937495=20, srv1805440317=46, srv887078750=95, srv1156207697=11, srv1631123540=38, srv208413821=59, srv1512369861=29, srv147646809=25, srv1628934416=37, srv714047869=86, srv1055825217=4, srv1689375657=41, srv1498621889=27, srv906894490=97, srv802982724=92, srv1143797053=10, srv1239268705=13, srv1620675215=35, srv1499411368=28, srv1854459090=49, srv966854894=99, srv1634751069=39, srv305369098=66, srv510569551=79, srv813569376=94, srv1385682506=18, srv1811019454=48, srv392061615=68, srv610091480=82, srv2007249272=56, srv640566639=85, srv1514938869=30, srv153974636=31, srv778701305=91, srv1908672910=52, srv501964800=76, srv1010742541=1, srv438092760=72, srv613410911=84, srv812285496=93, srv550616864=80, srv159487192=33, srv108372261=6, srv1609094881=34, srv278488853=63, srv484517777=75, srv1056024010=5, srv109769348=8, srv293502275=64, srv738769146=88, srv2015638186=58, srv1959849697=53, srv445952301=73, srv1876812807=50, srv754303931=89, srv1024622556=2, srv1781740622=45, srv922384391=98, srv394117076=69} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-04-14 13:55:40,207 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-04-14 13:55:40,207 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-04-14 13:55:40,207 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-04-14 13:55:40,207 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-04-14 13:55:40,207 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-04-14 13:55:40,208 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-04-14 13:55:40,208 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-04-14 13:55:40,208 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-04-14 13:55:40,208 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-04-14 13:55:40,208 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-04-14 13:55:40,208 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-04-14 13:55:40,208 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-04-14 13:55:40,209 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-04-14 13:55:40,209 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-04-14 13:55:40,209 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-04-14 13:55:40,209 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-04-14 13:55:40,209 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-04-14 13:55:40,209 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-04-14 13:55:40,209 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-04-14 13:55:40,209 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-04-14 13:55:40,210 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-04-14 13:55:40,210 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-04-14 13:55:40,210 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-04-14 13:55:40,210 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-04-14 13:55:40,210 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-04-14 13:55:40,210 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-04-14 13:55:40,210 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-04-14 13:55:40,210 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-04-14 13:55:40,210 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-04-14 13:55:40,211 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-04-14 13:55:40,211 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-04-14 13:55:40,211 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-04-14 13:55:40,211 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-04-14 13:55:40,211 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-04-14 13:55:40,211 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-04-14 13:55:40,211 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-04-14 13:55:40,211 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-04-14 13:55:40,211 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-04-14 13:55:40,211 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-04-14 13:55:40,212 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-04-14 13:55:40,212 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-04-14 13:55:40,212 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-04-14 13:55:40,212 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-04-14 13:55:40,212 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-04-14 13:55:40,212 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-04-14 13:55:40,212 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-04-14 13:55:40,212 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-04-14 13:55:40,212 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-04-14 13:55:40,213 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-04-14 13:55:40,213 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-04-14 13:55:40,213 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-04-14 13:55:40,213 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-04-14 13:55:40,213 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-04-14 13:55:40,213 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-04-14 13:55:40,213 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-04-14 13:55:40,213 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-04-14 13:55:40,213 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-04-14 13:55:40,214 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-04-14 13:55:40,214 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-04-14 13:55:40,214 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-04-14 13:55:40,214 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-04-14 13:55:40,214 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-04-14 13:55:40,214 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-04-14 13:55:40,214 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-04-14 13:55:40,214 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-04-14 13:55:40,214 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-04-14 13:55:40,214 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-04-14 13:55:40,215 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-04-14 13:55:40,215 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-04-14 13:55:40,215 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-04-14 13:55:40,215 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-04-14 13:55:40,215 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-04-14 13:55:40,215 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-04-14 13:55:40,215 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-04-14 13:55:40,215 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-04-14 13:55:40,215 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-04-14 13:55:40,216 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-04-14 13:55:40,216 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-04-14 13:55:40,216 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-04-14 13:55:40,216 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-04-14 13:55:40,216 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-04-14 13:55:40,216 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-04-14 13:55:40,216 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-04-14 13:55:40,216 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-04-14 13:55:40,216 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-04-14 13:55:40,216 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-04-14 13:55:40,217 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-04-14 13:55:40,217 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-04-14 13:55:40,217 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-04-14 13:55:40,217 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-04-14 13:55:40,217 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-04-14 13:55:40,217 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-04-14 13:55:40,217 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-04-14 13:55:40,217 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-04-14 13:55:40,217 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-04-14 13:55:40,217 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-04-14 13:55:40,217 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-04-14 13:55:40,218 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-04-14 13:55:40,218 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-04-14 13:55:40,218 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-04-14 13:55:40,218 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-04-14 13:55:40,407 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.04051883244266206, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.053904767003706694, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.04051883244266206, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.17266666666666666, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.23633333333333334, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-04-14 13:55:40,407 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-04-14 13:55:40,408 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.17716205838165125, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.04051883244266206, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.053904767003706694, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.04051883244266206, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.17266666666666666, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.23633333333333334, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-04-14 13:55:40,795 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 551 ms to try 5000 different iterations.  Found a solution that moves 2566 regions; Going from a computed imbalance of 0.17716205838165125 to a new imbalance of 0.014520210730107081. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.022396622053034183); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.03110028671723945, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.2851111111111111, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.022396622053034183); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.011666666666666667); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.041666666666666664, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-04-14 13:55:40,809 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv168947954:78 , srv27338155:78 , srv108372261:79 , srv1431213372:79 , srv1781740622:79 , srv392061615:79 , srv1609094881:80 , srv1045989767:81 , srv1487280795:81 , srv1557526779:81 , srv812285496:81 , srv1713428277:82 , srv1880316063:82 , srv293502275:82 , srv778701305:82 , srv1251505925:83 , srv147646809:83 , srv153974636:83 , srv159487192:83 , srv1631123540:83 , srv1805440317:83 , srv610091480:83 , srv738769146:83 , srv759693806:83 , srv1056024010:84 , srv1143797053:84 , srv1514938869:84 , srv398128577:84 , srv445952301:84 , srv550616864:84 , srv611582160:84 , srv754303931:84 , srv904655829:84 , srv966854894:84 , srv1010742541:85 , srv109769348:85 , srv1251462785:85 , srv1676818614:85 , srv1854459090:85 , srv1908672910:85 , srv2007468433:85 , srv421788873:85 , srv484517777:85 , srv714047869:85 , srv813569376:85 , srv1400848406:86 , srv1466835786:86 , srv1620675215:86 , srv1876812807:86 , srv1981536466:86 , srv2007249272:86 , srv215907271:86 , srv305369098:86 , srv509208445:86 , srv510569551:86 , srv640566639:86 , srv736035324:86 , srv1024622556:87 , srv1156207697:87 , srv1285631950:87 , srv1385682506:87 , srv1414937495:87 , srv1464085557:87 , srv1771202816:87 , srv1962950093:87 , srv329061599:87 , srv394117076:87 , srv501964800:87 , srv1008613770:88 , srv109595222:88 , srv1129889006:88 , srv1164872171:88 , srv1348117311:88 , srv1499411368:88 , srv1628491619:88 , srv1959849697:88 , srv208413821:88 , srv278488853:88 , srv802982724:88 , srv922384391:88 , srv1425353700:89 , srv1498621889:89 , srv1512369861:89 , srv1689375657:89 , srv1806859528:89 , srv1811019454:89 , srv252870332:89 , srv50527381:89 , srv552769393:89 , srv906894490:89 , srv1055825217:90 , srv1239268705:90 , srv1628934416:90 , srv1634751069:90 , srv613410911:90 , srv438092760:91 , srv887078750:91 , srv294128981:92 , srv462345037:92 , srv2015638186:523 }
2023-04-14 13:55:40,815 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-04-14 13:55:40,816 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1880316063=51, srv1806859528=47, srv1557526779=32, srv252870332=61, srv509208445=78, srv1164872171=12, srv2007468433=57, srv1400848406=19, srv1628491619=36, srv1008613770=0, srv398128577=70, srv462345037=74, srv552769393=81, srv421788873=71, srv1425353700=21, srv611582160=83, srv1251462785=14, srv1045989767=3, srv1676818614=40, srv329061599=67, srv1962950093=54, srv1129889006=9, srv1771202816=44, srv759693806=90, srv736035324=87, srv1487280795=26, srv1285631950=16, srv1431213372=22, srv1464085557=23, srv50527381=77, srv168947954=42, srv1251505925=15, srv109595222=7, srv1713428277=43, srv27338155=62, srv215907271=60, srv1466835786=24, srv1981536466=55, srv294128981=65, srv904655829=96, srv1348117311=17, srv1414937495=20, srv1805440317=46, srv887078750=95, srv1156207697=11, srv1631123540=38, srv208413821=59, srv1512369861=29, srv147646809=25, srv1628934416=37, srv714047869=86, srv1055825217=4, srv1689375657=41, srv1498621889=27, srv906894490=97, srv802982724=92, srv1143797053=10, srv1239268705=13, srv1620675215=35, srv1499411368=28, srv1854459090=49, srv966854894=99, srv1634751069=39, srv305369098=66, srv510569551=79, srv813569376=94, srv1385682506=18, srv1811019454=48, srv392061615=68, srv610091480=82, srv2007249272=56, srv640566639=85, srv1514938869=30, srv153974636=31, srv778701305=91, srv1908672910=52, srv501964800=76, srv1010742541=1, srv438092760=72, srv613410911=84, srv812285496=93, srv550616864=80, srv159487192=33, srv108372261=6, srv1609094881=34, srv278488853=63, srv484517777=75, srv1056024010=5, srv109769348=8, srv293502275=64, srv738769146=88, srv2015638186=58, srv1959849697=53, srv445952301=73, srv1876812807=50, srv754303931=89, srv1024622556=2, srv1781740622=45, srv922384391=98, srv394117076=69} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-04-14 13:55:40,835 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-04-14 13:55:40,836 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-04-14 13:55:40,836 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-04-14 13:55:40,836 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-04-14 13:55:40,836 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-04-14 13:55:40,836 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-04-14 13:55:40,836 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-04-14 13:55:40,836 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-04-14 13:55:40,836 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-04-14 13:55:40,836 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-04-14 13:55:40,837 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-04-14 13:55:40,837 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-04-14 13:55:40,837 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-04-14 13:55:40,837 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-04-14 13:55:40,837 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-04-14 13:55:40,837 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-04-14 13:55:40,837 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-04-14 13:55:40,837 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-04-14 13:55:40,838 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-04-14 13:55:40,838 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-04-14 13:55:40,838 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-04-14 13:55:40,838 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-04-14 13:55:40,838 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-04-14 13:55:40,838 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-04-14 13:55:40,838 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-04-14 13:55:40,838 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-04-14 13:55:40,838 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-04-14 13:55:40,838 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-04-14 13:55:40,839 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-04-14 13:55:40,839 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-04-14 13:55:40,839 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-04-14 13:55:40,839 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-04-14 13:55:40,839 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-04-14 13:55:40,839 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-04-14 13:55:40,839 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-04-14 13:55:40,839 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-04-14 13:55:40,840 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-04-14 13:55:40,840 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-04-14 13:55:40,840 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-04-14 13:55:40,840 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-04-14 13:55:40,840 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-04-14 13:55:40,840 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-04-14 13:55:40,840 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-04-14 13:55:40,840 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-04-14 13:55:40,841 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-04-14 13:55:40,841 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-04-14 13:55:40,841 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-04-14 13:55:40,841 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-04-14 13:55:40,841 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-04-14 13:55:40,841 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-04-14 13:55:40,841 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-04-14 13:55:40,841 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-04-14 13:55:40,841 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-04-14 13:55:40,842 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-04-14 13:55:40,842 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-04-14 13:55:40,842 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-04-14 13:55:40,842 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-04-14 13:55:40,842 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-04-14 13:55:40,842 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-04-14 13:55:40,842 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-04-14 13:55:40,842 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-04-14 13:55:40,842 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-04-14 13:55:40,843 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-04-14 13:55:40,843 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-04-14 13:55:40,843 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-04-14 13:55:40,843 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-04-14 13:55:40,843 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-04-14 13:55:40,843 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-04-14 13:55:40,843 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-04-14 13:55:40,843 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-04-14 13:55:40,843 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-04-14 13:55:40,844 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-04-14 13:55:40,844 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-04-14 13:55:40,844 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-04-14 13:55:40,844 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-04-14 13:55:40,844 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-04-14 13:55:40,844 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-04-14 13:55:40,844 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-04-14 13:55:40,844 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-04-14 13:55:40,844 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-04-14 13:55:40,845 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-04-14 13:55:40,845 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-04-14 13:55:40,845 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-04-14 13:55:40,845 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-04-14 13:55:40,845 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-04-14 13:55:40,845 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-04-14 13:55:40,845 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-04-14 13:55:40,845 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-04-14 13:55:40,845 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-04-14 13:55:40,846 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-04-14 13:55:40,846 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-04-14 13:55:40,846 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-04-14 13:55:40,846 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-04-14 13:55:40,846 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-04-14 13:55:40,846 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-04-14 13:55:40,846 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-04-14 13:55:40,846 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-04-14 13:55:40,846 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-04-14 13:55:40,846 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-04-14 13:55:40,847 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-04-14 13:55:40,847 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-04-14 13:55:40,983 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.022396622053034183); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.03110028671723945, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.022396622053034183); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.011666666666666667); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.041666666666666664, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-04-14 13:55:40,983 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-04-14 13:55:40,984 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.014502243214079662, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.022396622053034183); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.03110028671723945, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.022396622053034183); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.011666666666666667); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.041666666666666664, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-04-14 13:55:41,399 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 534 ms to try 5000 different iterations.  Found a solution that moves 984 regions; Going from a computed imbalance of 0.014502243214079662 to a new imbalance of 6.240781473338352E-4. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.006662924501529447); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.00831479419283098); MoveCostFunction : (multiplier=7.0, imbalance=0.10933333333333334, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.006662924501529447); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=2.5E-4); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0035833333333333333); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-04-14 13:55:41,401 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1056024010:82 , srv1414937495:82 , srv1425353700:82 , srv1628934416:82 , srv462345037:82 , srv1008613770:83 , srv1055825217:83 , srv1156207697:83 , srv1689375657:83 , srv1806859528:83 , srv1811019454:83 , srv438092760:83 , srv1164872171:84 , srv1251462785:84 , srv1400848406:84 , srv1487280795:84 , srv1634751069:84 , srv215907271:84 , srv294128981:84 , srv421788873:84 , srv501964800:84 , srv509208445:84 , srv613410911:84 , srv1024622556:85 , srv1239268705:85 , srv1431213372:85 , srv1464085557:85 , srv1499411368:85 , srv1514938869:85 , srv153974636:85 , srv1557526779:85 , srv1620675215:85 , srv1628491619:85 , srv1771202816:85 , srv1876812807:85 , srv1962950093:85 , srv2007249272:85 , srv252870332:85 , srv278488853:85 , srv392061615:85 , srv394117076:85 , srv398128577:85 , srv50527381:85 , srv510569551:85 , srv550616864:85 , srv552769393:85 , srv611582160:85 , srv736035324:85 , srv754303931:85 , srv802982724:85 , srv887078750:85 , srv906894490:85 , srv922384391:85 , srv966854894:85 , srv1045989767:86 , srv109769348:86 , srv1129889006:86 , srv1385682506:86 , srv1466835786:86 , srv1498621889:86 , srv159487192:86 , srv1676818614:86 , srv168947954:86 , srv1781740622:86 , srv1805440317:86 , srv1908672910:86 , srv1959849697:86 , srv2007468433:86 , srv208413821:86 , srv27338155:86 , srv329061599:86 , srv445952301:86 , srv610091480:86 , srv714047869:86 , srv813569376:86 , srv904655829:86 , srv1010742541:87 , srv109595222:87 , srv1143797053:87 , srv1285631950:87 , srv1348117311:87 , srv1512369861:87 , srv1880316063:87 , srv1981536466:87 , srv305369098:87 , srv640566639:87 , srv738769146:87 , srv759693806:87 , srv1251505925:88 , srv147646809:88 , srv1609094881:88 , srv1631123540:88 , srv1713428277:88 , srv1854459090:88 , srv293502275:88 , srv778701305:88 , srv812285496:88 , srv108372261:89 , srv484517777:89 , srv2015638186:544 }
2023-04-14 13:55:41,406 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-04-14 13:55:41,408 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1880316063=51, srv1806859528=47, srv1557526779=32, srv252870332=61, srv509208445=78, srv1164872171=12, srv2007468433=57, srv1400848406=19, srv1628491619=36, srv1008613770=0, srv398128577=70, srv462345037=74, srv552769393=81, srv421788873=71, srv1425353700=21, srv611582160=83, srv1251462785=14, srv1045989767=3, srv1676818614=40, srv329061599=67, srv1962950093=54, srv1129889006=9, srv1771202816=44, srv759693806=90, srv736035324=87, srv1487280795=26, srv1285631950=16, srv1431213372=22, srv1464085557=23, srv50527381=77, srv168947954=42, srv1251505925=15, srv109595222=7, srv1713428277=43, srv27338155=62, srv215907271=60, srv1466835786=24, srv1981536466=55, srv294128981=65, srv904655829=96, srv1348117311=17, srv1414937495=20, srv1805440317=46, srv887078750=95, srv1156207697=11, srv1631123540=38, srv208413821=59, srv1512369861=29, srv147646809=25, srv1628934416=37, srv714047869=86, srv1055825217=4, srv1689375657=41, srv1498621889=27, srv906894490=97, srv802982724=92, srv1143797053=10, srv1239268705=13, srv1620675215=35, srv1499411368=28, srv1854459090=49, srv966854894=99, srv1634751069=39, srv305369098=66, srv510569551=79, srv813569376=94, srv1385682506=18, srv1811019454=48, srv392061615=68, srv610091480=82, srv2007249272=56, srv640566639=85, srv1514938869=30, srv153974636=31, srv778701305=91, srv1908672910=52, srv501964800=76, srv1010742541=1, srv438092760=72, srv613410911=84, srv812285496=93, srv550616864=80, srv159487192=33, srv108372261=6, srv1609094881=34, srv278488853=63, srv484517777=75, srv1056024010=5, srv109769348=8, srv293502275=64, srv738769146=88, srv2015638186=58, srv1959849697=53, srv445952301=73, srv1876812807=50, srv754303931=89, srv1024622556=2, srv1781740622=45, srv922384391=98, srv394117076=69} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-04-14 13:55:41,431 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-04-14 13:55:41,432 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-04-14 13:55:41,432 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-04-14 13:55:41,432 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-04-14 13:55:41,432 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-04-14 13:55:41,432 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-04-14 13:55:41,432 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-04-14 13:55:41,432 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-04-14 13:55:41,432 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-04-14 13:55:41,432 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-04-14 13:55:41,432 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-04-14 13:55:41,432 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-04-14 13:55:41,432 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-04-14 13:55:41,432 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-04-14 13:55:41,432 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-04-14 13:55:41,432 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-04-14 13:55:41,433 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-04-14 13:55:41,433 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-04-14 13:55:41,433 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-04-14 13:55:41,433 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-04-14 13:55:41,433 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-04-14 13:55:41,433 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-04-14 13:55:41,433 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-04-14 13:55:41,433 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-04-14 13:55:41,433 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-04-14 13:55:41,433 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-04-14 13:55:41,433 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-04-14 13:55:41,433 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-04-14 13:55:41,433 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-04-14 13:55:41,433 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-04-14 13:55:41,434 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-04-14 13:55:41,434 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-04-14 13:55:41,434 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-04-14 13:55:41,434 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-04-14 13:55:41,434 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-04-14 13:55:41,434 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-04-14 13:55:41,434 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-04-14 13:55:41,434 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-04-14 13:55:41,434 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-04-14 13:55:41,434 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-04-14 13:55:41,434 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-04-14 13:55:41,434 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-04-14 13:55:41,434 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-04-14 13:55:41,434 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-04-14 13:55:41,434 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-04-14 13:55:41,435 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-04-14 13:55:41,435 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-04-14 13:55:41,435 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-04-14 13:55:41,435 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-04-14 13:55:41,435 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-04-14 13:55:41,435 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-04-14 13:55:41,435 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-04-14 13:55:41,435 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-04-14 13:55:41,435 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-04-14 13:55:41,435 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-04-14 13:55:41,435 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-04-14 13:55:41,435 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-04-14 13:55:41,435 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-04-14 13:55:41,435 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-04-14 13:55:41,436 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-04-14 13:55:41,436 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-04-14 13:55:41,436 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-04-14 13:55:41,436 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-04-14 13:55:41,436 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-04-14 13:55:41,436 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-04-14 13:55:41,436 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-04-14 13:55:41,437 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-04-14 13:55:41,437 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-04-14 13:55:41,437 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-04-14 13:55:41,437 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-04-14 13:55:41,437 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-04-14 13:55:41,437 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-04-14 13:55:41,437 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-04-14 13:55:41,437 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-04-14 13:55:41,437 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-04-14 13:55:41,437 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-04-14 13:55:41,437 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-04-14 13:55:41,437 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-04-14 13:55:41,437 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-04-14 13:55:41,437 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-04-14 13:55:41,437 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-04-14 13:55:41,438 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-04-14 13:55:41,438 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-04-14 13:55:41,438 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-04-14 13:55:41,438 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-04-14 13:55:41,438 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-04-14 13:55:41,438 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-04-14 13:55:41,438 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-04-14 13:55:41,438 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-04-14 13:55:41,438 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-04-14 13:55:41,438 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-04-14 13:55:41,438 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-04-14 13:55:41,438 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-04-14 13:55:41,438 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-04-14 13:55:41,438 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-04-14 13:55:41,438 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-04-14 13:55:41,439 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-04-14 13:55:41,439 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-04-14 13:55:41,439 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-04-14 13:55:41,439 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-04-14 13:55:41,439 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-04-14 13:55:41,561 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.006662924501529447); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.00831479419283098); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.006662924501529447); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=2.5E-4); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0035833333333333333); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-04-14 13:55:41,561 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-04-14 13:55:41,561 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=6.171880320684487E-4, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.006662924501529447); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.00831479419283098); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.006662924501529447); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=2.5E-4); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0035833333333333333); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-04-14 13:55:41,941 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 488 ms to try 5000 different iterations.  Found a solution that moves 281 regions; Going from a computed imbalance of 6.171880320684487E-4 to a new imbalance of 2.693283823727452E-5. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=3.5313429231318235E-4); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0018349396085439343); MoveCostFunction : (multiplier=7.0, imbalance=0.03122222222222222, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=3.5313429231318235E-4); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.6666666666666666E-4); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-04-14 13:55:41,943 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv887078750:82 , srv108372261:83 , srv1348117311:83 , srv1854459090:83 , srv1008613770:84 , srv1010742541:84 , srv1129889006:84 , srv1143797053:84 , srv1285631950:84 , srv1385682506:84 , srv1425353700:84 , srv1487280795:84 , srv1498621889:84 , srv1499411368:84 , srv1512369861:84 , srv1609094881:84 , srv1631123540:84 , srv1876812807:84 , srv1880316063:84 , srv1908672910:84 , srv2007468433:84 , srv27338155:84 , srv293502275:84 , srv294128981:84 , srv329061599:84 , srv392061615:84 , srv445952301:84 , srv484517777:84 , srv550616864:84 , srv552769393:84 , srv610091480:84 , srv611582160:84 , srv640566639:84 , srv714047869:84 , srv738769146:84 , srv759693806:84 , srv778701305:84 , srv813569376:84 , srv904655829:84 , srv922384391:84 , srv1024622556:85 , srv1045989767:85 , srv1055825217:85 , srv1056024010:85 , srv109595222:85 , srv109769348:85 , srv1156207697:85 , srv1164872171:85 , srv1239268705:85 , srv1251462785:85 , srv1251505925:85 , srv1400848406:85 , srv1414937495:85 , srv1431213372:85 , srv1464085557:85 , srv1466835786:85 , srv147646809:85 , srv1514938869:85 , srv153974636:85 , srv159487192:85 , srv1620675215:85 , srv1634751069:85 , srv1676818614:85 , srv1689375657:85 , srv168947954:85 , srv1713428277:85 , srv1771202816:85 , srv1781740622:85 , srv1805440317:85 , srv1806859528:85 , srv1811019454:85 , srv1959849697:85 , srv1962950093:85 , srv1981536466:85 , srv2007249272:85 , srv208413821:85 , srv215907271:85 , srv252870332:85 , srv278488853:85 , srv305369098:85 , srv394117076:85 , srv398128577:85 , srv421788873:85 , srv438092760:85 , srv462345037:85 , srv501964800:85 , srv50527381:85 , srv509208445:85 , srv510569551:85 , srv613410911:85 , srv736035324:85 , srv754303931:85 , srv802982724:85 , srv812285496:85 , srv906894490:85 , srv1557526779:86 , srv1628491619:86 , srv1628934416:86 , srv966854894:86 , srv2015638186:626 }
2023-04-14 13:55:41,948 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-04-14 13:55:41,949 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1880316063=51, srv1806859528=47, srv1557526779=32, srv252870332=61, srv509208445=78, srv1164872171=12, srv2007468433=57, srv1400848406=19, srv1628491619=36, srv1008613770=0, srv398128577=70, srv462345037=74, srv552769393=81, srv421788873=71, srv1425353700=21, srv611582160=83, srv1251462785=14, srv1045989767=3, srv1676818614=40, srv329061599=67, srv1962950093=54, srv1129889006=9, srv1771202816=44, srv759693806=90, srv736035324=87, srv1487280795=26, srv1285631950=16, srv1431213372=22, srv1464085557=23, srv50527381=77, srv168947954=42, srv1251505925=15, srv109595222=7, srv1713428277=43, srv27338155=62, srv215907271=60, srv1466835786=24, srv1981536466=55, srv294128981=65, srv904655829=96, srv1348117311=17, srv1414937495=20, srv1805440317=46, srv887078750=95, srv1156207697=11, srv1631123540=38, srv208413821=59, srv1512369861=29, srv147646809=25, srv1628934416=37, srv714047869=86, srv1055825217=4, srv1689375657=41, srv1498621889=27, srv906894490=97, srv802982724=92, srv1143797053=10, srv1239268705=13, srv1620675215=35, srv1499411368=28, srv1854459090=49, srv966854894=99, srv1634751069=39, srv305369098=66, srv510569551=79, srv813569376=94, srv1385682506=18, srv1811019454=48, srv392061615=68, srv610091480=82, srv2007249272=56, srv640566639=85, srv1514938869=30, srv153974636=31, srv778701305=91, srv1908672910=52, srv501964800=76, srv1010742541=1, srv438092760=72, srv613410911=84, srv812285496=93, srv550616864=80, srv159487192=33, srv108372261=6, srv1609094881=34, srv278488853=63, srv484517777=75, srv1056024010=5, srv109769348=8, srv293502275=64, srv738769146=88, srv2015638186=58, srv1959849697=53, srv445952301=73, srv1876812807=50, srv754303931=89, srv1024622556=2, srv1781740622=45, srv922384391=98, srv394117076=69} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-04-14 13:55:41,962 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-04-14 13:55:41,962 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-04-14 13:55:41,962 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-04-14 13:55:41,962 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-04-14 13:55:41,963 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-04-14 13:55:41,963 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-04-14 13:55:41,963 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-04-14 13:55:41,963 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-04-14 13:55:41,963 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-04-14 13:55:41,963 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-04-14 13:55:41,963 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-04-14 13:55:41,963 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-04-14 13:55:41,963 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-04-14 13:55:41,963 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-04-14 13:55:41,963 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-04-14 13:55:41,963 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-04-14 13:55:41,963 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-04-14 13:55:41,963 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-04-14 13:55:41,963 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-04-14 13:55:41,963 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-04-14 13:55:41,963 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-04-14 13:55:41,963 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-04-14 13:55:41,964 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-04-14 13:55:41,964 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-04-14 13:55:41,964 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-04-14 13:55:41,964 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-04-14 13:55:41,964 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-04-14 13:55:41,964 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-04-14 13:55:41,964 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-04-14 13:55:41,964 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-04-14 13:55:41,964 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-04-14 13:55:41,964 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-04-14 13:55:41,964 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-04-14 13:55:41,965 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-04-14 13:55:41,965 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-04-14 13:55:41,965 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-04-14 13:55:41,965 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-04-14 13:55:41,965 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-04-14 13:55:41,965 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-04-14 13:55:41,965 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-04-14 13:55:41,965 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-04-14 13:55:41,965 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-04-14 13:55:41,965 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-04-14 13:55:41,965 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-04-14 13:55:41,965 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-04-14 13:55:41,965 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-04-14 13:55:41,965 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-04-14 13:55:41,966 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-04-14 13:55:41,966 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-04-14 13:55:41,966 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-04-14 13:55:41,966 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-04-14 13:55:41,966 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-04-14 13:55:41,966 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-04-14 13:55:41,966 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-04-14 13:55:41,966 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-04-14 13:55:41,966 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-04-14 13:55:41,966 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-04-14 13:55:41,966 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-04-14 13:55:41,967 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-04-14 13:55:41,967 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-04-14 13:55:41,967 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-04-14 13:55:41,967 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-04-14 13:55:41,967 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-04-14 13:55:41,967 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-04-14 13:55:41,967 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-04-14 13:55:41,967 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-04-14 13:55:41,967 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-04-14 13:55:41,967 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-04-14 13:55:41,967 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-04-14 13:55:41,968 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-04-14 13:55:41,968 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-04-14 13:55:41,968 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-04-14 13:55:41,968 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-04-14 13:55:41,968 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-04-14 13:55:41,968 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-04-14 13:55:41,968 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-04-14 13:55:41,968 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-04-14 13:55:41,968 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-04-14 13:55:41,968 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-04-14 13:55:41,968 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-04-14 13:55:41,968 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-04-14 13:55:41,968 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-04-14 13:55:41,968 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-04-14 13:55:41,969 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-04-14 13:55:41,969 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-04-14 13:55:41,969 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-04-14 13:55:41,969 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-04-14 13:55:41,969 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-04-14 13:55:41,969 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-04-14 13:55:41,969 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-04-14 13:55:41,969 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-04-14 13:55:41,969 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-04-14 13:55:41,969 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-04-14 13:55:41,969 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-04-14 13:55:41,969 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-04-14 13:55:41,969 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-04-14 13:55:41,969 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-04-14 13:55:41,969 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-04-14 13:55:41,969 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-04-14 13:55:41,969 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-04-14 13:55:41,970 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-04-14 13:55:42,101 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=3.5313429231318235E-4); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0018349396085439343); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=3.5313429231318235E-4); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.6666666666666666E-4); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-04-14 13:55:42,102 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-04-14 13:55:42,102 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=2.4965234182829804E-5, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=3.5313429231318235E-4); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0018349396085439343); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=3.5313429231318235E-4); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.6666666666666666E-4); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-04-14 13:55:42,424 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 444 ms to try 5000 different iterations.  Found a solution that moves 23 regions; Going from a computed imbalance of 2.4965234182829804E-5 to a new imbalance of 6.193128181907117E-6. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0013400504203456161); MoveCostFunction : (multiplier=7.0, imbalance=0.0025555555555555557); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-04-14 13:55:42,424 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1512369861:83 , srv208413821:83 , srv421788873:83 , srv754303931:83 , srv1008613770:84 , srv1010742541:84 , srv1024622556:84 , srv1045989767:84 , srv1055825217:84 , srv1056024010:84 , srv108372261:84 , srv109595222:84 , srv109769348:84 , srv1129889006:84 , srv1156207697:84 , srv1164872171:84 , srv1239268705:84 , srv1251462785:84 , srv1251505925:84 , srv1285631950:84 , srv1385682506:84 , srv1400848406:84 , srv1414937495:84 , srv1425353700:84 , srv1431213372:84 , srv1464085557:84 , srv1466835786:84 , srv147646809:84 , srv1487280795:84 , srv1498621889:84 , srv1499411368:84 , srv1514938869:84 , srv153974636:84 , srv1557526779:84 , srv159487192:84 , srv1609094881:84 , srv1620675215:84 , srv1628491619:84 , srv1628934416:84 , srv1634751069:84 , srv1676818614:84 , srv1689375657:84 , srv168947954:84 , srv1713428277:84 , srv1771202816:84 , srv1781740622:84 , srv1805440317:84 , srv1806859528:84 , srv1811019454:84 , srv1854459090:84 , srv1876812807:84 , srv1880316063:84 , srv1908672910:84 , srv1959849697:84 , srv1962950093:84 , srv1981536466:84 , srv2007249272:84 , srv2007468433:84 , srv215907271:84 , srv252870332:84 , srv27338155:84 , srv278488853:84 , srv293502275:84 , srv294128981:84 , srv305369098:84 , srv329061599:84 , srv392061615:84 , srv394117076:84 , srv398128577:84 , srv438092760:84 , srv445952301:84 , srv462345037:84 , srv484517777:84 , srv501964800:84 , srv50527381:84 , srv509208445:84 , srv510569551:84 , srv550616864:84 , srv552769393:84 , srv610091480:84 , srv611582160:84 , srv613410911:84 , srv640566639:84 , srv736035324:84 , srv738769146:84 , srv759693806:84 , srv778701305:84 , srv802982724:84 , srv812285496:84 , srv813569376:84 , srv887078750:84 , srv904655829:84 , srv906894490:84 , srv966854894:84 , srv1143797053:85 , srv1348117311:85 , srv1631123540:85 , srv714047869:85 , srv922384391:85 , srv2015638186:683 }
2023-04-14 13:55:42,430 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-04-14 13:55:42,431 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1880316063=51, srv1806859528=47, srv1557526779=32, srv252870332=61, srv509208445=78, srv1164872171=12, srv2007468433=57, srv1400848406=19, srv1628491619=36, srv1008613770=0, srv398128577=70, srv462345037=74, srv552769393=81, srv421788873=71, srv1425353700=21, srv611582160=83, srv1251462785=14, srv1045989767=3, srv1676818614=40, srv329061599=67, srv1962950093=54, srv1129889006=9, srv1771202816=44, srv759693806=90, srv736035324=87, srv1487280795=26, srv1285631950=16, srv1431213372=22, srv1464085557=23, srv50527381=77, srv168947954=42, srv1251505925=15, srv109595222=7, srv1713428277=43, srv27338155=62, srv215907271=60, srv1466835786=24, srv1981536466=55, srv294128981=65, srv904655829=96, srv1348117311=17, srv1414937495=20, srv1805440317=46, srv887078750=95, srv1156207697=11, srv1631123540=38, srv208413821=59, srv1512369861=29, srv147646809=25, srv1628934416=37, srv714047869=86, srv1055825217=4, srv1689375657=41, srv1498621889=27, srv906894490=97, srv802982724=92, srv1143797053=10, srv1239268705=13, srv1620675215=35, srv1499411368=28, srv1854459090=49, srv966854894=99, srv1634751069=39, srv305369098=66, srv510569551=79, srv813569376=94, srv1385682506=18, srv1811019454=48, srv392061615=68, srv610091480=82, srv2007249272=56, srv640566639=85, srv1514938869=30, srv153974636=31, srv778701305=91, srv1908672910=52, srv501964800=76, srv1010742541=1, srv438092760=72, srv613410911=84, srv812285496=93, srv550616864=80, srv159487192=33, srv108372261=6, srv1609094881=34, srv278488853=63, srv484517777=75, srv1056024010=5, srv109769348=8, srv293502275=64, srv738769146=88, srv2015638186=58, srv1959849697=53, srv445952301=73, srv1876812807=50, srv754303931=89, srv1024622556=2, srv1781740622=45, srv922384391=98, srv394117076=69} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-04-14 13:55:42,448 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-04-14 13:55:42,448 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-04-14 13:55:42,449 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-04-14 13:55:42,449 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-04-14 13:55:42,449 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-04-14 13:55:42,449 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-04-14 13:55:42,449 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-04-14 13:55:42,449 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-04-14 13:55:42,449 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-04-14 13:55:42,449 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-04-14 13:55:42,449 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-04-14 13:55:42,449 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-04-14 13:55:42,449 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-04-14 13:55:42,449 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-04-14 13:55:42,450 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-04-14 13:55:42,450 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-04-14 13:55:42,450 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-04-14 13:55:42,450 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-04-14 13:55:42,450 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-04-14 13:55:42,450 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-04-14 13:55:42,450 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-04-14 13:55:42,450 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-04-14 13:55:42,450 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-04-14 13:55:42,450 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-04-14 13:55:42,450 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-04-14 13:55:42,450 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-04-14 13:55:42,450 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-04-14 13:55:42,451 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-04-14 13:55:42,451 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-04-14 13:55:42,451 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-04-14 13:55:42,451 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-04-14 13:55:42,451 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-04-14 13:55:42,451 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-04-14 13:55:42,451 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-04-14 13:55:42,451 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-04-14 13:55:42,451 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-04-14 13:55:42,451 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-04-14 13:55:42,451 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-04-14 13:55:42,451 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-04-14 13:55:42,452 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-04-14 13:55:42,452 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-04-14 13:55:42,452 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-04-14 13:55:42,452 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-04-14 13:55:42,452 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-04-14 13:55:42,452 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-04-14 13:55:42,452 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-04-14 13:55:42,452 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-04-14 13:55:42,452 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-04-14 13:55:42,452 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-04-14 13:55:42,452 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-04-14 13:55:42,453 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-04-14 13:55:42,453 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-04-14 13:55:42,453 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-04-14 13:55:42,453 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-04-14 13:55:42,453 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-04-14 13:55:42,453 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-04-14 13:55:42,453 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-04-14 13:55:42,453 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-04-14 13:55:42,453 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-04-14 13:55:42,453 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-04-14 13:55:42,453 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-04-14 13:55:42,453 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-04-14 13:55:42,453 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-04-14 13:55:42,454 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-04-14 13:55:42,454 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-04-14 13:55:42,454 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-04-14 13:55:42,454 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-04-14 13:55:42,454 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-04-14 13:55:42,454 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-04-14 13:55:42,454 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-04-14 13:55:42,454 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-04-14 13:55:42,454 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-04-14 13:55:42,454 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-04-14 13:55:42,454 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-04-14 13:55:42,454 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-04-14 13:55:42,455 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-04-14 13:55:42,455 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-04-14 13:55:42,455 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-04-14 13:55:42,455 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-04-14 13:55:42,455 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-04-14 13:55:42,455 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-04-14 13:55:42,455 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-04-14 13:55:42,455 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-04-14 13:55:42,455 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-04-14 13:55:42,455 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-04-14 13:55:42,455 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-04-14 13:55:42,455 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-04-14 13:55:42,455 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-04-14 13:55:42,456 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-04-14 13:55:42,456 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-04-14 13:55:42,456 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-04-14 13:55:42,456 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-04-14 13:55:42,456 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-04-14 13:55:42,456 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-04-14 13:55:42,456 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-04-14 13:55:42,456 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-04-14 13:55:42,456 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-04-14 13:55:42,456 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-04-14 13:55:42,456 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-04-14 13:55:42,457 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-04-14 13:55:42,457 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-04-14 13:55:42,589 INFO  [Time-limited test] balancer.StochasticLoadBalancer(381): Cluster wide - skipping load balancing because weighted average imbalance=6.032078739728369E-6 <= threshold(0.025). If you want more aggressive balancing, either lower hbase.master.balancer.stochastic.minCostNeedBalance from 0.025 or increase the relative multiplier(s) of the specific cost function(s). functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0013400504203456161); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-04-14 13:55:42,590 INFO  [Time-limited test] balancer.BalancerTestBase(570): Mock Final balance: { srv1512369861:83 , srv208413821:83 , srv421788873:83 , srv754303931:83 , srv1008613770:84 , srv1010742541:84 , srv1024622556:84 , srv1045989767:84 , srv1055825217:84 , srv1056024010:84 , srv108372261:84 , srv109595222:84 , srv109769348:84 , srv1129889006:84 , srv1156207697:84 , srv1164872171:84 , srv1239268705:84 , srv1251462785:84 , srv1251505925:84 , srv1285631950:84 , srv1385682506:84 , srv1400848406:84 , srv1414937495:84 , srv1425353700:84 , srv1431213372:84 , srv1464085557:84 , srv1466835786:84 , srv147646809:84 , srv1487280795:84 , srv1498621889:84 , srv1499411368:84 , srv1514938869:84 , srv153974636:84 , srv1557526779:84 , srv159487192:84 , srv1609094881:84 , srv1620675215:84 , srv1628491619:84 , srv1628934416:84 , srv1634751069:84 , srv1676818614:84 , srv1689375657:84 , srv168947954:84 , srv1713428277:84 , srv1771202816:84 , srv1781740622:84 , srv1805440317:84 , srv1806859528:84 , srv1811019454:84 , srv1854459090:84 , srv1876812807:84 , srv1880316063:84 , srv1908672910:84 , srv1959849697:84 , srv1962950093:84 , srv1981536466:84 , srv2007249272:84 , srv2007468433:84 , srv215907271:84 , srv252870332:84 , srv27338155:84 , srv278488853:84 , srv293502275:84 , srv294128981:84 , srv305369098:84 , srv329061599:84 , srv392061615:84 , srv394117076:84 , srv398128577:84 , srv438092760:84 , srv445952301:84 , srv462345037:84 , srv484517777:84 , srv501964800:84 , srv50527381:84 , srv509208445:84 , srv510569551:84 , srv550616864:84 , srv552769393:84 , srv610091480:84 , srv611582160:84 , srv613410911:84 , srv640566639:84 , srv736035324:84 , srv738769146:84 , srv759693806:84 , srv778701305:84 , srv802982724:84 , srv812285496:84 , srv813569376:84 , srv887078750:84 , srv904655829:84 , srv906894490:84 , srv966854894:84 , srv1143797053:85 , srv1348117311:85 , srv1631123540:85 , srv714047869:85 , srv922384391:85 , srv2015638186:683 }
2023-04-14 13:55:42,623 INFO  [Time-limited test] hbase.ResourceChecker(175): after: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnLargeClusterWithRacks Thread=10 (was 10), OpenFileDescriptor=260 (was 260), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=474 (was 436) - SystemLoadAverage LEAK? -, ProcessCount=208 (was 208), AvailableMemoryMB=1434 (was 1922)
2023-04-14 13:55:42,635 INFO  [Time-limited test] hbase.ResourceChecker(147): before: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnMidClusterWithRacks Thread=10, OpenFileDescriptor=260, MaxFileDescriptor=60000, SystemLoadAverage=474, ProcessCount=208, AvailableMemoryMB=1433
2023-04-14 13:55:42,636 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2023-04-14 13:55:42,636 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=5000, runMaxSteps=true, stepsPerRegion=800, maxRunningTime=120000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 111077.0 etc.
2023-04-14 13:55:42,650 INFO  [Time-limited test] balancer.BalancerTestBase(547): Mock Cluster : { srv1138115860:84 , srv1141460524:84 , srv1151261811:84 , srv12574539:84 , srv1273489627:84 , srv1310248354:84 , srv1323157357:84 , srv1584187296:84 , srv1585454138:84 , srv1604237640:84 , srv1708096563:84 , srv173615150:84 , srv1790033893:84 , srv1800888879:84 , srv1889420726:84 , srv2023818130:84 , srv2025154458:84 , srv2026544653:84 , srv2133540531:84 , srv2145993473:84 , srv25918573:84 , srv365088680:84 , srv393035071:84 , srv419514898:84 , srv558715991:84 , srv653555060:84 , srv719785733:84 , srv849285313:84 , srv939874654:84 , srv62321258:264 } [srvr=30 rgns=2700 avg=90.0 max=90 min=90]
2023-04-14 13:55:42,653 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-04-14 13:55:42,653 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv2023818130=15, srv62321258=25, srv1800888879=13, srv1138115860=0, srv25918573=20, srv1584187296=7, srv849285313=28, srv393035071=22, srv558715991=24, srv939874654=29, srv1273489627=4, srv1151261811=2, srv1889420726=14, srv2133540531=18, srv1604237640=9, srv2025154458=16, srv653555060=26, srv2145993473=19, srv173615150=11, srv1323157357=6, srv719785733=27, srv1310248354=5, srv1708096563=10, srv1790033893=12, srv2026544653=17, srv419514898=23, srv365088680=21, srv12574539=3, srv1585454138=8, srv1141460524=1} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-04-14 13:55:42,669 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-04-14 13:55:42,669 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-04-14 13:55:42,670 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-04-14 13:55:42,670 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-04-14 13:55:42,670 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-04-14 13:55:42,672 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-04-14 13:55:42,672 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-04-14 13:55:42,673 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-04-14 13:55:42,673 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-04-14 13:55:42,673 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-04-14 13:55:42,673 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-04-14 13:55:42,673 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-04-14 13:55:42,673 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-04-14 13:55:42,673 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-04-14 13:55:42,673 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-04-14 13:55:42,673 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-04-14 13:55:42,673 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-04-14 13:55:42,673 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-04-14 13:55:42,673 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-04-14 13:55:42,674 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-04-14 13:55:42,674 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-04-14 13:55:42,674 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-04-14 13:55:42,674 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-04-14 13:55:42,674 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-04-14 13:55:42,674 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-04-14 13:55:42,674 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-04-14 13:55:42,674 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-04-14 13:55:42,674 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-04-14 13:55:42,674 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-04-14 13:55:42,674 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-04-14 13:55:42,674 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=10, number of hosts=30, number of racks=4
2023-04-14 13:55:42,708 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=1.0872907392576185, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-04-14 13:55:42,709 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.9912468093533376, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=1.0872907392576185, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=64800000
2023-04-14 13:57:42,679 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 120001 ms to try 5661458 different iterations.  Found a solution that moves 1845 regions; Going from a computed imbalance of 0.9912468093533376 to a new imbalance of 4.306322040866546E-5. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); MoveCostFunction : (multiplier=7.0, imbalance=0.6833333333333333, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-04-14 13:57:42,686 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1138115860:90 , srv1141460524:90 , srv1151261811:90 , srv12574539:90 , srv1273489627:90 , srv1310248354:90 , srv1323157357:90 , srv1584187296:90 , srv1585454138:90 , srv1604237640:90 , srv1708096563:90 , srv173615150:90 , srv1790033893:90 , srv1800888879:90 , srv1889420726:90 , srv2023818130:90 , srv2025154458:90 , srv2026544653:90 , srv2133540531:90 , srv2145993473:90 , srv25918573:90 , srv365088680:90 , srv393035071:90 , srv419514898:90 , srv558715991:90 , srv62321258:90 , srv653555060:90 , srv719785733:90 , srv849285313:90 , srv939874654:90 }
2023-04-14 13:57:42,687 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-04-14 13:57:42,687 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv2023818130=15, srv62321258=25, srv1800888879=13, srv1138115860=0, srv25918573=20, srv1584187296=7, srv849285313=28, srv393035071=22, srv558715991=24, srv939874654=29, srv1273489627=4, srv1151261811=2, srv1889420726=14, srv2133540531=18, srv1604237640=9, srv2025154458=16, srv653555060=26, srv2145993473=19, srv173615150=11, srv1323157357=6, srv719785733=27, srv1310248354=5, srv1708096563=10, srv1790033893=12, srv2026544653=17, srv419514898=23, srv365088680=21, srv12574539=3, srv1585454138=8, srv1141460524=1} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-04-14 13:57:42,692 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-04-14 13:57:42,692 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-04-14 13:57:42,692 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-04-14 13:57:42,692 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-04-14 13:57:42,692 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-04-14 13:57:42,692 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-04-14 13:57:42,692 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-04-14 13:57:42,692 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-04-14 13:57:42,692 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-04-14 13:57:42,692 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-04-14 13:57:42,692 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-04-14 13:57:42,692 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-04-14 13:57:42,692 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-04-14 13:57:42,692 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-04-14 13:57:42,692 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-04-14 13:57:42,693 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-04-14 13:57:42,693 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-04-14 13:57:42,693 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-04-14 13:57:42,693 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-04-14 13:57:42,693 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-04-14 13:57:42,693 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-04-14 13:57:42,693 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-04-14 13:57:42,693 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-04-14 13:57:42,693 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-04-14 13:57:42,693 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-04-14 13:57:42,693 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-04-14 13:57:42,693 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-04-14 13:57:42,693 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-04-14 13:57:42,693 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-04-14 13:57:42,693 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-04-14 13:57:42,694 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=10, number of hosts=30, number of racks=4
2023-04-14 13:57:42,707 INFO  [Time-limited test] balancer.StochasticLoadBalancer(381): Cluster wide - skipping load balancing because weighted average imbalance=0.0 <= threshold(0.025). If you want more aggressive balancing, either lower hbase.master.balancer.stochastic.minCostNeedBalance from 0.025 or increase the relative multiplier(s) of the specific cost function(s). functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-04-14 13:57:42,707 INFO  [Time-limited test] balancer.BalancerTestBase(570): Mock Final balance: { srv1138115860:90 , srv1141460524:90 , srv1151261811:90 , srv12574539:90 , srv1273489627:90 , srv1310248354:90 , srv1323157357:90 , srv1584187296:90 , srv1585454138:90 , srv1604237640:90 , srv1708096563:90 , srv173615150:90 , srv1790033893:90 , srv1800888879:90 , srv1889420726:90 , srv2023818130:90 , srv2025154458:90 , srv2026544653:90 , srv2133540531:90 , srv2145993473:90 , srv25918573:90 , srv365088680:90 , srv393035071:90 , srv419514898:90 , srv558715991:90 , srv62321258:90 , srv653555060:90 , srv719785733:90 , srv849285313:90 , srv939874654:90 }
2023-04-14 13:57:42,720 INFO  [Time-limited test] hbase.ResourceChecker(175): after: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnMidClusterWithRacks Thread=9 (was 10), OpenFileDescriptor=260 (was 260), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=299 (was 474), ProcessCount=168 (was 208), AvailableMemoryMB=1541 (was 1433) - AvailableMemoryMB LEAK? -