2023-03-04 15:56:14,601 INFO  [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks timeout: 13 mins
2023-03-04 15:56:14,922 WARN  [Time-limited test] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties
2023-03-04 15:56:15,028 INFO  [Time-limited test] metrics.MetricRegistriesLoader(60): Loaded MetricRegistries class org.apache.hadoop.hbase.metrics.impl.MetricRegistriesImpl
2023-03-04 15:56:15,085 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2023-03-04 15:56:15,092 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc.
2023-03-04 15:56:15,105 INFO  [Time-limited test] hbase.ResourceChecker(147): before: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnLargeClusterWithRacks Thread=10, OpenFileDescriptor=260, MaxFileDescriptor=60000, SystemLoadAverage=102, ProcessCount=173, AvailableMemoryMB=6012
2023-03-04 15:56:15,107 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2023-03-04 15:56:15,107 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=5000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=10000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc.
2023-03-04 15:56:15,223 INFO  [Time-limited test] balancer.BalancerTestBase(547): Mock Cluster : { srv1027255241:84 , srv1080688773:84 , srv1091506671:84 , srv1112676090:84 , srv1125749791:84 , srv1131813353:84 , srv1186963056:84 , srv1189373797:84 , srv1201221025:84 , srv1234871679:84 , srv1245905492:84 , srv1254215173:84 , srv1279115348:84 , srv1340994013:84 , srv1387131094:84 , srv1415176671:84 , srv1452749059:84 , srv1481042159:84 , srv1495561558:84 , srv1515390922:84 , srv1520173108:84 , srv1539337244:84 , srv1557612390:84 , srv156111766:84 , srv1562868380:84 , srv1583413995:84 , srv1600251847:84 , srv1614924170:84 , srv1621962540:84 , srv1647309457:84 , srv1664424992:84 , srv1697470076:84 , srv1703025934:84 , srv1714724091:84 , srv1752531046:84 , srv1780255033:84 , srv1814191486:84 , srv1819667730:84 , srv1834984343:84 , srv1875695845:84 , srv1888359144:84 , srv1893835131:84 , srv1909269165:84 , srv1914151199:84 , srv1927549642:84 , srv1928065890:84 , srv1933133022:84 , srv1970650199:84 , srv1972629651:84 , srv1980658996:84 , srv1986938670:84 , srv1992224682:84 , srv2021988751:84 , srv203162381:84 , srv2055632705:84 , srv209253763:84 , srv209683504:84 , srv2124097980:84 , srv217728418:84 , srv233646120:84 , srv24811298:84 , srv318588001:84 , srv319963742:84 , srv321888726:84 , srv346421:84 , srv360330441:84 , srv367332499:84 , srv372732873:84 , srv38237893:84 , srv397130587:84 , srv406861661:84 , srv420642010:84 , srv432847275:84 , srv5115734:84 , srv513302092:84 , srv525762740:84 , srv531064050:84 , srv535815270:84 , srv552895300:84 , srv587232575:84 , srv637401588:84 , srv671246362:84 , srv791618124:84 , srv799720278:84 , srv827059092:84 , srv861392028:84 , srv862560954:84 , srv881277788:84 , srv889910219:84 , srv898042123:84 , srv898281189:84 , srv908538366:84 , srv921647400:84 , srv923798859:84 , srv928070972:84 , srv960042170:84 , srv970886249:84 , srv980100872:84 , srv984800897:84 , srv1517451536:684 } [srvr=100 rgns=9000 avg=90.0 max=90 min=90]
2023-03-04 15:56:15,231 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-03-04 15:56:15,240 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1992224682=52, srv862560954=87, srv928070972=95, srv372732873=68, srv319963742=63, srv513302092=75, srv898042123=90, srv898281189=91, srv5115734=74, srv217728418=59, srv980100872=98, srv24811298=61, srv1234871679=9, srv535815270=78, srv318588001=62, srv1972629651=49, srv1080688773=1, srv889910219=89, srv984800897=99, srv1452749059=16, srv1980658996=50, srv1614924170=28, srv346421=65, srv791618124=83, srv1201221025=8, srv525762740=76, srv1481042159=17, srv1189373797=7, srv1888359144=41, srv1909269165=43, srv827059092=85, srv1515390922=19, srv861392028=86, srv1583413995=26, srv1520173108=21, srv367332499=67, srv671246362=82, srv1517451536=20, srv587232575=80, srv908538366=92, srv1125749791=4, srv1557612390=23, srv321888726=64, srv1027255241=0, srv38237893=69, srv970886249=97, srv1131813353=5, srv1819667730=38, srv1186963056=6, srv923798859=94, srv531064050=77, srv1091506671=2, srv1914151199=44, srv406861661=71, srv1893835131=42, srv432847275=73, srv1697470076=32, srv360330441=66, srv552895300=79, srv1539337244=22, srv921647400=93, srv1714724091=34, srv637401588=81, srv397130587=70, srv1600251847=27, srv1245905492=10, srv1254215173=11, srv1647309457=30, srv1279115348=12, srv1834984343=39, srv209683504=57, srv1752531046=35, srv1112676090=3, srv2124097980=58, srv156111766=24, srv1780255033=36, srv799720278=84, srv1875695845=40, srv1621962540=29, srv2055632705=55, srv233646120=60, srv881277788=88, srv1664424992=31, srv420642010=72, srv1814191486=37, srv1933133022=47, srv1927549642=45, srv1928065890=46, srv1703025934=33, srv203162381=54, srv2021988751=53, srv1986938670=51, srv209253763=56, srv1415176671=15, srv1340994013=13, srv1970650199=48, srv1387131094=14, srv1495561558=18, srv960042170=96, srv1562868380=25} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-03-04 15:56:15,336 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-03-04 15:56:15,336 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-03-04 15:56:15,337 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-03-04 15:56:15,337 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-03-04 15:56:15,337 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-03-04 15:56:15,337 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-03-04 15:56:15,337 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-03-04 15:56:15,337 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-03-04 15:56:15,337 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-03-04 15:56:15,337 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-03-04 15:56:15,337 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-03-04 15:56:15,337 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-03-04 15:56:15,338 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-03-04 15:56:15,338 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-03-04 15:56:15,338 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-03-04 15:56:15,338 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-03-04 15:56:15,338 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-03-04 15:56:15,338 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-03-04 15:56:15,338 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-03-04 15:56:15,338 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-03-04 15:56:15,338 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-03-04 15:56:15,338 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-03-04 15:56:15,339 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-03-04 15:56:15,339 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-03-04 15:56:15,339 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-03-04 15:56:15,339 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-03-04 15:56:15,339 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-03-04 15:56:15,339 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-03-04 15:56:15,339 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-03-04 15:56:15,339 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-03-04 15:56:15,339 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-03-04 15:56:15,339 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-03-04 15:56:15,340 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-03-04 15:56:15,340 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-03-04 15:56:15,340 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-03-04 15:56:15,340 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-03-04 15:56:15,340 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-03-04 15:56:15,340 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-03-04 15:56:15,340 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-03-04 15:56:15,341 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-03-04 15:56:15,341 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-03-04 15:56:15,341 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-03-04 15:56:15,341 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-03-04 15:56:15,341 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-03-04 15:56:15,341 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-03-04 15:56:15,341 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-03-04 15:56:15,341 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-03-04 15:56:15,341 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-03-04 15:56:15,342 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-03-04 15:56:15,342 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-03-04 15:56:15,342 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-03-04 15:56:15,342 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-03-04 15:56:15,342 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-03-04 15:56:15,342 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-03-04 15:56:15,342 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-03-04 15:56:15,342 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-03-04 15:56:15,343 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-03-04 15:56:15,343 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-03-04 15:56:15,343 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-03-04 15:56:15,343 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-03-04 15:56:15,343 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-03-04 15:56:15,343 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-03-04 15:56:15,343 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-03-04 15:56:15,343 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-03-04 15:56:15,343 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-03-04 15:56:15,344 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-03-04 15:56:15,344 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-03-04 15:56:15,344 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-03-04 15:56:15,344 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-03-04 15:56:15,344 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-03-04 15:56:15,344 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-03-04 15:56:15,344 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-03-04 15:56:15,344 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-03-04 15:56:15,344 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-03-04 15:56:15,345 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-03-04 15:56:15,345 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-03-04 15:56:15,345 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-03-04 15:56:15,345 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-03-04 15:56:15,345 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-03-04 15:56:15,345 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-03-04 15:56:15,345 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-03-04 15:56:15,346 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-03-04 15:56:15,346 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-03-04 15:56:15,346 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-03-04 15:56:15,346 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-03-04 15:56:15,346 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-03-04 15:56:15,346 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-03-04 15:56:15,346 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-03-04 15:56:15,347 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-03-04 15:56:15,347 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-03-04 15:56:15,347 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-03-04 15:56:15,347 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-03-04 15:56:15,347 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-03-04 15:56:15,347 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-03-04 15:56:15,347 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-03-04 15:56:15,348 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-03-04 15:56:15,348 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-03-04 15:56:15,348 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-03-04 15:56:15,348 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-03-04 15:56:15,348 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-03-04 15:56:15,348 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-03-04 15:56:15,509 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.06666666666666667, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-03-04 15:56:15,509 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-03-04 15:56:15,509 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.9909252140407105, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.06666666666666667, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-03-04 15:56:15,806 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 431 ms to try 5000 different iterations.  Found a solution that moves 4702 regions; Going from a computed imbalance of 0.9909252140407105 to a new imbalance of 0.18231566067493132. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.03824853582269682, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.055579792692848566, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.5224444444444445, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.03824853582269682, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.178, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.23991666666666667, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-03-04 15:56:15,828 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1189373797:81 , srv1234871679:82 , srv1254215173:82 , srv367332499:82 , srv970886249:82 , srv1664424992:83 , srv1972629651:83 , srv203162381:83 , srv671246362:83 , srv861392028:83 , srv1245905492:84 , srv1452749059:84 , srv1539337244:84 , srv1986938670:84 , srv1992224682:84 , srv531064050:84 , srv1112676090:85 , srv1703025934:85 , srv1714724091:85 , srv1819667730:85 , srv1914151199:85 , srv1928065890:85 , srv1933133022:85 , srv2055632705:85 , srv209253763:85 , srv209683504:85 , srv24811298:85 , srv372732873:85 , srv397130587:85 , srv513302092:85 , srv881277788:85 , srv921647400:85 , srv1091506671:86 , srv1415176671:86 , srv1520173108:86 , srv1600251847:86 , srv1614924170:86 , srv1621962540:86 , srv1875695845:86 , srv2021988751:86 , srv2124097980:86 , srv217728418:86 , srv346421:86 , srv406861661:86 , srv420642010:86 , srv525762740:86 , srv799720278:86 , srv898042123:86 , srv960042170:86 , srv980100872:86 , srv984800897:86 , srv1495561558:87 , srv1515390922:87 , srv1834984343:87 , srv1980658996:87 , srv360330441:87 , srv38237893:87 , srv432847275:87 , srv552895300:87 , srv637401588:87 , srv791618124:87 , srv889910219:87 , srv898281189:87 , srv923798859:87 , srv1125749791:88 , srv1186963056:88 , srv1340994013:88 , srv1387131094:88 , srv156111766:88 , srv1647309457:88 , srv1697470076:88 , srv1752531046:88 , srv1814191486:88 , srv1888359144:88 , srv1927549642:88 , srv321888726:88 , srv587232575:88 , srv827059092:88 , srv908538366:88 , srv928070972:88 , srv1027255241:89 , srv1131813353:89 , srv1201221025:89 , srv1481042159:89 , srv1893835131:89 , srv1909269165:89 , srv318588001:89 , srv319963742:89 , srv5115734:89 , srv535815270:89 , srv862560954:89 , srv1279115348:90 , srv1583413995:90 , srv1557612390:91 , srv1562868380:91 , srv1970650199:91 , srv1080688773:92 , srv233646120:92 , srv1780255033:93 , srv1517451536:430 }
2023-03-04 15:56:15,834 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-03-04 15:56:15,836 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1992224682=52, srv862560954=87, srv928070972=95, srv372732873=68, srv319963742=63, srv513302092=75, srv898042123=90, srv898281189=91, srv5115734=74, srv217728418=59, srv980100872=98, srv24811298=61, srv1234871679=9, srv535815270=78, srv318588001=62, srv1972629651=49, srv1080688773=1, srv889910219=89, srv984800897=99, srv1452749059=16, srv1980658996=50, srv1614924170=28, srv346421=65, srv791618124=83, srv1201221025=8, srv525762740=76, srv1481042159=17, srv1189373797=7, srv1888359144=41, srv1909269165=43, srv827059092=85, srv1515390922=19, srv861392028=86, srv1583413995=26, srv1520173108=21, srv367332499=67, srv671246362=82, srv1517451536=20, srv587232575=80, srv908538366=92, srv1125749791=4, srv1557612390=23, srv321888726=64, srv1027255241=0, srv38237893=69, srv970886249=97, srv1131813353=5, srv1819667730=38, srv1186963056=6, srv923798859=94, srv531064050=77, srv1091506671=2, srv1914151199=44, srv406861661=71, srv1893835131=42, srv432847275=73, srv1697470076=32, srv360330441=66, srv552895300=79, srv1539337244=22, srv921647400=93, srv1714724091=34, srv637401588=81, srv397130587=70, srv1600251847=27, srv1245905492=10, srv1254215173=11, srv1647309457=30, srv1279115348=12, srv1834984343=39, srv209683504=57, srv1752531046=35, srv1112676090=3, srv2124097980=58, srv156111766=24, srv1780255033=36, srv799720278=84, srv1875695845=40, srv1621962540=29, srv2055632705=55, srv233646120=60, srv881277788=88, srv1664424992=31, srv420642010=72, srv1814191486=37, srv1933133022=47, srv1927549642=45, srv1928065890=46, srv1703025934=33, srv203162381=54, srv2021988751=53, srv1986938670=51, srv209253763=56, srv1415176671=15, srv1340994013=13, srv1970650199=48, srv1387131094=14, srv1495561558=18, srv960042170=96, srv1562868380=25} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-03-04 15:56:15,860 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-03-04 15:56:15,860 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-03-04 15:56:15,860 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-03-04 15:56:15,860 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-03-04 15:56:15,861 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-03-04 15:56:15,861 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-03-04 15:56:15,861 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-03-04 15:56:15,861 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-03-04 15:56:15,861 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-03-04 15:56:15,861 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-03-04 15:56:15,861 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-03-04 15:56:15,861 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-03-04 15:56:15,861 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-03-04 15:56:15,861 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-03-04 15:56:15,861 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-03-04 15:56:15,861 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-03-04 15:56:15,862 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-03-04 15:56:15,862 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-03-04 15:56:15,862 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-03-04 15:56:15,862 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-03-04 15:56:15,862 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-03-04 15:56:15,862 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-03-04 15:56:15,862 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-03-04 15:56:15,862 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-03-04 15:56:15,862 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-03-04 15:56:15,862 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-03-04 15:56:15,862 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-03-04 15:56:15,862 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-03-04 15:56:15,862 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-03-04 15:56:15,863 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-03-04 15:56:15,863 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-03-04 15:56:15,863 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-03-04 15:56:15,863 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-03-04 15:56:15,863 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-03-04 15:56:15,863 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-03-04 15:56:15,863 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-03-04 15:56:15,863 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-03-04 15:56:15,863 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-03-04 15:56:15,863 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-03-04 15:56:15,863 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-03-04 15:56:15,863 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-03-04 15:56:15,863 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-03-04 15:56:15,863 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-03-04 15:56:15,864 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-03-04 15:56:15,864 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-03-04 15:56:15,864 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-03-04 15:56:15,864 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-03-04 15:56:15,864 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-03-04 15:56:15,864 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-03-04 15:56:15,864 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-03-04 15:56:15,864 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-03-04 15:56:15,864 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-03-04 15:56:15,864 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-03-04 15:56:15,864 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-03-04 15:56:15,864 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-03-04 15:56:15,864 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-03-04 15:56:15,865 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-03-04 15:56:15,865 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-03-04 15:56:15,865 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-03-04 15:56:15,865 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-03-04 15:56:15,865 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-03-04 15:56:15,865 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-03-04 15:56:15,865 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-03-04 15:56:15,865 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-03-04 15:56:15,865 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-03-04 15:56:15,865 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-03-04 15:56:15,865 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-03-04 15:56:15,865 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-03-04 15:56:15,865 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-03-04 15:56:15,865 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-03-04 15:56:15,866 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-03-04 15:56:15,866 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-03-04 15:56:15,866 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-03-04 15:56:15,866 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-03-04 15:56:15,866 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-03-04 15:56:15,866 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-03-04 15:56:15,866 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-03-04 15:56:15,866 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-03-04 15:56:15,866 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-03-04 15:56:15,866 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-03-04 15:56:15,866 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-03-04 15:56:15,866 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-03-04 15:56:15,867 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-03-04 15:56:15,867 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-03-04 15:56:15,867 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-03-04 15:56:15,867 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-03-04 15:56:15,867 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-03-04 15:56:15,867 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-03-04 15:56:15,867 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-03-04 15:56:15,867 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-03-04 15:56:15,867 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-03-04 15:56:15,867 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-03-04 15:56:15,867 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-03-04 15:56:15,867 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-03-04 15:56:15,867 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-03-04 15:56:15,867 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-03-04 15:56:15,868 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-03-04 15:56:15,868 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-03-04 15:56:15,868 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-03-04 15:56:15,868 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-03-04 15:56:15,868 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-03-04 15:56:16,020 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.03824853582269682, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.055579792692848566, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.03824853582269682, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.178, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.23991666666666667, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-03-04 15:56:16,021 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-03-04 15:56:16,021 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.18228273656723026, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.03824853582269682, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.055579792692848566, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.03824853582269682, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.178, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.23991666666666667, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-03-04 15:56:16,283 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 396 ms to try 5000 different iterations.  Found a solution that moves 2629 regions; Going from a computed imbalance of 0.18228273656723026 to a new imbalance of 0.015315021720042841. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.022958074857166815); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.03530530620833994, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.2921111111111111, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.022958074857166815); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.01225); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.04441666666666667, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-03-04 15:56:16,292 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1780255033:77 , srv1970650199:80 , srv233646120:80 , srv1080688773:81 , srv1201221025:81 , srv1562868380:81 , srv1583413995:81 , srv862560954:81 , srv1131813353:82 , srv1186963056:82 , srv1340994013:82 , srv1814191486:82 , srv318588001:82 , srv1125749791:83 , srv1387131094:83 , srv1481042159:83 , srv1888359144:83 , srv321888726:83 , srv360330441:83 , srv1279115348:84 , srv1520173108:84 , srv156111766:84 , srv1647309457:84 , srv1834984343:84 , srv1927549642:84 , srv525762740:84 , srv637401588:84 , srv799720278:84 , srv827059092:84 , srv923798859:84 , srv960042170:84 , srv1027255241:85 , srv1091506671:85 , srv1112676090:85 , srv1495561558:85 , srv1557612390:85 , srv1614924170:85 , srv1893835131:85 , srv1909269165:85 , srv1980658996:85 , srv217728418:85 , srv24811298:85 , srv319963742:85 , srv346421:85 , srv372732873:85 , srv420642010:85 , srv432847275:85 , srv587232575:85 , srv881277788:85 , srv889910219:85 , srv898042123:85 , srv908538366:85 , srv928070972:85 , srv980100872:85 , srv1415176671:86 , srv1515390922:86 , srv1539337244:86 , srv1752531046:86 , srv1914151199:86 , srv1933133022:86 , srv2021988751:86 , srv406861661:86 , srv5115734:86 , srv535815270:86 , srv791618124:86 , srv898281189:86 , srv921647400:86 , srv1452749059:87 , srv1600251847:87 , srv1621962540:87 , srv1664424992:87 , srv1697470076:87 , srv1703025934:87 , srv1819667730:87 , srv1986938670:87 , srv1992224682:87 , srv209683504:87 , srv2124097980:87 , srv38237893:87 , srv513302092:87 , srv970886249:87 , srv1714724091:88 , srv1972629651:88 , srv203162381:88 , srv2055632705:88 , srv209253763:88 , srv397130587:88 , srv552895300:88 , srv984800897:88 , srv1245905492:89 , srv1875695845:89 , srv531064050:89 , srv671246362:89 , srv1234871679:90 , srv367332499:90 , srv861392028:90 , srv1189373797:91 , srv1254215173:91 , srv1928065890:91 , srv1517451536:548 }
2023-03-04 15:56:16,296 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-03-04 15:56:16,296 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1992224682=52, srv862560954=87, srv928070972=95, srv372732873=68, srv319963742=63, srv513302092=75, srv898042123=90, srv898281189=91, srv5115734=74, srv217728418=59, srv980100872=98, srv24811298=61, srv1234871679=9, srv535815270=78, srv318588001=62, srv1972629651=49, srv1080688773=1, srv889910219=89, srv984800897=99, srv1452749059=16, srv1980658996=50, srv1614924170=28, srv346421=65, srv791618124=83, srv1201221025=8, srv525762740=76, srv1481042159=17, srv1189373797=7, srv1888359144=41, srv1909269165=43, srv827059092=85, srv1515390922=19, srv861392028=86, srv1583413995=26, srv1520173108=21, srv367332499=67, srv671246362=82, srv1517451536=20, srv587232575=80, srv908538366=92, srv1125749791=4, srv1557612390=23, srv321888726=64, srv1027255241=0, srv38237893=69, srv970886249=97, srv1131813353=5, srv1819667730=38, srv1186963056=6, srv923798859=94, srv531064050=77, srv1091506671=2, srv1914151199=44, srv406861661=71, srv1893835131=42, srv432847275=73, srv1697470076=32, srv360330441=66, srv552895300=79, srv1539337244=22, srv921647400=93, srv1714724091=34, srv637401588=81, srv397130587=70, srv1600251847=27, srv1245905492=10, srv1254215173=11, srv1647309457=30, srv1279115348=12, srv1834984343=39, srv209683504=57, srv1752531046=35, srv1112676090=3, srv2124097980=58, srv156111766=24, srv1780255033=36, srv799720278=84, srv1875695845=40, srv1621962540=29, srv2055632705=55, srv233646120=60, srv881277788=88, srv1664424992=31, srv420642010=72, srv1814191486=37, srv1933133022=47, srv1927549642=45, srv1928065890=46, srv1703025934=33, srv203162381=54, srv2021988751=53, srv1986938670=51, srv209253763=56, srv1415176671=15, srv1340994013=13, srv1970650199=48, srv1387131094=14, srv1495561558=18, srv960042170=96, srv1562868380=25} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-03-04 15:56:16,310 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-03-04 15:56:16,310 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-03-04 15:56:16,310 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-03-04 15:56:16,310 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-03-04 15:56:16,310 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-03-04 15:56:16,310 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-03-04 15:56:16,310 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-03-04 15:56:16,310 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-03-04 15:56:16,310 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-03-04 15:56:16,310 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-03-04 15:56:16,310 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-03-04 15:56:16,310 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-03-04 15:56:16,310 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-03-04 15:56:16,310 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-03-04 15:56:16,311 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-03-04 15:56:16,311 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-03-04 15:56:16,311 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-03-04 15:56:16,311 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-03-04 15:56:16,311 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-03-04 15:56:16,311 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-03-04 15:56:16,311 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-03-04 15:56:16,311 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-03-04 15:56:16,311 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-03-04 15:56:16,311 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-03-04 15:56:16,311 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-03-04 15:56:16,311 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-03-04 15:56:16,311 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-03-04 15:56:16,311 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-03-04 15:56:16,311 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-03-04 15:56:16,311 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-03-04 15:56:16,312 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-03-04 15:56:16,312 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-03-04 15:56:16,312 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-03-04 15:56:16,312 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-03-04 15:56:16,312 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-03-04 15:56:16,312 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-03-04 15:56:16,312 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-03-04 15:56:16,312 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-03-04 15:56:16,312 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-03-04 15:56:16,312 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-03-04 15:56:16,312 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-03-04 15:56:16,312 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-03-04 15:56:16,312 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-03-04 15:56:16,312 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-03-04 15:56:16,312 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-03-04 15:56:16,312 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-03-04 15:56:16,313 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-03-04 15:56:16,313 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-03-04 15:56:16,313 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-03-04 15:56:16,313 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-03-04 15:56:16,313 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-03-04 15:56:16,313 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-03-04 15:56:16,313 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-03-04 15:56:16,313 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-03-04 15:56:16,313 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-03-04 15:56:16,313 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-03-04 15:56:16,313 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-03-04 15:56:16,313 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-03-04 15:56:16,313 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-03-04 15:56:16,313 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-03-04 15:56:16,313 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-03-04 15:56:16,313 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-03-04 15:56:16,314 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-03-04 15:56:16,314 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-03-04 15:56:16,314 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-03-04 15:56:16,314 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-03-04 15:56:16,314 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-03-04 15:56:16,314 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-03-04 15:56:16,314 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-03-04 15:56:16,314 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-03-04 15:56:16,314 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-03-04 15:56:16,314 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-03-04 15:56:16,314 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-03-04 15:56:16,314 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-03-04 15:56:16,314 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-03-04 15:56:16,314 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-03-04 15:56:16,314 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-03-04 15:56:16,315 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-03-04 15:56:16,315 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-03-04 15:56:16,315 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-03-04 15:56:16,315 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-03-04 15:56:16,315 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-03-04 15:56:16,315 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-03-04 15:56:16,315 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-03-04 15:56:16,315 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-03-04 15:56:16,315 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-03-04 15:56:16,315 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-03-04 15:56:16,315 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-03-04 15:56:16,315 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-03-04 15:56:16,315 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-03-04 15:56:16,315 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-03-04 15:56:16,315 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-03-04 15:56:16,315 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-03-04 15:56:16,316 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-03-04 15:56:16,316 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-03-04 15:56:16,316 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-03-04 15:56:16,316 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-03-04 15:56:16,316 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-03-04 15:56:16,316 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-03-04 15:56:16,316 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-03-04 15:56:16,316 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-03-04 15:56:16,439 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.022958074857166815); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.03530530620833994, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.022958074857166815); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.01225); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.04441666666666667, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-03-04 15:56:16,439 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-03-04 15:56:16,440 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.015296613068586843, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.022958074857166815); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.03530530620833994, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.022958074857166815); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.01225); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.04441666666666667, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-03-04 15:56:16,734 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 408 ms to try 5000 different iterations.  Found a solution that moves 998 regions; Going from a computed imbalance of 0.015296613068586843 to a new imbalance of 6.430859900906445E-4. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.007223301309353738); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.010249414863810766); MoveCostFunction : (multiplier=7.0, imbalance=0.11088888888888888, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.007223301309353738); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=2.5E-4); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0036666666666666666); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-03-04 15:56:16,739 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1557612390:82 , srv1697470076:82 , srv1875695845:82 , srv535815270:82 , srv1027255241:83 , srv1279115348:83 , srv1752531046:83 , srv1893835131:83 , srv1928065890:83 , srv38237893:83 , srv5115734:83 , srv984800897:83 , srv1080688773:84 , srv1245905492:84 , srv1254215173:84 , srv1495561558:84 , srv1621962540:84 , srv1909269165:84 , srv209253763:84 , srv209683504:84 , srv233646120:84 , srv397130587:84 , srv432847275:84 , srv531064050:84 , srv552895300:84 , srv861392028:84 , srv898281189:84 , srv908538366:84 , srv1415176671:85 , srv1515390922:85 , srv156111766:85 , srv1600251847:85 , srv1714724091:85 , srv1980658996:85 , srv2021988751:85 , srv2055632705:85 , srv2124097980:85 , srv319963742:85 , srv321888726:85 , srv406861661:85 , srv587232575:85 , srv671246362:85 , srv791618124:85 , srv898042123:85 , srv928070972:85 , srv1091506671:86 , srv1125749791:86 , srv1131813353:86 , srv1186963056:86 , srv1189373797:86 , srv1234871679:86 , srv1387131094:86 , srv1452749059:86 , srv1481042159:86 , srv1562868380:86 , srv1614924170:86 , srv1647309457:86 , srv1819667730:86 , srv1914151199:86 , srv1927549642:86 , srv1970650199:86 , srv1986938670:86 , srv1992224682:86 , srv203162381:86 , srv217728418:86 , srv318588001:86 , srv346421:86 , srv367332499:86 , srv420642010:86 , srv513302092:86 , srv827059092:86 , srv889910219:86 , srv921647400:86 , srv980100872:86 , srv1112676090:87 , srv1201221025:87 , srv1340994013:87 , srv1520173108:87 , srv1539337244:87 , srv1583413995:87 , srv1664424992:87 , srv1703025934:87 , srv1814191486:87 , srv1834984343:87 , srv1888359144:87 , srv1972629651:87 , srv360330441:87 , srv372732873:87 , srv525762740:87 , srv637401588:87 , srv799720278:87 , srv862560954:87 , srv923798859:87 , srv1780255033:88 , srv1933133022:88 , srv24811298:88 , srv881277788:88 , srv960042170:88 , srv970886249:88 , srv1517451536:544 }
2023-03-04 15:56:16,743 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-03-04 15:56:16,744 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1992224682=52, srv862560954=87, srv928070972=95, srv372732873=68, srv319963742=63, srv513302092=75, srv898042123=90, srv898281189=91, srv5115734=74, srv217728418=59, srv980100872=98, srv24811298=61, srv1234871679=9, srv535815270=78, srv318588001=62, srv1972629651=49, srv1080688773=1, srv889910219=89, srv984800897=99, srv1452749059=16, srv1980658996=50, srv1614924170=28, srv346421=65, srv791618124=83, srv1201221025=8, srv525762740=76, srv1481042159=17, srv1189373797=7, srv1888359144=41, srv1909269165=43, srv827059092=85, srv1515390922=19, srv861392028=86, srv1583413995=26, srv1520173108=21, srv367332499=67, srv671246362=82, srv1517451536=20, srv587232575=80, srv908538366=92, srv1125749791=4, srv1557612390=23, srv321888726=64, srv1027255241=0, srv38237893=69, srv970886249=97, srv1131813353=5, srv1819667730=38, srv1186963056=6, srv923798859=94, srv531064050=77, srv1091506671=2, srv1914151199=44, srv406861661=71, srv1893835131=42, srv432847275=73, srv1697470076=32, srv360330441=66, srv552895300=79, srv1539337244=22, srv921647400=93, srv1714724091=34, srv637401588=81, srv397130587=70, srv1600251847=27, srv1245905492=10, srv1254215173=11, srv1647309457=30, srv1279115348=12, srv1834984343=39, srv209683504=57, srv1752531046=35, srv1112676090=3, srv2124097980=58, srv156111766=24, srv1780255033=36, srv799720278=84, srv1875695845=40, srv1621962540=29, srv2055632705=55, srv233646120=60, srv881277788=88, srv1664424992=31, srv420642010=72, srv1814191486=37, srv1933133022=47, srv1927549642=45, srv1928065890=46, srv1703025934=33, srv203162381=54, srv2021988751=53, srv1986938670=51, srv209253763=56, srv1415176671=15, srv1340994013=13, srv1970650199=48, srv1387131094=14, srv1495561558=18, srv960042170=96, srv1562868380=25} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-03-04 15:56:16,763 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-03-04 15:56:16,763 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-03-04 15:56:16,763 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-03-04 15:56:16,763 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-03-04 15:56:16,763 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-03-04 15:56:16,763 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-03-04 15:56:16,763 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-03-04 15:56:16,764 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-03-04 15:56:16,764 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-03-04 15:56:16,764 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-03-04 15:56:16,764 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-03-04 15:56:16,764 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-03-04 15:56:16,764 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-03-04 15:56:16,764 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-03-04 15:56:16,764 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-03-04 15:56:16,764 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-03-04 15:56:16,764 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-03-04 15:56:16,764 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-03-04 15:56:16,764 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-03-04 15:56:16,764 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-03-04 15:56:16,764 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-03-04 15:56:16,764 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-03-04 15:56:16,764 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-03-04 15:56:16,765 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-03-04 15:56:16,765 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-03-04 15:56:16,765 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-03-04 15:56:16,765 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-03-04 15:56:16,765 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-03-04 15:56:16,765 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-03-04 15:56:16,765 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-03-04 15:56:16,765 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-03-04 15:56:16,765 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-03-04 15:56:16,765 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-03-04 15:56:16,765 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-03-04 15:56:16,765 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-03-04 15:56:16,765 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-03-04 15:56:16,765 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-03-04 15:56:16,766 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-03-04 15:56:16,766 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-03-04 15:56:16,766 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-03-04 15:56:16,766 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-03-04 15:56:16,766 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-03-04 15:56:16,766 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-03-04 15:56:16,766 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-03-04 15:56:16,766 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-03-04 15:56:16,766 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-03-04 15:56:16,766 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-03-04 15:56:16,766 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-03-04 15:56:16,766 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-03-04 15:56:16,766 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-03-04 15:56:16,766 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-03-04 15:56:16,767 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-03-04 15:56:16,767 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-03-04 15:56:16,767 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-03-04 15:56:16,767 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-03-04 15:56:16,767 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-03-04 15:56:16,767 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-03-04 15:56:16,767 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-03-04 15:56:16,767 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-03-04 15:56:16,767 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-03-04 15:56:16,767 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-03-04 15:56:16,767 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-03-04 15:56:16,767 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-03-04 15:56:16,767 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-03-04 15:56:16,767 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-03-04 15:56:16,767 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-03-04 15:56:16,767 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-03-04 15:56:16,768 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-03-04 15:56:16,768 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-03-04 15:56:16,768 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-03-04 15:56:16,768 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-03-04 15:56:16,768 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-03-04 15:56:16,768 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-03-04 15:56:16,768 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-03-04 15:56:16,768 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-03-04 15:56:16,768 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-03-04 15:56:16,768 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-03-04 15:56:16,768 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-03-04 15:56:16,768 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-03-04 15:56:16,768 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-03-04 15:56:16,768 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-03-04 15:56:16,769 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-03-04 15:56:16,769 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-03-04 15:56:16,769 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-03-04 15:56:16,769 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-03-04 15:56:16,769 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-03-04 15:56:16,769 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-03-04 15:56:16,769 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-03-04 15:56:16,769 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-03-04 15:56:16,769 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-03-04 15:56:16,769 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-03-04 15:56:16,769 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-03-04 15:56:16,769 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-03-04 15:56:16,769 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-03-04 15:56:16,769 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-03-04 15:56:16,769 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-03-04 15:56:16,770 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-03-04 15:56:16,770 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-03-04 15:56:16,770 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-03-04 15:56:16,770 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-03-04 15:56:16,770 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-03-04 15:56:16,886 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.007223301309353738); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.010249414863810766); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.007223301309353738); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=2.5E-4); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0036666666666666666); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-03-04 15:56:16,886 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-03-04 15:56:16,886 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=6.360978447300188E-4, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.007223301309353738); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.010249414863810766); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.007223301309353738); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=2.5E-4); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0036666666666666666); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-03-04 15:56:17,190 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 404 ms to try 5000 different iterations.  Found a solution that moves 259 regions; Going from a computed imbalance of 6.360978447300188E-4 to a new imbalance of 2.9681017142131253E-5. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=5.470732932414788E-4); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0022721660362024225); MoveCostFunction : (multiplier=7.0, imbalance=0.028777777777777777, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=5.470732932414788E-4); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.6666666666666666E-4); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-03-04 15:56:17,191 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1703025934:83 , srv1928065890:83 , srv552895300:83 , srv587232575:83 , srv1189373797:84 , srv1234871679:84 , srv1415176671:84 , srv1481042159:84 , srv1515390922:84 , srv1557612390:84 , srv1562868380:84 , srv1583413995:84 , srv1600251847:84 , srv1697470076:84 , srv1714724091:84 , srv1780255033:84 , srv1819667730:84 , srv1834984343:84 , srv1888359144:84 , srv1909269165:84 , srv1927549642:84 , srv1933133022:84 , srv1972629651:84 , srv1986938670:84 , srv1992224682:84 , srv209253763:84 , srv2124097980:84 , srv318588001:84 , srv319963742:84 , srv360330441:84 , srv367332499:84 , srv372732873:84 , srv420642010:84 , srv5115734:84 , srv513302092:84 , srv791618124:84 , srv827059092:84 , srv861392028:84 , srv881277788:84 , srv889910219:84 , srv923798859:84 , srv928070972:84 , srv960042170:84 , srv1027255241:85 , srv1080688773:85 , srv1091506671:85 , srv1112676090:85 , srv1125749791:85 , srv1131813353:85 , srv1201221025:85 , srv1279115348:85 , srv1340994013:85 , srv1387131094:85 , srv1452749059:85 , srv1520173108:85 , srv1539337244:85 , srv156111766:85 , srv1614924170:85 , srv1621962540:85 , srv1647309457:85 , srv1664424992:85 , srv1752531046:85 , srv1814191486:85 , srv1875695845:85 , srv1893835131:85 , srv1914151199:85 , srv1970650199:85 , srv1980658996:85 , srv2021988751:85 , srv203162381:85 , srv2055632705:85 , srv217728418:85 , srv24811298:85 , srv321888726:85 , srv346421:85 , srv38237893:85 , srv397130587:85 , srv406861661:85 , srv525762740:85 , srv535815270:85 , srv637401588:85 , srv671246362:85 , srv799720278:85 , srv862560954:85 , srv908538366:85 , srv921647400:85 , srv970886249:85 , srv984800897:85 , srv1186963056:86 , srv1245905492:86 , srv1254215173:86 , srv209683504:86 , srv233646120:86 , srv432847275:86 , srv531064050:86 , srv898042123:86 , srv898281189:86 , srv980100872:86 , srv1495561558:87 , srv1517451536:620 }
2023-03-04 15:56:17,194 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-03-04 15:56:17,195 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1992224682=52, srv862560954=87, srv928070972=95, srv372732873=68, srv319963742=63, srv513302092=75, srv898042123=90, srv898281189=91, srv5115734=74, srv217728418=59, srv980100872=98, srv24811298=61, srv1234871679=9, srv535815270=78, srv318588001=62, srv1972629651=49, srv1080688773=1, srv889910219=89, srv984800897=99, srv1452749059=16, srv1980658996=50, srv1614924170=28, srv346421=65, srv791618124=83, srv1201221025=8, srv525762740=76, srv1481042159=17, srv1189373797=7, srv1888359144=41, srv1909269165=43, srv827059092=85, srv1515390922=19, srv861392028=86, srv1583413995=26, srv1520173108=21, srv367332499=67, srv671246362=82, srv1517451536=20, srv587232575=80, srv908538366=92, srv1125749791=4, srv1557612390=23, srv321888726=64, srv1027255241=0, srv38237893=69, srv970886249=97, srv1131813353=5, srv1819667730=38, srv1186963056=6, srv923798859=94, srv531064050=77, srv1091506671=2, srv1914151199=44, srv406861661=71, srv1893835131=42, srv432847275=73, srv1697470076=32, srv360330441=66, srv552895300=79, srv1539337244=22, srv921647400=93, srv1714724091=34, srv637401588=81, srv397130587=70, srv1600251847=27, srv1245905492=10, srv1254215173=11, srv1647309457=30, srv1279115348=12, srv1834984343=39, srv209683504=57, srv1752531046=35, srv1112676090=3, srv2124097980=58, srv156111766=24, srv1780255033=36, srv799720278=84, srv1875695845=40, srv1621962540=29, srv2055632705=55, srv233646120=60, srv881277788=88, srv1664424992=31, srv420642010=72, srv1814191486=37, srv1933133022=47, srv1927549642=45, srv1928065890=46, srv1703025934=33, srv203162381=54, srv2021988751=53, srv1986938670=51, srv209253763=56, srv1415176671=15, srv1340994013=13, srv1970650199=48, srv1387131094=14, srv1495561558=18, srv960042170=96, srv1562868380=25} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-03-04 15:56:17,206 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-03-04 15:56:17,206 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-03-04 15:56:17,206 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-03-04 15:56:17,206 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-03-04 15:56:17,206 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-03-04 15:56:17,206 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-03-04 15:56:17,206 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-03-04 15:56:17,206 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-03-04 15:56:17,206 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-03-04 15:56:17,206 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-03-04 15:56:17,206 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-03-04 15:56:17,206 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-03-04 15:56:17,206 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-03-04 15:56:17,206 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-03-04 15:56:17,206 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-03-04 15:56:17,206 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-03-04 15:56:17,207 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-03-04 15:56:17,207 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-03-04 15:56:17,207 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-03-04 15:56:17,207 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-03-04 15:56:17,207 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-03-04 15:56:17,207 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-03-04 15:56:17,207 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-03-04 15:56:17,207 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-03-04 15:56:17,207 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-03-04 15:56:17,207 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-03-04 15:56:17,207 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-03-04 15:56:17,207 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-03-04 15:56:17,207 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-03-04 15:56:17,207 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-03-04 15:56:17,207 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-03-04 15:56:17,207 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-03-04 15:56:17,207 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-03-04 15:56:17,207 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-03-04 15:56:17,208 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-03-04 15:56:17,208 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-03-04 15:56:17,208 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-03-04 15:56:17,208 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-03-04 15:56:17,208 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-03-04 15:56:17,208 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-03-04 15:56:17,208 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-03-04 15:56:17,208 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-03-04 15:56:17,208 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-03-04 15:56:17,208 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-03-04 15:56:17,208 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-03-04 15:56:17,208 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-03-04 15:56:17,208 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-03-04 15:56:17,208 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-03-04 15:56:17,208 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-03-04 15:56:17,208 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-03-04 15:56:17,209 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-03-04 15:56:17,209 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-03-04 15:56:17,209 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-03-04 15:56:17,209 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-03-04 15:56:17,209 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-03-04 15:56:17,209 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-03-04 15:56:17,209 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-03-04 15:56:17,209 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-03-04 15:56:17,209 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-03-04 15:56:17,209 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-03-04 15:56:17,209 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-03-04 15:56:17,210 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-03-04 15:56:17,210 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-03-04 15:56:17,210 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-03-04 15:56:17,210 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-03-04 15:56:17,210 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-03-04 15:56:17,210 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-03-04 15:56:17,210 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-03-04 15:56:17,210 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-03-04 15:56:17,211 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-03-04 15:56:17,211 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-03-04 15:56:17,211 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-03-04 15:56:17,211 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-03-04 15:56:17,211 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-03-04 15:56:17,211 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-03-04 15:56:17,211 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-03-04 15:56:17,211 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-03-04 15:56:17,211 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-03-04 15:56:17,212 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-03-04 15:56:17,212 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-03-04 15:56:17,212 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-03-04 15:56:17,212 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-03-04 15:56:17,212 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-03-04 15:56:17,212 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-03-04 15:56:17,212 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-03-04 15:56:17,212 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-03-04 15:56:17,212 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-03-04 15:56:17,213 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-03-04 15:56:17,213 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-03-04 15:56:17,213 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-03-04 15:56:17,213 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-03-04 15:56:17,213 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-03-04 15:56:17,213 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-03-04 15:56:17,213 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-03-04 15:56:17,213 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-03-04 15:56:17,213 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-03-04 15:56:17,213 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-03-04 15:56:17,213 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-03-04 15:56:17,214 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-03-04 15:56:17,214 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-03-04 15:56:17,214 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-03-04 15:56:17,322 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=5.470732932414788E-4); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0022721660362024225); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=5.470732932414788E-4); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.6666666666666666E-4); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-03-04 15:56:17,322 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-03-04 15:56:17,323 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=2.7867460380205342E-5, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=5.470732932414788E-4); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0022721660362024225); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=5.470732932414788E-4); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.6666666666666666E-4); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-03-04 15:56:17,550 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 324 ms to try 5000 different iterations.  Found a solution that moves 35 regions; Going from a computed imbalance of 2.7867460380205342E-5 to a new imbalance of 6.989144291930044E-6. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0014982219165849825); MoveCostFunction : (multiplier=7.0, imbalance=0.0038888888888888888); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-03-04 15:56:17,550 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1245905492:83 , srv1254215173:83 , srv1495561558:83 , srv1647309457:83 , srv1933133022:83 , srv2055632705:83 , srv24811298:83 , srv319963742:83 , srv531064050:83 , srv637401588:83 , srv898281189:83 , srv980100872:83 , srv1027255241:84 , srv1080688773:84 , srv1091506671:84 , srv1112676090:84 , srv1125749791:84 , srv1131813353:84 , srv1186963056:84 , srv1189373797:84 , srv1201221025:84 , srv1234871679:84 , srv1279115348:84 , srv1340994013:84 , srv1387131094:84 , srv1452749059:84 , srv1481042159:84 , srv1515390922:84 , srv1520173108:84 , srv1539337244:84 , srv1557612390:84 , srv156111766:84 , srv1562868380:84 , srv1583413995:84 , srv1600251847:84 , srv1614924170:84 , srv1621962540:84 , srv1664424992:84 , srv1703025934:84 , srv1714724091:84 , srv1752531046:84 , srv1780255033:84 , srv1814191486:84 , srv1819667730:84 , srv1834984343:84 , srv1875695845:84 , srv1888359144:84 , srv1893835131:84 , srv1909269165:84 , srv1914151199:84 , srv1927549642:84 , srv1928065890:84 , srv1970650199:84 , srv1972629651:84 , srv1980658996:84 , srv2021988751:84 , srv203162381:84 , srv209683504:84 , srv2124097980:84 , srv217728418:84 , srv233646120:84 , srv346421:84 , srv367332499:84 , srv38237893:84 , srv397130587:84 , srv406861661:84 , srv432847275:84 , srv5115734:84 , srv513302092:84 , srv525762740:84 , srv535815270:84 , srv552895300:84 , srv671246362:84 , srv791618124:84 , srv799720278:84 , srv827059092:84 , srv862560954:84 , srv881277788:84 , srv889910219:84 , srv898042123:84 , srv908538366:84 , srv921647400:84 , srv923798859:84 , srv928070972:84 , srv960042170:84 , srv970886249:84 , srv984800897:84 , srv1415176671:85 , srv1697470076:85 , srv1986938670:85 , srv1992224682:85 , srv209253763:85 , srv318588001:85 , srv321888726:85 , srv360330441:85 , srv372732873:85 , srv420642010:85 , srv587232575:85 , srv861392028:85 , srv1517451536:684 }
2023-03-04 15:56:17,556 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-03-04 15:56:17,556 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1992224682=52, srv862560954=87, srv928070972=95, srv372732873=68, srv319963742=63, srv513302092=75, srv898042123=90, srv898281189=91, srv5115734=74, srv217728418=59, srv980100872=98, srv24811298=61, srv1234871679=9, srv535815270=78, srv318588001=62, srv1972629651=49, srv1080688773=1, srv889910219=89, srv984800897=99, srv1452749059=16, srv1980658996=50, srv1614924170=28, srv346421=65, srv791618124=83, srv1201221025=8, srv525762740=76, srv1481042159=17, srv1189373797=7, srv1888359144=41, srv1909269165=43, srv827059092=85, srv1515390922=19, srv861392028=86, srv1583413995=26, srv1520173108=21, srv367332499=67, srv671246362=82, srv1517451536=20, srv587232575=80, srv908538366=92, srv1125749791=4, srv1557612390=23, srv321888726=64, srv1027255241=0, srv38237893=69, srv970886249=97, srv1131813353=5, srv1819667730=38, srv1186963056=6, srv923798859=94, srv531064050=77, srv1091506671=2, srv1914151199=44, srv406861661=71, srv1893835131=42, srv432847275=73, srv1697470076=32, srv360330441=66, srv552895300=79, srv1539337244=22, srv921647400=93, srv1714724091=34, srv637401588=81, srv397130587=70, srv1600251847=27, srv1245905492=10, srv1254215173=11, srv1647309457=30, srv1279115348=12, srv1834984343=39, srv209683504=57, srv1752531046=35, srv1112676090=3, srv2124097980=58, srv156111766=24, srv1780255033=36, srv799720278=84, srv1875695845=40, srv1621962540=29, srv2055632705=55, srv233646120=60, srv881277788=88, srv1664424992=31, srv420642010=72, srv1814191486=37, srv1933133022=47, srv1927549642=45, srv1928065890=46, srv1703025934=33, srv203162381=54, srv2021988751=53, srv1986938670=51, srv209253763=56, srv1415176671=15, srv1340994013=13, srv1970650199=48, srv1387131094=14, srv1495561558=18, srv960042170=96, srv1562868380=25} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-03-04 15:56:17,573 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-03-04 15:56:17,573 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-03-04 15:56:17,573 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-03-04 15:56:17,573 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-03-04 15:56:17,573 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-03-04 15:56:17,573 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-03-04 15:56:17,573 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-03-04 15:56:17,573 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-03-04 15:56:17,573 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-03-04 15:56:17,574 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-03-04 15:56:17,574 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-03-04 15:56:17,574 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-03-04 15:56:17,574 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-03-04 15:56:17,574 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-03-04 15:56:17,574 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-03-04 15:56:17,574 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-03-04 15:56:17,574 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-03-04 15:56:17,574 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-03-04 15:56:17,574 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-03-04 15:56:17,574 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-03-04 15:56:17,574 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-03-04 15:56:17,575 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-03-04 15:56:17,575 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-03-04 15:56:17,575 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-03-04 15:56:17,575 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-03-04 15:56:17,575 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-03-04 15:56:17,575 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-03-04 15:56:17,575 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-03-04 15:56:17,575 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-03-04 15:56:17,575 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-03-04 15:56:17,575 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-03-04 15:56:17,575 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-03-04 15:56:17,575 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-03-04 15:56:17,575 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-03-04 15:56:17,575 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-03-04 15:56:17,575 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-03-04 15:56:17,575 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-03-04 15:56:17,575 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-03-04 15:56:17,575 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-03-04 15:56:17,575 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-03-04 15:56:17,575 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-03-04 15:56:17,575 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-03-04 15:56:17,575 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-03-04 15:56:17,576 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-03-04 15:56:17,576 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-03-04 15:56:17,576 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-03-04 15:56:17,576 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-03-04 15:56:17,576 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-03-04 15:56:17,576 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-03-04 15:56:17,576 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-03-04 15:56:17,576 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-03-04 15:56:17,576 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-03-04 15:56:17,576 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-03-04 15:56:17,576 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-03-04 15:56:17,576 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-03-04 15:56:17,577 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-03-04 15:56:17,577 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-03-04 15:56:17,577 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-03-04 15:56:17,577 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-03-04 15:56:17,577 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-03-04 15:56:17,577 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-03-04 15:56:17,577 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-03-04 15:56:17,577 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-03-04 15:56:17,577 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-03-04 15:56:17,577 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-03-04 15:56:17,577 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-03-04 15:56:17,577 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-03-04 15:56:17,577 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-03-04 15:56:17,577 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-03-04 15:56:17,577 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-03-04 15:56:17,577 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-03-04 15:56:17,577 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-03-04 15:56:17,577 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-03-04 15:56:17,577 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-03-04 15:56:17,578 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-03-04 15:56:17,578 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-03-04 15:56:17,578 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-03-04 15:56:17,578 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-03-04 15:56:17,578 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-03-04 15:56:17,578 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-03-04 15:56:17,578 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-03-04 15:56:17,578 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-03-04 15:56:17,578 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-03-04 15:56:17,578 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-03-04 15:56:17,578 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-03-04 15:56:17,578 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-03-04 15:56:17,578 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-03-04 15:56:17,578 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-03-04 15:56:17,578 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-03-04 15:56:17,578 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-03-04 15:56:17,578 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-03-04 15:56:17,578 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-03-04 15:56:17,578 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-03-04 15:56:17,578 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-03-04 15:56:17,579 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-03-04 15:56:17,579 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-03-04 15:56:17,579 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-03-04 15:56:17,579 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-03-04 15:56:17,579 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-03-04 15:56:17,579 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-03-04 15:56:17,579 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-03-04 15:56:17,693 INFO  [Time-limited test] balancer.StochasticLoadBalancer(381): Cluster wide - skipping load balancing because weighted average imbalance=6.744069053831948E-6 <= threshold(0.025). If you want more aggressive balancing, either lower hbase.master.balancer.stochastic.minCostNeedBalance from 0.025 or increase the relative multiplier(s) of the specific cost function(s). functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0014982219165849825); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-03-04 15:56:17,693 INFO  [Time-limited test] balancer.BalancerTestBase(570): Mock Final balance: { srv1245905492:83 , srv1254215173:83 , srv1495561558:83 , srv1647309457:83 , srv1933133022:83 , srv2055632705:83 , srv24811298:83 , srv319963742:83 , srv531064050:83 , srv637401588:83 , srv898281189:83 , srv980100872:83 , srv1027255241:84 , srv1080688773:84 , srv1091506671:84 , srv1112676090:84 , srv1125749791:84 , srv1131813353:84 , srv1186963056:84 , srv1189373797:84 , srv1201221025:84 , srv1234871679:84 , srv1279115348:84 , srv1340994013:84 , srv1387131094:84 , srv1452749059:84 , srv1481042159:84 , srv1515390922:84 , srv1520173108:84 , srv1539337244:84 , srv1557612390:84 , srv156111766:84 , srv1562868380:84 , srv1583413995:84 , srv1600251847:84 , srv1614924170:84 , srv1621962540:84 , srv1664424992:84 , srv1703025934:84 , srv1714724091:84 , srv1752531046:84 , srv1780255033:84 , srv1814191486:84 , srv1819667730:84 , srv1834984343:84 , srv1875695845:84 , srv1888359144:84 , srv1893835131:84 , srv1909269165:84 , srv1914151199:84 , srv1927549642:84 , srv1928065890:84 , srv1970650199:84 , srv1972629651:84 , srv1980658996:84 , srv2021988751:84 , srv203162381:84 , srv209683504:84 , srv2124097980:84 , srv217728418:84 , srv233646120:84 , srv346421:84 , srv367332499:84 , srv38237893:84 , srv397130587:84 , srv406861661:84 , srv432847275:84 , srv5115734:84 , srv513302092:84 , srv525762740:84 , srv535815270:84 , srv552895300:84 , srv671246362:84 , srv791618124:84 , srv799720278:84 , srv827059092:84 , srv862560954:84 , srv881277788:84 , srv889910219:84 , srv898042123:84 , srv908538366:84 , srv921647400:84 , srv923798859:84 , srv928070972:84 , srv960042170:84 , srv970886249:84 , srv984800897:84 , srv1415176671:85 , srv1697470076:85 , srv1986938670:85 , srv1992224682:85 , srv209253763:85 , srv318588001:85 , srv321888726:85 , srv360330441:85 , srv372732873:85 , srv420642010:85 , srv587232575:85 , srv861392028:85 , srv1517451536:684 }
2023-03-04 15:56:17,720 INFO  [Time-limited test] hbase.ResourceChecker(175): after: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnLargeClusterWithRacks Thread=10 (was 10), OpenFileDescriptor=260 (was 260), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=126 (was 102) - SystemLoadAverage LEAK? -, ProcessCount=173 (was 173), AvailableMemoryMB=5504 (was 6012)
2023-03-04 15:56:17,727 INFO  [Time-limited test] hbase.ResourceChecker(147): before: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnMidClusterWithRacks Thread=10, OpenFileDescriptor=260, MaxFileDescriptor=60000, SystemLoadAverage=126, ProcessCount=173, AvailableMemoryMB=5504
2023-03-04 15:56:17,728 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2023-03-04 15:56:17,728 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=5000, runMaxSteps=true, stepsPerRegion=800, maxRunningTime=120000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 111077.0 etc.
2023-03-04 15:56:17,740 INFO  [Time-limited test] balancer.BalancerTestBase(547): Mock Cluster : { srv1061189007:84 , srv1194681327:84 , srv130406929:84 , srv1403259082:84 , srv1445521370:84 , srv1553985779:84 , srv174554188:84 , srv1791387942:84 , srv1837661576:84 , srv1929013181:84 , srv1950853753:84 , srv1964988499:84 , srv1969063662:84 , srv2011965353:84 , srv2047283605:84 , srv2127726431:84 , srv282547643:84 , srv409562532:84 , srv622993113:84 , srv625840496:84 , srv635937854:84 , srv780337760:84 , srv78131324:84 , srv784391168:84 , srv80077768:84 , srv872991387:84 , srv906208918:84 , srv961593161:84 , srv980217961:84 , srv1758148242:264 } [srvr=30 rgns=2700 avg=90.0 max=90 min=90]
2023-03-04 15:56:17,742 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-03-04 15:56:17,743 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv2127726431=16, srv409562532=18, srv1553985779=5, srv1194681327=1, srv906208918=27, srv780337760=22, srv784391168=24, srv622993113=19, srv1929013181=10, srv2011965353=14, srv78131324=23, srv961593161=28, srv130406929=2, srv2047283605=15, srv174554188=6, srv625840496=20, srv80077768=25, srv1969063662=13, srv1758148242=7, srv282547643=17, srv1950853753=11, srv980217961=29, srv872991387=26, srv1403259082=3, srv1445521370=4, srv1791387942=8, srv1837661576=9, srv1061189007=0, srv635937854=21, srv1964988499=12} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-03-04 15:56:17,755 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-03-04 15:56:17,756 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-03-04 15:56:17,756 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-03-04 15:56:17,756 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-03-04 15:56:17,756 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-03-04 15:56:17,756 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-03-04 15:56:17,756 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-03-04 15:56:17,756 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-03-04 15:56:17,756 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-03-04 15:56:17,756 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-03-04 15:56:17,756 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-03-04 15:56:17,756 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-03-04 15:56:17,757 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-03-04 15:56:17,757 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-03-04 15:56:17,757 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-03-04 15:56:17,757 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-03-04 15:56:17,757 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-03-04 15:56:17,757 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-03-04 15:56:17,757 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-03-04 15:56:17,757 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-03-04 15:56:17,757 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-03-04 15:56:17,757 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-03-04 15:56:17,757 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-03-04 15:56:17,757 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-03-04 15:56:17,757 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-03-04 15:56:17,758 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-03-04 15:56:17,758 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-03-04 15:56:17,758 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-03-04 15:56:17,758 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-03-04 15:56:17,758 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-03-04 15:56:17,758 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=10, number of hosts=30, number of racks=4
2023-03-04 15:56:17,786 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=1.0480094396235216, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-03-04 15:56:17,786 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.9912344319440882, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=1.0480094396235216, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=64800000
2023-03-04 15:58:17,762 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 120001 ms to try 6167102 different iterations.  Found a solution that moves 1857 regions; Going from a computed imbalance of 0.9912344319440882 to a new imbalance of 4.334330639506329E-5. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); MoveCostFunction : (multiplier=7.0, imbalance=0.6877777777777778, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-03-04 15:58:17,768 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1061189007:90 , srv1194681327:90 , srv130406929:90 , srv1403259082:90 , srv1445521370:90 , srv1553985779:90 , srv174554188:90 , srv1758148242:90 , srv1791387942:90 , srv1837661576:90 , srv1929013181:90 , srv1950853753:90 , srv1964988499:90 , srv1969063662:90 , srv2011965353:90 , srv2047283605:90 , srv2127726431:90 , srv282547643:90 , srv409562532:90 , srv622993113:90 , srv625840496:90 , srv635937854:90 , srv780337760:90 , srv78131324:90 , srv784391168:90 , srv80077768:90 , srv872991387:90 , srv906208918:90 , srv961593161:90 , srv980217961:90 }
2023-03-04 15:58:17,769 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-03-04 15:58:17,769 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv2127726431=16, srv409562532=18, srv1553985779=5, srv1194681327=1, srv906208918=27, srv780337760=22, srv784391168=24, srv622993113=19, srv1929013181=10, srv2011965353=14, srv78131324=23, srv961593161=28, srv130406929=2, srv2047283605=15, srv174554188=6, srv625840496=20, srv80077768=25, srv1969063662=13, srv1758148242=7, srv282547643=17, srv1950853753=11, srv980217961=29, srv872991387=26, srv1403259082=3, srv1445521370=4, srv1791387942=8, srv1837661576=9, srv1061189007=0, srv635937854=21, srv1964988499=12} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-03-04 15:58:17,772 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-03-04 15:58:17,772 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-03-04 15:58:17,772 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-03-04 15:58:17,772 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-03-04 15:58:17,772 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-03-04 15:58:17,772 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-03-04 15:58:17,772 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-03-04 15:58:17,772 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-03-04 15:58:17,772 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-03-04 15:58:17,772 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-03-04 15:58:17,773 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-03-04 15:58:17,773 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-03-04 15:58:17,773 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-03-04 15:58:17,773 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-03-04 15:58:17,773 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-03-04 15:58:17,773 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-03-04 15:58:17,773 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-03-04 15:58:17,773 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-03-04 15:58:17,773 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-03-04 15:58:17,773 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-03-04 15:58:17,773 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-03-04 15:58:17,773 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-03-04 15:58:17,773 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-03-04 15:58:17,773 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-03-04 15:58:17,773 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-03-04 15:58:17,773 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-03-04 15:58:17,773 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-03-04 15:58:17,773 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-03-04 15:58:17,773 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-03-04 15:58:17,773 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-03-04 15:58:17,773 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=10, number of hosts=30, number of racks=4
2023-03-04 15:58:17,785 INFO  [Time-limited test] balancer.StochasticLoadBalancer(381): Cluster wide - skipping load balancing because weighted average imbalance=0.0 <= threshold(0.025). If you want more aggressive balancing, either lower hbase.master.balancer.stochastic.minCostNeedBalance from 0.025 or increase the relative multiplier(s) of the specific cost function(s). functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-03-04 15:58:17,785 INFO  [Time-limited test] balancer.BalancerTestBase(570): Mock Final balance: { srv1061189007:90 , srv1194681327:90 , srv130406929:90 , srv1403259082:90 , srv1445521370:90 , srv1553985779:90 , srv174554188:90 , srv1758148242:90 , srv1791387942:90 , srv1837661576:90 , srv1929013181:90 , srv1950853753:90 , srv1964988499:90 , srv1969063662:90 , srv2011965353:90 , srv2047283605:90 , srv2127726431:90 , srv282547643:90 , srv409562532:90 , srv622993113:90 , srv625840496:90 , srv635937854:90 , srv780337760:90 , srv78131324:90 , srv784391168:90 , srv80077768:90 , srv872991387:90 , srv906208918:90 , srv961593161:90 , srv980217961:90 }
2023-03-04 15:58:17,798 INFO  [Time-limited test] hbase.ResourceChecker(175): after: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnMidClusterWithRacks Thread=9 (was 10), OpenFileDescriptor=260 (was 260), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=250 (was 126) - SystemLoadAverage LEAK? -, ProcessCount=170 (was 173), AvailableMemoryMB=5527 (was 5504) - AvailableMemoryMB LEAK? -