2023-04-02 12:56:38,583 INFO  [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks timeout: 13 mins
2023-04-02 12:56:38,901 WARN  [Time-limited test] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties
2023-04-02 12:56:39,018 INFO  [Time-limited test] metrics.MetricRegistriesLoader(60): Loaded MetricRegistries class org.apache.hadoop.hbase.metrics.impl.MetricRegistriesImpl
2023-04-02 12:56:39,076 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2023-04-02 12:56:39,086 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc.
2023-04-02 12:56:39,101 INFO  [Time-limited test] hbase.ResourceChecker(147): before: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnLargeClusterWithRacks Thread=10, OpenFileDescriptor=260, MaxFileDescriptor=60000, SystemLoadAverage=434, ProcessCount=172, AvailableMemoryMB=4455
2023-04-02 12:56:39,103 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2023-04-02 12:56:39,104 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=5000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=10000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc.
2023-04-02 12:56:39,231 INFO  [Time-limited test] balancer.BalancerTestBase(547): Mock Cluster : { srv1097395853:84 , srv1157785823:84 , srv1192577198:84 , srv1199601597:84 , srv1202631542:84 , srv1261757869:84 , srv1267549759:84 , srv1270171577:84 , srv1302349614:84 , srv1360278794:84 , srv1371635134:84 , srv1421317767:84 , srv142246574:84 , srv1425707509:84 , srv142899833:84 , srv1444679552:84 , srv144794210:84 , srv1519457373:84 , srv1553138085:84 , srv1582281671:84 , srv158311823:84 , srv1588974766:84 , srv161283222:84 , srv1621581482:84 , srv1633202166:84 , srv1636798164:84 , srv1640419188:84 , srv1657805220:84 , srv1663177964:84 , srv1702966470:84 , srv1714109627:84 , srv1720693725:84 , srv1797364532:84 , srv1816204315:84 , srv1822230161:84 , srv1837326081:84 , srv1849344258:84 , srv1862957260:84 , srv1865802096:84 , srv1873358895:84 , srv1927910589:84 , srv1935152059:84 , srv195432139:84 , srv1970999333:84 , srv1971100463:84 , srv1975261813:84 , srv2032418436:84 , srv2048492138:84 , srv2057846745:84 , srv2100043785:84 , srv210808698:84 , srv2109921666:84 , srv2115257561:84 , srv2125641230:84 , srv2136285237:84 , srv21547363:84 , srv248857944:84 , srv276178022:84 , srv299808641:84 , srv352604032:84 , srv356132001:84 , srv367847256:84 , srv4008104:84 , srv406359304:84 , srv443964273:84 , srv446309995:84 , srv450764840:84 , srv48500126:84 , srv553936662:84 , srv556999185:84 , srv592826311:84 , srv595659142:84 , srv609433948:84 , srv625955507:84 , srv664461660:84 , srv672623833:84 , srv689651429:84 , srv719966714:84 , srv763745261:84 , srv818947698:84 , srv819102564:84 , srv835640714:84 , srv849155638:84 , srv868373310:84 , srv870948129:84 , srv880110492:84 , srv887320611:84 , srv895426015:84 , srv911694820:84 , srv912585498:84 , srv937162355:84 , srv944592781:84 , srv951564758:84 , srv961614578:84 , srv9654743:84 , srv987165866:84 , srv987573445:84 , srv989053563:84 , srv995981666:84 , srv215331777:684 } [srvr=100 rgns=9000 avg=90.0 max=90 min=90]
2023-04-02 12:56:39,239 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-04-02 12:56:39,248 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv819102564=81, srv987165866=96, srv1873358895=39, srv356132001=61, srv1553138085=18, srv911694820=89, srv161283222=22, srv1935152059=41, srv352604032=60, srv2032418436=46, srv880110492=86, srv195432139=42, srv987573445=97, srv1862957260=37, srv592826311=71, srv1970999333=43, srv1261757869=5, srv1702966470=29, srv835640714=82, srv625955507=74, srv868373310=84, srv446309995=66, srv142899833=14, srv1837326081=35, srv367847256=62, srv1822230161=34, srv1657805220=27, srv1621581482=23, srv1157785823=1, srv1714109627=30, srv2136285237=54, srv1588974766=21, srv1663177964=28, srv887320611=87, srv1865802096=38, srv1421317767=11, srv1971100463=44, srv556999185=70, srv719966714=78, srv937162355=91, srv248857944=57, srv995981666=99, srv1371635134=10, srv2048492138=47, srv553936662=69, srv1360278794=9, srv664461660=75, srv1519457373=17, srv443964273=65, srv1425707509=13, srv1582281671=19, srv9654743=95, srv1270171577=7, srv1975261813=45, srv276178022=58, srv1267549759=6, srv2109921666=51, srv2115257561=52, srv406359304=64, srv1633202166=24, srv1199601597=3, srv142246574=12, srv1797364532=32, srv215331777=55, srv951564758=93, srv989053563=98, srv944592781=92, srv595659142=72, srv1720693725=31, srv1202631542=4, srv144794210=16, srv4008104=63, srv1636798164=25, srv1640419188=26, srv2057846745=48, srv299808641=59, srv672623833=76, srv1849344258=36, srv21547363=56, srv895426015=88, srv1816204315=33, srv961614578=94, srv849155638=83, srv818947698=80, srv1444679552=15, srv450764840=67, srv2100043785=49, srv912585498=90, srv689651429=77, srv48500126=68, srv609433948=73, srv210808698=50, srv2125641230=53, srv158311823=20, srv870948129=85, srv1927910589=40, srv763745261=79, srv1097395853=0, srv1192577198=2, srv1302349614=8} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-04-02 12:56:39,354 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-04-02 12:56:39,354 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-04-02 12:56:39,354 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-04-02 12:56:39,354 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-04-02 12:56:39,355 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-04-02 12:56:39,355 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-04-02 12:56:39,355 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-04-02 12:56:39,355 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-04-02 12:56:39,355 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-04-02 12:56:39,355 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-04-02 12:56:39,356 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-04-02 12:56:39,356 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-04-02 12:56:39,356 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-04-02 12:56:39,356 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-04-02 12:56:39,356 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-04-02 12:56:39,356 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-04-02 12:56:39,356 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-04-02 12:56:39,357 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-04-02 12:56:39,357 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-04-02 12:56:39,357 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-04-02 12:56:39,357 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-04-02 12:56:39,357 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-04-02 12:56:39,357 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-04-02 12:56:39,357 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-04-02 12:56:39,357 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-04-02 12:56:39,357 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-04-02 12:56:39,357 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-04-02 12:56:39,358 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-04-02 12:56:39,358 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-04-02 12:56:39,358 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-04-02 12:56:39,358 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-04-02 12:56:39,358 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-04-02 12:56:39,358 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-04-02 12:56:39,358 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-04-02 12:56:39,359 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-04-02 12:56:39,359 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-04-02 12:56:39,359 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-04-02 12:56:39,359 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-04-02 12:56:39,359 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-04-02 12:56:39,359 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-04-02 12:56:39,359 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-04-02 12:56:39,359 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-04-02 12:56:39,359 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-04-02 12:56:39,360 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-04-02 12:56:39,360 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-04-02 12:56:39,360 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-04-02 12:56:39,360 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-04-02 12:56:39,360 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-04-02 12:56:39,360 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-04-02 12:56:39,360 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-04-02 12:56:39,361 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-04-02 12:56:39,361 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-04-02 12:56:39,361 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-04-02 12:56:39,361 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-04-02 12:56:39,361 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-04-02 12:56:39,361 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-04-02 12:56:39,361 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-04-02 12:56:39,361 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-04-02 12:56:39,361 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-04-02 12:56:39,362 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-04-02 12:56:39,362 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-04-02 12:56:39,362 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-04-02 12:56:39,362 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-04-02 12:56:39,362 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-04-02 12:56:39,362 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-04-02 12:56:39,362 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-04-02 12:56:39,362 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-04-02 12:56:39,362 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-04-02 12:56:39,362 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-04-02 12:56:39,362 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-04-02 12:56:39,362 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-04-02 12:56:39,363 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-04-02 12:56:39,363 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-04-02 12:56:39,363 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-04-02 12:56:39,363 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-04-02 12:56:39,363 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-04-02 12:56:39,363 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-04-02 12:56:39,363 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-04-02 12:56:39,363 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-04-02 12:56:39,364 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-04-02 12:56:39,364 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-04-02 12:56:39,364 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-04-02 12:56:39,364 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-04-02 12:56:39,364 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-04-02 12:56:39,364 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-04-02 12:56:39,364 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-04-02 12:56:39,364 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-04-02 12:56:39,365 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-04-02 12:56:39,365 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-04-02 12:56:39,365 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-04-02 12:56:39,365 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-04-02 12:56:39,365 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-04-02 12:56:39,365 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-04-02 12:56:39,365 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-04-02 12:56:39,366 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-04-02 12:56:39,366 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-04-02 12:56:39,366 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-04-02 12:56:39,366 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-04-02 12:56:39,366 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-04-02 12:56:39,366 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-04-02 12:56:39,367 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-04-02 12:56:39,665 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.06666666666666667, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-04-02 12:56:39,665 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-04-02 12:56:39,665 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.9909252140407105, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.06666666666666667, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-04-02 12:56:40,414 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 1014 ms to try 5000 different iterations.  Found a solution that moves 4672 regions; Going from a computed imbalance of 0.9909252140407105 to a new imbalance of 0.17876452886629665. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.03984412827412501, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.053354372954386595, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.5191111111111111, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.03984412827412501, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.17383333333333334, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.24216666666666667, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-04-02 12:56:40,447 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1588974766:82 , srv1636798164:82 , srv1849344258:82 , srv719966714:82 , srv1873358895:83 , srv2100043785:83 , srv4008104:83 , srv887320611:83 , srv912585498:83 , srv1192577198:84 , srv1267549759:84 , srv142246574:84 , srv1425707509:84 , srv144794210:84 , srv1663177964:84 , srv1971100463:84 , srv2057846745:84 , srv406359304:84 , srv446309995:84 , srv595659142:84 , srv672623833:84 , srv689651429:84 , srv849155638:84 , srv911694820:84 , srv9654743:84 , srv1097395853:85 , srv1202631542:85 , srv1302349614:85 , srv1371635134:85 , srv142899833:85 , srv161283222:85 , srv1640419188:85 , srv1702966470:85 , srv1862957260:85 , srv1970999333:85 , srv2048492138:85 , srv2136285237:85 , srv556999185:85 , srv592826311:85 , srv895426015:85 , srv951564758:85 , srv1261757869:86 , srv1444679552:86 , srv1553138085:86 , srv158311823:86 , srv1633202166:86 , srv1797364532:86 , srv1816204315:86 , srv1927910589:86 , srv2032418436:86 , srv210808698:86 , srv21547363:86 , srv299808641:86 , srv356132001:86 , srv553936662:86 , srv818947698:86 , srv870948129:86 , srv995981666:86 , srv1157785823:87 , srv1270171577:87 , srv1582281671:87 , srv1657805220:87 , srv276178022:87 , srv352604032:87 , srv450764840:87 , srv48500126:87 , srv609433948:87 , srv625955507:87 , srv944592781:87 , srv987165866:87 , srv989053563:87 , srv1360278794:88 , srv1714109627:88 , srv1822230161:88 , srv1837326081:88 , srv195432139:88 , srv1975261813:88 , srv2115257561:88 , srv2125641230:88 , srv835640714:88 , srv987573445:88 , srv1935152059:89 , srv367847256:89 , srv664461660:89 , srv763745261:89 , srv1865802096:90 , srv248857944:90 , srv443964273:90 , srv819102564:90 , srv868373310:90 , srv880110492:90 , srv1199601597:91 , srv1621581482:91 , srv937162355:91 , srv1720693725:92 , srv2109921666:92 , srv961614578:92 , srv1519457373:94 , srv1421317767:97 , srv215331777:444 }
2023-04-02 12:56:40,454 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-04-02 12:56:40,455 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv819102564=81, srv987165866=96, srv1873358895=39, srv356132001=61, srv1553138085=18, srv911694820=89, srv161283222=22, srv1935152059=41, srv352604032=60, srv2032418436=46, srv880110492=86, srv195432139=42, srv987573445=97, srv1862957260=37, srv592826311=71, srv1970999333=43, srv1261757869=5, srv1702966470=29, srv835640714=82, srv625955507=74, srv868373310=84, srv446309995=66, srv142899833=14, srv1837326081=35, srv367847256=62, srv1822230161=34, srv1657805220=27, srv1621581482=23, srv1157785823=1, srv1714109627=30, srv2136285237=54, srv1588974766=21, srv1663177964=28, srv887320611=87, srv1865802096=38, srv1421317767=11, srv1971100463=44, srv556999185=70, srv719966714=78, srv937162355=91, srv248857944=57, srv995981666=99, srv1371635134=10, srv2048492138=47, srv553936662=69, srv1360278794=9, srv664461660=75, srv1519457373=17, srv443964273=65, srv1425707509=13, srv1582281671=19, srv9654743=95, srv1270171577=7, srv1975261813=45, srv276178022=58, srv1267549759=6, srv2109921666=51, srv2115257561=52, srv406359304=64, srv1633202166=24, srv1199601597=3, srv142246574=12, srv1797364532=32, srv215331777=55, srv951564758=93, srv989053563=98, srv944592781=92, srv595659142=72, srv1720693725=31, srv1202631542=4, srv144794210=16, srv4008104=63, srv1636798164=25, srv1640419188=26, srv2057846745=48, srv299808641=59, srv672623833=76, srv1849344258=36, srv21547363=56, srv895426015=88, srv1816204315=33, srv961614578=94, srv849155638=83, srv818947698=80, srv1444679552=15, srv450764840=67, srv2100043785=49, srv912585498=90, srv689651429=77, srv48500126=68, srv609433948=73, srv210808698=50, srv2125641230=53, srv158311823=20, srv870948129=85, srv1927910589=40, srv763745261=79, srv1097395853=0, srv1192577198=2, srv1302349614=8} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-04-02 12:56:40,480 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-04-02 12:56:40,480 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-04-02 12:56:40,481 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-04-02 12:56:40,481 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-04-02 12:56:40,481 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-04-02 12:56:40,481 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-04-02 12:56:40,481 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-04-02 12:56:40,481 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-04-02 12:56:40,481 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-04-02 12:56:40,481 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-04-02 12:56:40,481 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-04-02 12:56:40,481 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-04-02 12:56:40,481 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-04-02 12:56:40,481 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-04-02 12:56:40,482 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-04-02 12:56:40,482 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-04-02 12:56:40,482 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-04-02 12:56:40,482 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-04-02 12:56:40,482 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-04-02 12:56:40,482 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-04-02 12:56:40,482 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-04-02 12:56:40,482 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-04-02 12:56:40,482 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-04-02 12:56:40,482 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-04-02 12:56:40,482 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-04-02 12:56:40,482 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-04-02 12:56:40,482 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-04-02 12:56:40,483 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-04-02 12:56:40,483 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-04-02 12:56:40,483 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-04-02 12:56:40,483 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-04-02 12:56:40,483 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-04-02 12:56:40,483 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-04-02 12:56:40,483 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-04-02 12:56:40,483 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-04-02 12:56:40,483 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-04-02 12:56:40,483 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-04-02 12:56:40,483 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-04-02 12:56:40,483 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-04-02 12:56:40,483 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-04-02 12:56:40,483 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-04-02 12:56:40,484 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-04-02 12:56:40,484 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-04-02 12:56:40,484 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-04-02 12:56:40,484 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-04-02 12:56:40,484 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-04-02 12:56:40,484 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-04-02 12:56:40,484 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-04-02 12:56:40,484 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-04-02 12:56:40,484 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-04-02 12:56:40,484 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-04-02 12:56:40,484 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-04-02 12:56:40,484 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-04-02 12:56:40,484 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-04-02 12:56:40,484 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-04-02 12:56:40,485 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-04-02 12:56:40,485 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-04-02 12:56:40,485 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-04-02 12:56:40,485 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-04-02 12:56:40,485 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-04-02 12:56:40,485 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-04-02 12:56:40,485 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-04-02 12:56:40,485 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-04-02 12:56:40,485 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-04-02 12:56:40,485 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-04-02 12:56:40,485 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-04-02 12:56:40,485 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-04-02 12:56:40,485 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-04-02 12:56:40,485 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-04-02 12:56:40,486 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-04-02 12:56:40,486 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-04-02 12:56:40,486 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-04-02 12:56:40,486 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-04-02 12:56:40,486 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-04-02 12:56:40,486 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-04-02 12:56:40,486 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-04-02 12:56:40,486 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-04-02 12:56:40,486 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-04-02 12:56:40,486 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-04-02 12:56:40,486 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-04-02 12:56:40,486 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-04-02 12:56:40,486 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-04-02 12:56:40,486 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-04-02 12:56:40,487 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-04-02 12:56:40,487 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-04-02 12:56:40,487 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-04-02 12:56:40,487 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-04-02 12:56:40,487 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-04-02 12:56:40,487 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-04-02 12:56:40,487 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-04-02 12:56:40,487 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-04-02 12:56:40,487 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-04-02 12:56:40,487 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-04-02 12:56:40,487 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-04-02 12:56:40,487 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-04-02 12:56:40,487 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-04-02 12:56:40,487 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-04-02 12:56:40,488 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-04-02 12:56:40,488 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-04-02 12:56:40,488 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-04-02 12:56:40,488 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-04-02 12:56:40,671 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.03984412827412501, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.053354372954386595, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.03984412827412501, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.17383333333333334, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.24216666666666667, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-04-02 12:56:40,671 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-04-02 12:56:40,672 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.1787318148230854, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.03984412827412501, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.053354372954386595, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.03984412827412501, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.17383333333333334, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.24216666666666667, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-04-02 12:56:41,028 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 521 ms to try 5000 different iterations.  Found a solution that moves 2616 regions; Going from a computed imbalance of 0.1787318148230854 to a new imbalance of 0.01361923829029246. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.02150468965752568); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.035155578541411735, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.2906666666666667, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.02150468965752568); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.010666666666666666); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0415, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-04-02 12:56:41,039 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1421317767:76 , srv1519457373:77 , srv1621581482:79 , srv1199601597:80 , srv763745261:80 , srv1720693725:81 , srv819102564:81 , srv880110492:81 , srv2109921666:82 , srv443964273:82 , srv868373310:82 , srv1270171577:83 , srv1714109627:83 , srv1865802096:83 , srv2125641230:83 , srv248857944:83 , srv48500126:83 , srv625955507:83 , srv937162355:83 , srv987165866:83 , srv987573445:83 , srv1657805220:84 , srv1837326081:84 , srv1935152059:84 , srv367847256:84 , srv609433948:84 , srv664461660:84 , srv818947698:84 , srv961614578:84 , srv1157785823:85 , srv1582281671:85 , srv158311823:85 , srv1797364532:85 , srv1822230161:85 , srv1927910589:85 , srv1975261813:85 , srv2032418436:85 , srv2115257561:85 , srv450764840:85 , srv592826311:85 , srv895426015:85 , srv951564758:85 , srv1192577198:86 , srv1261757869:86 , srv1267549759:86 , srv1360278794:86 , srv1371635134:86 , srv142246574:86 , srv1553138085:86 , srv161283222:86 , srv1702966470:86 , srv195432139:86 , srv1970999333:86 , srv2048492138:86 , srv210808698:86 , srv2136285237:86 , srv21547363:86 , srv299808641:86 , srv352604032:86 , srv356132001:86 , srv835640714:86 , srv989053563:86 , srv995981666:86 , srv1097395853:87 , srv1202631542:87 , srv1302349614:87 , srv1663177964:87 , srv1862957260:87 , srv1873358895:87 , srv276178022:87 , srv887320611:87 , srv1425707509:88 , srv142899833:88 , srv144794210:88 , srv1633202166:88 , srv1640419188:88 , srv1971100463:88 , srv406359304:88 , srv446309995:88 , srv553936662:88 , srv689651429:88 , srv849155638:88 , srv870948129:88 , srv9654743:88 , srv1816204315:89 , srv1849344258:89 , srv2057846745:89 , srv2100043785:89 , srv672623833:89 , srv719966714:89 , srv944592781:89 , srv1588974766:90 , srv1636798164:90 , srv4008104:90 , srv556999185:90 , srv595659142:90 , srv911694820:90 , srv912585498:90 , srv1444679552:92 , srv215331777:521 }
2023-04-02 12:56:41,046 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-04-02 12:56:41,047 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv819102564=81, srv987165866=96, srv1873358895=39, srv356132001=61, srv1553138085=18, srv911694820=89, srv161283222=22, srv1935152059=41, srv352604032=60, srv2032418436=46, srv880110492=86, srv195432139=42, srv987573445=97, srv1862957260=37, srv592826311=71, srv1970999333=43, srv1261757869=5, srv1702966470=29, srv835640714=82, srv625955507=74, srv868373310=84, srv446309995=66, srv142899833=14, srv1837326081=35, srv367847256=62, srv1822230161=34, srv1657805220=27, srv1621581482=23, srv1157785823=1, srv1714109627=30, srv2136285237=54, srv1588974766=21, srv1663177964=28, srv887320611=87, srv1865802096=38, srv1421317767=11, srv1971100463=44, srv556999185=70, srv719966714=78, srv937162355=91, srv248857944=57, srv995981666=99, srv1371635134=10, srv2048492138=47, srv553936662=69, srv1360278794=9, srv664461660=75, srv1519457373=17, srv443964273=65, srv1425707509=13, srv1582281671=19, srv9654743=95, srv1270171577=7, srv1975261813=45, srv276178022=58, srv1267549759=6, srv2109921666=51, srv2115257561=52, srv406359304=64, srv1633202166=24, srv1199601597=3, srv142246574=12, srv1797364532=32, srv215331777=55, srv951564758=93, srv989053563=98, srv944592781=92, srv595659142=72, srv1720693725=31, srv1202631542=4, srv144794210=16, srv4008104=63, srv1636798164=25, srv1640419188=26, srv2057846745=48, srv299808641=59, srv672623833=76, srv1849344258=36, srv21547363=56, srv895426015=88, srv1816204315=33, srv961614578=94, srv849155638=83, srv818947698=80, srv1444679552=15, srv450764840=67, srv2100043785=49, srv912585498=90, srv689651429=77, srv48500126=68, srv609433948=73, srv210808698=50, srv2125641230=53, srv158311823=20, srv870948129=85, srv1927910589=40, srv763745261=79, srv1097395853=0, srv1192577198=2, srv1302349614=8} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-04-02 12:56:41,069 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-04-02 12:56:41,070 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-04-02 12:56:41,070 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-04-02 12:56:41,070 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-04-02 12:56:41,070 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-04-02 12:56:41,070 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-04-02 12:56:41,070 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-04-02 12:56:41,070 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-04-02 12:56:41,071 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-04-02 12:56:41,071 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-04-02 12:56:41,071 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-04-02 12:56:41,071 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-04-02 12:56:41,071 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-04-02 12:56:41,071 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-04-02 12:56:41,071 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-04-02 12:56:41,071 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-04-02 12:56:41,071 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-04-02 12:56:41,071 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-04-02 12:56:41,072 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-04-02 12:56:41,072 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-04-02 12:56:41,072 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-04-02 12:56:41,072 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-04-02 12:56:41,072 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-04-02 12:56:41,072 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-04-02 12:56:41,072 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-04-02 12:56:41,072 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-04-02 12:56:41,072 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-04-02 12:56:41,072 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-04-02 12:56:41,073 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-04-02 12:56:41,073 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-04-02 12:56:41,073 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-04-02 12:56:41,073 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-04-02 12:56:41,073 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-04-02 12:56:41,073 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-04-02 12:56:41,073 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-04-02 12:56:41,073 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-04-02 12:56:41,073 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-04-02 12:56:41,073 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-04-02 12:56:41,074 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-04-02 12:56:41,074 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-04-02 12:56:41,074 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-04-02 12:56:41,074 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-04-02 12:56:41,074 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-04-02 12:56:41,074 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-04-02 12:56:41,074 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-04-02 12:56:41,074 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-04-02 12:56:41,074 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-04-02 12:56:41,075 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-04-02 12:56:41,075 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-04-02 12:56:41,075 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-04-02 12:56:41,075 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-04-02 12:56:41,075 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-04-02 12:56:41,075 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-04-02 12:56:41,075 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-04-02 12:56:41,075 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-04-02 12:56:41,075 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-04-02 12:56:41,075 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-04-02 12:56:41,076 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-04-02 12:56:41,076 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-04-02 12:56:41,076 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-04-02 12:56:41,076 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-04-02 12:56:41,076 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-04-02 12:56:41,076 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-04-02 12:56:41,076 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-04-02 12:56:41,076 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-04-02 12:56:41,076 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-04-02 12:56:41,076 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-04-02 12:56:41,076 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-04-02 12:56:41,077 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-04-02 12:56:41,077 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-04-02 12:56:41,077 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-04-02 12:56:41,077 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-04-02 12:56:41,077 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-04-02 12:56:41,077 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-04-02 12:56:41,077 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-04-02 12:56:41,077 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-04-02 12:56:41,077 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-04-02 12:56:41,077 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-04-02 12:56:41,078 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-04-02 12:56:41,078 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-04-02 12:56:41,078 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-04-02 12:56:41,078 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-04-02 12:56:41,078 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-04-02 12:56:41,078 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-04-02 12:56:41,078 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-04-02 12:56:41,078 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-04-02 12:56:41,078 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-04-02 12:56:41,078 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-04-02 12:56:41,079 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-04-02 12:56:41,079 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-04-02 12:56:41,079 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-04-02 12:56:41,079 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-04-02 12:56:41,079 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-04-02 12:56:41,079 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-04-02 12:56:41,079 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-04-02 12:56:41,079 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-04-02 12:56:41,079 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-04-02 12:56:41,079 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-04-02 12:56:41,080 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-04-02 12:56:41,080 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-04-02 12:56:41,080 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-04-02 12:56:41,198 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.02150468965752568); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.035155578541411735, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.02150468965752568); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.010666666666666666); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0415, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-04-02 12:56:41,198 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-04-02 12:56:41,198 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.013600920666782042, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.02150468965752568); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.035155578541411735, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.02150468965752568); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.010666666666666666); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0415, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-04-02 12:56:41,475 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 380 ms to try 5000 different iterations.  Found a solution that moves 952 regions; Going from a computed imbalance of 0.013600920666782042 to a new imbalance of 7.866416577559186E-4. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.006436350813697321); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.009721139910896655); MoveCostFunction : (multiplier=7.0, imbalance=0.10577777777777778, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.006436350813697321); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=3.333333333333333E-4); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0045); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-04-02 12:56:41,477 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1444679552:80 , srv961614578:81 , srv1816204315:83 , srv195432139:83 , srv556999185:83 , srv835640714:83 , srv911694820:83 , srv937162355:83 , srv944592781:83 , srv1261757869:84 , srv1360278794:84 , srv1421317767:84 , srv1633202166:84 , srv1640419188:84 , srv1720693725:84 , srv1975261813:84 , srv248857944:84 , srv276178022:84 , srv367847256:84 , srv4008104:84 , srv553936662:84 , srv595659142:84 , srv664461660:84 , srv870948129:84 , srv912585498:84 , srv1097395853:85 , srv1302349614:85 , srv142899833:85 , srv144794210:85 , srv1582281671:85 , srv1636798164:85 , srv1822230161:85 , srv1837326081:85 , srv1865802096:85 , srv1935152059:85 , srv1971100463:85 , srv2048492138:85 , srv2057846745:85 , srv2100043785:85 , srv210808698:85 , srv2109921666:85 , srv2115257561:85 , srv299808641:85 , srv352604032:85 , srv406359304:85 , srv446309995:85 , srv450764840:85 , srv672623833:85 , srv689651429:85 , srv849155638:85 , srv868373310:85 , srv9654743:85 , srv989053563:85 , srv995981666:85 , srv1157785823:86 , srv1199601597:86 , srv1202631542:86 , srv1371635134:86 , srv1553138085:86 , srv158311823:86 , srv161283222:86 , srv1657805220:86 , srv1702966470:86 , srv1714109627:86 , srv1862957260:86 , srv1970999333:86 , srv2032418436:86 , srv2125641230:86 , srv2136285237:86 , srv21547363:86 , srv356132001:86 , srv443964273:86 , srv609433948:86 , srv719966714:86 , srv819102564:86 , srv987573445:86 , srv1192577198:87 , srv1267549759:87 , srv1270171577:87 , srv142246574:87 , srv1425707509:87 , srv1519457373:87 , srv1588974766:87 , srv1621581482:87 , srv1663177964:87 , srv1849344258:87 , srv1873358895:87 , srv1927910589:87 , srv48500126:87 , srv592826311:87 , srv625955507:87 , srv880110492:87 , srv951564758:87 , srv987165866:87 , srv1797364532:88 , srv763745261:88 , srv818947698:88 , srv887320611:88 , srv895426015:89 , srv215331777:550 }
2023-04-02 12:56:41,481 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-04-02 12:56:41,482 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv819102564=81, srv987165866=96, srv1873358895=39, srv356132001=61, srv1553138085=18, srv911694820=89, srv161283222=22, srv1935152059=41, srv352604032=60, srv2032418436=46, srv880110492=86, srv195432139=42, srv987573445=97, srv1862957260=37, srv592826311=71, srv1970999333=43, srv1261757869=5, srv1702966470=29, srv835640714=82, srv625955507=74, srv868373310=84, srv446309995=66, srv142899833=14, srv1837326081=35, srv367847256=62, srv1822230161=34, srv1657805220=27, srv1621581482=23, srv1157785823=1, srv1714109627=30, srv2136285237=54, srv1588974766=21, srv1663177964=28, srv887320611=87, srv1865802096=38, srv1421317767=11, srv1971100463=44, srv556999185=70, srv719966714=78, srv937162355=91, srv248857944=57, srv995981666=99, srv1371635134=10, srv2048492138=47, srv553936662=69, srv1360278794=9, srv664461660=75, srv1519457373=17, srv443964273=65, srv1425707509=13, srv1582281671=19, srv9654743=95, srv1270171577=7, srv1975261813=45, srv276178022=58, srv1267549759=6, srv2109921666=51, srv2115257561=52, srv406359304=64, srv1633202166=24, srv1199601597=3, srv142246574=12, srv1797364532=32, srv215331777=55, srv951564758=93, srv989053563=98, srv944592781=92, srv595659142=72, srv1720693725=31, srv1202631542=4, srv144794210=16, srv4008104=63, srv1636798164=25, srv1640419188=26, srv2057846745=48, srv299808641=59, srv672623833=76, srv1849344258=36, srv21547363=56, srv895426015=88, srv1816204315=33, srv961614578=94, srv849155638=83, srv818947698=80, srv1444679552=15, srv450764840=67, srv2100043785=49, srv912585498=90, srv689651429=77, srv48500126=68, srv609433948=73, srv210808698=50, srv2125641230=53, srv158311823=20, srv870948129=85, srv1927910589=40, srv763745261=79, srv1097395853=0, srv1192577198=2, srv1302349614=8} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-04-02 12:56:41,498 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-04-02 12:56:41,499 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-04-02 12:56:41,499 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-04-02 12:56:41,499 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-04-02 12:56:41,499 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-04-02 12:56:41,499 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-04-02 12:56:41,499 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-04-02 12:56:41,499 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-04-02 12:56:41,499 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-04-02 12:56:41,499 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-04-02 12:56:41,499 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-04-02 12:56:41,499 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-04-02 12:56:41,499 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-04-02 12:56:41,499 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-04-02 12:56:41,499 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-04-02 12:56:41,500 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-04-02 12:56:41,500 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-04-02 12:56:41,500 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-04-02 12:56:41,500 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-04-02 12:56:41,500 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-04-02 12:56:41,500 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-04-02 12:56:41,500 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-04-02 12:56:41,500 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-04-02 12:56:41,500 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-04-02 12:56:41,500 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-04-02 12:56:41,500 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-04-02 12:56:41,500 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-04-02 12:56:41,500 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-04-02 12:56:41,500 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-04-02 12:56:41,500 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-04-02 12:56:41,500 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-04-02 12:56:41,501 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-04-02 12:56:41,501 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-04-02 12:56:41,501 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-04-02 12:56:41,501 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-04-02 12:56:41,501 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-04-02 12:56:41,501 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-04-02 12:56:41,501 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-04-02 12:56:41,501 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-04-02 12:56:41,501 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-04-02 12:56:41,501 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-04-02 12:56:41,501 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-04-02 12:56:41,501 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-04-02 12:56:41,501 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-04-02 12:56:41,501 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-04-02 12:56:41,501 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-04-02 12:56:41,501 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-04-02 12:56:41,502 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-04-02 12:56:41,502 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-04-02 12:56:41,502 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-04-02 12:56:41,502 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-04-02 12:56:41,502 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-04-02 12:56:41,502 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-04-02 12:56:41,502 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-04-02 12:56:41,502 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-04-02 12:56:41,502 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-04-02 12:56:41,502 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-04-02 12:56:41,502 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-04-02 12:56:41,502 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-04-02 12:56:41,502 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-04-02 12:56:41,502 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-04-02 12:56:41,502 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-04-02 12:56:41,502 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-04-02 12:56:41,502 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-04-02 12:56:41,503 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-04-02 12:56:41,503 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-04-02 12:56:41,503 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-04-02 12:56:41,503 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-04-02 12:56:41,503 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-04-02 12:56:41,503 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-04-02 12:56:41,503 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-04-02 12:56:41,503 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-04-02 12:56:41,503 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-04-02 12:56:41,503 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-04-02 12:56:41,503 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-04-02 12:56:41,503 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-04-02 12:56:41,503 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-04-02 12:56:41,503 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-04-02 12:56:41,503 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-04-02 12:56:41,503 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-04-02 12:56:41,504 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-04-02 12:56:41,504 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-04-02 12:56:41,504 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-04-02 12:56:41,504 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-04-02 12:56:41,504 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-04-02 12:56:41,504 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-04-02 12:56:41,504 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-04-02 12:56:41,504 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-04-02 12:56:41,504 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-04-02 12:56:41,504 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-04-02 12:56:41,504 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-04-02 12:56:41,504 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-04-02 12:56:41,504 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-04-02 12:56:41,504 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-04-02 12:56:41,504 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-04-02 12:56:41,504 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-04-02 12:56:41,504 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-04-02 12:56:41,505 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-04-02 12:56:41,505 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-04-02 12:56:41,505 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-04-02 12:56:41,505 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-04-02 12:56:41,616 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.006436350813697321); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.009721139910896655); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.006436350813697321); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=3.333333333333333E-4); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0045); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-04-02 12:56:41,616 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-04-02 12:56:41,616 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=7.799756112796504E-4, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.006436350813697321); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.009721139910896655); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.006436350813697321); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=3.333333333333333E-4); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0045); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-04-02 12:56:41,866 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 349 ms to try 5000 different iterations.  Found a solution that moves 260 regions; Going from a computed imbalance of 7.799756112796504E-4 to a new imbalance of 4.868726246644771E-5. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=4.737793696791342E-4); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0015713484026367722); MoveCostFunction : (multiplier=7.0, imbalance=0.028888888888888888, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=4.737793696791342E-4); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=4.166666666666667E-4); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-04-02 12:56:41,867 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1425707509:83 , srv1588974766:83 , srv1797364532:83 , srv2109921666:83 , srv595659142:83 , srv895426015:83 , srv944592781:83 , srv1157785823:84 , srv1202631542:84 , srv1302349614:84 , srv142899833:84 , srv1444679552:84 , srv1519457373:84 , srv1553138085:84 , srv1633202166:84 , srv1663177964:84 , srv1816204315:84 , srv1822230161:84 , srv1849344258:84 , srv1865802096:84 , srv1927910589:84 , srv1935152059:84 , srv1970999333:84 , srv2057846745:84 , srv2115257561:84 , srv2136285237:84 , srv21547363:84 , srv276178022:84 , srv299808641:84 , srv352604032:84 , srv356132001:84 , srv443964273:84 , srv553936662:84 , srv556999185:84 , srv664461660:84 , srv672623833:84 , srv763745261:84 , srv818947698:84 , srv849155638:84 , srv870948129:84 , srv880110492:84 , srv887320611:84 , srv937162355:84 , srv1192577198:85 , srv1199601597:85 , srv1267549759:85 , srv1270171577:85 , srv1360278794:85 , srv1371635134:85 , srv1421317767:85 , srv142246574:85 , srv144794210:85 , srv1582281671:85 , srv158311823:85 , srv161283222:85 , srv1621581482:85 , srv1636798164:85 , srv1640419188:85 , srv1657805220:85 , srv1702966470:85 , srv1714109627:85 , srv1720693725:85 , srv1837326081:85 , srv1862957260:85 , srv1873358895:85 , srv1975261813:85 , srv2032418436:85 , srv2100043785:85 , srv210808698:85 , srv2125641230:85 , srv248857944:85 , srv4008104:85 , srv406359304:85 , srv446309995:85 , srv450764840:85 , srv48500126:85 , srv592826311:85 , srv609433948:85 , srv625955507:85 , srv719966714:85 , srv819102564:85 , srv835640714:85 , srv911694820:85 , srv912585498:85 , srv951564758:85 , srv961614578:85 , srv9654743:85 , srv987165866:85 , srv987573445:85 , srv989053563:85 , srv995981666:85 , srv1097395853:86 , srv1261757869:86 , srv195432139:86 , srv1971100463:86 , srv2048492138:86 , srv367847256:86 , srv689651429:86 , srv868373310:86 , srv215331777:627 }
2023-04-02 12:56:41,871 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-04-02 12:56:41,871 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv819102564=81, srv987165866=96, srv1873358895=39, srv356132001=61, srv1553138085=18, srv911694820=89, srv161283222=22, srv1935152059=41, srv352604032=60, srv2032418436=46, srv880110492=86, srv195432139=42, srv987573445=97, srv1862957260=37, srv592826311=71, srv1970999333=43, srv1261757869=5, srv1702966470=29, srv835640714=82, srv625955507=74, srv868373310=84, srv446309995=66, srv142899833=14, srv1837326081=35, srv367847256=62, srv1822230161=34, srv1657805220=27, srv1621581482=23, srv1157785823=1, srv1714109627=30, srv2136285237=54, srv1588974766=21, srv1663177964=28, srv887320611=87, srv1865802096=38, srv1421317767=11, srv1971100463=44, srv556999185=70, srv719966714=78, srv937162355=91, srv248857944=57, srv995981666=99, srv1371635134=10, srv2048492138=47, srv553936662=69, srv1360278794=9, srv664461660=75, srv1519457373=17, srv443964273=65, srv1425707509=13, srv1582281671=19, srv9654743=95, srv1270171577=7, srv1975261813=45, srv276178022=58, srv1267549759=6, srv2109921666=51, srv2115257561=52, srv406359304=64, srv1633202166=24, srv1199601597=3, srv142246574=12, srv1797364532=32, srv215331777=55, srv951564758=93, srv989053563=98, srv944592781=92, srv595659142=72, srv1720693725=31, srv1202631542=4, srv144794210=16, srv4008104=63, srv1636798164=25, srv1640419188=26, srv2057846745=48, srv299808641=59, srv672623833=76, srv1849344258=36, srv21547363=56, srv895426015=88, srv1816204315=33, srv961614578=94, srv849155638=83, srv818947698=80, srv1444679552=15, srv450764840=67, srv2100043785=49, srv912585498=90, srv689651429=77, srv48500126=68, srv609433948=73, srv210808698=50, srv2125641230=53, srv158311823=20, srv870948129=85, srv1927910589=40, srv763745261=79, srv1097395853=0, srv1192577198=2, srv1302349614=8} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-04-02 12:56:41,882 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-04-02 12:56:41,882 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-04-02 12:56:41,882 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-04-02 12:56:41,882 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-04-02 12:56:41,882 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-04-02 12:56:41,882 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-04-02 12:56:41,882 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-04-02 12:56:41,882 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-04-02 12:56:41,883 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-04-02 12:56:41,883 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-04-02 12:56:41,883 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-04-02 12:56:41,883 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-04-02 12:56:41,883 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-04-02 12:56:41,883 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-04-02 12:56:41,883 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-04-02 12:56:41,883 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-04-02 12:56:41,883 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-04-02 12:56:41,883 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-04-02 12:56:41,883 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-04-02 12:56:41,884 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-04-02 12:56:41,884 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-04-02 12:56:41,884 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-04-02 12:56:41,884 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-04-02 12:56:41,884 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-04-02 12:56:41,884 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-04-02 12:56:41,884 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-04-02 12:56:41,884 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-04-02 12:56:41,884 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-04-02 12:56:41,884 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-04-02 12:56:41,884 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-04-02 12:56:41,884 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-04-02 12:56:41,884 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-04-02 12:56:41,884 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-04-02 12:56:41,884 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-04-02 12:56:41,885 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-04-02 12:56:41,885 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-04-02 12:56:41,885 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-04-02 12:56:41,885 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-04-02 12:56:41,885 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-04-02 12:56:41,885 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-04-02 12:56:41,885 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-04-02 12:56:41,885 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-04-02 12:56:41,885 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-04-02 12:56:41,885 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-04-02 12:56:41,885 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-04-02 12:56:41,885 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-04-02 12:56:41,885 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-04-02 12:56:41,885 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-04-02 12:56:41,885 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-04-02 12:56:41,885 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-04-02 12:56:41,885 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-04-02 12:56:41,885 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-04-02 12:56:41,885 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-04-02 12:56:41,885 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-04-02 12:56:41,886 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-04-02 12:56:41,886 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-04-02 12:56:41,886 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-04-02 12:56:41,886 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-04-02 12:56:41,886 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-04-02 12:56:41,886 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-04-02 12:56:41,886 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-04-02 12:56:41,886 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-04-02 12:56:41,886 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-04-02 12:56:41,886 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-04-02 12:56:41,886 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-04-02 12:56:41,886 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-04-02 12:56:41,886 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-04-02 12:56:41,886 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-04-02 12:56:41,886 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-04-02 12:56:41,887 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-04-02 12:56:41,887 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-04-02 12:56:41,887 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-04-02 12:56:41,887 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-04-02 12:56:41,887 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-04-02 12:56:41,887 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-04-02 12:56:41,887 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-04-02 12:56:41,887 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-04-02 12:56:41,888 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-04-02 12:56:41,888 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-04-02 12:56:41,888 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-04-02 12:56:41,888 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-04-02 12:56:41,888 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-04-02 12:56:41,888 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-04-02 12:56:41,888 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-04-02 12:56:41,888 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-04-02 12:56:41,888 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-04-02 12:56:41,888 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-04-02 12:56:41,888 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-04-02 12:56:41,889 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-04-02 12:56:41,889 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-04-02 12:56:41,889 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-04-02 12:56:41,889 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-04-02 12:56:41,889 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-04-02 12:56:41,889 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-04-02 12:56:41,889 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-04-02 12:56:41,889 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-04-02 12:56:41,889 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-04-02 12:56:41,889 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-04-02 12:56:41,889 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-04-02 12:56:41,890 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-04-02 12:56:41,890 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-04-02 12:56:42,001 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=4.737793696791342E-4); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0015713484026367722); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=4.737793696791342E-4); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=4.166666666666667E-4); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-04-02 12:56:42,001 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-04-02 12:56:42,002 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=4.6866703554861846E-5, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=4.737793696791342E-4); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0015713484026367722); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=4.737793696791342E-4); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=4.166666666666667E-4); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-04-02 12:56:42,207 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 308 ms to try 5000 different iterations.  Found a solution that moves 19 regions; Going from a computed imbalance of 4.6866703554861846E-5 to a new imbalance of 7.206280139868414E-6. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0015713484026367722); MoveCostFunction : (multiplier=7.0, imbalance=0.002111111111111111); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-04-02 12:56:42,207 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1097395853:83 , srv1360278794:83 , srv1862957260:83 , srv195432139:83 , srv1971100463:83 , srv367847256:83 , srv689651429:83 , srv868373310:83 , srv989053563:83 , srv1157785823:84 , srv1192577198:84 , srv1199601597:84 , srv1202631542:84 , srv1261757869:84 , srv1267549759:84 , srv1270171577:84 , srv1371635134:84 , srv1421317767:84 , srv142246574:84 , srv1425707509:84 , srv142899833:84 , srv1444679552:84 , srv144794210:84 , srv1519457373:84 , srv1553138085:84 , srv1582281671:84 , srv158311823:84 , srv1588974766:84 , srv161283222:84 , srv1621581482:84 , srv1633202166:84 , srv1636798164:84 , srv1640419188:84 , srv1657805220:84 , srv1663177964:84 , srv1702966470:84 , srv1714109627:84 , srv1720693725:84 , srv1797364532:84 , srv1816204315:84 , srv1822230161:84 , srv1837326081:84 , srv1849344258:84 , srv1865802096:84 , srv1873358895:84 , srv1927910589:84 , srv1935152059:84 , srv1975261813:84 , srv2032418436:84 , srv2048492138:84 , srv2057846745:84 , srv2100043785:84 , srv210808698:84 , srv2109921666:84 , srv2115257561:84 , srv2125641230:84 , srv21547363:84 , srv248857944:84 , srv276178022:84 , srv352604032:84 , srv356132001:84 , srv4008104:84 , srv406359304:84 , srv443964273:84 , srv446309995:84 , srv450764840:84 , srv48500126:84 , srv553936662:84 , srv556999185:84 , srv592826311:84 , srv609433948:84 , srv625955507:84 , srv672623833:84 , srv719966714:84 , srv818947698:84 , srv819102564:84 , srv835640714:84 , srv870948129:84 , srv880110492:84 , srv887320611:84 , srv895426015:84 , srv911694820:84 , srv912585498:84 , srv944592781:84 , srv951564758:84 , srv961614578:84 , srv9654743:84 , srv987165866:84 , srv987573445:84 , srv995981666:84 , srv1302349614:85 , srv1970999333:85 , srv2136285237:85 , srv299808641:85 , srv595659142:85 , srv664461660:85 , srv763745261:85 , srv849155638:85 , srv937162355:85 , srv215331777:684 }
2023-04-02 12:56:42,210 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-04-02 12:56:42,211 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv819102564=81, srv987165866=96, srv1873358895=39, srv356132001=61, srv1553138085=18, srv911694820=89, srv161283222=22, srv1935152059=41, srv352604032=60, srv2032418436=46, srv880110492=86, srv195432139=42, srv987573445=97, srv1862957260=37, srv592826311=71, srv1970999333=43, srv1261757869=5, srv1702966470=29, srv835640714=82, srv625955507=74, srv868373310=84, srv446309995=66, srv142899833=14, srv1837326081=35, srv367847256=62, srv1822230161=34, srv1657805220=27, srv1621581482=23, srv1157785823=1, srv1714109627=30, srv2136285237=54, srv1588974766=21, srv1663177964=28, srv887320611=87, srv1865802096=38, srv1421317767=11, srv1971100463=44, srv556999185=70, srv719966714=78, srv937162355=91, srv248857944=57, srv995981666=99, srv1371635134=10, srv2048492138=47, srv553936662=69, srv1360278794=9, srv664461660=75, srv1519457373=17, srv443964273=65, srv1425707509=13, srv1582281671=19, srv9654743=95, srv1270171577=7, srv1975261813=45, srv276178022=58, srv1267549759=6, srv2109921666=51, srv2115257561=52, srv406359304=64, srv1633202166=24, srv1199601597=3, srv142246574=12, srv1797364532=32, srv215331777=55, srv951564758=93, srv989053563=98, srv944592781=92, srv595659142=72, srv1720693725=31, srv1202631542=4, srv144794210=16, srv4008104=63, srv1636798164=25, srv1640419188=26, srv2057846745=48, srv299808641=59, srv672623833=76, srv1849344258=36, srv21547363=56, srv895426015=88, srv1816204315=33, srv961614578=94, srv849155638=83, srv818947698=80, srv1444679552=15, srv450764840=67, srv2100043785=49, srv912585498=90, srv689651429=77, srv48500126=68, srv609433948=73, srv210808698=50, srv2125641230=53, srv158311823=20, srv870948129=85, srv1927910589=40, srv763745261=79, srv1097395853=0, srv1192577198=2, srv1302349614=8} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-04-02 12:56:42,222 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-04-02 12:56:42,222 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-04-02 12:56:42,222 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-04-02 12:56:42,222 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-04-02 12:56:42,222 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-04-02 12:56:42,222 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-04-02 12:56:42,222 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-04-02 12:56:42,222 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-04-02 12:56:42,222 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-04-02 12:56:42,222 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-04-02 12:56:42,222 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-04-02 12:56:42,222 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-04-02 12:56:42,222 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-04-02 12:56:42,222 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-04-02 12:56:42,222 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-04-02 12:56:42,222 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-04-02 12:56:42,223 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-04-02 12:56:42,223 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-04-02 12:56:42,223 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-04-02 12:56:42,223 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-04-02 12:56:42,223 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-04-02 12:56:42,223 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-04-02 12:56:42,223 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-04-02 12:56:42,223 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-04-02 12:56:42,223 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-04-02 12:56:42,223 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-04-02 12:56:42,223 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-04-02 12:56:42,223 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-04-02 12:56:42,223 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-04-02 12:56:42,224 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-04-02 12:56:42,224 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-04-02 12:56:42,224 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-04-02 12:56:42,224 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-04-02 12:56:42,224 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-04-02 12:56:42,224 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-04-02 12:56:42,224 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-04-02 12:56:42,224 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-04-02 12:56:42,224 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-04-02 12:56:42,224 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-04-02 12:56:42,224 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-04-02 12:56:42,225 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-04-02 12:56:42,225 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-04-02 12:56:42,225 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-04-02 12:56:42,225 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-04-02 12:56:42,225 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-04-02 12:56:42,225 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-04-02 12:56:42,225 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-04-02 12:56:42,225 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-04-02 12:56:42,225 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-04-02 12:56:42,225 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-04-02 12:56:42,225 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-04-02 12:56:42,225 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-04-02 12:56:42,225 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-04-02 12:56:42,225 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-04-02 12:56:42,225 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-04-02 12:56:42,225 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-04-02 12:56:42,225 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-04-02 12:56:42,225 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-04-02 12:56:42,225 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-04-02 12:56:42,225 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-04-02 12:56:42,225 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-04-02 12:56:42,226 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-04-02 12:56:42,226 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-04-02 12:56:42,226 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-04-02 12:56:42,226 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-04-02 12:56:42,226 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-04-02 12:56:42,226 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-04-02 12:56:42,226 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-04-02 12:56:42,226 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-04-02 12:56:42,226 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-04-02 12:56:42,226 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-04-02 12:56:42,226 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-04-02 12:56:42,226 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-04-02 12:56:42,226 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-04-02 12:56:42,226 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-04-02 12:56:42,226 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-04-02 12:56:42,226 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-04-02 12:56:42,226 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-04-02 12:56:42,226 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-04-02 12:56:42,226 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-04-02 12:56:42,226 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-04-02 12:56:42,226 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-04-02 12:56:42,226 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-04-02 12:56:42,227 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-04-02 12:56:42,227 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-04-02 12:56:42,227 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-04-02 12:56:42,227 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-04-02 12:56:42,227 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-04-02 12:56:42,227 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-04-02 12:56:42,227 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-04-02 12:56:42,227 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-04-02 12:56:42,227 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-04-02 12:56:42,227 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-04-02 12:56:42,227 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-04-02 12:56:42,227 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-04-02 12:56:42,227 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-04-02 12:56:42,228 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-04-02 12:56:42,228 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-04-02 12:56:42,228 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-04-02 12:56:42,228 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-04-02 12:56:42,228 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-04-02 12:56:42,337 INFO  [Time-limited test] balancer.StochasticLoadBalancer(381): Cluster wide - skipping load balancing because weighted average imbalance=7.073239296329447E-6 <= threshold(0.025). If you want more aggressive balancing, either lower hbase.master.balancer.stochastic.minCostNeedBalance from 0.025 or increase the relative multiplier(s) of the specific cost function(s). functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0015713484026367722); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-04-02 12:56:42,337 INFO  [Time-limited test] balancer.BalancerTestBase(570): Mock Final balance: { srv1097395853:83 , srv1360278794:83 , srv1862957260:83 , srv195432139:83 , srv1971100463:83 , srv367847256:83 , srv689651429:83 , srv868373310:83 , srv989053563:83 , srv1157785823:84 , srv1192577198:84 , srv1199601597:84 , srv1202631542:84 , srv1261757869:84 , srv1267549759:84 , srv1270171577:84 , srv1371635134:84 , srv1421317767:84 , srv142246574:84 , srv1425707509:84 , srv142899833:84 , srv1444679552:84 , srv144794210:84 , srv1519457373:84 , srv1553138085:84 , srv1582281671:84 , srv158311823:84 , srv1588974766:84 , srv161283222:84 , srv1621581482:84 , srv1633202166:84 , srv1636798164:84 , srv1640419188:84 , srv1657805220:84 , srv1663177964:84 , srv1702966470:84 , srv1714109627:84 , srv1720693725:84 , srv1797364532:84 , srv1816204315:84 , srv1822230161:84 , srv1837326081:84 , srv1849344258:84 , srv1865802096:84 , srv1873358895:84 , srv1927910589:84 , srv1935152059:84 , srv1975261813:84 , srv2032418436:84 , srv2048492138:84 , srv2057846745:84 , srv2100043785:84 , srv210808698:84 , srv2109921666:84 , srv2115257561:84 , srv2125641230:84 , srv21547363:84 , srv248857944:84 , srv276178022:84 , srv352604032:84 , srv356132001:84 , srv4008104:84 , srv406359304:84 , srv443964273:84 , srv446309995:84 , srv450764840:84 , srv48500126:84 , srv553936662:84 , srv556999185:84 , srv592826311:84 , srv609433948:84 , srv625955507:84 , srv672623833:84 , srv719966714:84 , srv818947698:84 , srv819102564:84 , srv835640714:84 , srv870948129:84 , srv880110492:84 , srv887320611:84 , srv895426015:84 , srv911694820:84 , srv912585498:84 , srv944592781:84 , srv951564758:84 , srv961614578:84 , srv9654743:84 , srv987165866:84 , srv987573445:84 , srv995981666:84 , srv1302349614:85 , srv1970999333:85 , srv2136285237:85 , srv299808641:85 , srv595659142:85 , srv664461660:85 , srv763745261:85 , srv849155638:85 , srv937162355:85 , srv215331777:684 }
2023-04-02 12:56:42,363 INFO  [Time-limited test] hbase.ResourceChecker(175): after: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnLargeClusterWithRacks Thread=10 (was 10), OpenFileDescriptor=260 (was 260), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=457 (was 434) - SystemLoadAverage LEAK? -, ProcessCount=172 (was 172), AvailableMemoryMB=3950 (was 4455)
2023-04-02 12:56:42,371 INFO  [Time-limited test] hbase.ResourceChecker(147): before: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnMidClusterWithRacks Thread=10, OpenFileDescriptor=260, MaxFileDescriptor=60000, SystemLoadAverage=457, ProcessCount=172, AvailableMemoryMB=3949
2023-04-02 12:56:42,372 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2023-04-02 12:56:42,372 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=5000, runMaxSteps=true, stepsPerRegion=800, maxRunningTime=120000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 111077.0 etc.
2023-04-02 12:56:42,383 INFO  [Time-limited test] balancer.BalancerTestBase(547): Mock Cluster : { srv1010158778:84 , srv1085278367:84 , srv1124912913:84 , srv1265242387:84 , srv1267275364:84 , srv1284613458:84 , srv1285013408:84 , srv1443942518:84 , srv1450805959:84 , srv1516402252:84 , srv179685148:84 , srv1814707144:84 , srv1862339323:84 , srv1961333904:84 , srv2081944524:84 , srv241301098:84 , srv479190252:84 , srv497021788:84 , srv546324812:84 , srv567547838:84 , srv577539204:84 , srv585444901:84 , srv615922657:84 , srv638145249:84 , srv725704280:84 , srv820518712:84 , srv848253264:84 , srv856402406:84 , srv984725601:84 , srv2121727776:264 } [srvr=30 rgns=2700 avg=90.0 max=90 min=90]
2023-04-02 12:56:42,384 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-04-02 12:56:42,384 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv820518712=26, srv567547838=20, srv1862339323=12, srv1961333904=13, srv1124912913=2, srv1267275364=4, srv615922657=23, srv179685148=10, srv1285013408=6, srv1010158778=0, srv1284613458=5, srv2081944524=14, srv1450805959=8, srv856402406=28, srv2121727776=15, srv497021788=18, srv725704280=25, srv241301098=16, srv577539204=21, srv848253264=27, srv1516402252=9, srv479190252=17, srv585444901=22, srv1265242387=3, srv1814707144=11, srv984725601=29, srv1085278367=1, srv546324812=19, srv638145249=24, srv1443942518=7} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-04-02 12:56:42,393 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-04-02 12:56:42,393 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-04-02 12:56:42,393 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-04-02 12:56:42,393 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-04-02 12:56:42,393 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-04-02 12:56:42,393 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-04-02 12:56:42,393 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-04-02 12:56:42,393 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-04-02 12:56:42,393 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-04-02 12:56:42,393 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-04-02 12:56:42,393 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-04-02 12:56:42,394 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-04-02 12:56:42,394 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-04-02 12:56:42,394 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-04-02 12:56:42,394 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-04-02 12:56:42,394 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-04-02 12:56:42,394 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-04-02 12:56:42,394 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-04-02 12:56:42,394 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-04-02 12:56:42,394 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-04-02 12:56:42,394 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-04-02 12:56:42,394 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-04-02 12:56:42,394 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-04-02 12:56:42,394 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-04-02 12:56:42,394 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-04-02 12:56:42,394 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-04-02 12:56:42,394 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-04-02 12:56:42,394 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-04-02 12:56:42,394 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-04-02 12:56:42,394 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-04-02 12:56:42,394 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=10, number of hosts=30, number of racks=4
2023-04-02 12:56:42,410 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=1.0999515784773708, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-04-02 12:56:42,410 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.9912507987424343, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=1.0999515784773708, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=64800000
2023-04-02 12:58:42,397 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 120001 ms to try 6604787 different iterations.  Found a solution that moves 1859 regions; Going from a computed imbalance of 0.9912507987424343 to a new imbalance of 4.338998739279625E-5. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); MoveCostFunction : (multiplier=7.0, imbalance=0.6885185185185185, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-04-02 12:58:42,404 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1010158778:90 , srv1085278367:90 , srv1124912913:90 , srv1265242387:90 , srv1267275364:90 , srv1284613458:90 , srv1285013408:90 , srv1443942518:90 , srv1450805959:90 , srv1516402252:90 , srv179685148:90 , srv1814707144:90 , srv1862339323:90 , srv1961333904:90 , srv2081944524:90 , srv2121727776:90 , srv241301098:90 , srv479190252:90 , srv497021788:90 , srv546324812:90 , srv567547838:90 , srv577539204:90 , srv585444901:90 , srv615922657:90 , srv638145249:90 , srv725704280:90 , srv820518712:90 , srv848253264:90 , srv856402406:90 , srv984725601:90 }
2023-04-02 12:58:42,406 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-04-02 12:58:42,406 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv820518712=26, srv567547838=20, srv1862339323=12, srv1961333904=13, srv1124912913=2, srv1267275364=4, srv615922657=23, srv179685148=10, srv1285013408=6, srv1010158778=0, srv1284613458=5, srv2081944524=14, srv1450805959=8, srv856402406=28, srv2121727776=15, srv497021788=18, srv725704280=25, srv241301098=16, srv577539204=21, srv848253264=27, srv1516402252=9, srv479190252=17, srv585444901=22, srv1265242387=3, srv1814707144=11, srv984725601=29, srv1085278367=1, srv546324812=19, srv638145249=24, srv1443942518=7} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-04-02 12:58:42,410 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-04-02 12:58:42,410 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-04-02 12:58:42,410 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-04-02 12:58:42,410 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-04-02 12:58:42,410 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-04-02 12:58:42,410 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-04-02 12:58:42,410 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-04-02 12:58:42,411 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-04-02 12:58:42,411 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-04-02 12:58:42,411 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-04-02 12:58:42,411 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-04-02 12:58:42,411 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-04-02 12:58:42,411 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-04-02 12:58:42,411 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-04-02 12:58:42,411 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-04-02 12:58:42,411 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-04-02 12:58:42,411 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-04-02 12:58:42,411 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-04-02 12:58:42,411 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-04-02 12:58:42,411 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-04-02 12:58:42,411 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-04-02 12:58:42,411 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-04-02 12:58:42,411 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-04-02 12:58:42,411 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-04-02 12:58:42,411 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-04-02 12:58:42,411 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-04-02 12:58:42,411 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-04-02 12:58:42,411 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-04-02 12:58:42,411 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-04-02 12:58:42,411 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-04-02 12:58:42,411 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=10, number of hosts=30, number of racks=4
2023-04-02 12:58:42,423 INFO  [Time-limited test] balancer.StochasticLoadBalancer(381): Cluster wide - skipping load balancing because weighted average imbalance=0.0 <= threshold(0.025). If you want more aggressive balancing, either lower hbase.master.balancer.stochastic.minCostNeedBalance from 0.025 or increase the relative multiplier(s) of the specific cost function(s). functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-04-02 12:58:42,424 INFO  [Time-limited test] balancer.BalancerTestBase(570): Mock Final balance: { srv1010158778:90 , srv1085278367:90 , srv1124912913:90 , srv1265242387:90 , srv1267275364:90 , srv1284613458:90 , srv1285013408:90 , srv1443942518:90 , srv1450805959:90 , srv1516402252:90 , srv179685148:90 , srv1814707144:90 , srv1862339323:90 , srv1961333904:90 , srv2081944524:90 , srv2121727776:90 , srv241301098:90 , srv479190252:90 , srv497021788:90 , srv546324812:90 , srv567547838:90 , srv577539204:90 , srv585444901:90 , srv615922657:90 , srv638145249:90 , srv725704280:90 , srv820518712:90 , srv848253264:90 , srv856402406:90 , srv984725601:90 }
2023-04-02 12:58:42,436 INFO  [Time-limited test] hbase.ResourceChecker(175): after: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnMidClusterWithRacks Thread=9 (was 10), OpenFileDescriptor=260 (was 260), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=219 (was 457), ProcessCount=170 (was 172), AvailableMemoryMB=4263 (was 3949) - AvailableMemoryMB LEAK? -