2023-04-23 05:55:45,790 INFO  [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks timeout: 13 mins
2023-04-23 05:55:46,101 WARN  [Time-limited test] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties
2023-04-23 05:55:46,208 INFO  [Time-limited test] metrics.MetricRegistriesLoader(60): Loaded MetricRegistries class org.apache.hadoop.hbase.metrics.impl.MetricRegistriesImpl
2023-04-23 05:55:46,266 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2023-04-23 05:55:46,273 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc.
2023-04-23 05:55:46,286 INFO  [Time-limited test] hbase.ResourceChecker(147): before: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnLargeClusterWithRacks Thread=10, OpenFileDescriptor=260, MaxFileDescriptor=60000, SystemLoadAverage=384, ProcessCount=169, AvailableMemoryMB=13142
2023-04-23 05:55:46,288 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2023-04-23 05:55:46,288 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=5000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=10000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc.
2023-04-23 05:55:46,400 INFO  [Time-limited test] balancer.BalancerTestBase(547): Mock Cluster : { srv10025352:84 , srv1003228363:84 , srv1013578853:84 , srv1029116632:84 , srv109395987:84 , srv1108606998:84 , srv1127243840:84 , srv1135185160:84 , srv1138681126:84 , srv1144567252:84 , srv1165324360:84 , srv1179040069:84 , srv122247371:84 , srv1257230975:84 , srv1268038890:84 , srv1272553619:84 , srv1295115653:84 , srv1296350463:84 , srv1307853632:84 , srv1357432480:84 , srv1400772581:84 , srv1405998444:84 , srv1432205092:84 , srv145255978:84 , srv1461190596:84 , srv1484427392:84 , srv1555364806:84 , srv1640864409:84 , srv1687951506:84 , srv1737732169:84 , srv1743035410:84 , srv1744460045:84 , srv1746071946:84 , srv1765503602:84 , srv1785978222:84 , srv1786699036:84 , srv1795716874:84 , srv1805846914:84 , srv1813781451:84 , srv1820824274:84 , srv1822158286:84 , srv1825260834:84 , srv1848673801:84 , srv1879986121:84 , srv1935441298:84 , srv1938320937:84 , srv1959111107:84 , srv1960452039:84 , srv1975363066:84 , srv1976934160:84 , srv2010210698:84 , srv202613627:84 , srv2088501607:84 , srv2104284483:84 , srv2117499237:84 , srv216323632:84 , srv221662723:84 , srv24494917:84 , srv254278700:84 , srv255073710:84 , srv26106821:84 , srv275069922:84 , srv284895501:84 , srv314918144:84 , srv318846155:84 , srv325461900:84 , srv339815053:84 , srv343856696:84 , srv346615577:84 , srv348794215:84 , srv355837257:84 , srv391616730:84 , srv40097842:84 , srv420865150:84 , srv422525419:84 , srv449100416:84 , srv462030131:84 , srv466900625:84 , srv474447270:84 , srv484198237:84 , srv528536188:84 , srv531404946:84 , srv53756392:84 , srv62821846:84 , srv648067547:84 , srv679881841:84 , srv704137875:84 , srv715315293:84 , srv718770530:84 , srv762503609:84 , srv789114163:84 , srv814339993:84 , srv824384250:84 , srv831893074:84 , srv898837117:84 , srv917130662:84 , srv98849538:84 , srv996063184:84 , srv997089284:84 , srv1780699720:684 } [srvr=100 rgns=9000 avg=90.0 max=90 min=90]
2023-04-23 05:55:46,408 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-04-23 05:55:46,414 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv2117499237=55, srv1785978222=35, srv1400772581=20, srv1820824274=40, srv1813781451=39, srv216323632=56, srv391616730=72, srv824384250=93, srv40097842=73, srv1805846914=38, srv449100416=76, srv355837257=71, srv1935441298=45, srv422525419=75, srv2088501607=53, srv528536188=81, srv679881841=86, srv531404946=82, srv1138681126=8, srv1640864409=27, srv996063184=98, srv1108606998=5, srv1484427392=25, srv109395987=4, srv202613627=52, srv275069922=62, srv420865150=74, srv1144567252=9, srv221662723=57, srv1268038890=14, srv466900625=78, srv62821846=84, srv98849538=97, srv1296350463=17, srv831893074=94, srv2010210698=51, srv484198237=80, srv325461900=66, srv789114163=91, srv314918144=64, srv1461190596=24, srv1825260834=42, srv339815053=67, srv1029116632=3, srv704137875=87, srv2104284483=54, srv762503609=90, srv145255978=23, srv1405998444=21, srv122247371=12, srv1780699720=34, srv1786699036=36, srv346615577=69, srv318846155=65, srv1179040069=11, srv648067547=85, srv1848673801=43, srv10025352=0, srv1432205092=22, srv1744460045=31, srv1743035410=30, srv474447270=79, srv1555364806=26, srv898837117=95, srv1295115653=16, srv284895501=63, srv24494917=58, srv1960452039=48, srv718770530=89, srv1975363066=49, srv26106821=61, srv1165324360=10, srv1687951506=28, srv1959111107=47, srv1272553619=15, srv1976934160=50, srv1822158286=41, srv1307853632=18, srv254278700=59, srv715315293=88, srv462030131=77, srv1938320937=46, srv1003228363=1, srv814339993=92, srv53756392=83, srv917130662=96, srv1879986121=44, srv1765503602=33, srv1737732169=29, srv1746071946=32, srv255073710=60, srv1795716874=37, srv1135185160=7, srv997089284=99, srv348794215=70, srv1013578853=2, srv1257230975=13, srv343856696=68, srv1127243840=6, srv1357432480=19} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-04-23 05:55:46,495 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-04-23 05:55:46,496 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-04-23 05:55:46,496 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-04-23 05:55:46,496 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-04-23 05:55:46,496 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-04-23 05:55:46,496 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-04-23 05:55:46,496 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-04-23 05:55:46,496 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-04-23 05:55:46,496 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-04-23 05:55:46,496 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-04-23 05:55:46,497 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-04-23 05:55:46,497 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-04-23 05:55:46,497 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-04-23 05:55:46,497 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-04-23 05:55:46,497 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-04-23 05:55:46,497 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-04-23 05:55:46,497 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-04-23 05:55:46,497 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-04-23 05:55:46,497 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-04-23 05:55:46,497 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-04-23 05:55:46,498 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-04-23 05:55:46,498 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-04-23 05:55:46,498 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-04-23 05:55:46,498 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-04-23 05:55:46,498 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-04-23 05:55:46,498 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-04-23 05:55:46,498 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-04-23 05:55:46,498 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-04-23 05:55:46,498 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-04-23 05:55:46,498 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-04-23 05:55:46,498 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-04-23 05:55:46,498 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-04-23 05:55:46,499 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-04-23 05:55:46,499 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-04-23 05:55:46,499 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-04-23 05:55:46,499 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-04-23 05:55:46,499 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-04-23 05:55:46,499 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-04-23 05:55:46,499 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-04-23 05:55:46,499 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-04-23 05:55:46,499 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-04-23 05:55:46,499 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-04-23 05:55:46,499 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-04-23 05:55:46,500 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-04-23 05:55:46,500 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-04-23 05:55:46,500 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-04-23 05:55:46,500 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-04-23 05:55:46,500 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-04-23 05:55:46,500 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-04-23 05:55:46,500 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-04-23 05:55:46,500 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-04-23 05:55:46,500 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-04-23 05:55:46,500 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-04-23 05:55:46,500 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-04-23 05:55:46,500 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-04-23 05:55:46,501 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-04-23 05:55:46,501 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-04-23 05:55:46,501 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-04-23 05:55:46,501 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-04-23 05:55:46,501 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-04-23 05:55:46,501 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-04-23 05:55:46,501 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-04-23 05:55:46,501 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-04-23 05:55:46,501 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-04-23 05:55:46,501 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-04-23 05:55:46,501 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-04-23 05:55:46,502 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-04-23 05:55:46,502 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-04-23 05:55:46,502 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-04-23 05:55:46,502 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-04-23 05:55:46,502 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-04-23 05:55:46,502 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-04-23 05:55:46,502 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-04-23 05:55:46,502 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-04-23 05:55:46,502 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-04-23 05:55:46,502 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-04-23 05:55:46,502 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-04-23 05:55:46,502 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-04-23 05:55:46,502 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-04-23 05:55:46,503 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-04-23 05:55:46,503 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-04-23 05:55:46,503 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-04-23 05:55:46,503 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-04-23 05:55:46,503 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-04-23 05:55:46,503 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-04-23 05:55:46,503 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-04-23 05:55:46,503 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-04-23 05:55:46,503 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-04-23 05:55:46,503 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-04-23 05:55:46,503 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-04-23 05:55:46,503 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-04-23 05:55:46,504 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-04-23 05:55:46,504 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-04-23 05:55:46,504 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-04-23 05:55:46,504 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-04-23 05:55:46,504 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-04-23 05:55:46,504 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-04-23 05:55:46,504 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-04-23 05:55:46,504 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-04-23 05:55:46,504 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-04-23 05:55:46,504 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-04-23 05:55:46,791 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.06666666666666667, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-04-23 05:55:46,792 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-04-23 05:55:46,792 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.9909252140407105, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.06666666666666667, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-04-23 05:55:47,454 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 928 ms to try 5000 different iterations.  Found a solution that moves 4650 regions; Going from a computed imbalance of 0.9909252140407105 to a new imbalance of 0.1853207629170201. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.041667751575849475, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06126427088151967, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.5166666666666667, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.041667751575849475, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.18041666666666667, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.24866666666666667, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-04-23 05:55:47,479 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1400772581:80 , srv109395987:81 , srv1272553619:82 , srv1785978222:82 , srv26106821:82 , srv314918144:82 , srv462030131:82 , srv715315293:82 , srv997089284:82 , srv1013578853:83 , srv1296350463:83 , srv1746071946:83 , srv1786699036:83 , srv1820824274:83 , srv1848673801:83 , srv343856696:83 , srv53756392:83 , srv62821846:83 , srv917130662:83 , srv10025352:84 , srv1268038890:84 , srv1357432480:84 , srv1405998444:84 , srv1805846914:84 , srv2010210698:84 , srv2088501607:84 , srv2117499237:84 , srv284895501:84 , srv474447270:84 , srv814339993:84 , srv1029116632:85 , srv1135185160:85 , srv1144567252:85 , srv1295115653:85 , srv1461190596:85 , srv1744460045:85 , srv1795716874:85 , srv1975363066:85 , srv202613627:85 , srv216323632:85 , srv325461900:85 , srv355837257:85 , srv40097842:85 , srv422525419:85 , srv466900625:85 , srv704137875:85 , srv718770530:85 , srv1179040069:86 , srv1484427392:86 , srv1737732169:86 , srv1743035410:86 , srv1822158286:86 , srv255073710:86 , srv348794215:86 , srv449100416:86 , srv531404946:86 , srv789114163:86 , srv1138681126:87 , srv1307853632:87 , srv1432205092:87 , srv1640864409:87 , srv2104284483:87 , srv24494917:87 , srv318846155:87 , srv346615577:87 , srv484198237:87 , srv1108606998:88 , srv1127243840:88 , srv145255978:88 , srv1938320937:88 , srv1959111107:88 , srv339815053:88 , srv420865150:88 , srv648067547:88 , srv98849538:88 , srv996063184:88 , srv1003228363:89 , srv1165324360:89 , srv1687951506:89 , srv1825260834:89 , srv221662723:89 , srv254278700:89 , srv391616730:89 , srv679881841:89 , srv122247371:90 , srv1765503602:90 , srv1879986121:90 , srv1935441298:90 , srv1960452039:90 , srv528536188:90 , srv824384250:90 , srv898837117:90 , srv1555364806:91 , srv1813781451:91 , srv762503609:91 , srv1257230975:92 , srv275069922:94 , srv1976934160:95 , srv831893074:97 , srv1780699720:460 }
2023-04-23 05:55:47,483 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-04-23 05:55:47,484 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv2117499237=55, srv1785978222=35, srv1400772581=20, srv1820824274=40, srv1813781451=39, srv216323632=56, srv391616730=72, srv824384250=93, srv40097842=73, srv1805846914=38, srv449100416=76, srv355837257=71, srv1935441298=45, srv422525419=75, srv2088501607=53, srv528536188=81, srv679881841=86, srv531404946=82, srv1138681126=8, srv1640864409=27, srv996063184=98, srv1108606998=5, srv1484427392=25, srv109395987=4, srv202613627=52, srv275069922=62, srv420865150=74, srv1144567252=9, srv221662723=57, srv1268038890=14, srv466900625=78, srv62821846=84, srv98849538=97, srv1296350463=17, srv831893074=94, srv2010210698=51, srv484198237=80, srv325461900=66, srv789114163=91, srv314918144=64, srv1461190596=24, srv1825260834=42, srv339815053=67, srv1029116632=3, srv704137875=87, srv2104284483=54, srv762503609=90, srv145255978=23, srv1405998444=21, srv122247371=12, srv1780699720=34, srv1786699036=36, srv346615577=69, srv318846155=65, srv1179040069=11, srv648067547=85, srv1848673801=43, srv10025352=0, srv1432205092=22, srv1744460045=31, srv1743035410=30, srv474447270=79, srv1555364806=26, srv898837117=95, srv1295115653=16, srv284895501=63, srv24494917=58, srv1960452039=48, srv718770530=89, srv1975363066=49, srv26106821=61, srv1165324360=10, srv1687951506=28, srv1959111107=47, srv1272553619=15, srv1976934160=50, srv1822158286=41, srv1307853632=18, srv254278700=59, srv715315293=88, srv462030131=77, srv1938320937=46, srv1003228363=1, srv814339993=92, srv53756392=83, srv917130662=96, srv1879986121=44, srv1765503602=33, srv1737732169=29, srv1746071946=32, srv255073710=60, srv1795716874=37, srv1135185160=7, srv997089284=99, srv348794215=70, srv1013578853=2, srv1257230975=13, srv343856696=68, srv1127243840=6, srv1357432480=19} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-04-23 05:55:47,505 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-04-23 05:55:47,506 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-04-23 05:55:47,506 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-04-23 05:55:47,506 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-04-23 05:55:47,506 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-04-23 05:55:47,506 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-04-23 05:55:47,506 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-04-23 05:55:47,506 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-04-23 05:55:47,506 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-04-23 05:55:47,506 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-04-23 05:55:47,507 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-04-23 05:55:47,507 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-04-23 05:55:47,507 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-04-23 05:55:47,507 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-04-23 05:55:47,507 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-04-23 05:55:47,507 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-04-23 05:55:47,507 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-04-23 05:55:47,507 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-04-23 05:55:47,507 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-04-23 05:55:47,507 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-04-23 05:55:47,507 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-04-23 05:55:47,507 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-04-23 05:55:47,507 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-04-23 05:55:47,507 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-04-23 05:55:47,508 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-04-23 05:55:47,508 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-04-23 05:55:47,508 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-04-23 05:55:47,508 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-04-23 05:55:47,508 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-04-23 05:55:47,508 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-04-23 05:55:47,508 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-04-23 05:55:47,508 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-04-23 05:55:47,508 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-04-23 05:55:47,508 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-04-23 05:55:47,508 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-04-23 05:55:47,508 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-04-23 05:55:47,508 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-04-23 05:55:47,508 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-04-23 05:55:47,509 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-04-23 05:55:47,509 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-04-23 05:55:47,509 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-04-23 05:55:47,509 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-04-23 05:55:47,509 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-04-23 05:55:47,509 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-04-23 05:55:47,509 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-04-23 05:55:47,509 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-04-23 05:55:47,509 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-04-23 05:55:47,509 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-04-23 05:55:47,509 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-04-23 05:55:47,509 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-04-23 05:55:47,509 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-04-23 05:55:47,509 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-04-23 05:55:47,510 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-04-23 05:55:47,510 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-04-23 05:55:47,510 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-04-23 05:55:47,510 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-04-23 05:55:47,510 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-04-23 05:55:47,510 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-04-23 05:55:47,510 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-04-23 05:55:47,510 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-04-23 05:55:47,510 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-04-23 05:55:47,510 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-04-23 05:55:47,510 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-04-23 05:55:47,510 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-04-23 05:55:47,510 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-04-23 05:55:47,510 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-04-23 05:55:47,511 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-04-23 05:55:47,511 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-04-23 05:55:47,511 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-04-23 05:55:47,511 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-04-23 05:55:47,511 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-04-23 05:55:47,511 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-04-23 05:55:47,511 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-04-23 05:55:47,511 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-04-23 05:55:47,511 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-04-23 05:55:47,511 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-04-23 05:55:47,511 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-04-23 05:55:47,511 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-04-23 05:55:47,511 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-04-23 05:55:47,511 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-04-23 05:55:47,512 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-04-23 05:55:47,512 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-04-23 05:55:47,512 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-04-23 05:55:47,512 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-04-23 05:55:47,512 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-04-23 05:55:47,512 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-04-23 05:55:47,512 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-04-23 05:55:47,512 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-04-23 05:55:47,512 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-04-23 05:55:47,512 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-04-23 05:55:47,512 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-04-23 05:55:47,512 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-04-23 05:55:47,512 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-04-23 05:55:47,512 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-04-23 05:55:47,512 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-04-23 05:55:47,513 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-04-23 05:55:47,513 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-04-23 05:55:47,513 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-04-23 05:55:47,513 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-04-23 05:55:47,513 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-04-23 05:55:47,513 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-04-23 05:55:47,664 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.041667751575849475, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06126427088151967, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.041667751575849475, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.18041666666666667, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.24866666666666667, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-04-23 05:55:47,664 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-04-23 05:55:47,664 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.18528820292110135, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.041667751575849475, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06126427088151967, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.041667751575849475, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.18041666666666667, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.24866666666666667, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-04-23 05:55:47,948 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 411 ms to try 5000 different iterations.  Found a solution that moves 2677 regions; Going from a computed imbalance of 0.18528820292110135 to a new imbalance of 0.016595526422088887. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.022948838927725507); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.04137643023117926, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.29744444444444446, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.022948838927725507); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.013333333333333334); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0475, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-04-23 05:55:47,958 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv831893074:74 , srv1976934160:77 , srv275069922:77 , srv1257230975:79 , srv762503609:79 , srv1165324360:81 , srv122247371:81 , srv1555364806:81 , srv1813781451:81 , srv1879986121:81 , srv528536188:81 , srv679881841:81 , srv1765503602:82 , srv1825260834:82 , srv1960452039:82 , srv221662723:82 , srv420865150:82 , srv1003228363:83 , srv1127243840:83 , srv1307853632:83 , srv145255978:83 , srv484198237:83 , srv824384250:83 , srv1108606998:84 , srv1687951506:84 , srv1737732169:84 , srv1935441298:84 , srv2104284483:84 , srv254278700:84 , srv255073710:84 , srv339815053:84 , srv391616730:84 , srv648067547:84 , srv898837117:84 , srv98849538:84 , srv996063184:84 , srv1138681126:85 , srv1179040069:85 , srv1295115653:85 , srv1432205092:85 , srv1484427392:85 , srv1743035410:85 , srv1744460045:85 , srv24494917:85 , srv318846155:85 , srv325461900:85 , srv346615577:85 , srv1135185160:86 , srv1268038890:86 , srv1938320937:86 , srv1959111107:86 , srv2117499237:86 , srv348794215:86 , srv355837257:86 , srv422525419:86 , srv917130662:86 , srv1029116632:87 , srv1144567252:87 , srv1357432480:87 , srv1746071946:87 , srv1975363066:87 , srv2010210698:87 , srv449100416:87 , srv531404946:87 , srv704137875:87 , srv814339993:87 , srv1296350463:88 , srv1405998444:88 , srv1461190596:88 , srv1795716874:88 , srv1805846914:88 , srv1820824274:88 , srv1822158286:88 , srv202613627:88 , srv2088501607:88 , srv216323632:88 , srv284895501:88 , srv40097842:88 , srv466900625:88 , srv53756392:88 , srv789114163:88 , srv1272553619:89 , srv1786699036:89 , srv343856696:89 , srv715315293:89 , srv718770530:89 , srv10025352:90 , srv1013578853:90 , srv1640864409:90 , srv462030131:90 , srv474447270:90 , srv26106821:91 , srv314918144:91 , srv62821846:91 , srv1400772581:92 , srv1848673801:92 , srv997089284:92 , srv109395987:93 , srv1785978222:93 , srv1780699720:518 }
2023-04-23 05:55:47,961 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-04-23 05:55:47,962 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv2117499237=55, srv1785978222=35, srv1400772581=20, srv1820824274=40, srv1813781451=39, srv216323632=56, srv391616730=72, srv824384250=93, srv40097842=73, srv1805846914=38, srv449100416=76, srv355837257=71, srv1935441298=45, srv422525419=75, srv2088501607=53, srv528536188=81, srv679881841=86, srv531404946=82, srv1138681126=8, srv1640864409=27, srv996063184=98, srv1108606998=5, srv1484427392=25, srv109395987=4, srv202613627=52, srv275069922=62, srv420865150=74, srv1144567252=9, srv221662723=57, srv1268038890=14, srv466900625=78, srv62821846=84, srv98849538=97, srv1296350463=17, srv831893074=94, srv2010210698=51, srv484198237=80, srv325461900=66, srv789114163=91, srv314918144=64, srv1461190596=24, srv1825260834=42, srv339815053=67, srv1029116632=3, srv704137875=87, srv2104284483=54, srv762503609=90, srv145255978=23, srv1405998444=21, srv122247371=12, srv1780699720=34, srv1786699036=36, srv346615577=69, srv318846155=65, srv1179040069=11, srv648067547=85, srv1848673801=43, srv10025352=0, srv1432205092=22, srv1744460045=31, srv1743035410=30, srv474447270=79, srv1555364806=26, srv898837117=95, srv1295115653=16, srv284895501=63, srv24494917=58, srv1960452039=48, srv718770530=89, srv1975363066=49, srv26106821=61, srv1165324360=10, srv1687951506=28, srv1959111107=47, srv1272553619=15, srv1976934160=50, srv1822158286=41, srv1307853632=18, srv254278700=59, srv715315293=88, srv462030131=77, srv1938320937=46, srv1003228363=1, srv814339993=92, srv53756392=83, srv917130662=96, srv1879986121=44, srv1765503602=33, srv1737732169=29, srv1746071946=32, srv255073710=60, srv1795716874=37, srv1135185160=7, srv997089284=99, srv348794215=70, srv1013578853=2, srv1257230975=13, srv343856696=68, srv1127243840=6, srv1357432480=19} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-04-23 05:55:47,976 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-04-23 05:55:47,976 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-04-23 05:55:47,976 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-04-23 05:55:47,976 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-04-23 05:55:47,976 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-04-23 05:55:47,976 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-04-23 05:55:47,976 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-04-23 05:55:47,976 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-04-23 05:55:47,976 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-04-23 05:55:47,976 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-04-23 05:55:47,976 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-04-23 05:55:47,976 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-04-23 05:55:47,977 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-04-23 05:55:47,977 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-04-23 05:55:47,977 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-04-23 05:55:47,977 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-04-23 05:55:47,977 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-04-23 05:55:47,977 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-04-23 05:55:47,977 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-04-23 05:55:47,977 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-04-23 05:55:47,977 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-04-23 05:55:47,977 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-04-23 05:55:47,977 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-04-23 05:55:47,977 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-04-23 05:55:47,977 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-04-23 05:55:47,977 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-04-23 05:55:47,977 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-04-23 05:55:47,977 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-04-23 05:55:47,978 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-04-23 05:55:47,978 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-04-23 05:55:47,978 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-04-23 05:55:47,978 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-04-23 05:55:47,978 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-04-23 05:55:47,978 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-04-23 05:55:47,978 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-04-23 05:55:47,978 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-04-23 05:55:47,978 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-04-23 05:55:47,978 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-04-23 05:55:47,978 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-04-23 05:55:47,978 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-04-23 05:55:47,978 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-04-23 05:55:47,978 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-04-23 05:55:47,978 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-04-23 05:55:47,978 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-04-23 05:55:47,979 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-04-23 05:55:47,979 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-04-23 05:55:47,979 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-04-23 05:55:47,979 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-04-23 05:55:47,979 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-04-23 05:55:47,979 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-04-23 05:55:47,979 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-04-23 05:55:47,979 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-04-23 05:55:47,979 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-04-23 05:55:47,979 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-04-23 05:55:47,979 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-04-23 05:55:47,979 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-04-23 05:55:47,979 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-04-23 05:55:47,979 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-04-23 05:55:47,979 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-04-23 05:55:47,979 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-04-23 05:55:47,980 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-04-23 05:55:47,980 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-04-23 05:55:47,980 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-04-23 05:55:47,980 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-04-23 05:55:47,980 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-04-23 05:55:47,980 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-04-23 05:55:47,980 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-04-23 05:55:47,980 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-04-23 05:55:47,980 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-04-23 05:55:47,980 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-04-23 05:55:47,980 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-04-23 05:55:47,980 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-04-23 05:55:47,980 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-04-23 05:55:47,980 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-04-23 05:55:47,980 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-04-23 05:55:47,980 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-04-23 05:55:47,980 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-04-23 05:55:47,981 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-04-23 05:55:47,981 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-04-23 05:55:47,981 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-04-23 05:55:47,981 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-04-23 05:55:47,981 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-04-23 05:55:47,981 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-04-23 05:55:47,981 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-04-23 05:55:47,981 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-04-23 05:55:47,981 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-04-23 05:55:47,981 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-04-23 05:55:47,981 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-04-23 05:55:47,981 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-04-23 05:55:47,981 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-04-23 05:55:47,981 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-04-23 05:55:47,981 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-04-23 05:55:47,981 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-04-23 05:55:47,981 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-04-23 05:55:47,982 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-04-23 05:55:47,982 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-04-23 05:55:47,982 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-04-23 05:55:47,982 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-04-23 05:55:47,982 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-04-23 05:55:47,982 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-04-23 05:55:47,982 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-04-23 05:55:48,092 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.022948838927725507); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.04137643023117926, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.022948838927725507); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.013333333333333334); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0475, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-04-23 05:55:48,092 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-04-23 05:55:48,092 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.016576781667449213, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.022948838927725507); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.04137643023117926, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.022948838927725507); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.013333333333333334); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0475, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-04-23 05:55:48,355 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 358 ms to try 5000 different iterations.  Found a solution that moves 1009 regions; Going from a computed imbalance of 0.016576781667449213 to a new imbalance of 9.376268176226128E-4. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.006430535708627831); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.009847319278346619); MoveCostFunction : (multiplier=7.0, imbalance=0.1121111111111111, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.006430535708627831); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=5.833333333333334E-4); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0036666666666666666); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-04-23 05:55:48,359 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1640864409:81 , srv1848673801:82 , srv10025352:83 , srv1785978222:83 , srv1935441298:83 , srv1959111107:83 , srv718770530:83 , srv1013578853:84 , srv109395987:84 , srv1461190596:84 , srv1687951506:84 , srv1795716874:84 , srv1822158286:84 , srv1938320937:84 , srv1960452039:84 , srv216323632:84 , srv314918144:84 , srv474447270:84 , srv531404946:84 , srv62821846:84 , srv789114163:84 , srv824384250:84 , srv898837117:84 , srv997089284:84 , srv1003228363:85 , srv1138681126:85 , srv1144567252:85 , srv122247371:85 , srv1400772581:85 , srv1405998444:85 , srv1432205092:85 , srv1765503602:85 , srv1813781451:85 , srv1975363066:85 , srv202613627:85 , srv2088501607:85 , srv26106821:85 , srv284895501:85 , srv318846155:85 , srv339815053:85 , srv348794215:85 , srv391616730:85 , srv40097842:85 , srv449100416:85 , srv466900625:85 , srv53756392:85 , srv1029116632:86 , srv1108606998:86 , srv1179040069:86 , srv1257230975:86 , srv1272553619:86 , srv1307853632:86 , srv1357432480:86 , srv145255978:86 , srv1484427392:86 , srv1555364806:86 , srv1786699036:86 , srv1805846914:86 , srv1879986121:86 , srv1976934160:86 , srv2010210698:86 , srv2104284483:86 , srv24494917:86 , srv254278700:86 , srv275069922:86 , srv343856696:86 , srv346615577:86 , srv422525419:86 , srv462030131:86 , srv528536188:86 , srv648067547:86 , srv704137875:86 , srv814339993:86 , srv98849538:86 , srv996063184:86 , srv1127243840:87 , srv1135185160:87 , srv1165324360:87 , srv1295115653:87 , srv1296350463:87 , srv1743035410:87 , srv1744460045:87 , srv1746071946:87 , srv1820824274:87 , srv1825260834:87 , srv2117499237:87 , srv221662723:87 , srv255073710:87 , srv355837257:87 , srv420865150:87 , srv484198237:87 , srv679881841:87 , srv715315293:87 , srv762503609:87 , srv831893074:87 , srv1268038890:88 , srv1737732169:88 , srv325461900:88 , srv917130662:89 , srv1780699720:537 }
2023-04-23 05:55:48,365 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-04-23 05:55:48,367 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv2117499237=55, srv1785978222=35, srv1400772581=20, srv1820824274=40, srv1813781451=39, srv216323632=56, srv391616730=72, srv824384250=93, srv40097842=73, srv1805846914=38, srv449100416=76, srv355837257=71, srv1935441298=45, srv422525419=75, srv2088501607=53, srv528536188=81, srv679881841=86, srv531404946=82, srv1138681126=8, srv1640864409=27, srv996063184=98, srv1108606998=5, srv1484427392=25, srv109395987=4, srv202613627=52, srv275069922=62, srv420865150=74, srv1144567252=9, srv221662723=57, srv1268038890=14, srv466900625=78, srv62821846=84, srv98849538=97, srv1296350463=17, srv831893074=94, srv2010210698=51, srv484198237=80, srv325461900=66, srv789114163=91, srv314918144=64, srv1461190596=24, srv1825260834=42, srv339815053=67, srv1029116632=3, srv704137875=87, srv2104284483=54, srv762503609=90, srv145255978=23, srv1405998444=21, srv122247371=12, srv1780699720=34, srv1786699036=36, srv346615577=69, srv318846155=65, srv1179040069=11, srv648067547=85, srv1848673801=43, srv10025352=0, srv1432205092=22, srv1744460045=31, srv1743035410=30, srv474447270=79, srv1555364806=26, srv898837117=95, srv1295115653=16, srv284895501=63, srv24494917=58, srv1960452039=48, srv718770530=89, srv1975363066=49, srv26106821=61, srv1165324360=10, srv1687951506=28, srv1959111107=47, srv1272553619=15, srv1976934160=50, srv1822158286=41, srv1307853632=18, srv254278700=59, srv715315293=88, srv462030131=77, srv1938320937=46, srv1003228363=1, srv814339993=92, srv53756392=83, srv917130662=96, srv1879986121=44, srv1765503602=33, srv1737732169=29, srv1746071946=32, srv255073710=60, srv1795716874=37, srv1135185160=7, srv997089284=99, srv348794215=70, srv1013578853=2, srv1257230975=13, srv343856696=68, srv1127243840=6, srv1357432480=19} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-04-23 05:55:48,388 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-04-23 05:55:48,388 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-04-23 05:55:48,388 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-04-23 05:55:48,388 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-04-23 05:55:48,388 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-04-23 05:55:48,388 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-04-23 05:55:48,388 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-04-23 05:55:48,388 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-04-23 05:55:48,388 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-04-23 05:55:48,388 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-04-23 05:55:48,388 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-04-23 05:55:48,389 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-04-23 05:55:48,389 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-04-23 05:55:48,389 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-04-23 05:55:48,389 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-04-23 05:55:48,389 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-04-23 05:55:48,389 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-04-23 05:55:48,389 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-04-23 05:55:48,389 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-04-23 05:55:48,389 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-04-23 05:55:48,389 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-04-23 05:55:48,389 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-04-23 05:55:48,389 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-04-23 05:55:48,389 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-04-23 05:55:48,389 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-04-23 05:55:48,390 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-04-23 05:55:48,390 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-04-23 05:55:48,390 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-04-23 05:55:48,390 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-04-23 05:55:48,390 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-04-23 05:55:48,390 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-04-23 05:55:48,390 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-04-23 05:55:48,390 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-04-23 05:55:48,391 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-04-23 05:55:48,391 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-04-23 05:55:48,391 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-04-23 05:55:48,391 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-04-23 05:55:48,391 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-04-23 05:55:48,391 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-04-23 05:55:48,391 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-04-23 05:55:48,391 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-04-23 05:55:48,391 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-04-23 05:55:48,392 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-04-23 05:55:48,392 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-04-23 05:55:48,392 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-04-23 05:55:48,392 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-04-23 05:55:48,392 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-04-23 05:55:48,392 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-04-23 05:55:48,392 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-04-23 05:55:48,392 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-04-23 05:55:48,393 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-04-23 05:55:48,393 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-04-23 05:55:48,393 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-04-23 05:55:48,393 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-04-23 05:55:48,393 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-04-23 05:55:48,393 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-04-23 05:55:48,393 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-04-23 05:55:48,393 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-04-23 05:55:48,393 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-04-23 05:55:48,394 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-04-23 05:55:48,394 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-04-23 05:55:48,394 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-04-23 05:55:48,394 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-04-23 05:55:48,394 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-04-23 05:55:48,394 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-04-23 05:55:48,394 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-04-23 05:55:48,394 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-04-23 05:55:48,394 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-04-23 05:55:48,394 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-04-23 05:55:48,395 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-04-23 05:55:48,395 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-04-23 05:55:48,395 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-04-23 05:55:48,395 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-04-23 05:55:48,395 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-04-23 05:55:48,395 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-04-23 05:55:48,395 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-04-23 05:55:48,395 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-04-23 05:55:48,395 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-04-23 05:55:48,395 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-04-23 05:55:48,396 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-04-23 05:55:48,396 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-04-23 05:55:48,396 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-04-23 05:55:48,396 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-04-23 05:55:48,396 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-04-23 05:55:48,396 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-04-23 05:55:48,396 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-04-23 05:55:48,396 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-04-23 05:55:48,396 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-04-23 05:55:48,396 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-04-23 05:55:48,397 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-04-23 05:55:48,397 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-04-23 05:55:48,397 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-04-23 05:55:48,397 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-04-23 05:55:48,397 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-04-23 05:55:48,397 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-04-23 05:55:48,397 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-04-23 05:55:48,397 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-04-23 05:55:48,397 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-04-23 05:55:48,398 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-04-23 05:55:48,398 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-04-23 05:55:48,398 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-04-23 05:55:48,515 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.006430535708627831); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.009847319278346619); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.006430535708627831); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=5.833333333333334E-4); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0036666666666666666); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-04-23 05:55:48,515 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-04-23 05:55:48,516 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=9.305616486157277E-4, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.006430535708627831); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.009847319278346619); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.006430535708627831); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=5.833333333333334E-4); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0036666666666666666); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-04-23 05:55:48,774 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 362 ms to try 5000 different iterations.  Found a solution that moves 260 regions; Going from a computed imbalance of 9.305616486157277E-4 to a new imbalance of 2.851416066443462E-5. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=4.4668347344853864E-4); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.002118805753879094); MoveCostFunction : (multiplier=7.0, imbalance=0.028888888888888888, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=4.4668347344853864E-4); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.6666666666666666E-4); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-04-23 05:55:48,775 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1127243840:83 , srv1268038890:83 , srv1555364806:83 , srv254278700:83 , srv1029116632:84 , srv109395987:84 , srv1108606998:84 , srv1135185160:84 , srv1296350463:84 , srv1737732169:84 , srv1743035410:84 , srv1785978222:84 , srv1786699036:84 , srv1805846914:84 , srv1820824274:84 , srv1822158286:84 , srv1825260834:84 , srv1938320937:84 , srv1976934160:84 , srv202613627:84 , srv221662723:84 , srv24494917:84 , srv26106821:84 , srv325461900:84 , srv343856696:84 , srv346615577:84 , srv355837257:84 , srv40097842:84 , srv449100416:84 , srv462030131:84 , srv466900625:84 , srv62821846:84 , srv679881841:84 , srv715315293:84 , srv762503609:84 , srv789114163:84 , srv814339993:84 , srv824384250:84 , srv831893074:84 , srv898837117:84 , srv917130662:84 , srv98849538:84 , srv996063184:84 , srv10025352:85 , srv1003228363:85 , srv1013578853:85 , srv1138681126:85 , srv1144567252:85 , srv1165324360:85 , srv1179040069:85 , srv1257230975:85 , srv1272553619:85 , srv1295115653:85 , srv1307853632:85 , srv1357432480:85 , srv1400772581:85 , srv1405998444:85 , srv1432205092:85 , srv145255978:85 , srv1461190596:85 , srv1484427392:85 , srv1640864409:85 , srv1687951506:85 , srv1744460045:85 , srv1746071946:85 , srv1765503602:85 , srv1795716874:85 , srv1813781451:85 , srv1848673801:85 , srv1879986121:85 , srv1935441298:85 , srv1959111107:85 , srv1975363066:85 , srv2010210698:85 , srv2088501607:85 , srv2104284483:85 , srv2117499237:85 , srv255073710:85 , srv275069922:85 , srv284895501:85 , srv314918144:85 , srv318846155:85 , srv339815053:85 , srv348794215:85 , srv391616730:85 , srv420865150:85 , srv422525419:85 , srv474447270:85 , srv484198237:85 , srv528536188:85 , srv531404946:85 , srv648067547:85 , srv704137875:85 , srv718770530:85 , srv997089284:85 , srv1960452039:86 , srv216323632:86 , srv53756392:86 , srv122247371:87 , srv1780699720:627 }
2023-04-23 05:55:48,778 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-04-23 05:55:48,779 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv2117499237=55, srv1785978222=35, srv1400772581=20, srv1820824274=40, srv1813781451=39, srv216323632=56, srv391616730=72, srv824384250=93, srv40097842=73, srv1805846914=38, srv449100416=76, srv355837257=71, srv1935441298=45, srv422525419=75, srv2088501607=53, srv528536188=81, srv679881841=86, srv531404946=82, srv1138681126=8, srv1640864409=27, srv996063184=98, srv1108606998=5, srv1484427392=25, srv109395987=4, srv202613627=52, srv275069922=62, srv420865150=74, srv1144567252=9, srv221662723=57, srv1268038890=14, srv466900625=78, srv62821846=84, srv98849538=97, srv1296350463=17, srv831893074=94, srv2010210698=51, srv484198237=80, srv325461900=66, srv789114163=91, srv314918144=64, srv1461190596=24, srv1825260834=42, srv339815053=67, srv1029116632=3, srv704137875=87, srv2104284483=54, srv762503609=90, srv145255978=23, srv1405998444=21, srv122247371=12, srv1780699720=34, srv1786699036=36, srv346615577=69, srv318846155=65, srv1179040069=11, srv648067547=85, srv1848673801=43, srv10025352=0, srv1432205092=22, srv1744460045=31, srv1743035410=30, srv474447270=79, srv1555364806=26, srv898837117=95, srv1295115653=16, srv284895501=63, srv24494917=58, srv1960452039=48, srv718770530=89, srv1975363066=49, srv26106821=61, srv1165324360=10, srv1687951506=28, srv1959111107=47, srv1272553619=15, srv1976934160=50, srv1822158286=41, srv1307853632=18, srv254278700=59, srv715315293=88, srv462030131=77, srv1938320937=46, srv1003228363=1, srv814339993=92, srv53756392=83, srv917130662=96, srv1879986121=44, srv1765503602=33, srv1737732169=29, srv1746071946=32, srv255073710=60, srv1795716874=37, srv1135185160=7, srv997089284=99, srv348794215=70, srv1013578853=2, srv1257230975=13, srv343856696=68, srv1127243840=6, srv1357432480=19} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-04-23 05:55:48,789 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-04-23 05:55:48,790 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-04-23 05:55:48,790 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-04-23 05:55:48,790 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-04-23 05:55:48,790 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-04-23 05:55:48,790 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-04-23 05:55:48,790 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-04-23 05:55:48,790 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-04-23 05:55:48,790 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-04-23 05:55:48,790 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-04-23 05:55:48,790 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-04-23 05:55:48,790 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-04-23 05:55:48,790 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-04-23 05:55:48,790 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-04-23 05:55:48,790 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-04-23 05:55:48,790 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-04-23 05:55:48,790 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-04-23 05:55:48,790 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-04-23 05:55:48,790 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-04-23 05:55:48,790 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-04-23 05:55:48,791 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-04-23 05:55:48,791 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-04-23 05:55:48,791 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-04-23 05:55:48,791 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-04-23 05:55:48,791 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-04-23 05:55:48,791 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-04-23 05:55:48,791 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-04-23 05:55:48,791 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-04-23 05:55:48,791 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-04-23 05:55:48,791 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-04-23 05:55:48,791 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-04-23 05:55:48,791 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-04-23 05:55:48,791 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-04-23 05:55:48,791 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-04-23 05:55:48,791 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-04-23 05:55:48,791 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-04-23 05:55:48,791 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-04-23 05:55:48,791 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-04-23 05:55:48,791 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-04-23 05:55:48,791 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-04-23 05:55:48,791 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-04-23 05:55:48,791 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-04-23 05:55:48,792 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-04-23 05:55:48,792 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-04-23 05:55:48,792 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-04-23 05:55:48,792 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-04-23 05:55:48,792 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-04-23 05:55:48,792 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-04-23 05:55:48,792 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-04-23 05:55:48,792 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-04-23 05:55:48,792 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-04-23 05:55:48,792 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-04-23 05:55:48,792 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-04-23 05:55:48,792 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-04-23 05:55:48,792 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-04-23 05:55:48,792 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-04-23 05:55:48,792 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-04-23 05:55:48,792 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-04-23 05:55:48,792 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-04-23 05:55:48,793 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-04-23 05:55:48,793 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-04-23 05:55:48,793 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-04-23 05:55:48,793 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-04-23 05:55:48,793 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-04-23 05:55:48,793 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-04-23 05:55:48,793 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-04-23 05:55:48,793 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-04-23 05:55:48,793 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-04-23 05:55:48,793 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-04-23 05:55:48,793 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-04-23 05:55:48,794 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-04-23 05:55:48,794 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-04-23 05:55:48,794 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-04-23 05:55:48,794 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-04-23 05:55:48,794 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-04-23 05:55:48,794 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-04-23 05:55:48,794 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-04-23 05:55:48,794 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-04-23 05:55:48,795 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-04-23 05:55:48,795 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-04-23 05:55:48,795 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-04-23 05:55:48,795 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-04-23 05:55:48,795 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-04-23 05:55:48,795 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-04-23 05:55:48,795 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-04-23 05:55:48,795 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-04-23 05:55:48,795 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-04-23 05:55:48,795 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-04-23 05:55:48,795 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-04-23 05:55:48,795 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-04-23 05:55:48,796 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-04-23 05:55:48,796 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-04-23 05:55:48,796 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-04-23 05:55:48,796 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-04-23 05:55:48,796 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-04-23 05:55:48,796 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-04-23 05:55:48,796 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-04-23 05:55:48,796 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-04-23 05:55:48,796 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-04-23 05:55:48,796 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-04-23 05:55:48,796 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-04-23 05:55:48,903 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=4.4668347344853864E-4); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.002118805753879094); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=4.4668347344853864E-4); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.6666666666666666E-4); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-04-23 05:55:48,903 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-04-23 05:55:48,904 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=2.6693601752848763E-5, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=4.4668347344853864E-4); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.002118805753879094); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=4.4668347344853864E-4); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.6666666666666666E-4); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-04-23 05:55:49,104 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 297 ms to try 5000 different iterations.  Found a solution that moves 29 regions; Going from a computed imbalance of 2.6693601752848763E-5 to a new imbalance of 7.590819840450981E-6. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0016412198797244363); MoveCostFunction : (multiplier=7.0, imbalance=0.0032222222222222222); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-04-23 05:55:49,105 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv122247371:83 , srv1640864409:83 , srv216323632:83 , srv391616730:83 , srv474447270:83 , srv648067547:83 , srv704137875:83 , srv997089284:83 , srv10025352:84 , srv1003228363:84 , srv1013578853:84 , srv1029116632:84 , srv109395987:84 , srv1108606998:84 , srv1135185160:84 , srv1138681126:84 , srv1144567252:84 , srv1165324360:84 , srv1179040069:84 , srv1257230975:84 , srv1272553619:84 , srv1295115653:84 , srv1296350463:84 , srv1357432480:84 , srv1400772581:84 , srv1405998444:84 , srv1432205092:84 , srv145255978:84 , srv1461190596:84 , srv1484427392:84 , srv1687951506:84 , srv1737732169:84 , srv1743035410:84 , srv1744460045:84 , srv1746071946:84 , srv1765503602:84 , srv1785978222:84 , srv1786699036:84 , srv1795716874:84 , srv1805846914:84 , srv1813781451:84 , srv1820824274:84 , srv1822158286:84 , srv1825260834:84 , srv1848673801:84 , srv1879986121:84 , srv1935441298:84 , srv1938320937:84 , srv1959111107:84 , srv1960452039:84 , srv1975363066:84 , srv1976934160:84 , srv2010210698:84 , srv202613627:84 , srv2088501607:84 , srv2104284483:84 , srv2117499237:84 , srv221662723:84 , srv24494917:84 , srv254278700:84 , srv255073710:84 , srv26106821:84 , srv275069922:84 , srv284895501:84 , srv314918144:84 , srv318846155:84 , srv325461900:84 , srv339815053:84 , srv343856696:84 , srv346615577:84 , srv348794215:84 , srv355837257:84 , srv40097842:84 , srv420865150:84 , srv422525419:84 , srv449100416:84 , srv462030131:84 , srv466900625:84 , srv484198237:84 , srv528536188:84 , srv531404946:84 , srv53756392:84 , srv62821846:84 , srv715315293:84 , srv718770530:84 , srv789114163:84 , srv831893074:84 , srv898837117:84 , srv917130662:84 , srv98849538:84 , srv996063184:84 , srv1127243840:85 , srv1268038890:85 , srv1307853632:85 , srv1555364806:85 , srv679881841:85 , srv762503609:85 , srv814339993:85 , srv824384250:85 , srv1780699720:684 }
2023-04-23 05:55:49,108 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-04-23 05:55:49,108 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv2117499237=55, srv1785978222=35, srv1400772581=20, srv1820824274=40, srv1813781451=39, srv216323632=56, srv391616730=72, srv824384250=93, srv40097842=73, srv1805846914=38, srv449100416=76, srv355837257=71, srv1935441298=45, srv422525419=75, srv2088501607=53, srv528536188=81, srv679881841=86, srv531404946=82, srv1138681126=8, srv1640864409=27, srv996063184=98, srv1108606998=5, srv1484427392=25, srv109395987=4, srv202613627=52, srv275069922=62, srv420865150=74, srv1144567252=9, srv221662723=57, srv1268038890=14, srv466900625=78, srv62821846=84, srv98849538=97, srv1296350463=17, srv831893074=94, srv2010210698=51, srv484198237=80, srv325461900=66, srv789114163=91, srv314918144=64, srv1461190596=24, srv1825260834=42, srv339815053=67, srv1029116632=3, srv704137875=87, srv2104284483=54, srv762503609=90, srv145255978=23, srv1405998444=21, srv122247371=12, srv1780699720=34, srv1786699036=36, srv346615577=69, srv318846155=65, srv1179040069=11, srv648067547=85, srv1848673801=43, srv10025352=0, srv1432205092=22, srv1744460045=31, srv1743035410=30, srv474447270=79, srv1555364806=26, srv898837117=95, srv1295115653=16, srv284895501=63, srv24494917=58, srv1960452039=48, srv718770530=89, srv1975363066=49, srv26106821=61, srv1165324360=10, srv1687951506=28, srv1959111107=47, srv1272553619=15, srv1976934160=50, srv1822158286=41, srv1307853632=18, srv254278700=59, srv715315293=88, srv462030131=77, srv1938320937=46, srv1003228363=1, srv814339993=92, srv53756392=83, srv917130662=96, srv1879986121=44, srv1765503602=33, srv1737732169=29, srv1746071946=32, srv255073710=60, srv1795716874=37, srv1135185160=7, srv997089284=99, srv348794215=70, srv1013578853=2, srv1257230975=13, srv343856696=68, srv1127243840=6, srv1357432480=19} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-04-23 05:55:49,120 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-04-23 05:55:49,120 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-04-23 05:55:49,120 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-04-23 05:55:49,120 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-04-23 05:55:49,121 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-04-23 05:55:49,121 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-04-23 05:55:49,121 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-04-23 05:55:49,121 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-04-23 05:55:49,121 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-04-23 05:55:49,121 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-04-23 05:55:49,121 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-04-23 05:55:49,121 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-04-23 05:55:49,121 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-04-23 05:55:49,121 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-04-23 05:55:49,121 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-04-23 05:55:49,121 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-04-23 05:55:49,121 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-04-23 05:55:49,121 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-04-23 05:55:49,121 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-04-23 05:55:49,121 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-04-23 05:55:49,121 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-04-23 05:55:49,122 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-04-23 05:55:49,122 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-04-23 05:55:49,122 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-04-23 05:55:49,122 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-04-23 05:55:49,122 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-04-23 05:55:49,122 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-04-23 05:55:49,122 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-04-23 05:55:49,122 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-04-23 05:55:49,122 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-04-23 05:55:49,122 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-04-23 05:55:49,122 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-04-23 05:55:49,122 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-04-23 05:55:49,122 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-04-23 05:55:49,122 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-04-23 05:55:49,122 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-04-23 05:55:49,122 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-04-23 05:55:49,122 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-04-23 05:55:49,122 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-04-23 05:55:49,122 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-04-23 05:55:49,123 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-04-23 05:55:49,123 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-04-23 05:55:49,123 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-04-23 05:55:49,123 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-04-23 05:55:49,123 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-04-23 05:55:49,123 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-04-23 05:55:49,123 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-04-23 05:55:49,123 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-04-23 05:55:49,123 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-04-23 05:55:49,123 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-04-23 05:55:49,123 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-04-23 05:55:49,123 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-04-23 05:55:49,123 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-04-23 05:55:49,123 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-04-23 05:55:49,123 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-04-23 05:55:49,123 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-04-23 05:55:49,123 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-04-23 05:55:49,124 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-04-23 05:55:49,124 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-04-23 05:55:49,124 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-04-23 05:55:49,124 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-04-23 05:55:49,124 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-04-23 05:55:49,124 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-04-23 05:55:49,124 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-04-23 05:55:49,124 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-04-23 05:55:49,124 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-04-23 05:55:49,124 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-04-23 05:55:49,124 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-04-23 05:55:49,124 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-04-23 05:55:49,124 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-04-23 05:55:49,124 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-04-23 05:55:49,124 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-04-23 05:55:49,125 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-04-23 05:55:49,125 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-04-23 05:55:49,125 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-04-23 05:55:49,125 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-04-23 05:55:49,125 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-04-23 05:55:49,125 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-04-23 05:55:49,125 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-04-23 05:55:49,125 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-04-23 05:55:49,125 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-04-23 05:55:49,125 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-04-23 05:55:49,125 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-04-23 05:55:49,125 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-04-23 05:55:49,125 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-04-23 05:55:49,125 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-04-23 05:55:49,125 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-04-23 05:55:49,125 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-04-23 05:55:49,125 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-04-23 05:55:49,126 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-04-23 05:55:49,126 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-04-23 05:55:49,126 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-04-23 05:55:49,126 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-04-23 05:55:49,126 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-04-23 05:55:49,126 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-04-23 05:55:49,126 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-04-23 05:55:49,126 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-04-23 05:55:49,126 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-04-23 05:55:49,126 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-04-23 05:55:49,126 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-04-23 05:55:49,127 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-04-23 05:55:49,236 INFO  [Time-limited test] balancer.StochasticLoadBalancer(381): Cluster wide - skipping load balancing because weighted average imbalance=7.387757500312559E-6 <= threshold(0.025). If you want more aggressive balancing, either lower hbase.master.balancer.stochastic.minCostNeedBalance from 0.025 or increase the relative multiplier(s) of the specific cost function(s). functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0016412198797244363); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-04-23 05:55:49,236 INFO  [Time-limited test] balancer.BalancerTestBase(570): Mock Final balance: { srv122247371:83 , srv1640864409:83 , srv216323632:83 , srv391616730:83 , srv474447270:83 , srv648067547:83 , srv704137875:83 , srv997089284:83 , srv10025352:84 , srv1003228363:84 , srv1013578853:84 , srv1029116632:84 , srv109395987:84 , srv1108606998:84 , srv1135185160:84 , srv1138681126:84 , srv1144567252:84 , srv1165324360:84 , srv1179040069:84 , srv1257230975:84 , srv1272553619:84 , srv1295115653:84 , srv1296350463:84 , srv1357432480:84 , srv1400772581:84 , srv1405998444:84 , srv1432205092:84 , srv145255978:84 , srv1461190596:84 , srv1484427392:84 , srv1687951506:84 , srv1737732169:84 , srv1743035410:84 , srv1744460045:84 , srv1746071946:84 , srv1765503602:84 , srv1785978222:84 , srv1786699036:84 , srv1795716874:84 , srv1805846914:84 , srv1813781451:84 , srv1820824274:84 , srv1822158286:84 , srv1825260834:84 , srv1848673801:84 , srv1879986121:84 , srv1935441298:84 , srv1938320937:84 , srv1959111107:84 , srv1960452039:84 , srv1975363066:84 , srv1976934160:84 , srv2010210698:84 , srv202613627:84 , srv2088501607:84 , srv2104284483:84 , srv2117499237:84 , srv221662723:84 , srv24494917:84 , srv254278700:84 , srv255073710:84 , srv26106821:84 , srv275069922:84 , srv284895501:84 , srv314918144:84 , srv318846155:84 , srv325461900:84 , srv339815053:84 , srv343856696:84 , srv346615577:84 , srv348794215:84 , srv355837257:84 , srv40097842:84 , srv420865150:84 , srv422525419:84 , srv449100416:84 , srv462030131:84 , srv466900625:84 , srv484198237:84 , srv528536188:84 , srv531404946:84 , srv53756392:84 , srv62821846:84 , srv715315293:84 , srv718770530:84 , srv789114163:84 , srv831893074:84 , srv898837117:84 , srv917130662:84 , srv98849538:84 , srv996063184:84 , srv1127243840:85 , srv1268038890:85 , srv1307853632:85 , srv1555364806:85 , srv679881841:85 , srv762503609:85 , srv814339993:85 , srv824384250:85 , srv1780699720:684 }
2023-04-23 05:55:49,260 INFO  [Time-limited test] hbase.ResourceChecker(175): after: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnLargeClusterWithRacks Thread=10 (was 10), OpenFileDescriptor=260 (was 260), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=384 (was 384), ProcessCount=169 (was 169), AvailableMemoryMB=12663 (was 13142)
2023-04-23 05:55:49,268 INFO  [Time-limited test] hbase.ResourceChecker(147): before: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnMidClusterWithRacks Thread=10, OpenFileDescriptor=260, MaxFileDescriptor=60000, SystemLoadAverage=384, ProcessCount=169, AvailableMemoryMB=12663
2023-04-23 05:55:49,269 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2023-04-23 05:55:49,269 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=5000, runMaxSteps=true, stepsPerRegion=800, maxRunningTime=120000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 111077.0 etc.
2023-04-23 05:55:49,281 INFO  [Time-limited test] balancer.BalancerTestBase(547): Mock Cluster : { srv1022498377:84 , srv1097070278:84 , srv1139878121:84 , srv1200757511:84 , srv1286425400:84 , srv1297221862:84 , srv134604717:84 , srv1358529909:84 , srv1509817208:84 , srv1654080291:84 , srv1656925015:84 , srv167202356:84 , srv1694503531:84 , srv1806082413:84 , srv1850581608:84 , srv1852758042:84 , srv1987616539:84 , srv2093291431:84 , srv2108834496:84 , srv242278122:84 , srv298036453:84 , srv336713962:84 , srv516511797:84 , srv560081487:84 , srv566840077:84 , srv808654953:84 , srv815280641:84 , srv858875903:84 , srv880392791:84 , srv939086691:264 } [srvr=30 rgns=2700 avg=90.0 max=90 min=90]
2023-04-23 05:55:49,283 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-04-23 05:55:49,283 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv134604717=6, srv1286425400=4, srv1850581608=14, srv566840077=24, srv1022498377=0, srv2108834496=18, srv336713962=21, srv1297221862=5, srv1654080291=9, srv2093291431=17, srv858875903=27, srv1852758042=15, srv242278122=19, srv1806082413=13, srv1358529909=7, srv939086691=29, srv1200757511=3, srv1694503531=12, srv167202356=11, srv1987616539=16, srv560081487=23, srv1139878121=2, srv516511797=22, srv1509817208=8, srv298036453=20, srv815280641=26, srv1656925015=10, srv880392791=28, srv1097070278=1, srv808654953=25} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-04-23 05:55:49,296 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-04-23 05:55:49,297 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-04-23 05:55:49,297 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-04-23 05:55:49,297 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-04-23 05:55:49,297 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-04-23 05:55:49,297 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-04-23 05:55:49,297 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-04-23 05:55:49,297 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-04-23 05:55:49,297 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-04-23 05:55:49,297 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-04-23 05:55:49,297 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-04-23 05:55:49,297 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-04-23 05:55:49,298 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-04-23 05:55:49,298 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-04-23 05:55:49,298 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-04-23 05:55:49,298 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-04-23 05:55:49,298 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-04-23 05:55:49,298 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-04-23 05:55:49,298 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-04-23 05:55:49,298 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-04-23 05:55:49,298 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-04-23 05:55:49,298 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-04-23 05:55:49,298 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-04-23 05:55:49,298 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-04-23 05:55:49,298 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-04-23 05:55:49,299 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-04-23 05:55:49,299 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-04-23 05:55:49,299 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-04-23 05:55:49,299 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-04-23 05:55:49,299 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-04-23 05:55:49,299 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=10, number of hosts=30, number of racks=4
2023-04-23 05:55:49,325 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=1.1235847017263871, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-04-23 05:55:49,326 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.9912582454624007, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=1.1235847017263871, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=64800000
2023-04-23 05:57:49,303 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 120001 ms to try 6250399 different iterations.  Found a solution that moves 1861 regions; Going from a computed imbalance of 0.9912582454624007 to a new imbalance of 4.3436668390529226E-5. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); MoveCostFunction : (multiplier=7.0, imbalance=0.6892592592592592, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-04-23 05:57:49,311 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1022498377:90 , srv1097070278:90 , srv1139878121:90 , srv1200757511:90 , srv1286425400:90 , srv1297221862:90 , srv134604717:90 , srv1358529909:90 , srv1509817208:90 , srv1654080291:90 , srv1656925015:90 , srv167202356:90 , srv1694503531:90 , srv1806082413:90 , srv1850581608:90 , srv1852758042:90 , srv1987616539:90 , srv2093291431:90 , srv2108834496:90 , srv242278122:90 , srv298036453:90 , srv336713962:90 , srv516511797:90 , srv560081487:90 , srv566840077:90 , srv808654953:90 , srv815280641:90 , srv858875903:90 , srv880392791:90 , srv939086691:90 }
2023-04-23 05:57:49,312 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-04-23 05:57:49,312 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv134604717=6, srv1286425400=4, srv1850581608=14, srv566840077=24, srv1022498377=0, srv2108834496=18, srv336713962=21, srv1297221862=5, srv1654080291=9, srv2093291431=17, srv858875903=27, srv1852758042=15, srv242278122=19, srv1806082413=13, srv1358529909=7, srv939086691=29, srv1200757511=3, srv1694503531=12, srv167202356=11, srv1987616539=16, srv560081487=23, srv1139878121=2, srv516511797=22, srv1509817208=8, srv298036453=20, srv815280641=26, srv1656925015=10, srv880392791=28, srv1097070278=1, srv808654953=25} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-04-23 05:57:49,316 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-04-23 05:57:49,317 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-04-23 05:57:49,317 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-04-23 05:57:49,317 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-04-23 05:57:49,317 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-04-23 05:57:49,317 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-04-23 05:57:49,317 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-04-23 05:57:49,317 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-04-23 05:57:49,317 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-04-23 05:57:49,317 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-04-23 05:57:49,317 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-04-23 05:57:49,317 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-04-23 05:57:49,317 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-04-23 05:57:49,317 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-04-23 05:57:49,317 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-04-23 05:57:49,317 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-04-23 05:57:49,317 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-04-23 05:57:49,317 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-04-23 05:57:49,318 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-04-23 05:57:49,318 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-04-23 05:57:49,318 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-04-23 05:57:49,318 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-04-23 05:57:49,318 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-04-23 05:57:49,318 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-04-23 05:57:49,318 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-04-23 05:57:49,318 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-04-23 05:57:49,318 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-04-23 05:57:49,318 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-04-23 05:57:49,318 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-04-23 05:57:49,318 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-04-23 05:57:49,318 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=10, number of hosts=30, number of racks=4
2023-04-23 05:57:49,335 INFO  [Time-limited test] balancer.StochasticLoadBalancer(381): Cluster wide - skipping load balancing because weighted average imbalance=0.0 <= threshold(0.025). If you want more aggressive balancing, either lower hbase.master.balancer.stochastic.minCostNeedBalance from 0.025 or increase the relative multiplier(s) of the specific cost function(s). functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-04-23 05:57:49,335 INFO  [Time-limited test] balancer.BalancerTestBase(570): Mock Final balance: { srv1022498377:90 , srv1097070278:90 , srv1139878121:90 , srv1200757511:90 , srv1286425400:90 , srv1297221862:90 , srv134604717:90 , srv1358529909:90 , srv1509817208:90 , srv1654080291:90 , srv1656925015:90 , srv167202356:90 , srv1694503531:90 , srv1806082413:90 , srv1850581608:90 , srv1852758042:90 , srv1987616539:90 , srv2093291431:90 , srv2108834496:90 , srv242278122:90 , srv298036453:90 , srv336713962:90 , srv516511797:90 , srv560081487:90 , srv566840077:90 , srv808654953:90 , srv815280641:90 , srv858875903:90 , srv880392791:90 , srv939086691:90 }
2023-04-23 05:57:49,366 INFO  [Time-limited test] hbase.ResourceChecker(175): after: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnMidClusterWithRacks Thread=9 (was 10), OpenFileDescriptor=260 (was 260), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=280 (was 384), ProcessCount=169 (was 169), AvailableMemoryMB=12802 (was 12663) - AvailableMemoryMB LEAK? -