2023-08-23 22:55:47,097 INFO  [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks timeout: 13 mins
2023-08-23 22:55:47,423 WARN  [Time-limited test] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties
2023-08-23 22:55:47,539 INFO  [Time-limited test] metrics.MetricRegistriesLoader(60): Loaded MetricRegistries class org.apache.hadoop.hbase.metrics.impl.MetricRegistriesImpl
2023-08-23 22:55:47,603 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2023-08-23 22:55:47,613 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc.
2023-08-23 22:55:47,629 INFO  [Time-limited test] hbase.ResourceChecker(147): before: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnLargeClusterWithRacks Thread=12, OpenFileDescriptor=263, MaxFileDescriptor=60000, SystemLoadAverage=312, ProcessCount=169, AvailableMemoryMB=11833
2023-08-23 22:55:47,632 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2023-08-23 22:55:47,633 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=5000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=10000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc.
2023-08-23 22:55:47,793 INFO  [Time-limited test] balancer.BalancerTestBase(547): Mock Cluster : { srv1023815566:84 , srv1027139054:84 , srv1038359181:84 , srv1059566590:84 , srv1085406824:84 , srv1096373330:84 , srv1097690099:84 , srv1098943159:84 , srv1134736184:84 , srv1144813794:84 , srv1199818596:84 , srv1270988904:84 , srv1289453440:84 , srv1289545133:84 , srv13263276:84 , srv13418176:84 , srv1352900412:84 , srv1354547606:84 , srv1393963221:84 , srv1421165452:84 , srv1439514699:84 , srv1490793488:84 , srv1529331050:84 , srv1584753008:84 , srv1634923169:84 , srv1648976984:84 , srv1653195279:84 , srv167285686:84 , srv1686222:84 , srv1692028456:84 , srv1697455958:84 , srv1698266601:84 , srv1745246379:84 , srv1745418450:84 , srv1746951258:84 , srv1781592123:84 , srv1781673427:84 , srv1783328331:84 , srv1800590816:84 , srv1803027944:84 , srv1873045059:84 , srv1883019472:84 , srv1911104942:84 , srv1918986432:84 , srv1931928958:84 , srv1961847409:84 , srv2004543136:84 , srv2028149425:84 , srv2040031417:84 , srv2044495558:84 , srv2058399651:84 , srv2067428655:84 , srv2087335274:84 , srv2090576560:84 , srv2125812911:84 , srv2145848754:84 , srv320734443:84 , srv338095512:84 , srv343631556:84 , srv364183404:84 , srv373865801:84 , srv380982191:84 , srv44989397:84 , srv457668682:84 , srv467895016:84 , srv48948841:84 , srv493371999:84 , srv507667217:84 , srv547452695:84 , srv561289922:84 , srv56860117:84 , srv587205471:84 , srv604122050:84 , srv624315435:84 , srv64049580:84 , srv656055391:84 , srv666793146:84 , srv676009253:84 , srv68251511:84 , srv68907974:84 , srv725116844:84 , srv749714223:84 , srv754157505:84 , srv772876783:84 , srv80237613:84 , srv811128928:84 , srv813330022:84 , srv844383219:84 , srv845707326:84 , srv853816035:84 , srv8545920:84 , srv915321608:84 , srv939047500:84 , srv960182200:84 , srv96082152:84 , srv972532891:84 , srv980013021:84 , srv988403868:84 , srv994710165:84 , srv556405799:684 } [srvr=100 rgns=9000 avg=90.0 max=90 min=90]
2023-08-23 22:55:47,803 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-08-23 22:55:47,809 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1393963221=18, srv2028149425=47, srv2067428655=51, srv364183404=59, srv1289545133=13, srv13263276=14, srv994710165=99, srv1918986432=43, srv1270988904=11, srv853816035=90, srv1354547606=17, srv1584753008=23, srv1289453440=12, srv749714223=82, srv1134736184=8, srv2004543136=46, srv845707326=89, srv980013021=97, srv754157505=83, srv2044495558=49, srv666793146=77, srv1085406824=4, srv1873045059=40, srv813330022=87, srv44989397=62, srv725116844=81, srv1746951258=34, srv1803027944=39, srv2125812911=54, srv1439514699=20, srv915321608=92, srv64049580=75, srv80237613=85, srv972532891=96, srv13418176=15, srv1352900412=16, srv988403868=98, srv1800590816=38, srv547452695=68, srv844383219=88, srv8545920=91, srv1421165452=19, srv1097690099=6, srv1745246379=32, srv68251511=79, srv960182200=94, srv56860117=71, srv338095512=57, srv507667217=67, srv2058399651=50, srv1529331050=22, srv1697455958=30, srv604122050=73, srv1781673427=36, srv561289922=70, srv1931928958=44, srv1698266601=31, srv1199818596=10, srv772876783=84, srv1490793488=21, srv343631556=58, srv1059566590=3, srv1648976984=25, srv1745418450=33, srv587205471=72, srv1144813794=9, srv1634923169=24, srv1098943159=7, srv656055391=76, srv676009253=78, srv380982191=61, srv1783328331=37, srv1961847409=45, srv2040031417=48, srv467895016=64, srv96082152=95, srv320734443=56, srv48948841=65, srv457668682=63, srv1023815566=0, srv2090576560=53, srv1096373330=5, srv1027139054=1, srv167285686=27, srv2145848754=55, srv939047500=93, srv1911104942=42, srv1653195279=26, srv68907974=80, srv1781592123=35, srv373865801=60, srv1038359181=2, srv493371999=66, srv1692028456=29, srv1883019472=41, srv556405799=69, srv811128928=86, srv2087335274=52, srv1686222=28, srv624315435=74} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-08-23 22:55:47,907 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-08-23 22:55:47,907 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-08-23 22:55:47,907 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-08-23 22:55:47,907 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-08-23 22:55:47,907 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-08-23 22:55:47,908 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-08-23 22:55:47,908 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-08-23 22:55:47,908 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-08-23 22:55:47,908 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-08-23 22:55:47,908 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-08-23 22:55:47,908 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-08-23 22:55:47,908 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-08-23 22:55:47,909 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-08-23 22:55:47,909 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-08-23 22:55:47,909 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-08-23 22:55:47,909 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-08-23 22:55:47,909 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-08-23 22:55:47,910 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-08-23 22:55:47,910 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-08-23 22:55:47,910 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-08-23 22:55:47,910 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-08-23 22:55:47,910 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-08-23 22:55:47,910 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-08-23 22:55:47,911 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-08-23 22:55:47,911 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-08-23 22:55:47,911 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-08-23 22:55:47,911 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-08-23 22:55:47,911 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-08-23 22:55:47,911 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-08-23 22:55:47,911 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-08-23 22:55:47,912 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-08-23 22:55:47,912 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-08-23 22:55:47,912 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-08-23 22:55:47,912 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-08-23 22:55:47,912 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-08-23 22:55:47,912 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-08-23 22:55:47,913 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-08-23 22:55:47,913 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-08-23 22:55:47,913 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-08-23 22:55:47,913 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-08-23 22:55:47,913 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-08-23 22:55:47,914 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-08-23 22:55:47,914 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-08-23 22:55:47,914 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-08-23 22:55:47,914 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-08-23 22:55:47,914 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-08-23 22:55:47,914 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-08-23 22:55:47,914 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-08-23 22:55:47,915 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-08-23 22:55:47,915 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-08-23 22:55:47,915 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-08-23 22:55:47,915 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-08-23 22:55:47,915 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-08-23 22:55:47,915 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-08-23 22:55:47,915 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-08-23 22:55:47,916 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-08-23 22:55:47,916 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-08-23 22:55:47,916 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-08-23 22:55:47,916 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-08-23 22:55:47,916 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-08-23 22:55:47,916 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-08-23 22:55:47,916 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-08-23 22:55:47,917 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-08-23 22:55:47,917 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-08-23 22:55:47,917 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-08-23 22:55:47,917 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-08-23 22:55:47,917 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-08-23 22:55:47,917 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-08-23 22:55:47,917 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-08-23 22:55:47,918 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-08-23 22:55:47,918 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-08-23 22:55:47,918 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-08-23 22:55:47,918 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-08-23 22:55:47,918 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-08-23 22:55:47,918 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-08-23 22:55:47,918 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-08-23 22:55:47,919 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-08-23 22:55:47,919 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-08-23 22:55:47,919 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-08-23 22:55:47,919 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-08-23 22:55:47,919 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-08-23 22:55:47,919 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-08-23 22:55:47,919 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-08-23 22:55:47,920 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-08-23 22:55:47,920 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-08-23 22:55:47,920 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-08-23 22:55:47,920 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-08-23 22:55:47,920 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-08-23 22:55:47,920 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-08-23 22:55:47,920 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-08-23 22:55:47,920 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-08-23 22:55:47,921 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-08-23 22:55:47,921 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-08-23 22:55:47,921 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-08-23 22:55:47,921 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-08-23 22:55:47,922 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-08-23 22:55:47,922 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-08-23 22:55:47,922 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-08-23 22:55:47,922 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-08-23 22:55:47,922 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-08-23 22:55:47,922 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-08-23 22:55:48,320 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.06666666666666667, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-08-23 22:55:48,321 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-08-23 22:55:48,321 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.9909252140407105, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.06666666666666667, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-08-23 22:55:48,681 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 728 ms to try 5000 different iterations.  Found a solution that moves 4652 regions; Going from a computed imbalance of 0.9909252140407105 to a new imbalance of 0.18262227912799722. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.038374179185139363, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.05863964789521653, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.5168888888888888, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.038374179185139363, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.17775, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.24566666666666667, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-08-23 22:55:48,704 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1393963221:82 , srv1745246379:82 , srv1781673427:82 , srv2067428655:82 , srv2087335274:83 , srv320734443:83 , srv343631556:83 , srv467895016:83 , srv1059566590:84 , srv1911104942:84 , srv2058399651:84 , srv373865801:84 , srv68251511:84 , srv725116844:84 , srv960182200:84 , srv1096373330:85 , srv1097690099:85 , srv1289453440:85 , srv13263276:85 , srv1352900412:85 , srv1490793488:85 , srv167285686:85 , srv1686222:85 , srv1698266601:85 , srv1745418450:85 , srv1781592123:85 , srv1803027944:85 , srv1873045059:85 , srv2040031417:85 , srv44989397:85 , srv457668682:85 , srv48948841:85 , srv624315435:85 , srv64049580:85 , srv844383219:85 , srv8545920:85 , srv994710165:85 , srv1027139054:86 , srv1199818596:86 , srv13418176:86 , srv1634923169:86 , srv1648976984:86 , srv1697455958:86 , srv1783328331:86 , srv1918986432:86 , srv1961847409:86 , srv2125812911:86 , srv2145848754:86 , srv507667217:86 , srv56860117:86 , srv68907974:86 , srv749714223:86 , srv754157505:86 , srv811128928:86 , srv813330022:86 , srv853816035:86 , srv939047500:86 , srv96082152:86 , srv972532891:86 , srv1023815566:87 , srv1584753008:87 , srv1746951258:87 , srv2004543136:87 , srv2090576560:87 , srv338095512:87 , srv493371999:87 , srv547452695:87 , srv587205471:87 , srv656055391:87 , srv845707326:87 , srv1038359181:88 , srv1085406824:88 , srv1098943159:88 , srv1144813794:88 , srv1270988904:88 , srv1289545133:88 , srv1692028456:88 , srv1883019472:88 , srv380982191:88 , srv915321608:88 , srv980013021:88 , srv1421165452:89 , srv2028149425:89 , srv2044495558:89 , srv772876783:89 , srv988403868:89 , srv1134736184:90 , srv1439514699:90 , srv561289922:90 , srv1354547606:91 , srv1529331050:91 , srv1800590816:91 , srv1931928958:91 , srv364183404:91 , srv676009253:91 , srv1653195279:92 , srv604122050:93 , srv666793146:94 , srv80237613:94 , srv556405799:431 }
2023-08-23 22:55:48,708 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-08-23 22:55:48,709 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1393963221=18, srv2028149425=47, srv2067428655=51, srv364183404=59, srv1289545133=13, srv13263276=14, srv994710165=99, srv1918986432=43, srv1270988904=11, srv853816035=90, srv1354547606=17, srv1584753008=23, srv1289453440=12, srv749714223=82, srv1134736184=8, srv2004543136=46, srv845707326=89, srv980013021=97, srv754157505=83, srv2044495558=49, srv666793146=77, srv1085406824=4, srv1873045059=40, srv813330022=87, srv44989397=62, srv725116844=81, srv1746951258=34, srv1803027944=39, srv2125812911=54, srv1439514699=20, srv915321608=92, srv64049580=75, srv80237613=85, srv972532891=96, srv13418176=15, srv1352900412=16, srv988403868=98, srv1800590816=38, srv547452695=68, srv844383219=88, srv8545920=91, srv1421165452=19, srv1097690099=6, srv1745246379=32, srv68251511=79, srv960182200=94, srv56860117=71, srv338095512=57, srv507667217=67, srv2058399651=50, srv1529331050=22, srv1697455958=30, srv604122050=73, srv1781673427=36, srv561289922=70, srv1931928958=44, srv1698266601=31, srv1199818596=10, srv772876783=84, srv1490793488=21, srv343631556=58, srv1059566590=3, srv1648976984=25, srv1745418450=33, srv587205471=72, srv1144813794=9, srv1634923169=24, srv1098943159=7, srv656055391=76, srv676009253=78, srv380982191=61, srv1783328331=37, srv1961847409=45, srv2040031417=48, srv467895016=64, srv96082152=95, srv320734443=56, srv48948841=65, srv457668682=63, srv1023815566=0, srv2090576560=53, srv1096373330=5, srv1027139054=1, srv167285686=27, srv2145848754=55, srv939047500=93, srv1911104942=42, srv1653195279=26, srv68907974=80, srv1781592123=35, srv373865801=60, srv1038359181=2, srv493371999=66, srv1692028456=29, srv1883019472=41, srv556405799=69, srv811128928=86, srv2087335274=52, srv1686222=28, srv624315435=74} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-08-23 22:55:48,728 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-08-23 22:55:48,729 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-08-23 22:55:48,729 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-08-23 22:55:48,729 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-08-23 22:55:48,729 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-08-23 22:55:48,729 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-08-23 22:55:48,729 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-08-23 22:55:48,730 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-08-23 22:55:48,730 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-08-23 22:55:48,730 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-08-23 22:55:48,730 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-08-23 22:55:48,730 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-08-23 22:55:48,730 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-08-23 22:55:48,730 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-08-23 22:55:48,731 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-08-23 22:55:48,731 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-08-23 22:55:48,731 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-08-23 22:55:48,731 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-08-23 22:55:48,731 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-08-23 22:55:48,731 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-08-23 22:55:48,731 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-08-23 22:55:48,732 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-08-23 22:55:48,732 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-08-23 22:55:48,732 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-08-23 22:55:48,732 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-08-23 22:55:48,732 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-08-23 22:55:48,732 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-08-23 22:55:48,732 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-08-23 22:55:48,732 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-08-23 22:55:48,733 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-08-23 22:55:48,733 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-08-23 22:55:48,733 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-08-23 22:55:48,733 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-08-23 22:55:48,733 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-08-23 22:55:48,733 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-08-23 22:55:48,733 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-08-23 22:55:48,733 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-08-23 22:55:48,734 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-08-23 22:55:48,734 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-08-23 22:55:48,734 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-08-23 22:55:48,734 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-08-23 22:55:48,734 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-08-23 22:55:48,734 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-08-23 22:55:48,734 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-08-23 22:55:48,734 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-08-23 22:55:48,735 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-08-23 22:55:48,735 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-08-23 22:55:48,735 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-08-23 22:55:48,735 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-08-23 22:55:48,735 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-08-23 22:55:48,735 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-08-23 22:55:48,735 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-08-23 22:55:48,735 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-08-23 22:55:48,736 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-08-23 22:55:48,736 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-08-23 22:55:48,736 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-08-23 22:55:48,736 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-08-23 22:55:48,736 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-08-23 22:55:48,736 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-08-23 22:55:48,736 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-08-23 22:55:48,736 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-08-23 22:55:48,736 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-08-23 22:55:48,737 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-08-23 22:55:48,737 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-08-23 22:55:48,737 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-08-23 22:55:48,737 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-08-23 22:55:48,737 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-08-23 22:55:48,737 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-08-23 22:55:48,737 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-08-23 22:55:48,737 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-08-23 22:55:48,738 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-08-23 22:55:48,738 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-08-23 22:55:48,738 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-08-23 22:55:48,738 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-08-23 22:55:48,738 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-08-23 22:55:48,738 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-08-23 22:55:48,738 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-08-23 22:55:48,738 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-08-23 22:55:48,738 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-08-23 22:55:48,738 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-08-23 22:55:48,738 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-08-23 22:55:48,738 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-08-23 22:55:48,738 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-08-23 22:55:48,739 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-08-23 22:55:48,739 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-08-23 22:55:48,739 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-08-23 22:55:48,739 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-08-23 22:55:48,739 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-08-23 22:55:48,739 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-08-23 22:55:48,739 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-08-23 22:55:48,739 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-08-23 22:55:48,739 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-08-23 22:55:48,739 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-08-23 22:55:48,739 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-08-23 22:55:48,739 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-08-23 22:55:48,739 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-08-23 22:55:48,739 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-08-23 22:55:48,739 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-08-23 22:55:48,740 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-08-23 22:55:48,740 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-08-23 22:55:48,740 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-08-23 22:55:48,873 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.038374179185139363, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.05863964789521653, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.038374179185139363, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.17775, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.24566666666666667, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-08-23 22:55:48,873 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-08-23 22:55:48,874 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.18258970512777914, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.038374179185139363, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.05863964789521653, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.038374179185139363, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.17775, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.24566666666666667, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-08-23 22:55:49,237 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 477 ms to try 5000 different iterations.  Found a solution that moves 2623 regions; Going from a computed imbalance of 0.18258970512777914 to a new imbalance of 0.015432515127311553. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.01980450658580945); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.033123921323732645, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.29144444444444445, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.01980450658580945); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.011916666666666667); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.04933333333333333, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-08-23 22:55:49,260 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv666793146:78 , srv80237613:78 , srv1653195279:79 , srv604122050:79 , srv1800590816:80 , srv1931928958:80 , srv1439514699:82 , srv1529331050:82 , srv364183404:82 , srv676009253:82 , srv772876783:82 , srv988403868:82 , srv1038359181:83 , srv1085406824:83 , srv1134736184:83 , srv1144813794:83 , srv1289545133:83 , srv1354547606:83 , srv2004543136:83 , srv493371999:83 , srv561289922:83 , srv1023815566:84 , srv1883019472:84 , srv2028149425:84 , srv380982191:84 , srv656055391:84 , srv915321608:84 , srv1027139054:85 , srv1098943159:85 , srv13263276:85 , srv1421165452:85 , srv1584753008:85 , srv1634923169:85 , srv1692028456:85 , srv1697455958:85 , srv1911104942:85 , srv68907974:85 , srv845707326:85 , srv853816035:85 , srv1096373330:86 , srv1270988904:86 , srv1289453440:86 , srv13418176:86 , srv1648976984:86 , srv1745418450:86 , srv1746951258:86 , srv1783328331:86 , srv2044495558:86 , srv2125812911:86 , srv44989397:86 , srv56860117:86 , srv587205471:86 , srv624315435:86 , srv8545920:86 , srv939047500:86 , srv972532891:86 , srv980013021:86 , srv994710165:86 , srv1059566590:87 , srv1097690099:87 , srv1686222:87 , srv1873045059:87 , srv1918986432:87 , srv1961847409:87 , srv2040031417:87 , srv2090576560:87 , srv2145848754:87 , srv457668682:87 , srv547452695:87 , srv754157505:87 , srv844383219:87 , srv960182200:87 , srv1199818596:88 , srv1352900412:88 , srv1490793488:88 , srv167285686:88 , srv1698266601:88 , srv1781592123:88 , srv2087335274:88 , srv320734443:88 , srv338095512:88 , srv467895016:88 , srv48948841:88 , srv64049580:88 , srv749714223:88 , srv813330022:88 , srv96082152:88 , srv1745246379:89 , srv1781673427:89 , srv1803027944:89 , srv2067428655:89 , srv343631556:89 , srv373865801:89 , srv507667217:89 , srv725116844:89 , srv811128928:89 , srv1393963221:90 , srv68251511:90 , srv2058399651:91 , srv556405799:519 }
2023-08-23 22:55:49,267 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-08-23 22:55:49,268 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1393963221=18, srv2028149425=47, srv2067428655=51, srv364183404=59, srv1289545133=13, srv13263276=14, srv994710165=99, srv1918986432=43, srv1270988904=11, srv853816035=90, srv1354547606=17, srv1584753008=23, srv1289453440=12, srv749714223=82, srv1134736184=8, srv2004543136=46, srv845707326=89, srv980013021=97, srv754157505=83, srv2044495558=49, srv666793146=77, srv1085406824=4, srv1873045059=40, srv813330022=87, srv44989397=62, srv725116844=81, srv1746951258=34, srv1803027944=39, srv2125812911=54, srv1439514699=20, srv915321608=92, srv64049580=75, srv80237613=85, srv972532891=96, srv13418176=15, srv1352900412=16, srv988403868=98, srv1800590816=38, srv547452695=68, srv844383219=88, srv8545920=91, srv1421165452=19, srv1097690099=6, srv1745246379=32, srv68251511=79, srv960182200=94, srv56860117=71, srv338095512=57, srv507667217=67, srv2058399651=50, srv1529331050=22, srv1697455958=30, srv604122050=73, srv1781673427=36, srv561289922=70, srv1931928958=44, srv1698266601=31, srv1199818596=10, srv772876783=84, srv1490793488=21, srv343631556=58, srv1059566590=3, srv1648976984=25, srv1745418450=33, srv587205471=72, srv1144813794=9, srv1634923169=24, srv1098943159=7, srv656055391=76, srv676009253=78, srv380982191=61, srv1783328331=37, srv1961847409=45, srv2040031417=48, srv467895016=64, srv96082152=95, srv320734443=56, srv48948841=65, srv457668682=63, srv1023815566=0, srv2090576560=53, srv1096373330=5, srv1027139054=1, srv167285686=27, srv2145848754=55, srv939047500=93, srv1911104942=42, srv1653195279=26, srv68907974=80, srv1781592123=35, srv373865801=60, srv1038359181=2, srv493371999=66, srv1692028456=29, srv1883019472=41, srv556405799=69, srv811128928=86, srv2087335274=52, srv1686222=28, srv624315435=74} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-08-23 22:55:49,288 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-08-23 22:55:49,288 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-08-23 22:55:49,288 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-08-23 22:55:49,288 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-08-23 22:55:49,288 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-08-23 22:55:49,288 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-08-23 22:55:49,288 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-08-23 22:55:49,288 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-08-23 22:55:49,289 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-08-23 22:55:49,289 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-08-23 22:55:49,289 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-08-23 22:55:49,289 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-08-23 22:55:49,289 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-08-23 22:55:49,289 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-08-23 22:55:49,289 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-08-23 22:55:49,289 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-08-23 22:55:49,289 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-08-23 22:55:49,289 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-08-23 22:55:49,290 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-08-23 22:55:49,290 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-08-23 22:55:49,290 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-08-23 22:55:49,290 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-08-23 22:55:49,290 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-08-23 22:55:49,290 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-08-23 22:55:49,290 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-08-23 22:55:49,290 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-08-23 22:55:49,290 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-08-23 22:55:49,291 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-08-23 22:55:49,291 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-08-23 22:55:49,291 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-08-23 22:55:49,291 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-08-23 22:55:49,291 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-08-23 22:55:49,291 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-08-23 22:55:49,291 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-08-23 22:55:49,292 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-08-23 22:55:49,292 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-08-23 22:55:49,292 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-08-23 22:55:49,292 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-08-23 22:55:49,292 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-08-23 22:55:49,292 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-08-23 22:55:49,292 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-08-23 22:55:49,292 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-08-23 22:55:49,292 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-08-23 22:55:49,292 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-08-23 22:55:49,293 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-08-23 22:55:49,293 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-08-23 22:55:49,293 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-08-23 22:55:49,293 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-08-23 22:55:49,293 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-08-23 22:55:49,293 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-08-23 22:55:49,293 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-08-23 22:55:49,293 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-08-23 22:55:49,293 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-08-23 22:55:49,293 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-08-23 22:55:49,294 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-08-23 22:55:49,294 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-08-23 22:55:49,294 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-08-23 22:55:49,294 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-08-23 22:55:49,294 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-08-23 22:55:49,294 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-08-23 22:55:49,294 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-08-23 22:55:49,294 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-08-23 22:55:49,294 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-08-23 22:55:49,295 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-08-23 22:55:49,295 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-08-23 22:55:49,295 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-08-23 22:55:49,295 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-08-23 22:55:49,295 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-08-23 22:55:49,295 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-08-23 22:55:49,295 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-08-23 22:55:49,295 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-08-23 22:55:49,295 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-08-23 22:55:49,295 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-08-23 22:55:49,295 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-08-23 22:55:49,296 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-08-23 22:55:49,296 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-08-23 22:55:49,296 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-08-23 22:55:49,296 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-08-23 22:55:49,296 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-08-23 22:55:49,296 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-08-23 22:55:49,296 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-08-23 22:55:49,296 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-08-23 22:55:49,296 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-08-23 22:55:49,296 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-08-23 22:55:49,296 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-08-23 22:55:49,296 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-08-23 22:55:49,297 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-08-23 22:55:49,297 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-08-23 22:55:49,297 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-08-23 22:55:49,297 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-08-23 22:55:49,297 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-08-23 22:55:49,297 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-08-23 22:55:49,297 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-08-23 22:55:49,297 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-08-23 22:55:49,298 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-08-23 22:55:49,298 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-08-23 22:55:49,298 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-08-23 22:55:49,298 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-08-23 22:55:49,298 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-08-23 22:55:49,298 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-08-23 22:55:49,298 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-08-23 22:55:49,423 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.01980450658580945); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.033123921323732645, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.01980450658580945); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.011916666666666667); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.04933333333333333, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-08-23 22:55:49,424 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-08-23 22:55:49,424 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.015414148488753518, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.01980450658580945); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.033123921323732645, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.01980450658580945); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.011916666666666667); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.04933333333333333, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-08-23 22:55:49,754 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 440 ms to try 5000 different iterations.  Found a solution that moves 1034 regions; Going from a computed imbalance of 0.015414148488753518 to a new imbalance of 8.509558501508437E-4. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.005322847904476634); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.01007268756550942); MoveCostFunction : (multiplier=7.0, imbalance=0.11488888888888889, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.005322847904476634); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=4.166666666666667E-4); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.004416666666666667); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-08-23 22:55:49,756 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv507667217:82 , srv1354547606:83 , srv1421165452:83 , srv1803027944:83 , srv2044495558:83 , srv68251511:83 , srv749714223:83 , srv811128928:83 , srv813330022:83 , srv980013021:83 , srv1199818596:84 , srv1270988904:84 , srv1352900412:84 , srv1490793488:84 , srv1529331050:84 , srv1781592123:84 , srv1961847409:84 , srv2028149425:84 , srv2058399651:84 , srv2090576560:84 , srv338095512:84 , srv364183404:84 , srv373865801:84 , srv547452695:84 , srv676009253:84 , srv96082152:84 , srv1097690099:85 , srv1098943159:85 , srv1134736184:85 , srv1439514699:85 , srv1648976984:85 , srv167285686:85 , srv1686222:85 , srv1692028456:85 , srv1746951258:85 , srv1783328331:85 , srv1873045059:85 , srv1918986432:85 , srv2040031417:85 , srv2125812911:85 , srv2145848754:85 , srv457668682:85 , srv48948841:85 , srv56860117:85 , srv604122050:85 , srv64049580:85 , srv725116844:85 , srv754157505:85 , srv845707326:85 , srv939047500:85 , srv972532891:85 , srv1023815566:86 , srv1027139054:86 , srv1038359181:86 , srv1059566590:86 , srv1085406824:86 , srv1144813794:86 , srv1289545133:86 , srv13418176:86 , srv1393963221:86 , srv1653195279:86 , srv1697455958:86 , srv1698266601:86 , srv1745246379:86 , srv1745418450:86 , srv1781673427:86 , srv1800590816:86 , srv1883019472:86 , srv1931928958:86 , srv2087335274:86 , srv320734443:86 , srv380982191:86 , srv467895016:86 , srv561289922:86 , srv587205471:86 , srv656055391:86 , srv666793146:86 , srv772876783:86 , srv80237613:86 , srv844383219:86 , srv8545920:86 , srv915321608:86 , srv988403868:86 , srv994710165:86 , srv1096373330:87 , srv1289453440:87 , srv1584753008:87 , srv1634923169:87 , srv2067428655:87 , srv343631556:87 , srv44989397:87 , srv493371999:87 , srv624315435:87 , srv853816035:87 , srv960182200:87 , srv13263276:88 , srv1911104942:88 , srv2004543136:88 , srv68907974:88 , srv556405799:555 }
2023-08-23 22:55:49,759 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-08-23 22:55:49,760 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1393963221=18, srv2028149425=47, srv2067428655=51, srv364183404=59, srv1289545133=13, srv13263276=14, srv994710165=99, srv1918986432=43, srv1270988904=11, srv853816035=90, srv1354547606=17, srv1584753008=23, srv1289453440=12, srv749714223=82, srv1134736184=8, srv2004543136=46, srv845707326=89, srv980013021=97, srv754157505=83, srv2044495558=49, srv666793146=77, srv1085406824=4, srv1873045059=40, srv813330022=87, srv44989397=62, srv725116844=81, srv1746951258=34, srv1803027944=39, srv2125812911=54, srv1439514699=20, srv915321608=92, srv64049580=75, srv80237613=85, srv972532891=96, srv13418176=15, srv1352900412=16, srv988403868=98, srv1800590816=38, srv547452695=68, srv844383219=88, srv8545920=91, srv1421165452=19, srv1097690099=6, srv1745246379=32, srv68251511=79, srv960182200=94, srv56860117=71, srv338095512=57, srv507667217=67, srv2058399651=50, srv1529331050=22, srv1697455958=30, srv604122050=73, srv1781673427=36, srv561289922=70, srv1931928958=44, srv1698266601=31, srv1199818596=10, srv772876783=84, srv1490793488=21, srv343631556=58, srv1059566590=3, srv1648976984=25, srv1745418450=33, srv587205471=72, srv1144813794=9, srv1634923169=24, srv1098943159=7, srv656055391=76, srv676009253=78, srv380982191=61, srv1783328331=37, srv1961847409=45, srv2040031417=48, srv467895016=64, srv96082152=95, srv320734443=56, srv48948841=65, srv457668682=63, srv1023815566=0, srv2090576560=53, srv1096373330=5, srv1027139054=1, srv167285686=27, srv2145848754=55, srv939047500=93, srv1911104942=42, srv1653195279=26, srv68907974=80, srv1781592123=35, srv373865801=60, srv1038359181=2, srv493371999=66, srv1692028456=29, srv1883019472=41, srv556405799=69, srv811128928=86, srv2087335274=52, srv1686222=28, srv624315435=74} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-08-23 22:55:49,776 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-08-23 22:55:49,776 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-08-23 22:55:49,776 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-08-23 22:55:49,776 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-08-23 22:55:49,776 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-08-23 22:55:49,776 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-08-23 22:55:49,776 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-08-23 22:55:49,777 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-08-23 22:55:49,777 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-08-23 22:55:49,777 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-08-23 22:55:49,777 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-08-23 22:55:49,777 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-08-23 22:55:49,777 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-08-23 22:55:49,777 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-08-23 22:55:49,777 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-08-23 22:55:49,777 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-08-23 22:55:49,777 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-08-23 22:55:49,777 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-08-23 22:55:49,777 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-08-23 22:55:49,777 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-08-23 22:55:49,777 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-08-23 22:55:49,778 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-08-23 22:55:49,778 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-08-23 22:55:49,778 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-08-23 22:55:49,778 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-08-23 22:55:49,778 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-08-23 22:55:49,778 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-08-23 22:55:49,778 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-08-23 22:55:49,778 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-08-23 22:55:49,778 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-08-23 22:55:49,778 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-08-23 22:55:49,778 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-08-23 22:55:49,778 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-08-23 22:55:49,778 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-08-23 22:55:49,778 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-08-23 22:55:49,778 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-08-23 22:55:49,778 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-08-23 22:55:49,779 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-08-23 22:55:49,779 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-08-23 22:55:49,779 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-08-23 22:55:49,779 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-08-23 22:55:49,779 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-08-23 22:55:49,779 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-08-23 22:55:49,779 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-08-23 22:55:49,779 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-08-23 22:55:49,779 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-08-23 22:55:49,779 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-08-23 22:55:49,779 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-08-23 22:55:49,779 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-08-23 22:55:49,779 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-08-23 22:55:49,779 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-08-23 22:55:49,780 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-08-23 22:55:49,780 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-08-23 22:55:49,780 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-08-23 22:55:49,780 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-08-23 22:55:49,780 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-08-23 22:55:49,780 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-08-23 22:55:49,780 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-08-23 22:55:49,780 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-08-23 22:55:49,780 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-08-23 22:55:49,780 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-08-23 22:55:49,780 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-08-23 22:55:49,780 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-08-23 22:55:49,780 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-08-23 22:55:49,780 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-08-23 22:55:49,780 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-08-23 22:55:49,780 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-08-23 22:55:49,780 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-08-23 22:55:49,781 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-08-23 22:55:49,781 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-08-23 22:55:49,781 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-08-23 22:55:49,781 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-08-23 22:55:49,781 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-08-23 22:55:49,781 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-08-23 22:55:49,781 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-08-23 22:55:49,781 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-08-23 22:55:49,781 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-08-23 22:55:49,781 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-08-23 22:55:49,781 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-08-23 22:55:49,781 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-08-23 22:55:49,781 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-08-23 22:55:49,781 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-08-23 22:55:49,781 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-08-23 22:55:49,781 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-08-23 22:55:49,781 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-08-23 22:55:49,782 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-08-23 22:55:49,782 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-08-23 22:55:49,782 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-08-23 22:55:49,782 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-08-23 22:55:49,782 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-08-23 22:55:49,782 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-08-23 22:55:49,782 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-08-23 22:55:49,782 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-08-23 22:55:49,782 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-08-23 22:55:49,782 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-08-23 22:55:49,782 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-08-23 22:55:49,782 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-08-23 22:55:49,782 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-08-23 22:55:49,782 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-08-23 22:55:49,782 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-08-23 22:55:49,782 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-08-23 22:55:49,911 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.005322847904476634); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.01007268756550942); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.005322847904476634); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=4.166666666666667E-4); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.004416666666666667); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-08-23 22:55:49,911 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-08-23 22:55:49,912 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=8.4371562740246E-4, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.005322847904476634); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.01007268756550942); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.005322847904476634); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=4.166666666666667E-4); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.004416666666666667); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-08-23 22:55:50,208 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 412 ms to try 5000 different iterations.  Found a solution that moves 290 regions; Going from a computed imbalance of 8.4371562740246E-4 to a new imbalance of 2.1593269212336127E-5. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=5.23782800878924E-4); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.002118805753879094); MoveCostFunction : (multiplier=7.0, imbalance=0.03222222222222222, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=5.23782800878924E-4); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=8.333333333333333E-5); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-08-23 22:55:50,209 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1289453440:83 , srv1692028456:83 , srv1698266601:83 , srv338095512:83 , srv561289922:83 , srv587205471:83 , srv68907974:83 , srv1085406824:84 , srv1096373330:84 , srv1098943159:84 , srv1134736184:84 , srv1199818596:84 , srv1270988904:84 , srv13263276:84 , srv13418176:84 , srv1393963221:84 , srv1490793488:84 , srv1584753008:84 , srv1634923169:84 , srv1648976984:84 , srv167285686:84 , srv1746951258:84 , srv1783328331:84 , srv1883019472:84 , srv1911104942:84 , srv1918986432:84 , srv1961847409:84 , srv2004543136:84 , srv2044495558:84 , srv2058399651:84 , srv2067428655:84 , srv2090576560:84 , srv2125812911:84 , srv2145848754:84 , srv343631556:84 , srv380982191:84 , srv44989397:84 , srv48948841:84 , srv547452695:84 , srv604122050:84 , srv624315435:84 , srv64049580:84 , srv666793146:84 , srv725116844:84 , srv754157505:84 , srv80237613:84 , srv844383219:84 , srv853816035:84 , srv96082152:84 , srv980013021:84 , srv1023815566:85 , srv1027139054:85 , srv1038359181:85 , srv1059566590:85 , srv1097690099:85 , srv1144813794:85 , srv1289545133:85 , srv1352900412:85 , srv1354547606:85 , srv1421165452:85 , srv1439514699:85 , srv1529331050:85 , srv1686222:85 , srv1697455958:85 , srv1745246379:85 , srv1745418450:85 , srv1781592123:85 , srv1781673427:85 , srv1800590816:85 , srv1873045059:85 , srv1931928958:85 , srv2028149425:85 , srv2040031417:85 , srv2087335274:85 , srv320734443:85 , srv364183404:85 , srv373865801:85 , srv457668682:85 , srv467895016:85 , srv493371999:85 , srv507667217:85 , srv656055391:85 , srv676009253:85 , srv68251511:85 , srv772876783:85 , srv811128928:85 , srv813330022:85 , srv845707326:85 , srv915321608:85 , srv939047500:85 , srv960182200:85 , srv972532891:85 , srv988403868:85 , srv994710165:85 , srv1653195279:86 , srv1803027944:86 , srv56860117:86 , srv749714223:86 , srv8545920:86 , srv556405799:637 }
2023-08-23 22:55:50,213 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-08-23 22:55:50,213 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1393963221=18, srv2028149425=47, srv2067428655=51, srv364183404=59, srv1289545133=13, srv13263276=14, srv994710165=99, srv1918986432=43, srv1270988904=11, srv853816035=90, srv1354547606=17, srv1584753008=23, srv1289453440=12, srv749714223=82, srv1134736184=8, srv2004543136=46, srv845707326=89, srv980013021=97, srv754157505=83, srv2044495558=49, srv666793146=77, srv1085406824=4, srv1873045059=40, srv813330022=87, srv44989397=62, srv725116844=81, srv1746951258=34, srv1803027944=39, srv2125812911=54, srv1439514699=20, srv915321608=92, srv64049580=75, srv80237613=85, srv972532891=96, srv13418176=15, srv1352900412=16, srv988403868=98, srv1800590816=38, srv547452695=68, srv844383219=88, srv8545920=91, srv1421165452=19, srv1097690099=6, srv1745246379=32, srv68251511=79, srv960182200=94, srv56860117=71, srv338095512=57, srv507667217=67, srv2058399651=50, srv1529331050=22, srv1697455958=30, srv604122050=73, srv1781673427=36, srv561289922=70, srv1931928958=44, srv1698266601=31, srv1199818596=10, srv772876783=84, srv1490793488=21, srv343631556=58, srv1059566590=3, srv1648976984=25, srv1745418450=33, srv587205471=72, srv1144813794=9, srv1634923169=24, srv1098943159=7, srv656055391=76, srv676009253=78, srv380982191=61, srv1783328331=37, srv1961847409=45, srv2040031417=48, srv467895016=64, srv96082152=95, srv320734443=56, srv48948841=65, srv457668682=63, srv1023815566=0, srv2090576560=53, srv1096373330=5, srv1027139054=1, srv167285686=27, srv2145848754=55, srv939047500=93, srv1911104942=42, srv1653195279=26, srv68907974=80, srv1781592123=35, srv373865801=60, srv1038359181=2, srv493371999=66, srv1692028456=29, srv1883019472=41, srv556405799=69, srv811128928=86, srv2087335274=52, srv1686222=28, srv624315435=74} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-08-23 22:55:50,224 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-08-23 22:55:50,224 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-08-23 22:55:50,224 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-08-23 22:55:50,224 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-08-23 22:55:50,224 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-08-23 22:55:50,224 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-08-23 22:55:50,224 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-08-23 22:55:50,224 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-08-23 22:55:50,224 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-08-23 22:55:50,224 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-08-23 22:55:50,224 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-08-23 22:55:50,224 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-08-23 22:55:50,224 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-08-23 22:55:50,224 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-08-23 22:55:50,224 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-08-23 22:55:50,224 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-08-23 22:55:50,225 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-08-23 22:55:50,225 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-08-23 22:55:50,225 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-08-23 22:55:50,225 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-08-23 22:55:50,225 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-08-23 22:55:50,225 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-08-23 22:55:50,225 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-08-23 22:55:50,225 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-08-23 22:55:50,225 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-08-23 22:55:50,225 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-08-23 22:55:50,225 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-08-23 22:55:50,225 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-08-23 22:55:50,225 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-08-23 22:55:50,225 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-08-23 22:55:50,225 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-08-23 22:55:50,225 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-08-23 22:55:50,225 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-08-23 22:55:50,225 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-08-23 22:55:50,225 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-08-23 22:55:50,225 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-08-23 22:55:50,226 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-08-23 22:55:50,226 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-08-23 22:55:50,226 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-08-23 22:55:50,226 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-08-23 22:55:50,226 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-08-23 22:55:50,226 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-08-23 22:55:50,226 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-08-23 22:55:50,226 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-08-23 22:55:50,226 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-08-23 22:55:50,226 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-08-23 22:55:50,226 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-08-23 22:55:50,226 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-08-23 22:55:50,226 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-08-23 22:55:50,226 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-08-23 22:55:50,226 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-08-23 22:55:50,226 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-08-23 22:55:50,226 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-08-23 22:55:50,226 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-08-23 22:55:50,226 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-08-23 22:55:50,227 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-08-23 22:55:50,227 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-08-23 22:55:50,227 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-08-23 22:55:50,227 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-08-23 22:55:50,227 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-08-23 22:55:50,227 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-08-23 22:55:50,227 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-08-23 22:55:50,227 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-08-23 22:55:50,227 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-08-23 22:55:50,227 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-08-23 22:55:50,227 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-08-23 22:55:50,227 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-08-23 22:55:50,227 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-08-23 22:55:50,227 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-08-23 22:55:50,227 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-08-23 22:55:50,227 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-08-23 22:55:50,227 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-08-23 22:55:50,228 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-08-23 22:55:50,228 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-08-23 22:55:50,228 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-08-23 22:55:50,228 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-08-23 22:55:50,228 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-08-23 22:55:50,228 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-08-23 22:55:50,228 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-08-23 22:55:50,228 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-08-23 22:55:50,228 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-08-23 22:55:50,228 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-08-23 22:55:50,228 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-08-23 22:55:50,228 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-08-23 22:55:50,228 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-08-23 22:55:50,228 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-08-23 22:55:50,228 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-08-23 22:55:50,228 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-08-23 22:55:50,228 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-08-23 22:55:50,228 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-08-23 22:55:50,229 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-08-23 22:55:50,229 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-08-23 22:55:50,229 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-08-23 22:55:50,229 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-08-23 22:55:50,229 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-08-23 22:55:50,229 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-08-23 22:55:50,229 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-08-23 22:55:50,229 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-08-23 22:55:50,229 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-08-23 22:55:50,229 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-08-23 22:55:50,229 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-08-23 22:55:50,335 INFO  [Time-limited test] balancer.StochasticLoadBalancer(381): Cluster wide - skipping load balancing because weighted average imbalance=1.9562645810951903E-5 <= threshold(0.025). If you want more aggressive balancing, either lower hbase.master.balancer.stochastic.minCostNeedBalance from 0.025 or increase the relative multiplier(s) of the specific cost function(s). functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=5.23782800878924E-4); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.002118805753879094); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=5.23782800878924E-4); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=8.333333333333333E-5); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-08-23 22:55:50,336 INFO  [Time-limited test] balancer.BalancerTestBase(570): Mock Final balance: { srv1289453440:83 , srv1692028456:83 , srv1698266601:83 , srv338095512:83 , srv561289922:83 , srv587205471:83 , srv68907974:83 , srv1085406824:84 , srv1096373330:84 , srv1098943159:84 , srv1134736184:84 , srv1199818596:84 , srv1270988904:84 , srv13263276:84 , srv13418176:84 , srv1393963221:84 , srv1490793488:84 , srv1584753008:84 , srv1634923169:84 , srv1648976984:84 , srv167285686:84 , srv1746951258:84 , srv1783328331:84 , srv1883019472:84 , srv1911104942:84 , srv1918986432:84 , srv1961847409:84 , srv2004543136:84 , srv2044495558:84 , srv2058399651:84 , srv2067428655:84 , srv2090576560:84 , srv2125812911:84 , srv2145848754:84 , srv343631556:84 , srv380982191:84 , srv44989397:84 , srv48948841:84 , srv547452695:84 , srv604122050:84 , srv624315435:84 , srv64049580:84 , srv666793146:84 , srv725116844:84 , srv754157505:84 , srv80237613:84 , srv844383219:84 , srv853816035:84 , srv96082152:84 , srv980013021:84 , srv1023815566:85 , srv1027139054:85 , srv1038359181:85 , srv1059566590:85 , srv1097690099:85 , srv1144813794:85 , srv1289545133:85 , srv1352900412:85 , srv1354547606:85 , srv1421165452:85 , srv1439514699:85 , srv1529331050:85 , srv1686222:85 , srv1697455958:85 , srv1745246379:85 , srv1745418450:85 , srv1781592123:85 , srv1781673427:85 , srv1800590816:85 , srv1873045059:85 , srv1931928958:85 , srv2028149425:85 , srv2040031417:85 , srv2087335274:85 , srv320734443:85 , srv364183404:85 , srv373865801:85 , srv457668682:85 , srv467895016:85 , srv493371999:85 , srv507667217:85 , srv656055391:85 , srv676009253:85 , srv68251511:85 , srv772876783:85 , srv811128928:85 , srv813330022:85 , srv845707326:85 , srv915321608:85 , srv939047500:85 , srv960182200:85 , srv972532891:85 , srv988403868:85 , srv994710165:85 , srv1653195279:86 , srv1803027944:86 , srv56860117:86 , srv749714223:86 , srv8545920:86 , srv556405799:637 }
2023-08-23 22:55:50,364 INFO  [Time-limited test] hbase.ResourceChecker(175): after: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnLargeClusterWithRacks Thread=12 (was 12), OpenFileDescriptor=263 (was 263), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=312 (was 312), ProcessCount=169 (was 169), AvailableMemoryMB=11142 (was 11833)
2023-08-23 22:55:50,382 INFO  [Time-limited test] hbase.ResourceChecker(147): before: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnMidClusterWithRacks Thread=12, OpenFileDescriptor=263, MaxFileDescriptor=60000, SystemLoadAverage=312, ProcessCount=169, AvailableMemoryMB=11139
2023-08-23 22:55:50,383 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2023-08-23 22:55:50,383 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=5000, runMaxSteps=true, stepsPerRegion=800, maxRunningTime=120000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 111077.0 etc.
2023-08-23 22:55:50,396 INFO  [Time-limited test] balancer.BalancerTestBase(547): Mock Cluster : { srv1080066899:84 , srv1131799423:84 , srv1202121748:84 , srv1213966066:84 , srv1242558624:84 , srv1332747216:84 , srv1453755270:84 , srv1514547179:84 , srv1561080945:84 , srv1577308715:84 , srv1740551388:84 , srv1742870642:84 , srv1754655719:84 , srv1799304778:84 , srv1819263674:84 , srv1878423670:84 , srv1998945518:84 , srv2024630565:84 , srv2045560825:84 , srv2084778878:84 , srv319480256:84 , srv45852971:84 , srv530704243:84 , srv719082515:84 , srv730697724:84 , srv749671621:84 , srv790593678:84 , srv798839900:84 , srv893149635:84 , srv889228590:264 } [srvr=30 rgns=2700 avg=90.0 max=90 min=90]
2023-08-23 22:55:50,398 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-08-23 22:55:50,399 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1878423670=15, srv1577308715=9, srv1998945518=16, srv1213966066=3, srv1242558624=4, srv319480256=20, srv893149635=29, srv719082515=23, srv2045560825=18, srv1202121748=2, srv1742870642=11, srv530704243=22, srv1080066899=0, srv889228590=28, srv2024630565=17, srv1332747216=5, srv1819263674=14, srv2084778878=19, srv45852971=21, srv1740551388=10, srv1561080945=8, srv1799304778=13, srv798839900=27, srv790593678=26, srv1754655719=12, srv1514547179=7, srv1131799423=1, srv1453755270=6, srv749671621=25, srv730697724=24} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-08-23 22:55:50,410 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-08-23 22:55:50,411 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-08-23 22:55:50,411 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-08-23 22:55:50,411 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-08-23 22:55:50,411 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-08-23 22:55:50,411 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-08-23 22:55:50,411 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-08-23 22:55:50,411 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-08-23 22:55:50,411 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-08-23 22:55:50,411 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-08-23 22:55:50,411 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-08-23 22:55:50,411 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-08-23 22:55:50,412 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-08-23 22:55:50,412 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-08-23 22:55:50,412 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-08-23 22:55:50,412 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-08-23 22:55:50,412 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-08-23 22:55:50,412 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-08-23 22:55:50,412 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-08-23 22:55:50,412 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-08-23 22:55:50,412 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-08-23 22:55:50,412 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-08-23 22:55:50,412 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-08-23 22:55:50,413 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-08-23 22:55:50,413 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-08-23 22:55:50,413 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-08-23 22:55:50,413 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-08-23 22:55:50,413 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-08-23 22:55:50,413 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-08-23 22:55:50,413 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-08-23 22:55:50,413 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=10, number of hosts=30, number of racks=4
2023-08-23 22:55:50,438 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=1.1390495920814803, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-08-23 22:55:50,439 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.9912631183988541, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=1.1390495920814803, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=64800000
2023-08-23 22:57:50,417 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 120001 ms to try 5698702 different iterations.  Found a solution that moves 1855 regions; Going from a computed imbalance of 0.9912631183988541 to a new imbalance of 4.329662539733032E-5. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); MoveCostFunction : (multiplier=7.0, imbalance=0.687037037037037, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-08-23 22:57:50,425 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1080066899:90 , srv1131799423:90 , srv1202121748:90 , srv1213966066:90 , srv1242558624:90 , srv1332747216:90 , srv1453755270:90 , srv1514547179:90 , srv1561080945:90 , srv1577308715:90 , srv1740551388:90 , srv1742870642:90 , srv1754655719:90 , srv1799304778:90 , srv1819263674:90 , srv1878423670:90 , srv1998945518:90 , srv2024630565:90 , srv2045560825:90 , srv2084778878:90 , srv319480256:90 , srv45852971:90 , srv530704243:90 , srv719082515:90 , srv730697724:90 , srv749671621:90 , srv790593678:90 , srv798839900:90 , srv889228590:90 , srv893149635:90 }
2023-08-23 22:57:50,426 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-08-23 22:57:50,426 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1878423670=15, srv1577308715=9, srv1998945518=16, srv1213966066=3, srv1242558624=4, srv319480256=20, srv893149635=29, srv719082515=23, srv2045560825=18, srv1202121748=2, srv1742870642=11, srv530704243=22, srv1080066899=0, srv889228590=28, srv2024630565=17, srv1332747216=5, srv1819263674=14, srv2084778878=19, srv45852971=21, srv1740551388=10, srv1561080945=8, srv1799304778=13, srv798839900=27, srv790593678=26, srv1754655719=12, srv1514547179=7, srv1131799423=1, srv1453755270=6, srv749671621=25, srv730697724=24} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-08-23 22:57:50,431 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-08-23 22:57:50,431 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-08-23 22:57:50,431 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-08-23 22:57:50,431 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-08-23 22:57:50,431 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-08-23 22:57:50,432 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-08-23 22:57:50,432 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-08-23 22:57:50,432 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-08-23 22:57:50,432 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-08-23 22:57:50,432 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-08-23 22:57:50,432 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-08-23 22:57:50,432 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-08-23 22:57:50,432 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-08-23 22:57:50,432 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-08-23 22:57:50,432 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-08-23 22:57:50,432 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-08-23 22:57:50,433 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-08-23 22:57:50,433 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-08-23 22:57:50,433 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-08-23 22:57:50,433 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-08-23 22:57:50,433 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-08-23 22:57:50,433 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-08-23 22:57:50,433 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-08-23 22:57:50,433 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-08-23 22:57:50,433 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-08-23 22:57:50,433 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-08-23 22:57:50,433 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-08-23 22:57:50,433 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-08-23 22:57:50,434 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-08-23 22:57:50,434 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-08-23 22:57:50,434 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=10, number of hosts=30, number of racks=4
2023-08-23 22:57:50,451 INFO  [Time-limited test] balancer.StochasticLoadBalancer(381): Cluster wide - skipping load balancing because weighted average imbalance=0.0 <= threshold(0.025). If you want more aggressive balancing, either lower hbase.master.balancer.stochastic.minCostNeedBalance from 0.025 or increase the relative multiplier(s) of the specific cost function(s). functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-08-23 22:57:50,451 INFO  [Time-limited test] balancer.BalancerTestBase(570): Mock Final balance: { srv1080066899:90 , srv1131799423:90 , srv1202121748:90 , srv1213966066:90 , srv1242558624:90 , srv1332747216:90 , srv1453755270:90 , srv1514547179:90 , srv1561080945:90 , srv1577308715:90 , srv1740551388:90 , srv1742870642:90 , srv1754655719:90 , srv1799304778:90 , srv1819263674:90 , srv1878423670:90 , srv1998945518:90 , srv2024630565:90 , srv2045560825:90 , srv2084778878:90 , srv319480256:90 , srv45852971:90 , srv530704243:90 , srv719082515:90 , srv730697724:90 , srv749671621:90 , srv790593678:90 , srv798839900:90 , srv889228590:90 , srv893149635:90 }
2023-08-23 22:57:50,465 INFO  [Time-limited test] hbase.ResourceChecker(175): after: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnMidClusterWithRacks Thread=11 (was 12), OpenFileDescriptor=263 (was 263), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=189 (was 312), ProcessCount=169 (was 169), AvailableMemoryMB=11147 (was 11139) - AvailableMemoryMB LEAK? -