2023-12-10 15:53:20,113 INFO  [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks timeout: 13 mins
2023-12-10 15:53:20,439 WARN  [Time-limited test] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties
2023-12-10 15:53:20,555 INFO  [Time-limited test] metrics.MetricRegistriesLoader(60): Loaded MetricRegistries class org.apache.hadoop.hbase.metrics.impl.MetricRegistriesImpl
2023-12-10 15:53:20,640 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2023-12-10 15:53:20,650 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc.
2023-12-10 15:53:20,667 INFO  [Time-limited test] hbase.ResourceChecker(147): before: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnLargeClusterWithRacks Thread=12, OpenFileDescriptor=290, MaxFileDescriptor=60000, SystemLoadAverage=286, ProcessCount=173, AvailableMemoryMB=6510
2023-12-10 15:53:20,670 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2023-12-10 15:53:20,671 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=5000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=10000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc.
2023-12-10 15:53:20,821 INFO  [Time-limited test] balancer.BalancerTestBase(547): Mock Cluster : { srv1030789244:84 , srv1041608304:84 , srv1042040828:84 , srv1070391365:84 , srv1127451662:84 , srv117036332:84 , srv1175201943:84 , srv1179910587:84 , srv121325334:84 , srv1218803811:84 , srv123606512:84 , srv1260538171:84 , srv1268378271:84 , srv1273906615:84 , srv1278319145:84 , srv1293706035:84 , srv1295528319:84 , srv131265496:84 , srv1314486302:84 , srv1316557161:84 , srv1335700566:84 , srv1376012747:84 , srv1377599948:84 , srv1385497299:84 , srv1438020455:84 , srv1462451997:84 , srv1475350070:84 , srv1515756087:84 , srv1527941842:84 , srv1568448712:84 , srv1592745673:84 , srv1593175173:84 , srv1613277915:84 , srv164300190:84 , srv1644927176:84 , srv164952921:84 , srv165949979:84 , srv1679161149:84 , srv1781249274:84 , srv1791106812:84 , srv1805652715:84 , srv1814791805:84 , srv1841998010:84 , srv1869482138:84 , srv1892436852:84 , srv1904395735:84 , srv1928871456:84 , srv1941228129:84 , srv2016769362:84 , srv2017080140:84 , srv2041373250:84 , srv2042498526:84 , srv2056273218:84 , srv2099816443:84 , srv2113204270:84 , srv2141523228:84 , srv241097471:84 , srv253241483:84 , srv26999868:84 , srv273317260:84 , srv278635436:84 , srv279951164:84 , srv306252567:84 , srv313777994:84 , srv318419589:84 , srv322036989:84 , srv370369846:84 , srv400987052:84 , srv407886678:84 , srv420029126:84 , srv428664377:84 , srv433650001:84 , srv44343933:84 , srv443489156:84 , srv495545065:84 , srv505276612:84 , srv517866986:84 , srv548022719:84 , srv564198608:84 , srv585143019:84 , srv638456708:84 , srv65804207:84 , srv682000468:84 , srv686617537:84 , srv69253450:84 , srv712874545:84 , srv723219938:84 , srv747745921:84 , srv764084782:84 , srv798999195:84 , srv827378286:84 , srv905322781:84 , srv912213849:84 , srv918023770:84 , srv918681707:84 , srv943402433:84 , srv982301411:84 , srv990052032:84 , srv999126065:84 , srv1057243169:684 } [srvr=100 rgns=9000 avg=90.0 max=90 min=90]
2023-12-10 15:53:20,834 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-12-10 15:53:20,844 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv65804207=82, srv1613277915=33, srv912213849=93, srv322036989=66, srv241097471=57, srv313777994=64, srv1278319145=15, srv1260538171=12, srv1295528319=17, srv164952921=36, srv1377599948=23, srv1928871456=47, srv278635436=61, srv517866986=77, srv123606512=11, srv1385497299=24, srv1070391365=4, srv1527941842=29, srv686617537=84, srv712874545=86, srv943402433=96, srv1335700566=21, srv1175201943=7, srv1679161149=38, srv905322781=92, srv318419589=65, srv370369846=67, srv1316557161=20, srv2042498526=52, srv999126065=99, srv253241483=58, srv982301411=97, srv1781249274=39, srv2017080140=50, srv2041373250=51, srv548022719=78, srv1568448712=30, srv407886678=69, srv1869482138=44, srv798999195=90, srv495545065=75, srv585143019=80, srv990052032=98, srv1042040828=2, srv26999868=59, srv443489156=74, srv420029126=70, srv1805652715=41, srv1293706035=16, srv1268378271=13, srv164300190=34, srv827378286=91, srv682000468=83, srv747745921=88, srv306252567=63, srv1475350070=27, srv2099816443=54, srv1904395735=46, srv1273906615=14, srv1515756087=28, srv2016769362=49, srv638456708=81, srv1179910587=8, srv764084782=89, srv279951164=62, srv1892436852=45, srv428664377=71, srv1376012747=22, srv918023770=94, srv564198608=79, srv1791106812=40, srv273317260=60, srv1127451662=5, srv1592745673=31, srv1593175173=32, srv165949979=37, srv400987052=68, srv723219938=87, srv2056273218=53, srv131265496=18, srv1462451997=26, srv1644927176=35, srv1814791805=42, srv2141523228=56, srv1314486302=19, srv117036332=6, srv44343933=73, srv1438020455=25, srv1841998010=43, srv69253450=85, srv1218803811=10, srv121325334=9, srv1041608304=1, srv1941228129=48, srv2113204270=55, srv505276612=76, srv1057243169=3, srv1030789244=0, srv433650001=72, srv918681707=95} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-12-10 15:53:20,920 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-12-10 15:53:20,921 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-12-10 15:53:20,921 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-12-10 15:53:20,921 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-12-10 15:53:20,921 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-12-10 15:53:20,921 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-12-10 15:53:20,921 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-12-10 15:53:20,921 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-12-10 15:53:20,921 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-12-10 15:53:20,921 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-12-10 15:53:20,921 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-12-10 15:53:20,921 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-12-10 15:53:20,922 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-12-10 15:53:20,922 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-12-10 15:53:20,922 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-12-10 15:53:20,922 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-12-10 15:53:20,922 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-12-10 15:53:20,922 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-12-10 15:53:20,922 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-12-10 15:53:20,922 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-12-10 15:53:20,922 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-12-10 15:53:20,922 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-12-10 15:53:20,922 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-12-10 15:53:20,923 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-12-10 15:53:20,923 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-12-10 15:53:20,923 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-12-10 15:53:20,923 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-12-10 15:53:20,923 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-12-10 15:53:20,923 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-12-10 15:53:20,923 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-12-10 15:53:20,923 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-12-10 15:53:20,923 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-12-10 15:53:20,923 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-12-10 15:53:20,923 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-12-10 15:53:20,924 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-12-10 15:53:20,924 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-12-10 15:53:20,924 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-12-10 15:53:20,924 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-12-10 15:53:20,924 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-12-10 15:53:20,924 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-12-10 15:53:20,924 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-12-10 15:53:20,924 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-12-10 15:53:20,924 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-12-10 15:53:20,924 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-12-10 15:53:20,924 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-12-10 15:53:20,925 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-12-10 15:53:20,925 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-12-10 15:53:20,925 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-12-10 15:53:20,925 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-12-10 15:53:20,925 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-12-10 15:53:20,925 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-12-10 15:53:20,925 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-12-10 15:53:20,925 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-12-10 15:53:20,925 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-12-10 15:53:20,925 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-12-10 15:53:20,926 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-12-10 15:53:20,926 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-12-10 15:53:20,926 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-12-10 15:53:20,926 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-12-10 15:53:20,926 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-12-10 15:53:20,926 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-12-10 15:53:20,926 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-12-10 15:53:20,926 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-12-10 15:53:20,926 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-12-10 15:53:20,926 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-12-10 15:53:20,926 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-12-10 15:53:20,927 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-12-10 15:53:20,927 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-12-10 15:53:20,927 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-12-10 15:53:20,927 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-12-10 15:53:20,927 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-12-10 15:53:20,927 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-12-10 15:53:20,927 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-12-10 15:53:20,927 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-12-10 15:53:20,927 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-12-10 15:53:20,927 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-12-10 15:53:20,927 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-12-10 15:53:20,927 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-12-10 15:53:20,928 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-12-10 15:53:20,928 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-12-10 15:53:20,928 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-12-10 15:53:20,928 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-12-10 15:53:20,928 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-12-10 15:53:20,928 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-12-10 15:53:20,928 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-12-10 15:53:20,928 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-12-10 15:53:20,928 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-12-10 15:53:20,928 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-12-10 15:53:20,928 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-12-10 15:53:20,929 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-12-10 15:53:20,929 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-12-10 15:53:20,929 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-12-10 15:53:20,929 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-12-10 15:53:20,929 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-12-10 15:53:20,929 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-12-10 15:53:20,929 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-12-10 15:53:20,929 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-12-10 15:53:20,929 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-12-10 15:53:20,929 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-12-10 15:53:20,929 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-12-10 15:53:20,930 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-12-10 15:53:21,269 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.06666666666666667, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-12-10 15:53:21,270 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-12-10 15:53:21,270 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.9909252140407105, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.06666666666666667, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-12-10 15:53:21,726 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 775 ms to try 5000 different iterations.  Found a solution that moves 4704 regions; Going from a computed imbalance of 0.9909252140407105 to a new imbalance of 0.17839031450966616. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.03836020301313431, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.05342584568965025, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.5226666666666666, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.03836020301313431, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.17358333333333334, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.24058333333333334, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-12-10 15:53:21,747 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1179910587:82 , srv164952921:82 , srv131265496:83 , srv548022719:83 , srv1030789244:84 , srv1041608304:84 , srv117036332:84 , srv1218803811:84 , srv1475350070:84 , srv1568448712:84 , srv1593175173:84 , srv165949979:84 , srv1928871456:84 , srv279951164:84 , srv313777994:84 , srv420029126:84 , srv505276612:84 , srv517866986:84 , srv682000468:84 , srv747745921:84 , srv982301411:84 , srv1042040828:85 , srv123606512:85 , srv1293706035:85 , srv1314486302:85 , srv1462451997:85 , srv1644927176:85 , srv1679161149:85 , srv253241483:85 , srv428664377:85 , srv44343933:85 , srv912213849:85 , srv1175201943:86 , srv121325334:86 , srv1268378271:86 , srv1335700566:86 , srv1376012747:86 , srv1438020455:86 , srv1892436852:86 , srv1904395735:86 , srv2042498526:86 , srv2141523228:86 , srv26999868:86 , srv318419589:86 , srv370369846:86 , srv564198608:86 , srv65804207:86 , srv723219938:86 , srv943402433:86 , srv999126065:86 , srv1070391365:87 , srv1260538171:87 , srv1273906615:87 , srv1295528319:87 , srv1316557161:87 , srv1515756087:87 , srv1592745673:87 , srv1841998010:87 , srv1869482138:87 , srv2016769362:87 , srv2099816443:87 , srv241097471:87 , srv306252567:87 , srv407886678:87 , srv433650001:87 , srv443489156:87 , srv495545065:87 , srv585143019:87 , srv638456708:87 , srv686617537:87 , srv712874545:87 , srv764084782:87 , srv798999195:87 , srv827378286:87 , srv918023770:87 , srv918681707:87 , srv1278319145:88 , srv1941228129:88 , srv2017080140:88 , srv2056273218:88 , srv322036989:88 , srv905322781:88 , srv1127451662:89 , srv1613277915:89 , srv164300190:89 , srv1781249274:89 , srv1805652715:89 , srv2041373250:89 , srv273317260:89 , srv278635436:89 , srv1791106812:90 , srv2113204270:90 , srv69253450:90 , srv990052032:91 , srv1527941842:92 , srv1814791805:92 , srv1377599948:93 , srv400987052:93 , srv1385497299:95 , srv1057243169:431 }
2023-12-10 15:53:21,751 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-12-10 15:53:21,752 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv65804207=82, srv1613277915=33, srv912213849=93, srv322036989=66, srv241097471=57, srv313777994=64, srv1278319145=15, srv1260538171=12, srv1295528319=17, srv164952921=36, srv1377599948=23, srv1928871456=47, srv278635436=61, srv517866986=77, srv123606512=11, srv1385497299=24, srv1070391365=4, srv1527941842=29, srv686617537=84, srv712874545=86, srv943402433=96, srv1335700566=21, srv1175201943=7, srv1679161149=38, srv905322781=92, srv318419589=65, srv370369846=67, srv1316557161=20, srv2042498526=52, srv999126065=99, srv253241483=58, srv982301411=97, srv1781249274=39, srv2017080140=50, srv2041373250=51, srv548022719=78, srv1568448712=30, srv407886678=69, srv1869482138=44, srv798999195=90, srv495545065=75, srv585143019=80, srv990052032=98, srv1042040828=2, srv26999868=59, srv443489156=74, srv420029126=70, srv1805652715=41, srv1293706035=16, srv1268378271=13, srv164300190=34, srv827378286=91, srv682000468=83, srv747745921=88, srv306252567=63, srv1475350070=27, srv2099816443=54, srv1904395735=46, srv1273906615=14, srv1515756087=28, srv2016769362=49, srv638456708=81, srv1179910587=8, srv764084782=89, srv279951164=62, srv1892436852=45, srv428664377=71, srv1376012747=22, srv918023770=94, srv564198608=79, srv1791106812=40, srv273317260=60, srv1127451662=5, srv1592745673=31, srv1593175173=32, srv165949979=37, srv400987052=68, srv723219938=87, srv2056273218=53, srv131265496=18, srv1462451997=26, srv1644927176=35, srv1814791805=42, srv2141523228=56, srv1314486302=19, srv117036332=6, srv44343933=73, srv1438020455=25, srv1841998010=43, srv69253450=85, srv1218803811=10, srv121325334=9, srv1041608304=1, srv1941228129=48, srv2113204270=55, srv505276612=76, srv1057243169=3, srv1030789244=0, srv433650001=72, srv918681707=95} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-12-10 15:53:21,768 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-12-10 15:53:21,769 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-12-10 15:53:21,769 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-12-10 15:53:21,769 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-12-10 15:53:21,769 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-12-10 15:53:21,769 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-12-10 15:53:21,769 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-12-10 15:53:21,769 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-12-10 15:53:21,769 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-12-10 15:53:21,769 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-12-10 15:53:21,769 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-12-10 15:53:21,769 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-12-10 15:53:21,769 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-12-10 15:53:21,770 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-12-10 15:53:21,770 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-12-10 15:53:21,770 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-12-10 15:53:21,770 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-12-10 15:53:21,770 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-12-10 15:53:21,770 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-12-10 15:53:21,770 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-12-10 15:53:21,770 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-12-10 15:53:21,770 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-12-10 15:53:21,770 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-12-10 15:53:21,770 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-12-10 15:53:21,770 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-12-10 15:53:21,770 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-12-10 15:53:21,771 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-12-10 15:53:21,771 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-12-10 15:53:21,771 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-12-10 15:53:21,771 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-12-10 15:53:21,771 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-12-10 15:53:21,771 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-12-10 15:53:21,771 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-12-10 15:53:21,771 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-12-10 15:53:21,771 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-12-10 15:53:21,771 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-12-10 15:53:21,771 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-12-10 15:53:21,771 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-12-10 15:53:21,771 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-12-10 15:53:21,771 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-12-10 15:53:21,772 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-12-10 15:53:21,772 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-12-10 15:53:21,772 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-12-10 15:53:21,772 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-12-10 15:53:21,772 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-12-10 15:53:21,772 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-12-10 15:53:21,772 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-12-10 15:53:21,772 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-12-10 15:53:21,772 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-12-10 15:53:21,772 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-12-10 15:53:21,772 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-12-10 15:53:21,772 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-12-10 15:53:21,772 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-12-10 15:53:21,773 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-12-10 15:53:21,773 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-12-10 15:53:21,773 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-12-10 15:53:21,773 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-12-10 15:53:21,773 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-12-10 15:53:21,773 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-12-10 15:53:21,773 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-12-10 15:53:21,773 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-12-10 15:53:21,773 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-12-10 15:53:21,773 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-12-10 15:53:21,773 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-12-10 15:53:21,773 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-12-10 15:53:21,773 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-12-10 15:53:21,773 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-12-10 15:53:21,774 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-12-10 15:53:21,774 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-12-10 15:53:21,774 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-12-10 15:53:21,774 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-12-10 15:53:21,774 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-12-10 15:53:21,774 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-12-10 15:53:21,774 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-12-10 15:53:21,774 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-12-10 15:53:21,774 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-12-10 15:53:21,774 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-12-10 15:53:21,774 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-12-10 15:53:21,774 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-12-10 15:53:21,774 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-12-10 15:53:21,774 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-12-10 15:53:21,774 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-12-10 15:53:21,775 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-12-10 15:53:21,775 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-12-10 15:53:21,775 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-12-10 15:53:21,775 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-12-10 15:53:21,775 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-12-10 15:53:21,775 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-12-10 15:53:21,775 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-12-10 15:53:21,775 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-12-10 15:53:21,775 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-12-10 15:53:21,775 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-12-10 15:53:21,775 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-12-10 15:53:21,775 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-12-10 15:53:21,775 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-12-10 15:53:21,775 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-12-10 15:53:21,776 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-12-10 15:53:21,776 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-12-10 15:53:21,776 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-12-10 15:53:21,776 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-12-10 15:53:21,776 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-12-10 15:53:21,970 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.03836020301313431, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.05342584568965025, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.03836020301313431, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.17358333333333334, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.24058333333333334, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-12-10 15:53:21,970 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-12-10 15:53:21,971 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.17835737639766577, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.03836020301313431, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.05342584568965025, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.03836020301313431, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.17358333333333334, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.24058333333333334, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-12-10 15:53:22,315 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 520 ms to try 5000 different iterations.  Found a solution that moves 2672 regions; Going from a computed imbalance of 0.17835737639766577 to a new imbalance of 0.016041160311179324. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.02184985438567946); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.03273880579927647, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.29688888888888887, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.02184985438567946); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.013083333333333334); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.044333333333333336, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-12-10 15:53:22,330 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1377599948:78 , srv1385497299:79 , srv1814791805:80 , srv69253450:80 , srv1781249274:81 , srv2041373250:81 , srv1127451662:82 , srv1273906615:82 , srv1278319145:82 , srv1515756087:82 , srv1805652715:82 , srv2017080140:82 , srv278635436:82 , srv905322781:82 , srv990052032:82 , srv1070391365:83 , srv1295528319:83 , srv1335700566:83 , srv1527941842:83 , srv1592745673:83 , srv1791106812:83 , srv1869482138:83 , srv2113204270:83 , srv400987052:83 , srv407886678:83 , srv1268378271:84 , srv1316557161:84 , srv164300190:84 , srv1941228129:84 , srv318419589:84 , srv433650001:84 , srv564198608:84 , srv638456708:84 , srv723219938:84 , srv827378286:84 , srv1042040828:85 , srv1260538171:85 , srv1613277915:85 , srv2016769362:85 , srv2056273218:85 , srv2099816443:85 , srv273317260:85 , srv306252567:85 , srv585143019:85 , srv1175201943:86 , srv121325334:86 , srv1218803811:86 , srv1841998010:86 , srv1892436852:86 , srv1904395735:86 , srv241097471:86 , srv253241483:86 , srv313777994:86 , srv322036989:86 , srv420029126:86 , srv44343933:86 , srv443489156:86 , srv495545065:86 , srv764084782:86 , srv798999195:86 , srv912213849:86 , srv918023770:86 , srv999126065:86 , srv1030789244:87 , srv117036332:87 , srv1314486302:87 , srv1438020455:87 , srv1644927176:87 , srv1679161149:87 , srv2141523228:87 , srv26999868:87 , srv65804207:87 , srv712874545:87 , srv1179910587:88 , srv123606512:88 , srv131265496:88 , srv1568448712:88 , srv1593175173:88 , srv165949979:88 , srv2042498526:88 , srv279951164:88 , srv370369846:88 , srv505276612:88 , srv517866986:88 , srv686617537:88 , srv747745921:88 , srv918681707:88 , srv982301411:88 , srv1041608304:89 , srv1293706035:89 , srv1376012747:89 , srv1928871456:89 , srv428664377:89 , srv682000468:89 , srv1462451997:90 , srv548022719:90 , srv943402433:90 , srv1475350070:91 , srv164952921:92 , srv1057243169:537 }
2023-12-10 15:53:22,336 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-12-10 15:53:22,337 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv65804207=82, srv1613277915=33, srv912213849=93, srv322036989=66, srv241097471=57, srv313777994=64, srv1278319145=15, srv1260538171=12, srv1295528319=17, srv164952921=36, srv1377599948=23, srv1928871456=47, srv278635436=61, srv517866986=77, srv123606512=11, srv1385497299=24, srv1070391365=4, srv1527941842=29, srv686617537=84, srv712874545=86, srv943402433=96, srv1335700566=21, srv1175201943=7, srv1679161149=38, srv905322781=92, srv318419589=65, srv370369846=67, srv1316557161=20, srv2042498526=52, srv999126065=99, srv253241483=58, srv982301411=97, srv1781249274=39, srv2017080140=50, srv2041373250=51, srv548022719=78, srv1568448712=30, srv407886678=69, srv1869482138=44, srv798999195=90, srv495545065=75, srv585143019=80, srv990052032=98, srv1042040828=2, srv26999868=59, srv443489156=74, srv420029126=70, srv1805652715=41, srv1293706035=16, srv1268378271=13, srv164300190=34, srv827378286=91, srv682000468=83, srv747745921=88, srv306252567=63, srv1475350070=27, srv2099816443=54, srv1904395735=46, srv1273906615=14, srv1515756087=28, srv2016769362=49, srv638456708=81, srv1179910587=8, srv764084782=89, srv279951164=62, srv1892436852=45, srv428664377=71, srv1376012747=22, srv918023770=94, srv564198608=79, srv1791106812=40, srv273317260=60, srv1127451662=5, srv1592745673=31, srv1593175173=32, srv165949979=37, srv400987052=68, srv723219938=87, srv2056273218=53, srv131265496=18, srv1462451997=26, srv1644927176=35, srv1814791805=42, srv2141523228=56, srv1314486302=19, srv117036332=6, srv44343933=73, srv1438020455=25, srv1841998010=43, srv69253450=85, srv1218803811=10, srv121325334=9, srv1041608304=1, srv1941228129=48, srv2113204270=55, srv505276612=76, srv1057243169=3, srv1030789244=0, srv433650001=72, srv918681707=95} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-12-10 15:53:22,374 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-12-10 15:53:22,375 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-12-10 15:53:22,375 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-12-10 15:53:22,375 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-12-10 15:53:22,375 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-12-10 15:53:22,375 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-12-10 15:53:22,375 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-12-10 15:53:22,376 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-12-10 15:53:22,376 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-12-10 15:53:22,376 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-12-10 15:53:22,376 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-12-10 15:53:22,376 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-12-10 15:53:22,376 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-12-10 15:53:22,376 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-12-10 15:53:22,376 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-12-10 15:53:22,377 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-12-10 15:53:22,377 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-12-10 15:53:22,377 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-12-10 15:53:22,377 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-12-10 15:53:22,377 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-12-10 15:53:22,377 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-12-10 15:53:22,377 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-12-10 15:53:22,377 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-12-10 15:53:22,377 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-12-10 15:53:22,378 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-12-10 15:53:22,378 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-12-10 15:53:22,378 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-12-10 15:53:22,378 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-12-10 15:53:22,378 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-12-10 15:53:22,378 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-12-10 15:53:22,378 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-12-10 15:53:22,378 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-12-10 15:53:22,379 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-12-10 15:53:22,379 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-12-10 15:53:22,379 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-12-10 15:53:22,379 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-12-10 15:53:22,379 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-12-10 15:53:22,379 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-12-10 15:53:22,379 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-12-10 15:53:22,379 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-12-10 15:53:22,379 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-12-10 15:53:22,380 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-12-10 15:53:22,380 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-12-10 15:53:22,380 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-12-10 15:53:22,380 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-12-10 15:53:22,380 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-12-10 15:53:22,380 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-12-10 15:53:22,380 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-12-10 15:53:22,380 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-12-10 15:53:22,381 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-12-10 15:53:22,381 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-12-10 15:53:22,381 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-12-10 15:53:22,381 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-12-10 15:53:22,381 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-12-10 15:53:22,381 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-12-10 15:53:22,381 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-12-10 15:53:22,381 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-12-10 15:53:22,381 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-12-10 15:53:22,382 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-12-10 15:53:22,382 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-12-10 15:53:22,382 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-12-10 15:53:22,382 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-12-10 15:53:22,382 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-12-10 15:53:22,382 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-12-10 15:53:22,382 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-12-10 15:53:22,382 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-12-10 15:53:22,382 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-12-10 15:53:22,383 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-12-10 15:53:22,383 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-12-10 15:53:22,383 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-12-10 15:53:22,383 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-12-10 15:53:22,383 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-12-10 15:53:22,383 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-12-10 15:53:22,383 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-12-10 15:53:22,383 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-12-10 15:53:22,383 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-12-10 15:53:22,384 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-12-10 15:53:22,384 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-12-10 15:53:22,384 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-12-10 15:53:22,384 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-12-10 15:53:22,384 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-12-10 15:53:22,384 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-12-10 15:53:22,384 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-12-10 15:53:22,384 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-12-10 15:53:22,384 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-12-10 15:53:22,385 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-12-10 15:53:22,385 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-12-10 15:53:22,385 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-12-10 15:53:22,385 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-12-10 15:53:22,385 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-12-10 15:53:22,385 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-12-10 15:53:22,385 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-12-10 15:53:22,385 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-12-10 15:53:22,385 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-12-10 15:53:22,386 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-12-10 15:53:22,386 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-12-10 15:53:22,386 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-12-10 15:53:22,386 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-12-10 15:53:22,386 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-12-10 15:53:22,386 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-12-10 15:53:22,386 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-12-10 15:53:22,532 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.02184985438567946); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.03273880579927647, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.02184985438567946); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.013083333333333334); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.044333333333333336, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-12-10 15:53:22,532 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-12-10 15:53:22,532 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.01602245056728795, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.02184985438567946); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.03273880579927647, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.02184985438567946); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.013083333333333334); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.044333333333333336, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-12-10 15:53:22,786 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 378 ms to try 5000 different iterations.  Found a solution that moves 1010 regions; Going from a computed imbalance of 0.01602245056728795 to a new imbalance of 6.435084792635082E-4. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.004870181532870474); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.007842444017689564); MoveCostFunction : (multiplier=7.0, imbalance=0.11222222222222222, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.004870181532870474); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=2.5E-4); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.003916666666666666); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-12-10 15:53:22,789 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1376012747:82 , srv1462451997:82 , srv1475350070:82 , srv400987052:82 , srv918681707:82 , srv943402433:82 , srv1293706035:83 , srv1527941842:83 , srv428664377:83 , srv712874545:83 , srv1041608304:84 , srv1385497299:84 , srv1613277915:84 , srv164300190:84 , srv164952921:84 , srv1841998010:84 , srv1928871456:84 , srv2113204270:84 , srv26999868:84 , srv273317260:84 , srv322036989:84 , srv370369846:84 , srv443489156:84 , srv495545065:84 , srv548022719:84 , srv682000468:84 , srv686617537:84 , srv990052032:84 , srv1175201943:85 , srv123606512:85 , srv1438020455:85 , srv1568448712:85 , srv1593175173:85 , srv165949979:85 , srv1791106812:85 , srv1814791805:85 , srv1904395735:85 , srv1941228129:85 , srv2042498526:85 , srv2056273218:85 , srv2099816443:85 , srv2141523228:85 , srv241097471:85 , srv517866986:85 , srv764084782:85 , srv798999195:85 , srv918023770:85 , srv999126065:85 , srv1030789244:86 , srv117036332:86 , srv121325334:86 , srv1260538171:86 , srv131265496:86 , srv1314486302:86 , srv1316557161:86 , srv1644927176:86 , srv1679161149:86 , srv1805652715:86 , srv1892436852:86 , srv2016769362:86 , srv279951164:86 , srv306252567:86 , srv433650001:86 , srv505276612:86 , srv585143019:86 , srv638456708:86 , srv65804207:86 , srv747745921:86 , srv827378286:86 , srv1127451662:87 , srv1179910587:87 , srv1268378271:87 , srv1278319145:87 , srv1377599948:87 , srv1592745673:87 , srv1869482138:87 , srv2017080140:87 , srv278635436:87 , srv313777994:87 , srv420029126:87 , srv44343933:87 , srv564198608:87 , srv723219938:87 , srv912213849:87 , srv982301411:87 , srv1042040828:88 , srv1070391365:88 , srv1218803811:88 , srv1273906615:88 , srv1295528319:88 , srv1335700566:88 , srv1781249274:88 , srv2041373250:88 , srv253241483:88 , srv318419589:88 , srv407886678:88 , srv69253450:88 , srv905322781:88 , srv1515756087:89 , srv1057243169:533 }
2023-12-10 15:53:22,792 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-12-10 15:53:22,793 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv65804207=82, srv1613277915=33, srv912213849=93, srv322036989=66, srv241097471=57, srv313777994=64, srv1278319145=15, srv1260538171=12, srv1295528319=17, srv164952921=36, srv1377599948=23, srv1928871456=47, srv278635436=61, srv517866986=77, srv123606512=11, srv1385497299=24, srv1070391365=4, srv1527941842=29, srv686617537=84, srv712874545=86, srv943402433=96, srv1335700566=21, srv1175201943=7, srv1679161149=38, srv905322781=92, srv318419589=65, srv370369846=67, srv1316557161=20, srv2042498526=52, srv999126065=99, srv253241483=58, srv982301411=97, srv1781249274=39, srv2017080140=50, srv2041373250=51, srv548022719=78, srv1568448712=30, srv407886678=69, srv1869482138=44, srv798999195=90, srv495545065=75, srv585143019=80, srv990052032=98, srv1042040828=2, srv26999868=59, srv443489156=74, srv420029126=70, srv1805652715=41, srv1293706035=16, srv1268378271=13, srv164300190=34, srv827378286=91, srv682000468=83, srv747745921=88, srv306252567=63, srv1475350070=27, srv2099816443=54, srv1904395735=46, srv1273906615=14, srv1515756087=28, srv2016769362=49, srv638456708=81, srv1179910587=8, srv764084782=89, srv279951164=62, srv1892436852=45, srv428664377=71, srv1376012747=22, srv918023770=94, srv564198608=79, srv1791106812=40, srv273317260=60, srv1127451662=5, srv1592745673=31, srv1593175173=32, srv165949979=37, srv400987052=68, srv723219938=87, srv2056273218=53, srv131265496=18, srv1462451997=26, srv1644927176=35, srv1814791805=42, srv2141523228=56, srv1314486302=19, srv117036332=6, srv44343933=73, srv1438020455=25, srv1841998010=43, srv69253450=85, srv1218803811=10, srv121325334=9, srv1041608304=1, srv1941228129=48, srv2113204270=55, srv505276612=76, srv1057243169=3, srv1030789244=0, srv433650001=72, srv918681707=95} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-12-10 15:53:22,805 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-12-10 15:53:22,805 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-12-10 15:53:22,805 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-12-10 15:53:22,805 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-12-10 15:53:22,805 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-12-10 15:53:22,806 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-12-10 15:53:22,806 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-12-10 15:53:22,806 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-12-10 15:53:22,806 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-12-10 15:53:22,806 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-12-10 15:53:22,806 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-12-10 15:53:22,806 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-12-10 15:53:22,806 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-12-10 15:53:22,806 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-12-10 15:53:22,806 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-12-10 15:53:22,806 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-12-10 15:53:22,806 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-12-10 15:53:22,806 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-12-10 15:53:22,806 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-12-10 15:53:22,806 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-12-10 15:53:22,807 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-12-10 15:53:22,807 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-12-10 15:53:22,807 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-12-10 15:53:22,807 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-12-10 15:53:22,807 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-12-10 15:53:22,807 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-12-10 15:53:22,807 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-12-10 15:53:22,807 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-12-10 15:53:22,808 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-12-10 15:53:22,808 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-12-10 15:53:22,808 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-12-10 15:53:22,808 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-12-10 15:53:22,808 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-12-10 15:53:22,808 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-12-10 15:53:22,808 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-12-10 15:53:22,808 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-12-10 15:53:22,808 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-12-10 15:53:22,808 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-12-10 15:53:22,809 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-12-10 15:53:22,809 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-12-10 15:53:22,809 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-12-10 15:53:22,809 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-12-10 15:53:22,809 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-12-10 15:53:22,809 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-12-10 15:53:22,809 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-12-10 15:53:22,809 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-12-10 15:53:22,810 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-12-10 15:53:22,810 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-12-10 15:53:22,810 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-12-10 15:53:22,810 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-12-10 15:53:22,810 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-12-10 15:53:22,810 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-12-10 15:53:22,810 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-12-10 15:53:22,810 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-12-10 15:53:22,810 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-12-10 15:53:22,811 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-12-10 15:53:22,811 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-12-10 15:53:22,811 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-12-10 15:53:22,811 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-12-10 15:53:22,811 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-12-10 15:53:22,811 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-12-10 15:53:22,811 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-12-10 15:53:22,811 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-12-10 15:53:22,812 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-12-10 15:53:22,812 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-12-10 15:53:22,812 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-12-10 15:53:22,812 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-12-10 15:53:22,812 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-12-10 15:53:22,812 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-12-10 15:53:22,812 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-12-10 15:53:22,812 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-12-10 15:53:22,812 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-12-10 15:53:22,812 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-12-10 15:53:22,813 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-12-10 15:53:22,813 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-12-10 15:53:22,813 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-12-10 15:53:22,813 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-12-10 15:53:22,813 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-12-10 15:53:22,813 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-12-10 15:53:22,813 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-12-10 15:53:22,813 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-12-10 15:53:22,813 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-12-10 15:53:22,813 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-12-10 15:53:22,814 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-12-10 15:53:22,814 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-12-10 15:53:22,814 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-12-10 15:53:22,814 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-12-10 15:53:22,814 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-12-10 15:53:22,814 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-12-10 15:53:22,814 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-12-10 15:53:22,814 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-12-10 15:53:22,814 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-12-10 15:53:22,814 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-12-10 15:53:22,815 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-12-10 15:53:22,815 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-12-10 15:53:22,815 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-12-10 15:53:22,815 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-12-10 15:53:22,815 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-12-10 15:53:22,815 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-12-10 15:53:22,815 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-12-10 15:53:22,815 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-12-10 15:53:22,947 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.004870181532870474); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.007842444017689564); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.004870181532870474); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=2.5E-4); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.003916666666666666); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-12-10 15:53:22,947 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-12-10 15:53:22,947 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=6.364363081069632E-4, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.004870181532870474); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.007842444017689564); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.004870181532870474); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=2.5E-4); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.003916666666666666); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-12-10 15:53:23,374 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 547 ms to try 5000 different iterations.  Found a solution that moves 222 regions; Going from a computed imbalance of 6.364363081069632E-4 to a new imbalance of 1.9017408200253155E-5. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=3.5313429231318235E-4); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0018349396085439343); MoveCostFunction : (multiplier=7.0, imbalance=0.024666666666666667); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=3.5313429231318235E-4); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=8.333333333333333E-5); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-12-10 15:53:23,375 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv2042498526:83 , srv253241483:83 , srv564198608:83 , srv65804207:83 , srv686617537:83 , srv982301411:83 , srv1042040828:84 , srv1127451662:84 , srv121325334:84 , srv123606512:84 , srv1260538171:84 , srv1295528319:84 , srv131265496:84 , srv1314486302:84 , srv1377599948:84 , srv1385497299:84 , srv1438020455:84 , srv1475350070:84 , srv1515756087:84 , srv1527941842:84 , srv1613277915:84 , srv1644927176:84 , srv164952921:84 , srv1679161149:84 , srv1781249274:84 , srv1791106812:84 , srv1892436852:84 , srv2016769362:84 , srv2041373250:84 , srv2056273218:84 , srv2141523228:84 , srv241097471:84 , srv273317260:84 , srv278635436:84 , srv279951164:84 , srv306252567:84 , srv318419589:84 , srv322036989:84 , srv370369846:84 , srv400987052:84 , srv407886678:84 , srv44343933:84 , srv505276612:84 , srv585143019:84 , srv69253450:84 , srv747745921:84 , srv798999195:84 , srv905322781:84 , srv912213849:84 , srv918023770:84 , srv943402433:84 , srv1041608304:85 , srv1070391365:85 , srv117036332:85 , srv1175201943:85 , srv1179910587:85 , srv1218803811:85 , srv1268378271:85 , srv1273906615:85 , srv1278319145:85 , srv1293706035:85 , srv1316557161:85 , srv1335700566:85 , srv1376012747:85 , srv1462451997:85 , srv1568448712:85 , srv1592745673:85 , srv1593175173:85 , srv164300190:85 , srv165949979:85 , srv1805652715:85 , srv1814791805:85 , srv1841998010:85 , srv1869482138:85 , srv1904395735:85 , srv1928871456:85 , srv1941228129:85 , srv2017080140:85 , srv2099816443:85 , srv2113204270:85 , srv26999868:85 , srv313777994:85 , srv420029126:85 , srv428664377:85 , srv433650001:85 , srv443489156:85 , srv495545065:85 , srv517866986:85 , srv548022719:85 , srv638456708:85 , srv682000468:85 , srv712874545:85 , srv723219938:85 , srv764084782:85 , srv827378286:85 , srv918681707:85 , srv990052032:85 , srv999126065:85 , srv1030789244:86 , srv1057243169:641 }
2023-12-10 15:53:23,378 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-12-10 15:53:23,379 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv65804207=82, srv1613277915=33, srv912213849=93, srv322036989=66, srv241097471=57, srv313777994=64, srv1278319145=15, srv1260538171=12, srv1295528319=17, srv164952921=36, srv1377599948=23, srv1928871456=47, srv278635436=61, srv517866986=77, srv123606512=11, srv1385497299=24, srv1070391365=4, srv1527941842=29, srv686617537=84, srv712874545=86, srv943402433=96, srv1335700566=21, srv1175201943=7, srv1679161149=38, srv905322781=92, srv318419589=65, srv370369846=67, srv1316557161=20, srv2042498526=52, srv999126065=99, srv253241483=58, srv982301411=97, srv1781249274=39, srv2017080140=50, srv2041373250=51, srv548022719=78, srv1568448712=30, srv407886678=69, srv1869482138=44, srv798999195=90, srv495545065=75, srv585143019=80, srv990052032=98, srv1042040828=2, srv26999868=59, srv443489156=74, srv420029126=70, srv1805652715=41, srv1293706035=16, srv1268378271=13, srv164300190=34, srv827378286=91, srv682000468=83, srv747745921=88, srv306252567=63, srv1475350070=27, srv2099816443=54, srv1904395735=46, srv1273906615=14, srv1515756087=28, srv2016769362=49, srv638456708=81, srv1179910587=8, srv764084782=89, srv279951164=62, srv1892436852=45, srv428664377=71, srv1376012747=22, srv918023770=94, srv564198608=79, srv1791106812=40, srv273317260=60, srv1127451662=5, srv1592745673=31, srv1593175173=32, srv165949979=37, srv400987052=68, srv723219938=87, srv2056273218=53, srv131265496=18, srv1462451997=26, srv1644927176=35, srv1814791805=42, srv2141523228=56, srv1314486302=19, srv117036332=6, srv44343933=73, srv1438020455=25, srv1841998010=43, srv69253450=85, srv1218803811=10, srv121325334=9, srv1041608304=1, srv1941228129=48, srv2113204270=55, srv505276612=76, srv1057243169=3, srv1030789244=0, srv433650001=72, srv918681707=95} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-12-10 15:53:23,391 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-12-10 15:53:23,391 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-12-10 15:53:23,391 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-12-10 15:53:23,391 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-12-10 15:53:23,391 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-12-10 15:53:23,391 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-12-10 15:53:23,391 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-12-10 15:53:23,391 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-12-10 15:53:23,391 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-12-10 15:53:23,391 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-12-10 15:53:23,391 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-12-10 15:53:23,391 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-12-10 15:53:23,391 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-12-10 15:53:23,391 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-12-10 15:53:23,392 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-12-10 15:53:23,392 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-12-10 15:53:23,392 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-12-10 15:53:23,392 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-12-10 15:53:23,392 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-12-10 15:53:23,392 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-12-10 15:53:23,392 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-12-10 15:53:23,392 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-12-10 15:53:23,392 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-12-10 15:53:23,392 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-12-10 15:53:23,392 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-12-10 15:53:23,392 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-12-10 15:53:23,392 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-12-10 15:53:23,392 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-12-10 15:53:23,392 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-12-10 15:53:23,392 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-12-10 15:53:23,392 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-12-10 15:53:23,392 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-12-10 15:53:23,392 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-12-10 15:53:23,393 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-12-10 15:53:23,393 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-12-10 15:53:23,393 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-12-10 15:53:23,393 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-12-10 15:53:23,393 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-12-10 15:53:23,393 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-12-10 15:53:23,393 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-12-10 15:53:23,393 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-12-10 15:53:23,393 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-12-10 15:53:23,393 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-12-10 15:53:23,393 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-12-10 15:53:23,393 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-12-10 15:53:23,393 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-12-10 15:53:23,393 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-12-10 15:53:23,393 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-12-10 15:53:23,393 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-12-10 15:53:23,393 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-12-10 15:53:23,394 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-12-10 15:53:23,394 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-12-10 15:53:23,394 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-12-10 15:53:23,394 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-12-10 15:53:23,394 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-12-10 15:53:23,394 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-12-10 15:53:23,394 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-12-10 15:53:23,394 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-12-10 15:53:23,394 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-12-10 15:53:23,394 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-12-10 15:53:23,394 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-12-10 15:53:23,395 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-12-10 15:53:23,395 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-12-10 15:53:23,395 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-12-10 15:53:23,395 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-12-10 15:53:23,395 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-12-10 15:53:23,395 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-12-10 15:53:23,395 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-12-10 15:53:23,395 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-12-10 15:53:23,396 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-12-10 15:53:23,396 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-12-10 15:53:23,396 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-12-10 15:53:23,396 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-12-10 15:53:23,396 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-12-10 15:53:23,396 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-12-10 15:53:23,396 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-12-10 15:53:23,396 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-12-10 15:53:23,396 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-12-10 15:53:23,396 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-12-10 15:53:23,397 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-12-10 15:53:23,397 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-12-10 15:53:23,397 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-12-10 15:53:23,397 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-12-10 15:53:23,397 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-12-10 15:53:23,397 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-12-10 15:53:23,397 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-12-10 15:53:23,397 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-12-10 15:53:23,397 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-12-10 15:53:23,397 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-12-10 15:53:23,398 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-12-10 15:53:23,398 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-12-10 15:53:23,398 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-12-10 15:53:23,398 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-12-10 15:53:23,398 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-12-10 15:53:23,398 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-12-10 15:53:23,398 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-12-10 15:53:23,398 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-12-10 15:53:23,398 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-12-10 15:53:23,398 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-12-10 15:53:23,398 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-12-10 15:53:23,398 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-12-10 15:53:23,514 INFO  [Time-limited test] balancer.StochasticLoadBalancer(381): Cluster wide - skipping load balancing because weighted average imbalance=1.7462930975745232E-5 <= threshold(0.025). If you want more aggressive balancing, either lower hbase.master.balancer.stochastic.minCostNeedBalance from 0.025 or increase the relative multiplier(s) of the specific cost function(s). functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=3.5313429231318235E-4); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0018349396085439343); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=3.5313429231318235E-4); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=8.333333333333333E-5); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-12-10 15:53:23,514 INFO  [Time-limited test] balancer.BalancerTestBase(570): Mock Final balance: { srv2042498526:83 , srv253241483:83 , srv564198608:83 , srv65804207:83 , srv686617537:83 , srv982301411:83 , srv1042040828:84 , srv1127451662:84 , srv121325334:84 , srv123606512:84 , srv1260538171:84 , srv1295528319:84 , srv131265496:84 , srv1314486302:84 , srv1377599948:84 , srv1385497299:84 , srv1438020455:84 , srv1475350070:84 , srv1515756087:84 , srv1527941842:84 , srv1613277915:84 , srv1644927176:84 , srv164952921:84 , srv1679161149:84 , srv1781249274:84 , srv1791106812:84 , srv1892436852:84 , srv2016769362:84 , srv2041373250:84 , srv2056273218:84 , srv2141523228:84 , srv241097471:84 , srv273317260:84 , srv278635436:84 , srv279951164:84 , srv306252567:84 , srv318419589:84 , srv322036989:84 , srv370369846:84 , srv400987052:84 , srv407886678:84 , srv44343933:84 , srv505276612:84 , srv585143019:84 , srv69253450:84 , srv747745921:84 , srv798999195:84 , srv905322781:84 , srv912213849:84 , srv918023770:84 , srv943402433:84 , srv1041608304:85 , srv1070391365:85 , srv117036332:85 , srv1175201943:85 , srv1179910587:85 , srv1218803811:85 , srv1268378271:85 , srv1273906615:85 , srv1278319145:85 , srv1293706035:85 , srv1316557161:85 , srv1335700566:85 , srv1376012747:85 , srv1462451997:85 , srv1568448712:85 , srv1592745673:85 , srv1593175173:85 , srv164300190:85 , srv165949979:85 , srv1805652715:85 , srv1814791805:85 , srv1841998010:85 , srv1869482138:85 , srv1904395735:85 , srv1928871456:85 , srv1941228129:85 , srv2017080140:85 , srv2099816443:85 , srv2113204270:85 , srv26999868:85 , srv313777994:85 , srv420029126:85 , srv428664377:85 , srv433650001:85 , srv443489156:85 , srv495545065:85 , srv517866986:85 , srv548022719:85 , srv638456708:85 , srv682000468:85 , srv712874545:85 , srv723219938:85 , srv764084782:85 , srv827378286:85 , srv918681707:85 , srv990052032:85 , srv999126065:85 , srv1030789244:86 , srv1057243169:641 }
2023-12-10 15:53:23,549 INFO  [Time-limited test] hbase.ResourceChecker(175): after: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnLargeClusterWithRacks Thread=12 (was 12), OpenFileDescriptor=290 (was 290), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=328 (was 286) - SystemLoadAverage LEAK? -, ProcessCount=173 (was 173), AvailableMemoryMB=5697 (was 6510)
2023-12-10 15:53:23,565 INFO  [Time-limited test] hbase.ResourceChecker(147): before: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnMidClusterWithRacks Thread=12, OpenFileDescriptor=290, MaxFileDescriptor=60000, SystemLoadAverage=328, ProcessCount=173, AvailableMemoryMB=5682
2023-12-10 15:53:23,566 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2023-12-10 15:53:23,567 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=5000, runMaxSteps=true, stepsPerRegion=800, maxRunningTime=120000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 111077.0 etc.
2023-12-10 15:53:23,591 INFO  [Time-limited test] balancer.BalancerTestBase(547): Mock Cluster : { srv1101374183:84 , srv1168884843:84 , srv1195612205:84 , srv1214920554:84 , srv1254744516:84 , srv1309610518:84 , srv1315522647:84 , srv1543548684:84 , srv1668386190:84 , srv1690581247:84 , srv1757226573:84 , srv1773010698:84 , srv1814756492:84 , srv1828950185:84 , srv1949533608:84 , srv2013201976:84 , srv2042550300:84 , srv20495519:84 , srv2131373646:84 , srv434059726:84 , srv4900280:84 , srv499944604:84 , srv540986426:84 , srv544716972:84 , srv687493937:84 , srv877066522:84 , srv890771550:84 , srv910528713:84 , srv966169950:84 , srv1368449887:264 } [srvr=30 rgns=2700 avg=90.0 max=90 min=90]
2023-12-10 15:53:23,593 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-12-10 15:53:23,593 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv544716972=24, srv2013201976=16, srv1773010698=12, srv1101374183=0, srv877066522=26, srv1814756492=13, srv434059726=20, srv1368449887=7, srv20495519=18, srv499944604=22, srv2042550300=17, srv1668386190=9, srv1949533608=15, srv890771550=27, srv4900280=21, srv1543548684=8, srv1690581247=10, srv687493937=25, srv910528713=28, srv1309610518=5, srv1195612205=2, srv1828950185=14, srv1254744516=4, srv2131373646=19, srv1315522647=6, srv966169950=29, srv1168884843=1, srv1214920554=3, srv1757226573=11, srv540986426=23} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-12-10 15:53:23,607 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-12-10 15:53:23,607 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-12-10 15:53:23,607 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-12-10 15:53:23,607 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-12-10 15:53:23,607 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-12-10 15:53:23,607 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-12-10 15:53:23,608 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-12-10 15:53:23,608 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-12-10 15:53:23,608 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-12-10 15:53:23,608 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-12-10 15:53:23,608 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-12-10 15:53:23,608 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-12-10 15:53:23,609 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-12-10 15:53:23,609 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-12-10 15:53:23,609 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-12-10 15:53:23,609 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-12-10 15:53:23,609 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-12-10 15:53:23,609 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-12-10 15:53:23,609 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-12-10 15:53:23,609 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-12-10 15:53:23,609 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-12-10 15:53:23,609 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-12-10 15:53:23,609 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-12-10 15:53:23,609 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-12-10 15:53:23,609 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-12-10 15:53:23,610 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-12-10 15:53:23,610 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-12-10 15:53:23,610 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-12-10 15:53:23,610 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-12-10 15:53:23,610 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-12-10 15:53:23,610 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=10, number of hosts=30, number of racks=4
2023-12-10 15:53:23,635 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=1.1640560360758163, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-12-10 15:53:23,636 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.9912709978477032, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=1.1640560360758163, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=64800000
2023-12-10 15:55:23,615 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 120001 ms to try 5719340 different iterations.  Found a solution that moves 1845 regions; Going from a computed imbalance of 0.9912709978477032 to a new imbalance of 4.306322040866546E-5. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); MoveCostFunction : (multiplier=7.0, imbalance=0.6833333333333333, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-12-10 15:55:23,624 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1101374183:90 , srv1168884843:90 , srv1195612205:90 , srv1214920554:90 , srv1254744516:90 , srv1309610518:90 , srv1315522647:90 , srv1368449887:90 , srv1543548684:90 , srv1668386190:90 , srv1690581247:90 , srv1757226573:90 , srv1773010698:90 , srv1814756492:90 , srv1828950185:90 , srv1949533608:90 , srv2013201976:90 , srv2042550300:90 , srv20495519:90 , srv2131373646:90 , srv434059726:90 , srv4900280:90 , srv499944604:90 , srv540986426:90 , srv544716972:90 , srv687493937:90 , srv877066522:90 , srv890771550:90 , srv910528713:90 , srv966169950:90 }
2023-12-10 15:55:23,626 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-12-10 15:55:23,627 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv544716972=24, srv2013201976=16, srv1773010698=12, srv1101374183=0, srv877066522=26, srv1814756492=13, srv434059726=20, srv1368449887=7, srv20495519=18, srv499944604=22, srv2042550300=17, srv1668386190=9, srv1949533608=15, srv890771550=27, srv4900280=21, srv1543548684=8, srv1690581247=10, srv687493937=25, srv910528713=28, srv1309610518=5, srv1195612205=2, srv1828950185=14, srv1254744516=4, srv2131373646=19, srv1315522647=6, srv966169950=29, srv1168884843=1, srv1214920554=3, srv1757226573=11, srv540986426=23} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-12-10 15:55:23,632 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-12-10 15:55:23,632 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-12-10 15:55:23,632 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-12-10 15:55:23,632 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-12-10 15:55:23,633 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-12-10 15:55:23,633 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-12-10 15:55:23,633 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-12-10 15:55:23,633 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-12-10 15:55:23,633 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-12-10 15:55:23,633 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-12-10 15:55:23,633 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-12-10 15:55:23,633 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-12-10 15:55:23,633 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-12-10 15:55:23,633 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-12-10 15:55:23,633 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-12-10 15:55:23,634 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-12-10 15:55:23,634 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-12-10 15:55:23,634 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-12-10 15:55:23,634 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-12-10 15:55:23,634 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-12-10 15:55:23,634 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-12-10 15:55:23,634 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-12-10 15:55:23,634 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-12-10 15:55:23,634 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-12-10 15:55:23,634 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-12-10 15:55:23,634 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-12-10 15:55:23,634 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-12-10 15:55:23,635 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-12-10 15:55:23,635 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-12-10 15:55:23,635 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-12-10 15:55:23,635 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=10, number of hosts=30, number of racks=4
2023-12-10 15:55:23,653 INFO  [Time-limited test] balancer.StochasticLoadBalancer(381): Cluster wide - skipping load balancing because weighted average imbalance=0.0 <= threshold(0.025). If you want more aggressive balancing, either lower hbase.master.balancer.stochastic.minCostNeedBalance from 0.025 or increase the relative multiplier(s) of the specific cost function(s). functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-12-10 15:55:23,654 INFO  [Time-limited test] balancer.BalancerTestBase(570): Mock Final balance: { srv1101374183:90 , srv1168884843:90 , srv1195612205:90 , srv1214920554:90 , srv1254744516:90 , srv1309610518:90 , srv1315522647:90 , srv1368449887:90 , srv1543548684:90 , srv1668386190:90 , srv1690581247:90 , srv1757226573:90 , srv1773010698:90 , srv1814756492:90 , srv1828950185:90 , srv1949533608:90 , srv2013201976:90 , srv2042550300:90 , srv20495519:90 , srv2131373646:90 , srv434059726:90 , srv4900280:90 , srv499944604:90 , srv540986426:90 , srv544716972:90 , srv687493937:90 , srv877066522:90 , srv890771550:90 , srv910528713:90 , srv966169950:90 }
2023-12-10 15:55:23,673 INFO  [Time-limited test] hbase.ResourceChecker(175): after: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnMidClusterWithRacks Thread=11 (was 12), OpenFileDescriptor=290 (was 290), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=194 (was 328), ProcessCount=171 (was 173), AvailableMemoryMB=5261 (was 5682)