2023-03-12 21:54:15,209 INFO  [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks timeout: 13 mins
2023-03-12 21:54:15,503 WARN  [Time-limited test] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties
2023-03-12 21:54:15,621 INFO  [Time-limited test] metrics.MetricRegistriesLoader(60): Loaded MetricRegistries class org.apache.hadoop.hbase.metrics.impl.MetricRegistriesImpl
2023-03-12 21:54:15,681 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2023-03-12 21:54:15,688 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc.
2023-03-12 21:54:15,701 INFO  [Time-limited test] hbase.ResourceChecker(147): before: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnLargeClusterWithRacks Thread=10, OpenFileDescriptor=260, MaxFileDescriptor=60000, SystemLoadAverage=249, ProcessCount=169, AvailableMemoryMB=5312
2023-03-12 21:54:15,703 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2023-03-12 21:54:15,703 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=5000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=10000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc.
2023-03-12 21:54:15,819 INFO  [Time-limited test] balancer.BalancerTestBase(547): Mock Cluster : { srv1014238431:84 , srv1029319731:84 , srv1058938614:84 , srv1073402278:84 , srv1073639884:84 , srv1082537335:84 , srv112266497:84 , srv1140346302:84 , srv1146177595:84 , srv1146848466:84 , srv1153663657:84 , srv1198837542:84 , srv121050265:84 , srv1235682173:84 , srv1242882556:84 , srv1246894648:84 , srv1292604335:84 , srv1300604187:84 , srv1342705741:84 , srv1347109977:84 , srv1358663018:84 , srv1404024145:84 , srv1431075565:84 , srv1436575019:84 , srv1442441434:84 , srv1442910623:84 , srv1482175738:84 , srv149133437:84 , srv1510848877:84 , srv152402697:84 , srv155636319:84 , srv1575941921:84 , srv1647081085:84 , srv1669824696:84 , srv168955075:84 , srv1701557935:84 , srv1710769617:84 , srv17347669:84 , srv1742991106:84 , srv1747261948:84 , srv185082739:84 , srv1851063786:84 , srv1860732393:84 , srv1867468589:84 , srv1882239925:84 , srv1927053598:84 , srv1959459706:84 , srv1972708142:84 , srv1993606793:84 , srv2008744041:84 , srv2020146599:84 , srv2021574200:84 , srv2023367703:84 , srv2025193494:84 , srv2089958028:84 , srv2098928276:84 , srv2103415611:84 , srv2111374628:84 , srv2115143022:84 , srv2146814077:84 , srv225613481:84 , srv229604407:84 , srv234595589:84 , srv238942798:84 , srv242281786:84 , srv250562630:84 , srv320372594:84 , srv322557391:84 , srv372157472:84 , srv372481732:84 , srv374134354:84 , srv421275541:84 , srv421334942:84 , srv434672176:84 , srv44320991:84 , srv460811230:84 , srv49106072:84 , srv491174685:84 , srv563478308:84 , srv598523107:84 , srv60729094:84 , srv627074760:84 , srv641491395:84 , srv676640103:84 , srv713409441:84 , srv754822938:84 , srv766261508:84 , srv77210713:84 , srv800147750:84 , srv818260882:84 , srv830061719:84 , srv837341642:84 , srv872843635:84 , srv890207024:84 , srv898763244:84 , srv943921092:84 , srv984633106:84 , srv996360310:84 , srv997604676:84 , srv571693342:684 } [srvr=100 rgns=9000 avg=90.0 max=90 min=90]
2023-03-12 21:54:15,827 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-03-12 21:54:15,833 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv943921092=96, srv818260882=90, srv225613481=60, srv1014238431=0, srv1404024145=21, srv1198837542=11, srv242281786=64, srv491174685=77, srv837341642=92, srv1342705741=18, srv77210713=88, srv1972708142=47, srv434672176=73, srv112266497=6, srv1300604187=17, srv1058938614=2, srv421275541=71, srv250562630=65, srv2008744041=49, srv372481732=69, srv1882239925=44, srv1442441434=24, srv49106072=76, srv234595589=62, srv1747261948=39, srv1647081085=32, srv641491395=83, srv1442910623=25, srv238942798=63, srv1073402278=3, srv2146814077=59, srv2023367703=52, srv2021574200=51, srv996360310=98, srv1242882556=14, srv1153663657=10, srv1292604335=16, srv372157472=68, srv1146848466=9, srv2089958028=54, srv121050265=12, srv800147750=89, srv1431075565=22, srv185082739=40, srv1073639884=4, srv1860732393=42, srv1140346302=7, srv421334942=72, srv1927053598=45, srv997604676=99, srv1575941921=31, srv2111374628=57, srv460811230=75, srv2098928276=55, srv1146177595=8, srv44320991=74, srv1510848877=28, srv1851063786=41, srv155636319=30, srv152402697=29, srv374134354=70, srv1082537335=5, srv1436575019=23, srv322557391=67, srv1358663018=20, srv563478308=78, srv1246894648=15, srv598523107=80, srv168955075=34, srv1347109977=19, srv754822938=86, srv149133437=27, srv898763244=95, srv229604407=61, srv60729094=81, srv320372594=66, srv1867468589=43, srv2115143022=58, srv713409441=85, srv676640103=84, srv2020146599=50, srv627074760=82, srv890207024=94, srv2103415611=56, srv1710769617=36, srv1482175738=26, srv2025193494=53, srv1993606793=48, srv1029319731=1, srv1701557935=35, srv571693342=79, srv830061719=91, srv17347669=37, srv872843635=93, srv1235682173=13, srv984633106=97, srv1669824696=33, srv766261508=87, srv1742991106=38, srv1959459706=46} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-03-12 21:54:15,903 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-03-12 21:54:15,904 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-03-12 21:54:15,904 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-03-12 21:54:15,904 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-03-12 21:54:15,904 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-03-12 21:54:15,904 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-03-12 21:54:15,904 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-03-12 21:54:15,904 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-03-12 21:54:15,904 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-03-12 21:54:15,904 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-03-12 21:54:15,904 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-03-12 21:54:15,904 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-03-12 21:54:15,905 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-03-12 21:54:15,905 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-03-12 21:54:15,905 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-03-12 21:54:15,905 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-03-12 21:54:15,905 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-03-12 21:54:15,905 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-03-12 21:54:15,905 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-03-12 21:54:15,905 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-03-12 21:54:15,905 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-03-12 21:54:15,905 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-03-12 21:54:15,906 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-03-12 21:54:15,906 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-03-12 21:54:15,906 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-03-12 21:54:15,906 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-03-12 21:54:15,906 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-03-12 21:54:15,906 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-03-12 21:54:15,906 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-03-12 21:54:15,906 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-03-12 21:54:15,906 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-03-12 21:54:15,906 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-03-12 21:54:15,906 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-03-12 21:54:15,906 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-03-12 21:54:15,907 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-03-12 21:54:15,907 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-03-12 21:54:15,907 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-03-12 21:54:15,907 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-03-12 21:54:15,907 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-03-12 21:54:15,907 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-03-12 21:54:15,907 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-03-12 21:54:15,907 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-03-12 21:54:15,907 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-03-12 21:54:15,907 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-03-12 21:54:15,907 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-03-12 21:54:15,907 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-03-12 21:54:15,908 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-03-12 21:54:15,908 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-03-12 21:54:15,908 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-03-12 21:54:15,908 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-03-12 21:54:15,908 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-03-12 21:54:15,908 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-03-12 21:54:15,908 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-03-12 21:54:15,908 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-03-12 21:54:15,908 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-03-12 21:54:15,908 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-03-12 21:54:15,908 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-03-12 21:54:15,909 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-03-12 21:54:15,909 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-03-12 21:54:15,909 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-03-12 21:54:15,909 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-03-12 21:54:15,909 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-03-12 21:54:15,909 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-03-12 21:54:15,909 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-03-12 21:54:15,909 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-03-12 21:54:15,909 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-03-12 21:54:15,909 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-03-12 21:54:15,909 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-03-12 21:54:15,909 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-03-12 21:54:15,910 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-03-12 21:54:15,910 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-03-12 21:54:15,910 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-03-12 21:54:15,910 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-03-12 21:54:15,910 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-03-12 21:54:15,910 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-03-12 21:54:15,910 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-03-12 21:54:15,910 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-03-12 21:54:15,910 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-03-12 21:54:15,910 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-03-12 21:54:15,910 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-03-12 21:54:15,910 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-03-12 21:54:15,911 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-03-12 21:54:15,911 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-03-12 21:54:15,911 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-03-12 21:54:15,911 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-03-12 21:54:15,911 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-03-12 21:54:15,911 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-03-12 21:54:15,911 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-03-12 21:54:15,911 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-03-12 21:54:15,911 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-03-12 21:54:15,911 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-03-12 21:54:15,911 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-03-12 21:54:15,911 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-03-12 21:54:15,911 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-03-12 21:54:15,912 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-03-12 21:54:15,912 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-03-12 21:54:15,912 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-03-12 21:54:15,912 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-03-12 21:54:15,912 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-03-12 21:54:15,912 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-03-12 21:54:15,912 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-03-12 21:54:16,084 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.06666666666666667, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-03-12 21:54:16,085 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-03-12 21:54:16,085 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.9909252140407105, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.06666666666666667, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-03-12 21:54:16,772 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 838 ms to try 5000 different iterations.  Found a solution that moves 4665 regions; Going from a computed imbalance of 0.9909252140407105 to a new imbalance of 0.18635579502983676. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.038942563568208986, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.05909341270704171, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.5183333333333333, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.038942563568208986, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.18125, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.2520833333333333, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-03-12 21:54:16,799 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv44320991:82 , srv676640103:82 , srv818260882:82 , srv1058938614:83 , srv1082537335:83 , srv1710769617:83 , srv372157472:83 , srv372481732:83 , srv837341642:83 , srv1153663657:84 , srv1246894648:84 , srv1575941921:84 , srv17347669:84 , srv1959459706:84 , srv2089958028:84 , srv2111374628:84 , srv2115143022:84 , srv242281786:84 , srv713409441:84 , srv1073639884:85 , srv1146177595:85 , srv1242882556:85 , srv1342705741:85 , srv1442441434:85 , srv1647081085:85 , srv1701557935:85 , srv185082739:85 , srv1882239925:85 , srv1972708142:85 , srv2020146599:85 , srv2023367703:85 , srv225613481:85 , srv234595589:85 , srv322557391:85 , srv374134354:85 , srv421334942:85 , srv563478308:85 , srv872843635:85 , srv943921092:85 , srv121050265:86 , srv1404024145:86 , srv1431075565:86 , srv1436575019:86 , srv1742991106:86 , srv2008744041:86 , srv2025193494:86 , srv229604407:86 , srv320372594:86 , srv460811230:86 , srv598523107:86 , srv60729094:86 , srv766261508:86 , srv890207024:86 , srv996360310:86 , srv1014238431:87 , srv1146848466:87 , srv1442910623:87 , srv1482175738:87 , srv1510848877:87 , srv155636319:87 , srv1927053598:87 , srv1993606793:87 , srv2098928276:87 , srv2146814077:87 , srv238942798:87 , srv421275541:87 , srv434672176:87 , srv49106072:87 , srv491174685:87 , srv898763244:87 , srv1029319731:88 , srv1073402278:88 , srv112266497:88 , srv1140346302:88 , srv1235682173:88 , srv1300604187:88 , srv149133437:88 , srv152402697:88 , srv168955075:88 , srv1860732393:88 , srv2021574200:88 , srv2103415611:88 , srv1292604335:89 , srv1358663018:89 , srv1669824696:89 , srv250562630:89 , srv754822938:89 , srv800147750:89 , srv830061719:89 , srv984633106:89 , srv1198837542:90 , srv77210713:90 , srv997604676:90 , srv1851063786:91 , srv1347109977:92 , srv1867468589:92 , srv627074760:93 , srv641491395:93 , srv1747261948:99 , srv571693342:436 }
2023-03-12 21:54:16,804 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-03-12 21:54:16,805 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv943921092=96, srv818260882=90, srv225613481=60, srv1014238431=0, srv1404024145=21, srv1198837542=11, srv242281786=64, srv491174685=77, srv837341642=92, srv1342705741=18, srv77210713=88, srv1972708142=47, srv434672176=73, srv112266497=6, srv1300604187=17, srv1058938614=2, srv421275541=71, srv250562630=65, srv2008744041=49, srv372481732=69, srv1882239925=44, srv1442441434=24, srv49106072=76, srv234595589=62, srv1747261948=39, srv1647081085=32, srv641491395=83, srv1442910623=25, srv238942798=63, srv1073402278=3, srv2146814077=59, srv2023367703=52, srv2021574200=51, srv996360310=98, srv1242882556=14, srv1153663657=10, srv1292604335=16, srv372157472=68, srv1146848466=9, srv2089958028=54, srv121050265=12, srv800147750=89, srv1431075565=22, srv185082739=40, srv1073639884=4, srv1860732393=42, srv1140346302=7, srv421334942=72, srv1927053598=45, srv997604676=99, srv1575941921=31, srv2111374628=57, srv460811230=75, srv2098928276=55, srv1146177595=8, srv44320991=74, srv1510848877=28, srv1851063786=41, srv155636319=30, srv152402697=29, srv374134354=70, srv1082537335=5, srv1436575019=23, srv322557391=67, srv1358663018=20, srv563478308=78, srv1246894648=15, srv598523107=80, srv168955075=34, srv1347109977=19, srv754822938=86, srv149133437=27, srv898763244=95, srv229604407=61, srv60729094=81, srv320372594=66, srv1867468589=43, srv2115143022=58, srv713409441=85, srv676640103=84, srv2020146599=50, srv627074760=82, srv890207024=94, srv2103415611=56, srv1710769617=36, srv1482175738=26, srv2025193494=53, srv1993606793=48, srv1029319731=1, srv1701557935=35, srv571693342=79, srv830061719=91, srv17347669=37, srv872843635=93, srv1235682173=13, srv984633106=97, srv1669824696=33, srv766261508=87, srv1742991106=38, srv1959459706=46} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-03-12 21:54:16,826 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-03-12 21:54:16,827 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-03-12 21:54:16,827 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-03-12 21:54:16,827 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-03-12 21:54:16,827 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-03-12 21:54:16,828 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-03-12 21:54:16,828 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-03-12 21:54:16,828 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-03-12 21:54:16,828 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-03-12 21:54:16,828 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-03-12 21:54:16,828 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-03-12 21:54:16,829 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-03-12 21:54:16,829 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-03-12 21:54:16,829 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-03-12 21:54:16,829 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-03-12 21:54:16,829 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-03-12 21:54:16,829 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-03-12 21:54:16,829 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-03-12 21:54:16,829 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-03-12 21:54:16,829 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-03-12 21:54:16,829 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-03-12 21:54:16,830 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-03-12 21:54:16,830 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-03-12 21:54:16,830 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-03-12 21:54:16,830 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-03-12 21:54:16,830 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-03-12 21:54:16,830 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-03-12 21:54:16,830 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-03-12 21:54:16,830 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-03-12 21:54:16,831 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-03-12 21:54:16,831 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-03-12 21:54:16,831 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-03-12 21:54:16,831 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-03-12 21:54:16,831 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-03-12 21:54:16,831 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-03-12 21:54:16,831 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-03-12 21:54:16,831 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-03-12 21:54:16,831 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-03-12 21:54:16,831 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-03-12 21:54:16,832 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-03-12 21:54:16,832 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-03-12 21:54:16,832 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-03-12 21:54:16,832 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-03-12 21:54:16,832 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-03-12 21:54:16,832 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-03-12 21:54:16,832 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-03-12 21:54:16,832 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-03-12 21:54:16,832 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-03-12 21:54:16,832 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-03-12 21:54:16,832 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-03-12 21:54:16,832 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-03-12 21:54:16,833 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-03-12 21:54:16,833 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-03-12 21:54:16,833 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-03-12 21:54:16,833 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-03-12 21:54:16,833 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-03-12 21:54:16,833 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-03-12 21:54:16,833 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-03-12 21:54:16,833 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-03-12 21:54:16,833 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-03-12 21:54:16,833 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-03-12 21:54:16,834 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-03-12 21:54:16,834 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-03-12 21:54:16,834 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-03-12 21:54:16,834 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-03-12 21:54:16,834 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-03-12 21:54:16,834 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-03-12 21:54:16,834 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-03-12 21:54:16,834 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-03-12 21:54:16,834 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-03-12 21:54:16,834 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-03-12 21:54:16,834 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-03-12 21:54:16,834 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-03-12 21:54:16,835 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-03-12 21:54:16,835 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-03-12 21:54:16,835 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-03-12 21:54:16,835 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-03-12 21:54:16,835 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-03-12 21:54:16,835 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-03-12 21:54:16,835 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-03-12 21:54:16,835 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-03-12 21:54:16,835 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-03-12 21:54:16,835 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-03-12 21:54:16,835 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-03-12 21:54:16,836 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-03-12 21:54:16,836 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-03-12 21:54:16,836 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-03-12 21:54:16,836 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-03-12 21:54:16,836 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-03-12 21:54:16,836 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-03-12 21:54:16,836 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-03-12 21:54:16,836 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-03-12 21:54:16,837 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-03-12 21:54:16,837 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-03-12 21:54:16,837 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-03-12 21:54:16,837 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-03-12 21:54:16,837 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-03-12 21:54:16,837 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-03-12 21:54:16,837 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-03-12 21:54:16,837 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-03-12 21:54:16,837 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-03-12 21:54:16,974 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.038942563568208986, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.05909341270704171, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.038942563568208986, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.18125, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.2520833333333333, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-03-12 21:54:16,974 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-03-12 21:54:16,974 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.1863231300016731, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.038942563568208986, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.05909341270704171, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.038942563568208986, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.18125, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.2520833333333333, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-03-12 21:54:17,336 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 477 ms to try 5000 different iterations.  Found a solution that moves 2677 regions; Going from a computed imbalance of 0.1863231300016731 to a new imbalance of 0.01443414216200404. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.021732539651653397); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.03585104487502075, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.29744444444444446, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.021732539651653397); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.011166666666666667); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0455, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-03-12 21:54:17,346 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1747261948:75 , srv1347109977:79 , srv1851063786:79 , srv641491395:79 , srv1073402278:81 , srv1867468589:81 , srv984633106:81 , srv1198837542:82 , srv1292604335:82 , srv1860732393:82 , srv2103415611:82 , srv250562630:82 , srv997604676:82 , srv1140346302:83 , srv1431075565:83 , srv49106072:83 , srv598523107:83 , srv627074760:83 , srv800147750:83 , srv898763244:83 , srv1014238431:84 , srv1235682173:84 , srv1358663018:84 , srv1482175738:84 , srv152402697:84 , srv1742991106:84 , srv2098928276:84 , srv2146814077:84 , srv229604407:84 , srv491174685:84 , srv754822938:84 , srv77210713:84 , srv830061719:84 , srv1029319731:85 , srv112266497:85 , srv1146848466:85 , srv1300604187:85 , srv1404024145:85 , srv1436575019:85 , srv149133437:85 , srv1510848877:85 , srv2008744041:85 , srv2021574200:85 , srv2025193494:85 , srv421275541:85 , srv421334942:85 , srv434672176:85 , srv460811230:85 , srv563478308:85 , srv943921092:85 , srv1442441434:86 , srv1442910623:86 , srv1669824696:86 , srv1701557935:86 , srv1927053598:86 , srv1993606793:86 , srv2111374628:86 , srv238942798:86 , srv320372594:86 , srv890207024:86 , srv121050265:87 , srv1242882556:87 , srv1246894648:87 , srv155636319:87 , srv1575941921:87 , srv168955075:87 , srv2023367703:87 , srv2115143022:87 , srv225613481:87 , srv374134354:87 , srv713409441:87 , srv1058938614:88 , srv1073639884:88 , srv1082537335:88 , srv1146177595:88 , srv1153663657:88 , srv1647081085:88 , srv1710769617:88 , srv1882239925:88 , srv1959459706:88 , srv1972708142:88 , srv2089958028:88 , srv234595589:88 , srv372157472:88 , srv60729094:88 , srv837341642:88 , srv872843635:88 , srv996360310:88 , srv1342705741:89 , srv322557391:89 , srv676640103:89 , srv17347669:90 , srv2020146599:90 , srv372481732:90 , srv818260882:90 , srv185082739:91 , srv242281786:91 , srv44320991:91 , srv766261508:91 , srv571693342:531 }
2023-03-12 21:54:17,349 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-03-12 21:54:17,350 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv943921092=96, srv818260882=90, srv225613481=60, srv1014238431=0, srv1404024145=21, srv1198837542=11, srv242281786=64, srv491174685=77, srv837341642=92, srv1342705741=18, srv77210713=88, srv1972708142=47, srv434672176=73, srv112266497=6, srv1300604187=17, srv1058938614=2, srv421275541=71, srv250562630=65, srv2008744041=49, srv372481732=69, srv1882239925=44, srv1442441434=24, srv49106072=76, srv234595589=62, srv1747261948=39, srv1647081085=32, srv641491395=83, srv1442910623=25, srv238942798=63, srv1073402278=3, srv2146814077=59, srv2023367703=52, srv2021574200=51, srv996360310=98, srv1242882556=14, srv1153663657=10, srv1292604335=16, srv372157472=68, srv1146848466=9, srv2089958028=54, srv121050265=12, srv800147750=89, srv1431075565=22, srv185082739=40, srv1073639884=4, srv1860732393=42, srv1140346302=7, srv421334942=72, srv1927053598=45, srv997604676=99, srv1575941921=31, srv2111374628=57, srv460811230=75, srv2098928276=55, srv1146177595=8, srv44320991=74, srv1510848877=28, srv1851063786=41, srv155636319=30, srv152402697=29, srv374134354=70, srv1082537335=5, srv1436575019=23, srv322557391=67, srv1358663018=20, srv563478308=78, srv1246894648=15, srv598523107=80, srv168955075=34, srv1347109977=19, srv754822938=86, srv149133437=27, srv898763244=95, srv229604407=61, srv60729094=81, srv320372594=66, srv1867468589=43, srv2115143022=58, srv713409441=85, srv676640103=84, srv2020146599=50, srv627074760=82, srv890207024=94, srv2103415611=56, srv1710769617=36, srv1482175738=26, srv2025193494=53, srv1993606793=48, srv1029319731=1, srv1701557935=35, srv571693342=79, srv830061719=91, srv17347669=37, srv872843635=93, srv1235682173=13, srv984633106=97, srv1669824696=33, srv766261508=87, srv1742991106=38, srv1959459706=46} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-03-12 21:54:17,379 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-03-12 21:54:17,380 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-03-12 21:54:17,380 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-03-12 21:54:17,380 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-03-12 21:54:17,380 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-03-12 21:54:17,380 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-03-12 21:54:17,381 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-03-12 21:54:17,381 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-03-12 21:54:17,381 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-03-12 21:54:17,382 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-03-12 21:54:17,382 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-03-12 21:54:17,382 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-03-12 21:54:17,382 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-03-12 21:54:17,382 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-03-12 21:54:17,382 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-03-12 21:54:17,382 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-03-12 21:54:17,382 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-03-12 21:54:17,383 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-03-12 21:54:17,383 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-03-12 21:54:17,383 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-03-12 21:54:17,383 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-03-12 21:54:17,383 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-03-12 21:54:17,383 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-03-12 21:54:17,383 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-03-12 21:54:17,383 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-03-12 21:54:17,383 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-03-12 21:54:17,383 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-03-12 21:54:17,384 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-03-12 21:54:17,384 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-03-12 21:54:17,384 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-03-12 21:54:17,384 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-03-12 21:54:17,384 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-03-12 21:54:17,384 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-03-12 21:54:17,384 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-03-12 21:54:17,385 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-03-12 21:54:17,385 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-03-12 21:54:17,385 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-03-12 21:54:17,385 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-03-12 21:54:17,385 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-03-12 21:54:17,385 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-03-12 21:54:17,385 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-03-12 21:54:17,385 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-03-12 21:54:17,385 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-03-12 21:54:17,386 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-03-12 21:54:17,386 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-03-12 21:54:17,386 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-03-12 21:54:17,386 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-03-12 21:54:17,386 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-03-12 21:54:17,386 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-03-12 21:54:17,386 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-03-12 21:54:17,386 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-03-12 21:54:17,386 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-03-12 21:54:17,387 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-03-12 21:54:17,387 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-03-12 21:54:17,387 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-03-12 21:54:17,387 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-03-12 21:54:17,387 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-03-12 21:54:17,387 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-03-12 21:54:17,387 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-03-12 21:54:17,387 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-03-12 21:54:17,387 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-03-12 21:54:17,387 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-03-12 21:54:17,388 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-03-12 21:54:17,388 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-03-12 21:54:17,388 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-03-12 21:54:17,388 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-03-12 21:54:17,388 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-03-12 21:54:17,388 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-03-12 21:54:17,388 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-03-12 21:54:17,388 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-03-12 21:54:17,388 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-03-12 21:54:17,389 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-03-12 21:54:17,389 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-03-12 21:54:17,389 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-03-12 21:54:17,389 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-03-12 21:54:17,389 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-03-12 21:54:17,389 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-03-12 21:54:17,389 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-03-12 21:54:17,389 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-03-12 21:54:17,389 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-03-12 21:54:17,390 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-03-12 21:54:17,390 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-03-12 21:54:17,390 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-03-12 21:54:17,390 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-03-12 21:54:17,390 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-03-12 21:54:17,390 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-03-12 21:54:17,390 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-03-12 21:54:17,390 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-03-12 21:54:17,390 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-03-12 21:54:17,390 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-03-12 21:54:17,391 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-03-12 21:54:17,391 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-03-12 21:54:17,391 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-03-12 21:54:17,391 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-03-12 21:54:17,391 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-03-12 21:54:17,391 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-03-12 21:54:17,391 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-03-12 21:54:17,391 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-03-12 21:54:17,391 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-03-12 21:54:17,391 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-03-12 21:54:17,392 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-03-12 21:54:17,519 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.021732539651653397); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.03585104487502075, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.021732539651653397); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.011166666666666667); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0455, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-03-12 21:54:17,519 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-03-12 21:54:17,520 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.014415397407364366, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.021732539651653397); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.03585104487502075, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.021732539651653397); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.011166666666666667); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0455, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-03-12 21:54:17,754 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 342 ms to try 5000 different iterations.  Found a solution that moves 993 regions; Going from a computed imbalance of 0.014415397407364366 to a new imbalance of 6.178645060998641E-4. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.006434413029274749); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.010498249546785257); MoveCostFunction : (multiplier=7.0, imbalance=0.11033333333333334, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.006434413029274749); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.6666666666666666E-4); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.00425); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-03-12 21:54:17,757 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv185082739:81 , srv627074760:81 , srv766261508:81 , srv168955075:82 , srv242281786:82 , srv1029319731:83 , srv155636319:83 , srv1747261948:83 , srv1927053598:83 , srv2020146599:83 , srv322557391:83 , srv112266497:84 , srv1146177595:84 , srv121050265:84 , srv1300604187:84 , srv1342705741:84 , srv1358663018:84 , srv149133437:84 , srv1669824696:84 , srv17347669:84 , srv1993606793:84 , srv2021574200:84 , srv234595589:84 , srv238942798:84 , srv372481732:84 , srv44320991:84 , srv60729094:84 , srv77210713:84 , srv996360310:84 , srv1198837542:85 , srv1242882556:85 , srv1442910623:85 , srv1510848877:85 , srv152402697:85 , srv1575941921:85 , srv1647081085:85 , srv1867468589:85 , srv1882239925:85 , srv1972708142:85 , srv2089958028:85 , srv225613481:85 , srv320372594:85 , srv374134354:85 , srv421275541:85 , srv434672176:85 , srv641491395:85 , srv754822938:85 , srv800147750:85 , srv830061719:85 , srv872843635:85 , srv997604676:85 , srv1073639884:86 , srv1082537335:86 , srv1140346302:86 , srv1146848466:86 , srv1153663657:86 , srv1235682173:86 , srv1246894648:86 , srv1292604335:86 , srv1347109977:86 , srv1404024145:86 , srv1436575019:86 , srv1701557935:86 , srv2008744041:86 , srv2023367703:86 , srv2025193494:86 , srv2098928276:86 , srv2115143022:86 , srv250562630:86 , srv491174685:86 , srv676640103:86 , srv818260882:86 , srv890207024:86 , srv1014238431:87 , srv1058938614:87 , srv1442441434:87 , srv1482175738:87 , srv1710769617:87 , srv1851063786:87 , srv1860732393:87 , srv1959459706:87 , srv2103415611:87 , srv2111374628:87 , srv2146814077:87 , srv229604407:87 , srv372157472:87 , srv460811230:87 , srv713409441:87 , srv837341642:87 , srv943921092:87 , srv1431075565:88 , srv1742991106:88 , srv421334942:88 , srv49106072:88 , srv563478308:88 , srv598523107:88 , srv898763244:88 , srv984633106:88 , srv1073402278:90 , srv571693342:548 }
2023-03-12 21:54:17,763 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-03-12 21:54:17,764 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv943921092=96, srv818260882=90, srv225613481=60, srv1014238431=0, srv1404024145=21, srv1198837542=11, srv242281786=64, srv491174685=77, srv837341642=92, srv1342705741=18, srv77210713=88, srv1972708142=47, srv434672176=73, srv112266497=6, srv1300604187=17, srv1058938614=2, srv421275541=71, srv250562630=65, srv2008744041=49, srv372481732=69, srv1882239925=44, srv1442441434=24, srv49106072=76, srv234595589=62, srv1747261948=39, srv1647081085=32, srv641491395=83, srv1442910623=25, srv238942798=63, srv1073402278=3, srv2146814077=59, srv2023367703=52, srv2021574200=51, srv996360310=98, srv1242882556=14, srv1153663657=10, srv1292604335=16, srv372157472=68, srv1146848466=9, srv2089958028=54, srv121050265=12, srv800147750=89, srv1431075565=22, srv185082739=40, srv1073639884=4, srv1860732393=42, srv1140346302=7, srv421334942=72, srv1927053598=45, srv997604676=99, srv1575941921=31, srv2111374628=57, srv460811230=75, srv2098928276=55, srv1146177595=8, srv44320991=74, srv1510848877=28, srv1851063786=41, srv155636319=30, srv152402697=29, srv374134354=70, srv1082537335=5, srv1436575019=23, srv322557391=67, srv1358663018=20, srv563478308=78, srv1246894648=15, srv598523107=80, srv168955075=34, srv1347109977=19, srv754822938=86, srv149133437=27, srv898763244=95, srv229604407=61, srv60729094=81, srv320372594=66, srv1867468589=43, srv2115143022=58, srv713409441=85, srv676640103=84, srv2020146599=50, srv627074760=82, srv890207024=94, srv2103415611=56, srv1710769617=36, srv1482175738=26, srv2025193494=53, srv1993606793=48, srv1029319731=1, srv1701557935=35, srv571693342=79, srv830061719=91, srv17347669=37, srv872843635=93, srv1235682173=13, srv984633106=97, srv1669824696=33, srv766261508=87, srv1742991106=38, srv1959459706=46} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-03-12 21:54:17,782 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-03-12 21:54:17,782 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-03-12 21:54:17,782 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-03-12 21:54:17,782 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-03-12 21:54:17,782 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-03-12 21:54:17,782 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-03-12 21:54:17,782 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-03-12 21:54:17,782 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-03-12 21:54:17,783 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-03-12 21:54:17,783 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-03-12 21:54:17,783 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-03-12 21:54:17,783 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-03-12 21:54:17,783 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-03-12 21:54:17,783 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-03-12 21:54:17,783 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-03-12 21:54:17,783 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-03-12 21:54:17,783 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-03-12 21:54:17,783 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-03-12 21:54:17,784 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-03-12 21:54:17,784 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-03-12 21:54:17,784 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-03-12 21:54:17,784 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-03-12 21:54:17,784 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-03-12 21:54:17,784 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-03-12 21:54:17,784 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-03-12 21:54:17,784 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-03-12 21:54:17,784 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-03-12 21:54:17,784 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-03-12 21:54:17,784 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-03-12 21:54:17,784 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-03-12 21:54:17,784 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-03-12 21:54:17,785 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-03-12 21:54:17,785 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-03-12 21:54:17,785 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-03-12 21:54:17,785 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-03-12 21:54:17,785 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-03-12 21:54:17,785 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-03-12 21:54:17,785 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-03-12 21:54:17,785 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-03-12 21:54:17,785 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-03-12 21:54:17,785 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-03-12 21:54:17,785 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-03-12 21:54:17,785 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-03-12 21:54:17,785 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-03-12 21:54:17,785 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-03-12 21:54:17,785 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-03-12 21:54:17,785 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-03-12 21:54:17,785 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-03-12 21:54:17,786 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-03-12 21:54:17,786 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-03-12 21:54:17,786 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-03-12 21:54:17,786 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-03-12 21:54:17,786 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-03-12 21:54:17,786 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-03-12 21:54:17,786 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-03-12 21:54:17,786 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-03-12 21:54:17,786 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-03-12 21:54:17,786 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-03-12 21:54:17,786 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-03-12 21:54:17,786 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-03-12 21:54:17,786 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-03-12 21:54:17,786 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-03-12 21:54:17,786 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-03-12 21:54:17,786 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-03-12 21:54:17,786 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-03-12 21:54:17,786 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-03-12 21:54:17,787 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-03-12 21:54:17,787 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-03-12 21:54:17,787 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-03-12 21:54:17,787 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-03-12 21:54:17,787 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-03-12 21:54:17,787 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-03-12 21:54:17,787 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-03-12 21:54:17,787 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-03-12 21:54:17,787 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-03-12 21:54:17,787 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-03-12 21:54:17,787 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-03-12 21:54:17,787 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-03-12 21:54:17,787 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-03-12 21:54:17,787 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-03-12 21:54:17,787 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-03-12 21:54:17,787 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-03-12 21:54:17,787 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-03-12 21:54:17,787 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-03-12 21:54:17,787 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-03-12 21:54:17,788 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-03-12 21:54:17,788 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-03-12 21:54:17,788 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-03-12 21:54:17,788 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-03-12 21:54:17,788 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-03-12 21:54:17,788 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-03-12 21:54:17,788 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-03-12 21:54:17,788 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-03-12 21:54:17,788 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-03-12 21:54:17,788 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-03-12 21:54:17,788 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-03-12 21:54:17,788 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-03-12 21:54:17,788 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-03-12 21:54:17,788 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-03-12 21:54:17,788 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-03-12 21:54:17,789 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-03-12 21:54:17,891 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.006434413029274749); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.010498249546785257); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.006434413029274749); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.6666666666666666E-4); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.00425); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-03-12 21:54:17,891 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-03-12 21:54:17,892 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=6.109113714875383E-4, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.006434413029274749); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.010498249546785257); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.006434413029274749); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.6666666666666666E-4); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.00425); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-03-12 21:54:18,215 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 414 ms to try 5000 different iterations.  Found a solution that moves 244 regions; Going from a computed imbalance of 6.109113714875383E-4 to a new imbalance of 4.1709916630096794E-5. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=4.178341294946416E-4); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0017727200782610348); MoveCostFunction : (multiplier=7.0, imbalance=0.02711111111111111, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=4.178341294946416E-4); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=3.333333333333333E-4); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-03-12 21:54:18,216 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1073402278:83 , srv1669824696:83 , srv1959459706:83 , srv460811230:83 , srv766261508:83 , srv1014238431:84 , srv1058938614:84 , srv1073639884:84 , srv1146848466:84 , srv1153663657:84 , srv121050265:84 , srv1235682173:84 , srv1482175738:84 , srv1647081085:84 , srv168955075:84 , srv1701557935:84 , srv1710769617:84 , srv17347669:84 , srv1742991106:84 , srv1747261948:84 , srv1867468589:84 , srv1882239925:84 , srv1972708142:84 , srv2020146599:84 , srv2146814077:84 , srv372157472:84 , srv421334942:84 , srv49106072:84 , srv563478308:84 , srv60729094:84 , srv641491395:84 , srv713409441:84 , srv754822938:84 , srv77210713:84 , srv818260882:84 , srv830061719:84 , srv837341642:84 , srv872843635:84 , srv890207024:84 , srv898763244:84 , srv984633106:84 , srv996360310:84 , srv1082537335:85 , srv112266497:85 , srv1140346302:85 , srv1146177595:85 , srv1198837542:85 , srv1242882556:85 , srv1246894648:85 , srv1292604335:85 , srv1300604187:85 , srv1342705741:85 , srv1347109977:85 , srv1358663018:85 , srv1404024145:85 , srv1431075565:85 , srv1436575019:85 , srv1442441434:85 , srv1442910623:85 , srv149133437:85 , srv1510848877:85 , srv152402697:85 , srv155636319:85 , srv185082739:85 , srv1851063786:85 , srv1860732393:85 , srv1993606793:85 , srv2008744041:85 , srv2021574200:85 , srv2023367703:85 , srv2089958028:85 , srv2098928276:85 , srv2103415611:85 , srv2111374628:85 , srv2115143022:85 , srv225613481:85 , srv229604407:85 , srv234595589:85 , srv238942798:85 , srv242281786:85 , srv250562630:85 , srv320372594:85 , srv322557391:85 , srv372481732:85 , srv374134354:85 , srv421275541:85 , srv434672176:85 , srv44320991:85 , srv491174685:85 , srv598523107:85 , srv627074760:85 , srv676640103:85 , srv800147750:85 , srv943921092:85 , srv997604676:85 , srv1029319731:86 , srv1575941921:86 , srv2025193494:86 , srv1927053598:87 , srv571693342:627 }
2023-03-12 21:54:18,220 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-03-12 21:54:18,220 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv943921092=96, srv818260882=90, srv225613481=60, srv1014238431=0, srv1404024145=21, srv1198837542=11, srv242281786=64, srv491174685=77, srv837341642=92, srv1342705741=18, srv77210713=88, srv1972708142=47, srv434672176=73, srv112266497=6, srv1300604187=17, srv1058938614=2, srv421275541=71, srv250562630=65, srv2008744041=49, srv372481732=69, srv1882239925=44, srv1442441434=24, srv49106072=76, srv234595589=62, srv1747261948=39, srv1647081085=32, srv641491395=83, srv1442910623=25, srv238942798=63, srv1073402278=3, srv2146814077=59, srv2023367703=52, srv2021574200=51, srv996360310=98, srv1242882556=14, srv1153663657=10, srv1292604335=16, srv372157472=68, srv1146848466=9, srv2089958028=54, srv121050265=12, srv800147750=89, srv1431075565=22, srv185082739=40, srv1073639884=4, srv1860732393=42, srv1140346302=7, srv421334942=72, srv1927053598=45, srv997604676=99, srv1575941921=31, srv2111374628=57, srv460811230=75, srv2098928276=55, srv1146177595=8, srv44320991=74, srv1510848877=28, srv1851063786=41, srv155636319=30, srv152402697=29, srv374134354=70, srv1082537335=5, srv1436575019=23, srv322557391=67, srv1358663018=20, srv563478308=78, srv1246894648=15, srv598523107=80, srv168955075=34, srv1347109977=19, srv754822938=86, srv149133437=27, srv898763244=95, srv229604407=61, srv60729094=81, srv320372594=66, srv1867468589=43, srv2115143022=58, srv713409441=85, srv676640103=84, srv2020146599=50, srv627074760=82, srv890207024=94, srv2103415611=56, srv1710769617=36, srv1482175738=26, srv2025193494=53, srv1993606793=48, srv1029319731=1, srv1701557935=35, srv571693342=79, srv830061719=91, srv17347669=37, srv872843635=93, srv1235682173=13, srv984633106=97, srv1669824696=33, srv766261508=87, srv1742991106=38, srv1959459706=46} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-03-12 21:54:18,231 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-03-12 21:54:18,231 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-03-12 21:54:18,231 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-03-12 21:54:18,231 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-03-12 21:54:18,231 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-03-12 21:54:18,231 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-03-12 21:54:18,231 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-03-12 21:54:18,231 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-03-12 21:54:18,232 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-03-12 21:54:18,232 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-03-12 21:54:18,232 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-03-12 21:54:18,232 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-03-12 21:54:18,232 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-03-12 21:54:18,232 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-03-12 21:54:18,232 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-03-12 21:54:18,232 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-03-12 21:54:18,232 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-03-12 21:54:18,232 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-03-12 21:54:18,232 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-03-12 21:54:18,232 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-03-12 21:54:18,232 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-03-12 21:54:18,232 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-03-12 21:54:18,232 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-03-12 21:54:18,232 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-03-12 21:54:18,233 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-03-12 21:54:18,233 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-03-12 21:54:18,233 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-03-12 21:54:18,233 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-03-12 21:54:18,233 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-03-12 21:54:18,233 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-03-12 21:54:18,233 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-03-12 21:54:18,233 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-03-12 21:54:18,233 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-03-12 21:54:18,233 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-03-12 21:54:18,233 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-03-12 21:54:18,233 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-03-12 21:54:18,233 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-03-12 21:54:18,233 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-03-12 21:54:18,233 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-03-12 21:54:18,233 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-03-12 21:54:18,233 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-03-12 21:54:18,233 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-03-12 21:54:18,233 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-03-12 21:54:18,233 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-03-12 21:54:18,234 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-03-12 21:54:18,234 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-03-12 21:54:18,234 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-03-12 21:54:18,234 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-03-12 21:54:18,234 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-03-12 21:54:18,234 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-03-12 21:54:18,234 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-03-12 21:54:18,234 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-03-12 21:54:18,234 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-03-12 21:54:18,234 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-03-12 21:54:18,234 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-03-12 21:54:18,234 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-03-12 21:54:18,234 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-03-12 21:54:18,234 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-03-12 21:54:18,234 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-03-12 21:54:18,234 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-03-12 21:54:18,235 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-03-12 21:54:18,235 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-03-12 21:54:18,235 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-03-12 21:54:18,235 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-03-12 21:54:18,235 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-03-12 21:54:18,235 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-03-12 21:54:18,235 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-03-12 21:54:18,235 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-03-12 21:54:18,235 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-03-12 21:54:18,236 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-03-12 21:54:18,236 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-03-12 21:54:18,236 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-03-12 21:54:18,236 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-03-12 21:54:18,236 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-03-12 21:54:18,236 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-03-12 21:54:18,236 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-03-12 21:54:18,236 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-03-12 21:54:18,236 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-03-12 21:54:18,236 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-03-12 21:54:18,236 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-03-12 21:54:18,237 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-03-12 21:54:18,237 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-03-12 21:54:18,237 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-03-12 21:54:18,237 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-03-12 21:54:18,237 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-03-12 21:54:18,237 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-03-12 21:54:18,237 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-03-12 21:54:18,237 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-03-12 21:54:18,237 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-03-12 21:54:18,237 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-03-12 21:54:18,237 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-03-12 21:54:18,237 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-03-12 21:54:18,237 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-03-12 21:54:18,237 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-03-12 21:54:18,237 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-03-12 21:54:18,238 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-03-12 21:54:18,238 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-03-12 21:54:18,238 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-03-12 21:54:18,238 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-03-12 21:54:18,238 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-03-12 21:54:18,238 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-03-12 21:54:18,348 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=4.178341294946416E-4); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0017727200782610348); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=4.178341294946416E-4); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=3.333333333333333E-4); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-03-12 21:54:18,348 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-03-12 21:54:18,349 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=4.000139211307007E-5, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=4.178341294946416E-4); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0017727200782610348); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=4.178341294946416E-4); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=3.333333333333333E-4); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-03-12 21:54:18,561 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 312 ms to try 5000 different iterations.  Found a solution that moves 23 regions; Going from a computed imbalance of 4.000139211307007E-5 to a new imbalance of 6.905118496010697E-6. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0014982219165849825); MoveCostFunction : (multiplier=7.0, imbalance=0.0025555555555555557); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-03-12 21:54:18,561 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1073639884:83 , srv1342705741:83 , srv1442441434:83 , srv1442910623:83 , srv1927053598:83 , srv2023367703:83 , srv2025193494:83 , srv1014238431:84 , srv1029319731:84 , srv1058938614:84 , srv1073402278:84 , srv1082537335:84 , srv112266497:84 , srv1140346302:84 , srv1146177595:84 , srv1146848466:84 , srv1153663657:84 , srv1198837542:84 , srv1235682173:84 , srv1242882556:84 , srv1246894648:84 , srv1292604335:84 , srv1300604187:84 , srv1347109977:84 , srv1358663018:84 , srv1404024145:84 , srv1431075565:84 , srv1436575019:84 , srv1482175738:84 , srv149133437:84 , srv1510848877:84 , srv152402697:84 , srv155636319:84 , srv1575941921:84 , srv1647081085:84 , srv1669824696:84 , srv1710769617:84 , srv17347669:84 , srv1742991106:84 , srv185082739:84 , srv1851063786:84 , srv1860732393:84 , srv1867468589:84 , srv1882239925:84 , srv1959459706:84 , srv1972708142:84 , srv1993606793:84 , srv2008744041:84 , srv2020146599:84 , srv2021574200:84 , srv2089958028:84 , srv2098928276:84 , srv2103415611:84 , srv2111374628:84 , srv2115143022:84 , srv2146814077:84 , srv225613481:84 , srv229604407:84 , srv234595589:84 , srv238942798:84 , srv242281786:84 , srv250562630:84 , srv320372594:84 , srv322557391:84 , srv372157472:84 , srv372481732:84 , srv374134354:84 , srv421275541:84 , srv421334942:84 , srv434672176:84 , srv44320991:84 , srv49106072:84 , srv491174685:84 , srv563478308:84 , srv598523107:84 , srv60729094:84 , srv627074760:84 , srv676640103:84 , srv713409441:84 , srv754822938:84 , srv77210713:84 , srv800147750:84 , srv818260882:84 , srv830061719:84 , srv837341642:84 , srv872843635:84 , srv890207024:84 , srv898763244:84 , srv943921092:84 , srv984633106:84 , srv996360310:84 , srv997604676:84 , srv121050265:85 , srv168955075:85 , srv1701557935:85 , srv1747261948:85 , srv460811230:85 , srv641491395:85 , srv766261508:85 , srv571693342:684 }
2023-03-12 21:54:18,565 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-03-12 21:54:18,566 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv943921092=96, srv818260882=90, srv225613481=60, srv1014238431=0, srv1404024145=21, srv1198837542=11, srv242281786=64, srv491174685=77, srv837341642=92, srv1342705741=18, srv77210713=88, srv1972708142=47, srv434672176=73, srv112266497=6, srv1300604187=17, srv1058938614=2, srv421275541=71, srv250562630=65, srv2008744041=49, srv372481732=69, srv1882239925=44, srv1442441434=24, srv49106072=76, srv234595589=62, srv1747261948=39, srv1647081085=32, srv641491395=83, srv1442910623=25, srv238942798=63, srv1073402278=3, srv2146814077=59, srv2023367703=52, srv2021574200=51, srv996360310=98, srv1242882556=14, srv1153663657=10, srv1292604335=16, srv372157472=68, srv1146848466=9, srv2089958028=54, srv121050265=12, srv800147750=89, srv1431075565=22, srv185082739=40, srv1073639884=4, srv1860732393=42, srv1140346302=7, srv421334942=72, srv1927053598=45, srv997604676=99, srv1575941921=31, srv2111374628=57, srv460811230=75, srv2098928276=55, srv1146177595=8, srv44320991=74, srv1510848877=28, srv1851063786=41, srv155636319=30, srv152402697=29, srv374134354=70, srv1082537335=5, srv1436575019=23, srv322557391=67, srv1358663018=20, srv563478308=78, srv1246894648=15, srv598523107=80, srv168955075=34, srv1347109977=19, srv754822938=86, srv149133437=27, srv898763244=95, srv229604407=61, srv60729094=81, srv320372594=66, srv1867468589=43, srv2115143022=58, srv713409441=85, srv676640103=84, srv2020146599=50, srv627074760=82, srv890207024=94, srv2103415611=56, srv1710769617=36, srv1482175738=26, srv2025193494=53, srv1993606793=48, srv1029319731=1, srv1701557935=35, srv571693342=79, srv830061719=91, srv17347669=37, srv872843635=93, srv1235682173=13, srv984633106=97, srv1669824696=33, srv766261508=87, srv1742991106=38, srv1959459706=46} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-03-12 21:54:18,576 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-03-12 21:54:18,576 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-03-12 21:54:18,576 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-03-12 21:54:18,576 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-03-12 21:54:18,576 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-03-12 21:54:18,576 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-03-12 21:54:18,576 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-03-12 21:54:18,576 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-03-12 21:54:18,577 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-03-12 21:54:18,577 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-03-12 21:54:18,577 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-03-12 21:54:18,577 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-03-12 21:54:18,577 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-03-12 21:54:18,577 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-03-12 21:54:18,577 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-03-12 21:54:18,577 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-03-12 21:54:18,577 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-03-12 21:54:18,577 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-03-12 21:54:18,577 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-03-12 21:54:18,577 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-03-12 21:54:18,577 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-03-12 21:54:18,577 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-03-12 21:54:18,577 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-03-12 21:54:18,577 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-03-12 21:54:18,577 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-03-12 21:54:18,577 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-03-12 21:54:18,577 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-03-12 21:54:18,577 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-03-12 21:54:18,577 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-03-12 21:54:18,578 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-03-12 21:54:18,578 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-03-12 21:54:18,578 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-03-12 21:54:18,578 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-03-12 21:54:18,578 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-03-12 21:54:18,578 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-03-12 21:54:18,578 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-03-12 21:54:18,578 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-03-12 21:54:18,578 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-03-12 21:54:18,578 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-03-12 21:54:18,578 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-03-12 21:54:18,578 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-03-12 21:54:18,578 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-03-12 21:54:18,578 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-03-12 21:54:18,578 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-03-12 21:54:18,578 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-03-12 21:54:18,578 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-03-12 21:54:18,578 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-03-12 21:54:18,578 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-03-12 21:54:18,578 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-03-12 21:54:18,578 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-03-12 21:54:18,578 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-03-12 21:54:18,579 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-03-12 21:54:18,579 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-03-12 21:54:18,579 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-03-12 21:54:18,579 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-03-12 21:54:18,579 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-03-12 21:54:18,579 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-03-12 21:54:18,579 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-03-12 21:54:18,579 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-03-12 21:54:18,579 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-03-12 21:54:18,579 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-03-12 21:54:18,579 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-03-12 21:54:18,579 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-03-12 21:54:18,579 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-03-12 21:54:18,579 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-03-12 21:54:18,579 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-03-12 21:54:18,579 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-03-12 21:54:18,579 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-03-12 21:54:18,579 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-03-12 21:54:18,579 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-03-12 21:54:18,579 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-03-12 21:54:18,579 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-03-12 21:54:18,579 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-03-12 21:54:18,579 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-03-12 21:54:18,580 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-03-12 21:54:18,580 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-03-12 21:54:18,580 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-03-12 21:54:18,580 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-03-12 21:54:18,580 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-03-12 21:54:18,580 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-03-12 21:54:18,580 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-03-12 21:54:18,580 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-03-12 21:54:18,580 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-03-12 21:54:18,580 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-03-12 21:54:18,580 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-03-12 21:54:18,580 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-03-12 21:54:18,580 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-03-12 21:54:18,580 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-03-12 21:54:18,580 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-03-12 21:54:18,580 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-03-12 21:54:18,580 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-03-12 21:54:18,580 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-03-12 21:54:18,580 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-03-12 21:54:18,581 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-03-12 21:54:18,581 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-03-12 21:54:18,581 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-03-12 21:54:18,581 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-03-12 21:54:18,581 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-03-12 21:54:18,581 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-03-12 21:54:18,581 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-03-12 21:54:18,581 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-03-12 21:54:18,684 INFO  [Time-limited test] balancer.StochasticLoadBalancer(381): Cluster wide - skipping load balancing because weighted average imbalance=6.744069053831948E-6 <= threshold(0.025). If you want more aggressive balancing, either lower hbase.master.balancer.stochastic.minCostNeedBalance from 0.025 or increase the relative multiplier(s) of the specific cost function(s). functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0014982219165849825); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-03-12 21:54:18,684 INFO  [Time-limited test] balancer.BalancerTestBase(570): Mock Final balance: { srv1073639884:83 , srv1342705741:83 , srv1442441434:83 , srv1442910623:83 , srv1927053598:83 , srv2023367703:83 , srv2025193494:83 , srv1014238431:84 , srv1029319731:84 , srv1058938614:84 , srv1073402278:84 , srv1082537335:84 , srv112266497:84 , srv1140346302:84 , srv1146177595:84 , srv1146848466:84 , srv1153663657:84 , srv1198837542:84 , srv1235682173:84 , srv1242882556:84 , srv1246894648:84 , srv1292604335:84 , srv1300604187:84 , srv1347109977:84 , srv1358663018:84 , srv1404024145:84 , srv1431075565:84 , srv1436575019:84 , srv1482175738:84 , srv149133437:84 , srv1510848877:84 , srv152402697:84 , srv155636319:84 , srv1575941921:84 , srv1647081085:84 , srv1669824696:84 , srv1710769617:84 , srv17347669:84 , srv1742991106:84 , srv185082739:84 , srv1851063786:84 , srv1860732393:84 , srv1867468589:84 , srv1882239925:84 , srv1959459706:84 , srv1972708142:84 , srv1993606793:84 , srv2008744041:84 , srv2020146599:84 , srv2021574200:84 , srv2089958028:84 , srv2098928276:84 , srv2103415611:84 , srv2111374628:84 , srv2115143022:84 , srv2146814077:84 , srv225613481:84 , srv229604407:84 , srv234595589:84 , srv238942798:84 , srv242281786:84 , srv250562630:84 , srv320372594:84 , srv322557391:84 , srv372157472:84 , srv372481732:84 , srv374134354:84 , srv421275541:84 , srv421334942:84 , srv434672176:84 , srv44320991:84 , srv49106072:84 , srv491174685:84 , srv563478308:84 , srv598523107:84 , srv60729094:84 , srv627074760:84 , srv676640103:84 , srv713409441:84 , srv754822938:84 , srv77210713:84 , srv800147750:84 , srv818260882:84 , srv830061719:84 , srv837341642:84 , srv872843635:84 , srv890207024:84 , srv898763244:84 , srv943921092:84 , srv984633106:84 , srv996360310:84 , srv997604676:84 , srv121050265:85 , srv168955075:85 , srv1701557935:85 , srv1747261948:85 , srv460811230:85 , srv641491395:85 , srv766261508:85 , srv571693342:684 }
2023-03-12 21:54:18,711 INFO  [Time-limited test] hbase.ResourceChecker(175): after: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnLargeClusterWithRacks Thread=10 (was 10), OpenFileDescriptor=260 (was 260), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=261 (was 249) - SystemLoadAverage LEAK? -, ProcessCount=169 (was 169), AvailableMemoryMB=4817 (was 5312)
2023-03-12 21:54:18,718 INFO  [Time-limited test] hbase.ResourceChecker(147): before: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnMidClusterWithRacks Thread=10, OpenFileDescriptor=260, MaxFileDescriptor=60000, SystemLoadAverage=261, ProcessCount=169, AvailableMemoryMB=4817
2023-03-12 21:54:18,719 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2023-03-12 21:54:18,719 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=5000, runMaxSteps=true, stepsPerRegion=800, maxRunningTime=120000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 111077.0 etc.
2023-03-12 21:54:18,726 INFO  [Time-limited test] balancer.BalancerTestBase(547): Mock Cluster : { srv1018261823:84 , srv1041030733:84 , srv105482051:84 , srv1156611836:84 , srv1331123916:84 , srv1440935656:84 , srv1445860330:84 , srv1467070298:84 , srv1542570861:84 , srv1696205329:84 , srv1709817297:84 , srv1773126572:84 , srv1784740294:84 , srv180562288:84 , srv193326699:84 , srv1955342746:84 , srv2035549859:84 , srv204278883:84 , srv2078602492:84 , srv2084868389:84 , srv254211397:84 , srv379162926:84 , srv398695809:84 , srv449951337:84 , srv513703206:84 , srv681189390:84 , srv745883107:84 , srv833000369:84 , srv947483099:84 , srv785455171:264 } [srvr=30 rgns=2700 avg=90.0 max=90 min=90]
2023-03-12 21:54:18,727 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-03-12 21:54:18,728 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv2035549859=16, srv2078602492=18, srv513703206=24, srv193326699=14, srv785455171=27, srv1467070298=7, srv745883107=26, srv204278883=17, srv833000369=28, srv1331123916=4, srv1955342746=15, srv1440935656=5, srv1156611836=3, srv1041030733=1, srv2084868389=19, srv379162926=21, srv105482051=2, srv1542570861=8, srv1709817297=10, srv254211397=20, srv1445860330=6, srv398695809=22, srv449951337=23, srv1784740294=12, srv1773126572=11, srv180562288=13, srv1018261823=0, srv681189390=25, srv947483099=29, srv1696205329=9} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-03-12 21:54:18,736 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-03-12 21:54:18,736 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-03-12 21:54:18,736 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-03-12 21:54:18,736 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-03-12 21:54:18,736 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-03-12 21:54:18,736 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-03-12 21:54:18,736 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-03-12 21:54:18,736 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-03-12 21:54:18,736 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-03-12 21:54:18,736 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-03-12 21:54:18,736 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-03-12 21:54:18,736 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-03-12 21:54:18,737 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-03-12 21:54:18,737 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-03-12 21:54:18,737 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-03-12 21:54:18,737 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-03-12 21:54:18,737 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-03-12 21:54:18,737 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-03-12 21:54:18,737 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-03-12 21:54:18,737 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-03-12 21:54:18,737 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-03-12 21:54:18,737 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-03-12 21:54:18,737 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-03-12 21:54:18,737 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-03-12 21:54:18,737 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-03-12 21:54:18,737 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-03-12 21:54:18,737 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-03-12 21:54:18,737 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-03-12 21:54:18,737 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-03-12 21:54:18,737 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-03-12 21:54:18,737 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=10, number of hosts=30, number of racks=4
2023-03-12 21:54:18,752 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=1.1388045562018694, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-03-12 21:54:18,752 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.9912630411888486, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=1.1388045562018694, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=64800000
2023-03-12 21:56:18,740 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 120001 ms to try 6410423 different iterations.  Found a solution that moves 1856 regions; Going from a computed imbalance of 0.9912630411888486 to a new imbalance of 4.3319965896196796E-5. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); MoveCostFunction : (multiplier=7.0, imbalance=0.6874074074074074, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-03-12 21:56:18,746 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1018261823:90 , srv1041030733:90 , srv105482051:90 , srv1156611836:90 , srv1331123916:90 , srv1440935656:90 , srv1445860330:90 , srv1467070298:90 , srv1542570861:90 , srv1696205329:90 , srv1709817297:90 , srv1773126572:90 , srv1784740294:90 , srv180562288:90 , srv193326699:90 , srv1955342746:90 , srv2035549859:90 , srv204278883:90 , srv2078602492:90 , srv2084868389:90 , srv254211397:90 , srv379162926:90 , srv398695809:90 , srv449951337:90 , srv513703206:90 , srv681189390:90 , srv745883107:90 , srv785455171:90 , srv833000369:90 , srv947483099:90 }
2023-03-12 21:56:18,747 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-03-12 21:56:18,747 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv2035549859=16, srv2078602492=18, srv513703206=24, srv193326699=14, srv785455171=27, srv1467070298=7, srv745883107=26, srv204278883=17, srv833000369=28, srv1331123916=4, srv1955342746=15, srv1440935656=5, srv1156611836=3, srv1041030733=1, srv2084868389=19, srv379162926=21, srv105482051=2, srv1542570861=8, srv1709817297=10, srv254211397=20, srv1445860330=6, srv398695809=22, srv449951337=23, srv1784740294=12, srv1773126572=11, srv180562288=13, srv1018261823=0, srv681189390=25, srv947483099=29, srv1696205329=9} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-03-12 21:56:18,750 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-03-12 21:56:18,750 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-03-12 21:56:18,750 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-03-12 21:56:18,750 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-03-12 21:56:18,750 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-03-12 21:56:18,750 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-03-12 21:56:18,751 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-03-12 21:56:18,751 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-03-12 21:56:18,751 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-03-12 21:56:18,751 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-03-12 21:56:18,751 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-03-12 21:56:18,751 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-03-12 21:56:18,751 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-03-12 21:56:18,751 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-03-12 21:56:18,751 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-03-12 21:56:18,751 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-03-12 21:56:18,751 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-03-12 21:56:18,751 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-03-12 21:56:18,751 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-03-12 21:56:18,751 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-03-12 21:56:18,751 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-03-12 21:56:18,751 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-03-12 21:56:18,751 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-03-12 21:56:18,751 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-03-12 21:56:18,751 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-03-12 21:56:18,751 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-03-12 21:56:18,751 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-03-12 21:56:18,751 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-03-12 21:56:18,751 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-03-12 21:56:18,751 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-03-12 21:56:18,752 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=10, number of hosts=30, number of racks=4
2023-03-12 21:56:18,763 INFO  [Time-limited test] balancer.StochasticLoadBalancer(381): Cluster wide - skipping load balancing because weighted average imbalance=0.0 <= threshold(0.025). If you want more aggressive balancing, either lower hbase.master.balancer.stochastic.minCostNeedBalance from 0.025 or increase the relative multiplier(s) of the specific cost function(s). functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-03-12 21:56:18,763 INFO  [Time-limited test] balancer.BalancerTestBase(570): Mock Final balance: { srv1018261823:90 , srv1041030733:90 , srv105482051:90 , srv1156611836:90 , srv1331123916:90 , srv1440935656:90 , srv1445860330:90 , srv1467070298:90 , srv1542570861:90 , srv1696205329:90 , srv1709817297:90 , srv1773126572:90 , srv1784740294:90 , srv180562288:90 , srv193326699:90 , srv1955342746:90 , srv2035549859:90 , srv204278883:90 , srv2078602492:90 , srv2084868389:90 , srv254211397:90 , srv379162926:90 , srv398695809:90 , srv449951337:90 , srv513703206:90 , srv681189390:90 , srv745883107:90 , srv785455171:90 , srv833000369:90 , srv947483099:90 }
2023-03-12 21:56:18,778 INFO  [Time-limited test] hbase.ResourceChecker(175): after: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnMidClusterWithRacks Thread=9 (was 10), OpenFileDescriptor=260 (was 260), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=154 (was 261), ProcessCount=169 (was 169), AvailableMemoryMB=4508 (was 4817)