2023-10-04 16:53:25,996 INFO  [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks timeout: 13 mins
2023-10-04 16:53:26,285 WARN  [Time-limited test] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties
2023-10-04 16:53:26,393 INFO  [Time-limited test] metrics.MetricRegistriesLoader(60): Loaded MetricRegistries class org.apache.hadoop.hbase.metrics.impl.MetricRegistriesImpl
2023-10-04 16:53:26,454 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2023-10-04 16:53:26,461 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc.
2023-10-04 16:53:26,475 INFO  [Time-limited test] hbase.ResourceChecker(147): before: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnLargeClusterWithRacks Thread=12, OpenFileDescriptor=263, MaxFileDescriptor=60000, SystemLoadAverage=270, ProcessCount=170, AvailableMemoryMB=8136
2023-10-04 16:53:26,477 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2023-10-04 16:53:26,477 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=5000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=10000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc.
2023-10-04 16:53:26,610 INFO  [Time-limited test] balancer.BalancerTestBase(547): Mock Cluster : { srv101770247:84 , srv1068827785:84 , srv1073803850:84 , srv1098797264:84 , srv1103055446:84 , srv1171857255:84 , srv1196129839:84 , srv121258908:84 , srv1242692316:84 , srv1269190573:84 , srv1270451779:84 , srv128055135:84 , srv1317613494:84 , srv1329988143:84 , srv1330111195:84 , srv1462187019:84 , srv1507664158:84 , srv1516410130:84 , srv1537522029:84 , srv1553142427:84 , srv1572817834:84 , srv1584049622:84 , srv1607131590:84 , srv1638425624:84 , srv168531986:84 , srv1729558305:84 , srv1731758792:84 , srv1757188297:84 , srv1775813962:84 , srv1782116099:84 , srv1811697367:84 , srv1816724103:84 , srv1835033928:84 , srv1838591256:84 , srv1861423466:84 , srv1867565385:84 , srv1873933404:84 , srv1909479367:84 , srv1917077267:84 , srv1933007072:84 , srv1938662934:84 , srv1940372420:84 , srv1945176629:84 , srv195595895:84 , srv1967203201:84 , srv1969292362:84 , srv1972177660:84 , srv1983117846:84 , srv1996387187:84 , srv2017184412:84 , srv2034321081:84 , srv2037912926:84 , srv2061780628:84 , srv2062096408:84 , srv2065026210:84 , srv2069377194:84 , srv2075093471:84 , srv2084554257:84 , srv2106558583:84 , srv2112978604:84 , srv2144965382:84 , srv219788335:84 , srv229769047:84 , srv35462773:84 , srv47214118:84 , srv483743733:84 , srv486050198:84 , srv487879435:84 , srv492056613:84 , srv49333046:84 , srv564770534:84 , srv576370357:84 , srv588858185:84 , srv626104979:84 , srv631466097:84 , srv644722014:84 , srv648109908:84 , srv676823909:84 , srv685159509:84 , srv686277106:84 , srv68813696:84 , srv73459681:84 , srv747041260:84 , srv775838387:84 , srv781990958:84 , srv793011736:84 , srv832161682:84 , srv84348585:84 , srv853952991:84 , srv879511394:84 , srv903848075:84 , srv943094993:84 , srv959543756:84 , srv962871361:84 , srv972265165:84 , srv972352255:84 , srv985947319:84 , srv993734056:84 , srv995172051:84 , srv1075389140:684 } [srvr=100 rgns=9000 avg=90.0 max=90 min=90]
2023-10-04 16:53:26,619 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-10-04 16:53:26,628 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1909479367=38, srv2144965382=61, srv219788335=62, srv648109908=77, srv1516410130=18, srv47214118=65, srv985947319=97, srv486050198=67, srv972265165=95, srv1073803850=2, srv2062096408=54, srv1098797264=4, srv1917077267=39, srv943094993=92, srv2061780628=53, srv1972177660=47, srv832161682=87, srv2112978604=60, srv1572817834=21, srv1933007072=40, srv2034321081=51, srv68813696=81, srv747041260=83, srv1507664158=17, srv2106558583=59, srv1835033928=33, srv73459681=82, srv49333046=70, srv2037912926=52, srv229769047=63, srv962871361=94, srv1242692316=9, srv121258908=8, srv1775813962=29, srv1838591256=34, srv1171857255=6, srv1983117846=48, srv1996387187=49, srv84348585=88, srv35462773=64, srv1867565385=36, srv631466097=75, srv1731758792=27, srv1940372420=42, srv775838387=84, srv564770534=71, srv2017184412=50, srv879511394=90, srv1553142427=20, srv1103055446=5, srv1638425624=24, srv1967203201=45, srv588858185=73, srv1607131590=23, srv1782116099=30, srv1816724103=32, srv101770247=0, srv1969292362=46, srv1729558305=26, srv1945176629=43, srv793011736=86, srv1811697367=31, srv2069377194=56, srv1075389140=3, srv2065026210=55, srv1873933404=37, srv1196129839=7, srv483743733=66, srv1938662934=41, srv492056613=69, srv1861423466=35, srv1757188297=28, srv2084554257=58, srv576370357=72, srv128055135=12, srv853952991=89, srv195595895=44, srv993734056=98, srv1269190573=10, srv1330111195=15, srv1537522029=19, srv487879435=68, srv685159509=79, srv676823909=78, srv781990958=85, srv1270451779=11, srv972352255=96, srv1068827785=1, srv1462187019=16, srv1317613494=13, srv959543756=93, srv2075093471=57, srv168531986=25, srv903848075=91, srv686277106=80, srv1329988143=14, srv1584049622=22, srv644722014=76, srv995172051=99, srv626104979=74} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-10-04 16:53:26,716 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-10-04 16:53:26,716 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-10-04 16:53:26,717 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-10-04 16:53:26,717 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-10-04 16:53:26,717 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-10-04 16:53:26,717 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-10-04 16:53:26,717 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-10-04 16:53:26,718 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-10-04 16:53:26,718 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-10-04 16:53:26,718 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-10-04 16:53:26,718 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-10-04 16:53:26,718 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-10-04 16:53:26,719 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-10-04 16:53:26,719 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-10-04 16:53:26,719 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-10-04 16:53:26,719 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-10-04 16:53:26,719 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-10-04 16:53:26,719 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-10-04 16:53:26,720 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-10-04 16:53:26,720 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-10-04 16:53:26,720 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-10-04 16:53:26,720 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-10-04 16:53:26,720 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-10-04 16:53:26,720 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-10-04 16:53:26,721 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-10-04 16:53:26,721 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-10-04 16:53:26,721 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-10-04 16:53:26,721 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-10-04 16:53:26,721 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-10-04 16:53:26,721 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-10-04 16:53:26,722 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-10-04 16:53:26,722 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-10-04 16:53:26,722 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-10-04 16:53:26,722 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-10-04 16:53:26,722 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-10-04 16:53:26,722 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-10-04 16:53:26,723 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-10-04 16:53:26,723 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-10-04 16:53:26,723 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-10-04 16:53:26,723 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-10-04 16:53:26,723 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-10-04 16:53:26,723 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-10-04 16:53:26,724 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-10-04 16:53:26,724 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-10-04 16:53:26,724 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-10-04 16:53:26,724 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-10-04 16:53:26,724 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-10-04 16:53:26,724 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-10-04 16:53:26,724 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-10-04 16:53:26,725 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-10-04 16:53:26,725 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-10-04 16:53:26,725 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-10-04 16:53:26,725 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-10-04 16:53:26,725 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-10-04 16:53:26,725 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-10-04 16:53:26,726 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-10-04 16:53:26,726 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-10-04 16:53:26,726 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-10-04 16:53:26,726 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-10-04 16:53:26,726 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-10-04 16:53:26,726 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-10-04 16:53:26,726 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-10-04 16:53:26,727 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-10-04 16:53:26,727 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-10-04 16:53:26,727 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-10-04 16:53:26,727 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-10-04 16:53:26,727 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-10-04 16:53:26,727 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-10-04 16:53:26,727 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-10-04 16:53:26,728 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-10-04 16:53:26,728 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-10-04 16:53:26,728 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-10-04 16:53:26,728 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-10-04 16:53:26,728 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-10-04 16:53:26,728 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-10-04 16:53:26,729 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-10-04 16:53:26,729 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-10-04 16:53:26,729 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-10-04 16:53:26,729 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-10-04 16:53:26,729 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-10-04 16:53:26,729 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-10-04 16:53:26,729 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-10-04 16:53:26,730 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-10-04 16:53:26,730 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-10-04 16:53:26,730 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-10-04 16:53:26,730 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-10-04 16:53:26,730 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-10-04 16:53:26,730 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-10-04 16:53:26,730 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-10-04 16:53:26,731 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-10-04 16:53:26,731 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-10-04 16:53:26,731 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-10-04 16:53:26,731 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-10-04 16:53:26,731 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-10-04 16:53:26,732 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-10-04 16:53:26,732 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-10-04 16:53:26,732 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-10-04 16:53:26,732 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-10-04 16:53:26,732 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-10-04 16:53:26,732 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-10-04 16:53:26,733 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-10-04 16:53:26,923 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.06666666666666667, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-10-04 16:53:26,923 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-10-04 16:53:26,923 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.9909252140407105, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.06666666666666667, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-10-04 16:53:27,297 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 532 ms to try 5000 different iterations.  Found a solution that moves 4656 regions; Going from a computed imbalance of 0.9909252140407105 to a new imbalance of 0.18440736617773898. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.04145411555227627, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.05856878887515969, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.5173333333333333, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.04145411555227627, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.17975, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.24533333333333332, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-10-04 16:53:27,310 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1775813962:81 , srv1909479367:81 , srv2075093471:81 , srv1317613494:82 , srv1330111195:82 , srv1507664158:82 , srv2112978604:82 , srv487879435:82 , srv676823909:82 , srv959543756:82 , srv1068827785:83 , srv128055135:83 , srv1553142427:83 , srv2084554257:83 , srv483743733:83 , srv853952991:83 , srv972352255:83 , srv1329988143:84 , srv1572817834:84 , srv1584049622:84 , srv1816724103:84 , srv1917077267:84 , srv2037912926:84 , srv2061780628:84 , srv35462773:84 , srv793011736:84 , srv993734056:84 , srv1098797264:85 , srv1103055446:85 , srv1171857255:85 , srv1269190573:85 , srv1516410130:85 , srv1835033928:85 , srv1861423466:85 , srv1972177660:85 , srv1983117846:85 , srv492056613:85 , srv576370357:85 , srv588858185:85 , srv626104979:85 , srv775838387:85 , srv781990958:85 , srv972265165:85 , srv1073803850:86 , srv1242692316:86 , srv1638425624:86 , srv168531986:86 , srv1757188297:86 , srv1873933404:86 , srv1933007072:86 , srv1945176629:86 , srv1967203201:86 , srv1996387187:86 , srv2069377194:86 , srv219788335:86 , srv49333046:86 , srv631466097:86 , srv648109908:86 , srv68813696:86 , srv73459681:86 , srv879511394:86 , srv1196129839:87 , srv1462187019:87 , srv1729558305:87 , srv1782116099:87 , srv1867565385:87 , srv1940372420:87 , srv195595895:87 , srv2062096408:87 , srv2144965382:87 , srv229769047:87 , srv47214118:87 , srv985947319:87 , srv1270451779:88 , srv1969292362:88 , srv2017184412:88 , srv2034321081:88 , srv2065026210:88 , srv644722014:88 , srv686277106:88 , srv84348585:88 , srv943094993:88 , srv1607131590:89 , srv1938662934:89 , srv1537522029:90 , srv1811697367:90 , srv1838591256:90 , srv832161682:90 , srv101770247:91 , srv121258908:91 , srv564770534:91 , srv903848075:91 , srv995172051:91 , srv486050198:92 , srv1731758792:93 , srv685159509:94 , srv962871361:94 , srv2106558583:96 , srv747041260:98 , srv1075389140:458 }
2023-10-04 16:53:27,314 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-10-04 16:53:27,315 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1909479367=38, srv2144965382=61, srv219788335=62, srv648109908=77, srv1516410130=18, srv47214118=65, srv985947319=97, srv486050198=67, srv972265165=95, srv1073803850=2, srv2062096408=54, srv1098797264=4, srv1917077267=39, srv943094993=92, srv2061780628=53, srv1972177660=47, srv832161682=87, srv2112978604=60, srv1572817834=21, srv1933007072=40, srv2034321081=51, srv68813696=81, srv747041260=83, srv1507664158=17, srv2106558583=59, srv1835033928=33, srv73459681=82, srv49333046=70, srv2037912926=52, srv229769047=63, srv962871361=94, srv1242692316=9, srv121258908=8, srv1775813962=29, srv1838591256=34, srv1171857255=6, srv1983117846=48, srv1996387187=49, srv84348585=88, srv35462773=64, srv1867565385=36, srv631466097=75, srv1731758792=27, srv1940372420=42, srv775838387=84, srv564770534=71, srv2017184412=50, srv879511394=90, srv1553142427=20, srv1103055446=5, srv1638425624=24, srv1967203201=45, srv588858185=73, srv1607131590=23, srv1782116099=30, srv1816724103=32, srv101770247=0, srv1969292362=46, srv1729558305=26, srv1945176629=43, srv793011736=86, srv1811697367=31, srv2069377194=56, srv1075389140=3, srv2065026210=55, srv1873933404=37, srv1196129839=7, srv483743733=66, srv1938662934=41, srv492056613=69, srv1861423466=35, srv1757188297=28, srv2084554257=58, srv576370357=72, srv128055135=12, srv853952991=89, srv195595895=44, srv993734056=98, srv1269190573=10, srv1330111195=15, srv1537522029=19, srv487879435=68, srv685159509=79, srv676823909=78, srv781990958=85, srv1270451779=11, srv972352255=96, srv1068827785=1, srv1462187019=16, srv1317613494=13, srv959543756=93, srv2075093471=57, srv168531986=25, srv903848075=91, srv686277106=80, srv1329988143=14, srv1584049622=22, srv644722014=76, srv995172051=99, srv626104979=74} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-10-04 16:53:27,334 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-10-04 16:53:27,335 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-10-04 16:53:27,335 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-10-04 16:53:27,335 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-10-04 16:53:27,335 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-10-04 16:53:27,335 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-10-04 16:53:27,335 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-10-04 16:53:27,335 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-10-04 16:53:27,335 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-10-04 16:53:27,335 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-10-04 16:53:27,335 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-10-04 16:53:27,335 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-10-04 16:53:27,335 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-10-04 16:53:27,336 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-10-04 16:53:27,336 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-10-04 16:53:27,336 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-10-04 16:53:27,336 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-10-04 16:53:27,336 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-10-04 16:53:27,336 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-10-04 16:53:27,336 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-10-04 16:53:27,336 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-10-04 16:53:27,336 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-10-04 16:53:27,336 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-10-04 16:53:27,336 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-10-04 16:53:27,336 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-10-04 16:53:27,336 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-10-04 16:53:27,336 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-10-04 16:53:27,337 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-10-04 16:53:27,337 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-10-04 16:53:27,337 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-10-04 16:53:27,337 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-10-04 16:53:27,337 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-10-04 16:53:27,337 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-10-04 16:53:27,337 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-10-04 16:53:27,337 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-10-04 16:53:27,337 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-10-04 16:53:27,337 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-10-04 16:53:27,337 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-10-04 16:53:27,338 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-10-04 16:53:27,338 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-10-04 16:53:27,338 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-10-04 16:53:27,338 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-10-04 16:53:27,338 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-10-04 16:53:27,338 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-10-04 16:53:27,338 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-10-04 16:53:27,338 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-10-04 16:53:27,338 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-10-04 16:53:27,338 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-10-04 16:53:27,338 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-10-04 16:53:27,338 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-10-04 16:53:27,339 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-10-04 16:53:27,339 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-10-04 16:53:27,339 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-10-04 16:53:27,339 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-10-04 16:53:27,339 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-10-04 16:53:27,339 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-10-04 16:53:27,339 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-10-04 16:53:27,339 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-10-04 16:53:27,339 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-10-04 16:53:27,339 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-10-04 16:53:27,339 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-10-04 16:53:27,340 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-10-04 16:53:27,340 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-10-04 16:53:27,340 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-10-04 16:53:27,340 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-10-04 16:53:27,340 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-10-04 16:53:27,340 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-10-04 16:53:27,340 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-10-04 16:53:27,340 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-10-04 16:53:27,340 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-10-04 16:53:27,340 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-10-04 16:53:27,340 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-10-04 16:53:27,340 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-10-04 16:53:27,340 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-10-04 16:53:27,341 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-10-04 16:53:27,341 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-10-04 16:53:27,341 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-10-04 16:53:27,341 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-10-04 16:53:27,341 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-10-04 16:53:27,341 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-10-04 16:53:27,341 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-10-04 16:53:27,341 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-10-04 16:53:27,341 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-10-04 16:53:27,342 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-10-04 16:53:27,342 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-10-04 16:53:27,342 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-10-04 16:53:27,342 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-10-04 16:53:27,342 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-10-04 16:53:27,342 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-10-04 16:53:27,342 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-10-04 16:53:27,342 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-10-04 16:53:27,342 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-10-04 16:53:27,343 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-10-04 16:53:27,343 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-10-04 16:53:27,343 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-10-04 16:53:27,343 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-10-04 16:53:27,343 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-10-04 16:53:27,343 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-10-04 16:53:27,343 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-10-04 16:53:27,343 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-10-04 16:53:27,343 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-10-04 16:53:27,523 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.04145411555227627, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.05856878887515969, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.04145411555227627, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.17975, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.24533333333333332, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-10-04 16:53:27,523 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-10-04 16:53:27,524 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.1843747641689223, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.04145411555227627, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.05856878887515969, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.04145411555227627, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.17975, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.24533333333333332, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-10-04 16:53:27,904 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 537 ms to try 5000 different iterations.  Found a solution that moves 2616 regions; Going from a computed imbalance of 0.1843747641689223 to a new imbalance of 0.015652943259227982. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.02181501203228694); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.03161922726931932, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.2906666666666667, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.02181501203228694); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.01275); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.043416666666666666, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-10-04 16:53:27,917 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv747041260:73 , srv1731758792:77 , srv2106558583:77 , srv685159509:77 , srv101770247:81 , srv1607131590:81 , srv486050198:81 , srv564770534:81 , srv832161682:81 , srv962871361:81 , srv121258908:82 , srv1537522029:82 , srv1811697367:82 , srv1938662934:82 , srv2017184412:82 , srv2065026210:82 , srv903848075:82 , srv995172051:82 , srv1196129839:83 , srv1270451779:83 , srv1838591256:83 , srv84348585:83 , srv1242692316:84 , srv1867565385:84 , srv1873933404:84 , srv1940372420:84 , srv1969292362:84 , srv2062096408:84 , srv2144965382:84 , srv229769047:84 , srv943094993:84 , srv1462187019:85 , srv1782116099:85 , srv1996387187:85 , srv2034321081:85 , srv2069377194:85 , srv47214118:85 , srv492056613:85 , srv631466097:85 , srv644722014:85 , srv985947319:85 , srv1098797264:86 , srv1269190573:86 , srv1516410130:86 , srv1638425624:86 , srv1729558305:86 , srv1945176629:86 , srv195595895:86 , srv1967203201:86 , srv49333046:86 , srv686277106:86 , srv73459681:86 , srv1171857255:87 , srv1584049622:87 , srv168531986:87 , srv1835033928:87 , srv1861423466:87 , srv1972177660:87 , srv219788335:87 , srv588858185:87 , srv626104979:87 , srv781990958:87 , srv853952991:87 , srv879511394:87 , srv1068827785:88 , srv1073803850:88 , srv128055135:88 , srv1329988143:88 , srv1757188297:88 , srv1917077267:88 , srv1933007072:88 , srv1983117846:88 , srv2084554257:88 , srv576370357:88 , srv648109908:88 , srv775838387:88 , srv972265165:88 , srv972352255:88 , srv993734056:88 , srv1330111195:89 , srv1507664158:89 , srv1572817834:89 , srv1816724103:89 , srv2037912926:89 , srv2061780628:89 , srv2112978604:89 , srv35462773:89 , srv483743733:89 , srv676823909:89 , srv793011736:89 , srv1103055446:90 , srv487879435:90 , srv68813696:90 , srv959543756:90 , srv1317613494:91 , srv1553142427:91 , srv1775813962:91 , srv1909479367:92 , srv2075093471:92 , srv1075389140:510 }
2023-10-04 16:53:27,922 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-10-04 16:53:27,923 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1909479367=38, srv2144965382=61, srv219788335=62, srv648109908=77, srv1516410130=18, srv47214118=65, srv985947319=97, srv486050198=67, srv972265165=95, srv1073803850=2, srv2062096408=54, srv1098797264=4, srv1917077267=39, srv943094993=92, srv2061780628=53, srv1972177660=47, srv832161682=87, srv2112978604=60, srv1572817834=21, srv1933007072=40, srv2034321081=51, srv68813696=81, srv747041260=83, srv1507664158=17, srv2106558583=59, srv1835033928=33, srv73459681=82, srv49333046=70, srv2037912926=52, srv229769047=63, srv962871361=94, srv1242692316=9, srv121258908=8, srv1775813962=29, srv1838591256=34, srv1171857255=6, srv1983117846=48, srv1996387187=49, srv84348585=88, srv35462773=64, srv1867565385=36, srv631466097=75, srv1731758792=27, srv1940372420=42, srv775838387=84, srv564770534=71, srv2017184412=50, srv879511394=90, srv1553142427=20, srv1103055446=5, srv1638425624=24, srv1967203201=45, srv588858185=73, srv1607131590=23, srv1782116099=30, srv1816724103=32, srv101770247=0, srv1969292362=46, srv1729558305=26, srv1945176629=43, srv793011736=86, srv1811697367=31, srv2069377194=56, srv1075389140=3, srv2065026210=55, srv1873933404=37, srv1196129839=7, srv483743733=66, srv1938662934=41, srv492056613=69, srv1861423466=35, srv1757188297=28, srv2084554257=58, srv576370357=72, srv128055135=12, srv853952991=89, srv195595895=44, srv993734056=98, srv1269190573=10, srv1330111195=15, srv1537522029=19, srv487879435=68, srv685159509=79, srv676823909=78, srv781990958=85, srv1270451779=11, srv972352255=96, srv1068827785=1, srv1462187019=16, srv1317613494=13, srv959543756=93, srv2075093471=57, srv168531986=25, srv903848075=91, srv686277106=80, srv1329988143=14, srv1584049622=22, srv644722014=76, srv995172051=99, srv626104979=74} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-10-04 16:53:27,939 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-10-04 16:53:27,939 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-10-04 16:53:27,939 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-10-04 16:53:27,939 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-10-04 16:53:27,940 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-10-04 16:53:27,940 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-10-04 16:53:27,940 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-10-04 16:53:27,940 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-10-04 16:53:27,940 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-10-04 16:53:27,940 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-10-04 16:53:27,940 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-10-04 16:53:27,941 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-10-04 16:53:27,941 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-10-04 16:53:27,941 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-10-04 16:53:27,942 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-10-04 16:53:27,942 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-10-04 16:53:27,942 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-10-04 16:53:27,942 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-10-04 16:53:27,942 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-10-04 16:53:27,942 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-10-04 16:53:27,942 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-10-04 16:53:27,942 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-10-04 16:53:27,942 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-10-04 16:53:27,942 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-10-04 16:53:27,943 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-10-04 16:53:27,943 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-10-04 16:53:27,943 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-10-04 16:53:27,943 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-10-04 16:53:27,943 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-10-04 16:53:27,943 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-10-04 16:53:27,943 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-10-04 16:53:27,943 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-10-04 16:53:27,944 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-10-04 16:53:27,944 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-10-04 16:53:27,944 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-10-04 16:53:27,944 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-10-04 16:53:27,944 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-10-04 16:53:27,944 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-10-04 16:53:27,944 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-10-04 16:53:27,944 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-10-04 16:53:27,944 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-10-04 16:53:27,944 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-10-04 16:53:27,945 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-10-04 16:53:27,945 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-10-04 16:53:27,945 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-10-04 16:53:27,945 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-10-04 16:53:27,945 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-10-04 16:53:27,945 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-10-04 16:53:27,945 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-10-04 16:53:27,945 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-10-04 16:53:27,945 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-10-04 16:53:27,946 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-10-04 16:53:27,946 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-10-04 16:53:27,946 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-10-04 16:53:27,946 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-10-04 16:53:27,946 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-10-04 16:53:27,946 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-10-04 16:53:27,946 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-10-04 16:53:27,946 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-10-04 16:53:27,946 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-10-04 16:53:27,947 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-10-04 16:53:27,947 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-10-04 16:53:27,947 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-10-04 16:53:27,947 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-10-04 16:53:27,947 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-10-04 16:53:27,947 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-10-04 16:53:27,947 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-10-04 16:53:27,947 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-10-04 16:53:27,947 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-10-04 16:53:27,948 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-10-04 16:53:27,948 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-10-04 16:53:27,948 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-10-04 16:53:27,948 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-10-04 16:53:27,948 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-10-04 16:53:27,948 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-10-04 16:53:27,948 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-10-04 16:53:27,948 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-10-04 16:53:27,948 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-10-04 16:53:27,949 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-10-04 16:53:27,949 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-10-04 16:53:27,954 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-10-04 16:53:27,954 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-10-04 16:53:27,954 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-10-04 16:53:27,954 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-10-04 16:53:27,954 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-10-04 16:53:27,954 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-10-04 16:53:27,954 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-10-04 16:53:27,954 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-10-04 16:53:27,954 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-10-04 16:53:27,955 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-10-04 16:53:27,955 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-10-04 16:53:27,955 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-10-04 16:53:27,955 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-10-04 16:53:27,955 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-10-04 16:53:27,955 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-10-04 16:53:27,955 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-10-04 16:53:27,955 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-10-04 16:53:27,955 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-10-04 16:53:27,956 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-10-04 16:53:27,956 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-10-04 16:53:27,956 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-10-04 16:53:28,116 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.02181501203228694); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.03161922726931932, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.02181501203228694); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.01275); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.043416666666666666, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-10-04 16:53:28,116 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-10-04 16:53:28,117 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.015634625635717565, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.02181501203228694); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.03161922726931932, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.02181501203228694); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.01275); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.043416666666666666, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-10-04 16:53:28,441 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 444 ms to try 5000 different iterations.  Found a solution that moves 956 regions; Going from a computed imbalance of 0.015634625635717565 to a new imbalance of 4.0482957015450764E-4. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.005211573066470477); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.007871014035869962); MoveCostFunction : (multiplier=7.0, imbalance=0.10622222222222222, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.005211573066470477); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=8.333333333333333E-5); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.002916666666666667); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-10-04 16:53:28,444 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv68813696:81 , srv1073803850:83 , srv1103055446:83 , srv1553142427:83 , srv648109908:83 , srv686277106:83 , srv962871361:83 , srv1729558305:84 , srv1816724103:84 , srv1838591256:84 , srv1909479367:84 , srv1933007072:84 , srv1983117846:84 , srv2106558583:84 , srv35462773:84 , srv486050198:84 , srv73459681:84 , srv793011736:84 , srv879511394:84 , srv995172051:84 , srv101770247:85 , srv1171857255:85 , srv121258908:85 , srv1329988143:85 , srv1462187019:85 , srv1537522029:85 , srv1572817834:85 , srv1638425624:85 , srv168531986:85 , srv1782116099:85 , srv1861423466:85 , srv1917077267:85 , srv195595895:85 , srv1967203201:85 , srv2034321081:85 , srv2061780628:85 , srv2075093471:85 , srv219788335:85 , srv47214118:85 , srv483743733:85 , srv487879435:85 , srv576370357:85 , srv626104979:85 , srv644722014:85 , srv775838387:85 , srv959543756:85 , srv972265165:85 , srv985947319:85 , srv1098797264:86 , srv1269190573:86 , srv1270451779:86 , srv1317613494:86 , srv1330111195:86 , srv1516410130:86 , srv1584049622:86 , srv1757188297:86 , srv1775813962:86 , srv1811697367:86 , srv1835033928:86 , srv1938662934:86 , srv1945176629:86 , srv1969292362:86 , srv1972177660:86 , srv2037912926:86 , srv2069377194:86 , srv2112978604:86 , srv229769047:86 , srv49333046:86 , srv564770534:86 , srv588858185:86 , srv631466097:86 , srv676823909:86 , srv747041260:86 , srv781990958:86 , srv903848075:86 , srv943094993:86 , srv993734056:86 , srv1068827785:87 , srv1196129839:87 , srv128055135:87 , srv1507664158:87 , srv1607131590:87 , srv1731758792:87 , srv1867565385:87 , srv1940372420:87 , srv1996387187:87 , srv2062096408:87 , srv2065026210:87 , srv2084554257:87 , srv2144965382:87 , srv492056613:87 , srv685159509:87 , srv832161682:87 , srv84348585:87 , srv972352255:87 , srv1242692316:88 , srv2017184412:88 , srv853952991:88 , srv1873933404:89 , srv1075389140:536 }
2023-10-04 16:53:28,450 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-10-04 16:53:28,452 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1909479367=38, srv2144965382=61, srv219788335=62, srv648109908=77, srv1516410130=18, srv47214118=65, srv985947319=97, srv486050198=67, srv972265165=95, srv1073803850=2, srv2062096408=54, srv1098797264=4, srv1917077267=39, srv943094993=92, srv2061780628=53, srv1972177660=47, srv832161682=87, srv2112978604=60, srv1572817834=21, srv1933007072=40, srv2034321081=51, srv68813696=81, srv747041260=83, srv1507664158=17, srv2106558583=59, srv1835033928=33, srv73459681=82, srv49333046=70, srv2037912926=52, srv229769047=63, srv962871361=94, srv1242692316=9, srv121258908=8, srv1775813962=29, srv1838591256=34, srv1171857255=6, srv1983117846=48, srv1996387187=49, srv84348585=88, srv35462773=64, srv1867565385=36, srv631466097=75, srv1731758792=27, srv1940372420=42, srv775838387=84, srv564770534=71, srv2017184412=50, srv879511394=90, srv1553142427=20, srv1103055446=5, srv1638425624=24, srv1967203201=45, srv588858185=73, srv1607131590=23, srv1782116099=30, srv1816724103=32, srv101770247=0, srv1969292362=46, srv1729558305=26, srv1945176629=43, srv793011736=86, srv1811697367=31, srv2069377194=56, srv1075389140=3, srv2065026210=55, srv1873933404=37, srv1196129839=7, srv483743733=66, srv1938662934=41, srv492056613=69, srv1861423466=35, srv1757188297=28, srv2084554257=58, srv576370357=72, srv128055135=12, srv853952991=89, srv195595895=44, srv993734056=98, srv1269190573=10, srv1330111195=15, srv1537522029=19, srv487879435=68, srv685159509=79, srv676823909=78, srv781990958=85, srv1270451779=11, srv972352255=96, srv1068827785=1, srv1462187019=16, srv1317613494=13, srv959543756=93, srv2075093471=57, srv168531986=25, srv903848075=91, srv686277106=80, srv1329988143=14, srv1584049622=22, srv644722014=76, srv995172051=99, srv626104979=74} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-10-04 16:53:28,475 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-10-04 16:53:28,475 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-10-04 16:53:28,476 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-10-04 16:53:28,476 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-10-04 16:53:28,476 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-10-04 16:53:28,476 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-10-04 16:53:28,476 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-10-04 16:53:28,476 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-10-04 16:53:28,476 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-10-04 16:53:28,476 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-10-04 16:53:28,476 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-10-04 16:53:28,476 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-10-04 16:53:28,476 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-10-04 16:53:28,476 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-10-04 16:53:28,476 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-10-04 16:53:28,476 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-10-04 16:53:28,477 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-10-04 16:53:28,477 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-10-04 16:53:28,477 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-10-04 16:53:28,477 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-10-04 16:53:28,477 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-10-04 16:53:28,477 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-10-04 16:53:28,477 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-10-04 16:53:28,477 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-10-04 16:53:28,477 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-10-04 16:53:28,477 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-10-04 16:53:28,478 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-10-04 16:53:28,478 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-10-04 16:53:28,478 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-10-04 16:53:28,478 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-10-04 16:53:28,478 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-10-04 16:53:28,478 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-10-04 16:53:28,478 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-10-04 16:53:28,478 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-10-04 16:53:28,479 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-10-04 16:53:28,479 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-10-04 16:53:28,479 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-10-04 16:53:28,479 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-10-04 16:53:28,479 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-10-04 16:53:28,479 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-10-04 16:53:28,479 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-10-04 16:53:28,479 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-10-04 16:53:28,480 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-10-04 16:53:28,480 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-10-04 16:53:28,480 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-10-04 16:53:28,480 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-10-04 16:53:28,480 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-10-04 16:53:28,480 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-10-04 16:53:28,480 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-10-04 16:53:28,480 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-10-04 16:53:28,480 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-10-04 16:53:28,481 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-10-04 16:53:28,481 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-10-04 16:53:28,481 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-10-04 16:53:28,481 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-10-04 16:53:28,481 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-10-04 16:53:28,481 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-10-04 16:53:28,481 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-10-04 16:53:28,481 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-10-04 16:53:28,481 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-10-04 16:53:28,482 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-10-04 16:53:28,482 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-10-04 16:53:28,482 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-10-04 16:53:28,482 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-10-04 16:53:28,482 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-10-04 16:53:28,482 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-10-04 16:53:28,482 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-10-04 16:53:28,482 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-10-04 16:53:28,482 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-10-04 16:53:28,482 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-10-04 16:53:28,482 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-10-04 16:53:28,482 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-10-04 16:53:28,482 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-10-04 16:53:28,483 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-10-04 16:53:28,483 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-10-04 16:53:28,483 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-10-04 16:53:28,483 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-10-04 16:53:28,483 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-10-04 16:53:28,483 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-10-04 16:53:28,483 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-10-04 16:53:28,483 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-10-04 16:53:28,483 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-10-04 16:53:28,483 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-10-04 16:53:28,483 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-10-04 16:53:28,483 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-10-04 16:53:28,483 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-10-04 16:53:28,483 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-10-04 16:53:28,483 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-10-04 16:53:28,483 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-10-04 16:53:28,483 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-10-04 16:53:28,484 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-10-04 16:53:28,484 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-10-04 16:53:28,484 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-10-04 16:53:28,484 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-10-04 16:53:28,484 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-10-04 16:53:28,484 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-10-04 16:53:28,484 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-10-04 16:53:28,484 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-10-04 16:53:28,484 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-10-04 16:53:28,484 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-10-04 16:53:28,484 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-10-04 16:53:28,612 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.005211573066470477); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.007871014035869962); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.005211573066470477); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=8.333333333333333E-5); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.002916666666666667); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-10-04 16:53:28,613 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-10-04 16:53:28,613 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=3.9813551507959967E-4, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.005211573066470477); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.007871014035869962); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.005211573066470477); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=8.333333333333333E-5); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.002916666666666667); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-10-04 16:53:28,948 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 451 ms to try 5000 different iterations.  Found a solution that moves 218 regions; Going from a computed imbalance of 3.9813551507959967E-4 to a new imbalance of 1.929041017310283E-5. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=4.737793696791342E-4); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0017727200782610348); MoveCostFunction : (multiplier=7.0, imbalance=0.02422222222222222); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=4.737793696791342E-4); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=8.333333333333333E-5); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-10-04 16:53:28,949 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1757188297:82 , srv903848075:82 , srv1317613494:83 , srv1330111195:83 , srv1873933404:83 , srv2037912926:83 , srv972265165:83 , srv1068827785:84 , srv1103055446:84 , srv1196129839:84 , srv121258908:84 , srv1242692316:84 , srv128055135:84 , srv1507664158:84 , srv1516410130:84 , srv1572817834:84 , srv168531986:84 , srv1775813962:84 , srv1811697367:84 , srv1867565385:84 , srv1917077267:84 , srv1933007072:84 , srv1940372420:84 , srv1945176629:84 , srv195595895:84 , srv1969292362:84 , srv1972177660:84 , srv1996387187:84 , srv2017184412:84 , srv2034321081:84 , srv2062096408:84 , srv2084554257:84 , srv2144965382:84 , srv219788335:84 , srv49333046:84 , srv564770534:84 , srv576370357:84 , srv588858185:84 , srv644722014:84 , srv685159509:84 , srv775838387:84 , srv781990958:84 , srv832161682:84 , srv84348585:84 , srv853952991:84 , srv943094993:84 , srv962871361:84 , srv972352255:84 , srv993734056:84 , srv995172051:84 , srv101770247:85 , srv1073803850:85 , srv1098797264:85 , srv1171857255:85 , srv1269190573:85 , srv1270451779:85 , srv1462187019:85 , srv1537522029:85 , srv1553142427:85 , srv1584049622:85 , srv1607131590:85 , srv1638425624:85 , srv1729558305:85 , srv1731758792:85 , srv1782116099:85 , srv1816724103:85 , srv1835033928:85 , srv1838591256:85 , srv1861423466:85 , srv1909479367:85 , srv1938662934:85 , srv1967203201:85 , srv1983117846:85 , srv2061780628:85 , srv2065026210:85 , srv2069377194:85 , srv2075093471:85 , srv2106558583:85 , srv2112978604:85 , srv229769047:85 , srv35462773:85 , srv47214118:85 , srv483743733:85 , srv486050198:85 , srv487879435:85 , srv492056613:85 , srv626104979:85 , srv631466097:85 , srv747041260:85 , srv793011736:85 , srv879511394:85 , srv959543756:85 , srv985947319:85 , srv1329988143:86 , srv648109908:86 , srv676823909:86 , srv686277106:86 , srv68813696:86 , srv73459681:86 , srv1075389140:638 }
2023-10-04 16:53:28,954 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-10-04 16:53:28,955 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1909479367=38, srv2144965382=61, srv219788335=62, srv648109908=77, srv1516410130=18, srv47214118=65, srv985947319=97, srv486050198=67, srv972265165=95, srv1073803850=2, srv2062096408=54, srv1098797264=4, srv1917077267=39, srv943094993=92, srv2061780628=53, srv1972177660=47, srv832161682=87, srv2112978604=60, srv1572817834=21, srv1933007072=40, srv2034321081=51, srv68813696=81, srv747041260=83, srv1507664158=17, srv2106558583=59, srv1835033928=33, srv73459681=82, srv49333046=70, srv2037912926=52, srv229769047=63, srv962871361=94, srv1242692316=9, srv121258908=8, srv1775813962=29, srv1838591256=34, srv1171857255=6, srv1983117846=48, srv1996387187=49, srv84348585=88, srv35462773=64, srv1867565385=36, srv631466097=75, srv1731758792=27, srv1940372420=42, srv775838387=84, srv564770534=71, srv2017184412=50, srv879511394=90, srv1553142427=20, srv1103055446=5, srv1638425624=24, srv1967203201=45, srv588858185=73, srv1607131590=23, srv1782116099=30, srv1816724103=32, srv101770247=0, srv1969292362=46, srv1729558305=26, srv1945176629=43, srv793011736=86, srv1811697367=31, srv2069377194=56, srv1075389140=3, srv2065026210=55, srv1873933404=37, srv1196129839=7, srv483743733=66, srv1938662934=41, srv492056613=69, srv1861423466=35, srv1757188297=28, srv2084554257=58, srv576370357=72, srv128055135=12, srv853952991=89, srv195595895=44, srv993734056=98, srv1269190573=10, srv1330111195=15, srv1537522029=19, srv487879435=68, srv685159509=79, srv676823909=78, srv781990958=85, srv1270451779=11, srv972352255=96, srv1068827785=1, srv1462187019=16, srv1317613494=13, srv959543756=93, srv2075093471=57, srv168531986=25, srv903848075=91, srv686277106=80, srv1329988143=14, srv1584049622=22, srv644722014=76, srv995172051=99, srv626104979=74} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-10-04 16:53:28,973 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-10-04 16:53:28,973 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-10-04 16:53:28,973 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-10-04 16:53:28,973 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-10-04 16:53:28,973 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-10-04 16:53:28,973 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-10-04 16:53:28,973 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-10-04 16:53:28,973 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-10-04 16:53:28,974 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-10-04 16:53:28,974 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-10-04 16:53:28,974 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-10-04 16:53:28,974 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-10-04 16:53:28,974 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-10-04 16:53:28,974 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-10-04 16:53:28,974 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-10-04 16:53:28,974 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-10-04 16:53:28,974 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-10-04 16:53:28,974 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-10-04 16:53:28,974 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-10-04 16:53:28,975 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-10-04 16:53:28,975 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-10-04 16:53:28,975 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-10-04 16:53:28,975 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-10-04 16:53:28,975 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-10-04 16:53:28,975 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-10-04 16:53:28,975 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-10-04 16:53:28,975 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-10-04 16:53:28,975 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-10-04 16:53:28,975 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-10-04 16:53:28,975 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-10-04 16:53:28,976 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-10-04 16:53:28,976 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-10-04 16:53:28,976 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-10-04 16:53:28,976 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-10-04 16:53:28,976 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-10-04 16:53:28,976 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-10-04 16:53:28,976 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-10-04 16:53:28,976 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-10-04 16:53:28,976 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-10-04 16:53:28,976 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-10-04 16:53:28,976 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-10-04 16:53:28,977 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-10-04 16:53:28,977 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-10-04 16:53:28,977 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-10-04 16:53:28,977 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-10-04 16:53:28,977 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-10-04 16:53:28,977 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-10-04 16:53:28,977 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-10-04 16:53:28,977 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-10-04 16:53:28,977 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-10-04 16:53:28,977 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-10-04 16:53:28,977 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-10-04 16:53:28,978 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-10-04 16:53:28,978 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-10-04 16:53:28,978 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-10-04 16:53:28,978 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-10-04 16:53:28,978 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-10-04 16:53:28,978 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-10-04 16:53:28,978 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-10-04 16:53:28,978 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-10-04 16:53:28,978 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-10-04 16:53:28,978 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-10-04 16:53:28,978 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-10-04 16:53:28,978 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-10-04 16:53:28,979 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-10-04 16:53:28,979 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-10-04 16:53:28,979 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-10-04 16:53:28,979 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-10-04 16:53:28,979 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-10-04 16:53:28,979 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-10-04 16:53:28,980 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-10-04 16:53:28,980 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-10-04 16:53:28,980 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-10-04 16:53:28,980 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-10-04 16:53:28,980 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-10-04 16:53:28,980 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-10-04 16:53:28,980 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-10-04 16:53:28,980 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-10-04 16:53:28,980 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-10-04 16:53:28,980 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-10-04 16:53:28,980 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-10-04 16:53:28,981 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-10-04 16:53:28,981 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-10-04 16:53:28,981 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-10-04 16:53:28,981 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-10-04 16:53:28,981 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-10-04 16:53:28,981 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-10-04 16:53:28,981 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-10-04 16:53:28,981 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-10-04 16:53:28,981 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-10-04 16:53:28,981 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-10-04 16:53:28,981 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-10-04 16:53:28,982 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-10-04 16:53:28,982 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-10-04 16:53:28,982 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-10-04 16:53:28,982 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-10-04 16:53:28,982 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-10-04 16:53:28,982 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-10-04 16:53:28,982 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-10-04 16:53:28,982 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-10-04 16:53:28,982 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-10-04 16:53:29,117 INFO  [Time-limited test] balancer.StochasticLoadBalancer(381): Cluster wide - skipping load balancing because weighted average imbalance=1.776394154723469E-5 <= threshold(0.025). If you want more aggressive balancing, either lower hbase.master.balancer.stochastic.minCostNeedBalance from 0.025 or increase the relative multiplier(s) of the specific cost function(s). functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=4.737793696791342E-4); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0017727200782610348); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=4.737793696791342E-4); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=8.333333333333333E-5); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-10-04 16:53:29,118 INFO  [Time-limited test] balancer.BalancerTestBase(570): Mock Final balance: { srv1757188297:82 , srv903848075:82 , srv1317613494:83 , srv1330111195:83 , srv1873933404:83 , srv2037912926:83 , srv972265165:83 , srv1068827785:84 , srv1103055446:84 , srv1196129839:84 , srv121258908:84 , srv1242692316:84 , srv128055135:84 , srv1507664158:84 , srv1516410130:84 , srv1572817834:84 , srv168531986:84 , srv1775813962:84 , srv1811697367:84 , srv1867565385:84 , srv1917077267:84 , srv1933007072:84 , srv1940372420:84 , srv1945176629:84 , srv195595895:84 , srv1969292362:84 , srv1972177660:84 , srv1996387187:84 , srv2017184412:84 , srv2034321081:84 , srv2062096408:84 , srv2084554257:84 , srv2144965382:84 , srv219788335:84 , srv49333046:84 , srv564770534:84 , srv576370357:84 , srv588858185:84 , srv644722014:84 , srv685159509:84 , srv775838387:84 , srv781990958:84 , srv832161682:84 , srv84348585:84 , srv853952991:84 , srv943094993:84 , srv962871361:84 , srv972352255:84 , srv993734056:84 , srv995172051:84 , srv101770247:85 , srv1073803850:85 , srv1098797264:85 , srv1171857255:85 , srv1269190573:85 , srv1270451779:85 , srv1462187019:85 , srv1537522029:85 , srv1553142427:85 , srv1584049622:85 , srv1607131590:85 , srv1638425624:85 , srv1729558305:85 , srv1731758792:85 , srv1782116099:85 , srv1816724103:85 , srv1835033928:85 , srv1838591256:85 , srv1861423466:85 , srv1909479367:85 , srv1938662934:85 , srv1967203201:85 , srv1983117846:85 , srv2061780628:85 , srv2065026210:85 , srv2069377194:85 , srv2075093471:85 , srv2106558583:85 , srv2112978604:85 , srv229769047:85 , srv35462773:85 , srv47214118:85 , srv483743733:85 , srv486050198:85 , srv487879435:85 , srv492056613:85 , srv626104979:85 , srv631466097:85 , srv747041260:85 , srv793011736:85 , srv879511394:85 , srv959543756:85 , srv985947319:85 , srv1329988143:86 , srv648109908:86 , srv676823909:86 , srv686277106:86 , srv68813696:86 , srv73459681:86 , srv1075389140:638 }
2023-10-04 16:53:29,151 INFO  [Time-limited test] hbase.ResourceChecker(175): after: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnLargeClusterWithRacks Thread=12 (was 12), OpenFileDescriptor=263 (was 263), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=297 (was 270) - SystemLoadAverage LEAK? -, ProcessCount=170 (was 170), AvailableMemoryMB=8273 (was 8136) - AvailableMemoryMB LEAK? -
2023-10-04 16:53:29,162 INFO  [Time-limited test] hbase.ResourceChecker(147): before: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnMidClusterWithRacks Thread=12, OpenFileDescriptor=263, MaxFileDescriptor=60000, SystemLoadAverage=297, ProcessCount=170, AvailableMemoryMB=8272
2023-10-04 16:53:29,163 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2023-10-04 16:53:29,164 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=5000, runMaxSteps=true, stepsPerRegion=800, maxRunningTime=120000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 111077.0 etc.
2023-10-04 16:53:29,184 INFO  [Time-limited test] balancer.BalancerTestBase(547): Mock Cluster : { srv1075804784:84 , srv1286768671:84 , srv1350591240:84 , srv1458469828:84 , srv1486888341:84 , srv1583910974:84 , srv1702145297:84 , srv1706724886:84 , srv1740342406:84 , srv182294194:84 , srv187696170:84 , srv191000157:84 , srv2094276150:84 , srv2127942062:84 , srv247886482:84 , srv349759478:84 , srv447816002:84 , srv454052928:84 , srv519522961:84 , srv537410305:84 , srv569269415:84 , srv70447598:84 , srv751159544:84 , srv772425744:84 , srv792079501:84 , srv852373817:84 , srv865992767:84 , srv86659750:84 , srv959257868:84 , srv1067100925:264 } [srvr=30 rgns=2700 avg=90.0 max=90 min=90]
2023-10-04 16:53:29,186 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-10-04 16:53:29,186 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1286768671=2, srv187696170=11, srv2094276150=13, srv1458469828=4, srv537410305=20, srv1740342406=9, srv792079501=25, srv86659750=28, srv1067100925=0, srv247886482=15, srv959257868=29, srv1702145297=7, srv1583910974=6, srv852373817=26, srv1706724886=8, srv447816002=17, srv191000157=12, srv865992767=27, srv519522961=19, srv182294194=10, srv2127942062=14, srv1350591240=3, srv569269415=21, srv1075804784=1, srv70447598=22, srv1486888341=5, srv751159544=23, srv349759478=16, srv772425744=24, srv454052928=18} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-10-04 16:53:29,206 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-10-04 16:53:29,207 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-10-04 16:53:29,207 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-10-04 16:53:29,207 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-10-04 16:53:29,207 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-10-04 16:53:29,207 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-10-04 16:53:29,207 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-10-04 16:53:29,207 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-10-04 16:53:29,207 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-10-04 16:53:29,208 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-10-04 16:53:29,208 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-10-04 16:53:29,208 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-10-04 16:53:29,208 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-10-04 16:53:29,208 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-10-04 16:53:29,208 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-10-04 16:53:29,208 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-10-04 16:53:29,208 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-10-04 16:53:29,208 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-10-04 16:53:29,208 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-10-04 16:53:29,208 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-10-04 16:53:29,208 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-10-04 16:53:29,209 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-10-04 16:53:29,209 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-10-04 16:53:29,209 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-10-04 16:53:29,209 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-10-04 16:53:29,209 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-10-04 16:53:29,209 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-10-04 16:53:29,209 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-10-04 16:53:29,209 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-10-04 16:53:29,209 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-10-04 16:53:29,209 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=10, number of hosts=30, number of racks=4
2023-10-04 16:53:29,238 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=1.1180110753518429, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-10-04 16:53:29,238 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.9912564892309298, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=1.1180110753518429, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=64800000
2023-10-04 16:55:29,212 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 120001 ms to try 5653218 different iterations.  Found a solution that moves 1861 regions; Going from a computed imbalance of 0.9912564892309298 to a new imbalance of 4.3436668390529226E-5. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); MoveCostFunction : (multiplier=7.0, imbalance=0.6892592592592592, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-10-04 16:55:29,218 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1067100925:90 , srv1075804784:90 , srv1286768671:90 , srv1350591240:90 , srv1458469828:90 , srv1486888341:90 , srv1583910974:90 , srv1702145297:90 , srv1706724886:90 , srv1740342406:90 , srv182294194:90 , srv187696170:90 , srv191000157:90 , srv2094276150:90 , srv2127942062:90 , srv247886482:90 , srv349759478:90 , srv447816002:90 , srv454052928:90 , srv519522961:90 , srv537410305:90 , srv569269415:90 , srv70447598:90 , srv751159544:90 , srv772425744:90 , srv792079501:90 , srv852373817:90 , srv865992767:90 , srv86659750:90 , srv959257868:90 }
2023-10-04 16:55:29,219 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-10-04 16:55:29,219 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1286768671=2, srv187696170=11, srv2094276150=13, srv1458469828=4, srv537410305=20, srv1740342406=9, srv792079501=25, srv86659750=28, srv1067100925=0, srv247886482=15, srv959257868=29, srv1702145297=7, srv1583910974=6, srv852373817=26, srv1706724886=8, srv447816002=17, srv191000157=12, srv865992767=27, srv519522961=19, srv182294194=10, srv2127942062=14, srv1350591240=3, srv569269415=21, srv1075804784=1, srv70447598=22, srv1486888341=5, srv751159544=23, srv349759478=16, srv772425744=24, srv454052928=18} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-10-04 16:55:29,223 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-10-04 16:55:29,223 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-10-04 16:55:29,223 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-10-04 16:55:29,223 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-10-04 16:55:29,223 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-10-04 16:55:29,223 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-10-04 16:55:29,223 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-10-04 16:55:29,223 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-10-04 16:55:29,223 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-10-04 16:55:29,223 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-10-04 16:55:29,223 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-10-04 16:55:29,223 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-10-04 16:55:29,223 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-10-04 16:55:29,223 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-10-04 16:55:29,223 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-10-04 16:55:29,223 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-10-04 16:55:29,223 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-10-04 16:55:29,223 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-10-04 16:55:29,224 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-10-04 16:55:29,224 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-10-04 16:55:29,224 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-10-04 16:55:29,224 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-10-04 16:55:29,224 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-10-04 16:55:29,224 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-10-04 16:55:29,224 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-10-04 16:55:29,224 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-10-04 16:55:29,224 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-10-04 16:55:29,224 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-10-04 16:55:29,224 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-10-04 16:55:29,224 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-10-04 16:55:29,224 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=10, number of hosts=30, number of racks=4
2023-10-04 16:55:29,236 INFO  [Time-limited test] balancer.StochasticLoadBalancer(381): Cluster wide - skipping load balancing because weighted average imbalance=0.0 <= threshold(0.025). If you want more aggressive balancing, either lower hbase.master.balancer.stochastic.minCostNeedBalance from 0.025 or increase the relative multiplier(s) of the specific cost function(s). functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-10-04 16:55:29,236 INFO  [Time-limited test] balancer.BalancerTestBase(570): Mock Final balance: { srv1067100925:90 , srv1075804784:90 , srv1286768671:90 , srv1350591240:90 , srv1458469828:90 , srv1486888341:90 , srv1583910974:90 , srv1702145297:90 , srv1706724886:90 , srv1740342406:90 , srv182294194:90 , srv187696170:90 , srv191000157:90 , srv2094276150:90 , srv2127942062:90 , srv247886482:90 , srv349759478:90 , srv447816002:90 , srv454052928:90 , srv519522961:90 , srv537410305:90 , srv569269415:90 , srv70447598:90 , srv751159544:90 , srv772425744:90 , srv792079501:90 , srv852373817:90 , srv865992767:90 , srv86659750:90 , srv959257868:90 }
2023-10-04 16:55:29,249 INFO  [Time-limited test] hbase.ResourceChecker(175): after: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnMidClusterWithRacks Thread=11 (was 12), OpenFileDescriptor=263 (was 263), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=174 (was 297), ProcessCount=170 (was 170), AvailableMemoryMB=6983 (was 8272)