2023-10-10 03:53:24,358 INFO  [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks timeout: 13 mins
2023-10-10 03:53:24,656 WARN  [Time-limited test] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties
2023-10-10 03:53:24,755 INFO  [Time-limited test] metrics.MetricRegistriesLoader(60): Loaded MetricRegistries class org.apache.hadoop.hbase.metrics.impl.MetricRegistriesImpl
2023-10-10 03:53:24,817 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2023-10-10 03:53:24,824 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc.
2023-10-10 03:53:24,841 INFO  [Time-limited test] hbase.ResourceChecker(147): before: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnLargeClusterWithRacks Thread=12, OpenFileDescriptor=263, MaxFileDescriptor=60000, SystemLoadAverage=291, ProcessCount=170, AvailableMemoryMB=10323
2023-10-10 03:53:24,843 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2023-10-10 03:53:24,844 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=5000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=10000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc.
2023-10-10 03:53:24,984 INFO  [Time-limited test] balancer.BalancerTestBase(547): Mock Cluster : { srv1001915258:84 , srv1023025462:84 , srv103843039:84 , srv1041501194:84 , srv1064931316:84 , srv1108679584:84 , srv1212879697:84 , srv1233633609:84 , srv1280346023:84 , srv1295503494:84 , srv1303710663:84 , srv131246678:84 , srv1329949423:84 , srv137601149:84 , srv139183708:84 , srv139782199:84 , srv1411725638:84 , srv1421009350:84 , srv1433475835:84 , srv1450787698:84 , srv1485161147:84 , srv148654932:84 , srv1510725488:84 , srv1511777743:84 , srv15380488:84 , srv1550728400:84 , srv1573994403:84 , srv1578120724:84 , srv1596863807:84 , srv1600422716:84 , srv1604733587:84 , srv1616951669:84 , srv1617900861:84 , srv1636593398:84 , srv164752786:84 , srv1650145207:84 , srv169545304:84 , srv1708271166:84 , srv1742072423:84 , srv1770058748:84 , srv1784653186:84 , srv1795919635:84 , srv1855963861:84 , srv1860844098:84 , srv192609214:84 , srv1933123806:84 , srv19793311:84 , srv1989126511:84 , srv1989328678:84 , srv2046830471:84 , srv2055003699:84 , srv237395721:84 , srv247193072:84 , srv261309160:84 , srv264009359:84 , srv289918775:84 , srv292998868:84 , srv327434915:84 , srv351670155:84 , srv362999829:84 , srv395566346:84 , srv43452250:84 , srv47605244:84 , srv478121519:84 , srv488949057:84 , srv512536860:84 , srv520939050:84 , srv54832089:84 , srv553573448:84 , srv554122467:84 , srv560117044:84 , srv564588100:84 , srv583122128:84 , srv594331907:84 , srv616204238:84 , srv630689217:84 , srv667232182:84 , srv707388674:84 , srv738053550:84 , srv741848282:84 , srv751530991:84 , srv752600893:84 , srv792283592:84 , srv795607597:84 , srv796787921:84 , srv796937607:84 , srv809787814:84 , srv827801333:84 , srv873594518:84 , srv87537905:84 , srv877733259:84 , srv888833276:84 , srv889839640:84 , srv896351227:84 , srv932917251:84 , srv938847729:84 , srv956014665:84 , srv968019051:84 , srv99134436:84 , srv3576025:684 } [srvr=100 rgns=9000 avg=90.0 max=90 min=90]
2023-10-10 03:53:24,991 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-10-10 03:53:24,997 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv583122128=73, srv1295503494=9, srv751530991=81, srv1742072423=38, srv1596863807=28, srv512536860=66, srv137601149=13, srv131246678=11, srv520939050=67, srv1550728400=25, srv1329949423=12, srv169545304=36, srv1708271166=37, srv554122467=70, srv1770058748=39, srv1784653186=40, srv1041501194=3, srv395566346=61, srv1485161147=20, srv292998868=56, srv560117044=71, srv877733259=91, srv1001915258=0, srv1617900861=32, srv237395721=51, srv1233633609=7, srv896351227=94, srv553573448=69, srv630689217=76, srv327434915=57, srv707388674=78, srv54832089=68, srv889839640=93, srv43452250=62, srv667232182=77, srv351670155=58, srv264009359=54, srv1616951669=31, srv1933123806=45, srv148654932=21, srv1636593398=33, srv1578120724=27, srv873594518=89, srv103843039=2, srv752600893=82, srv809787814=87, srv261309160=53, srv792283592=83, srv1511777743=23, srv1855963861=42, srv1450787698=19, srv1604733587=30, srv164752786=34, srv2046830471=49, srv1650145207=35, srv616204238=75, srv1573994403=26, srv1421009350=17, srv362999829=60, srv3576025=59, srv932917251=95, srv738053550=79, srv796787921=85, srv938847729=96, srv139183708=14, srv827801333=88, srv1023025462=1, srv1280346023=8, srv968019051=98, srv795607597=84, srv888833276=92, srv247193072=52, srv1212879697=6, srv2055003699=50, srv1411725638=16, srv796937607=86, srv478121519=64, srv564588100=72, srv87537905=90, srv1860844098=43, srv139782199=15, srv192609214=44, srv47605244=63, srv1064931316=4, srv1989126511=47, srv1989328678=48, srv741848282=80, srv1600422716=29, srv1795919635=41, srv956014665=97, srv1108679584=5, srv1510725488=22, srv289918775=55, srv1433475835=18, srv19793311=46, srv488949057=65, srv1303710663=10, srv15380488=24, srv594331907=74, srv99134436=99} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-10-10 03:53:25,073 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-10-10 03:53:25,073 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-10-10 03:53:25,073 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-10-10 03:53:25,073 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-10-10 03:53:25,073 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-10-10 03:53:25,074 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-10-10 03:53:25,074 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-10-10 03:53:25,074 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-10-10 03:53:25,074 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-10-10 03:53:25,074 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-10-10 03:53:25,074 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-10-10 03:53:25,074 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-10-10 03:53:25,074 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-10-10 03:53:25,074 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-10-10 03:53:25,074 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-10-10 03:53:25,075 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-10-10 03:53:25,075 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-10-10 03:53:25,075 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-10-10 03:53:25,075 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-10-10 03:53:25,075 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-10-10 03:53:25,075 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-10-10 03:53:25,075 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-10-10 03:53:25,075 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-10-10 03:53:25,075 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-10-10 03:53:25,075 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-10-10 03:53:25,075 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-10-10 03:53:25,075 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-10-10 03:53:25,076 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-10-10 03:53:25,076 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-10-10 03:53:25,076 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-10-10 03:53:25,076 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-10-10 03:53:25,076 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-10-10 03:53:25,076 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-10-10 03:53:25,076 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-10-10 03:53:25,076 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-10-10 03:53:25,076 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-10-10 03:53:25,076 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-10-10 03:53:25,076 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-10-10 03:53:25,077 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-10-10 03:53:25,077 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-10-10 03:53:25,077 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-10-10 03:53:25,077 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-10-10 03:53:25,077 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-10-10 03:53:25,077 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-10-10 03:53:25,077 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-10-10 03:53:25,077 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-10-10 03:53:25,077 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-10-10 03:53:25,077 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-10-10 03:53:25,078 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-10-10 03:53:25,078 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-10-10 03:53:25,078 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-10-10 03:53:25,078 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-10-10 03:53:25,078 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-10-10 03:53:25,078 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-10-10 03:53:25,078 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-10-10 03:53:25,078 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-10-10 03:53:25,078 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-10-10 03:53:25,078 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-10-10 03:53:25,078 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-10-10 03:53:25,078 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-10-10 03:53:25,079 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-10-10 03:53:25,079 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-10-10 03:53:25,079 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-10-10 03:53:25,079 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-10-10 03:53:25,079 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-10-10 03:53:25,079 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-10-10 03:53:25,079 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-10-10 03:53:25,079 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-10-10 03:53:25,079 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-10-10 03:53:25,079 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-10-10 03:53:25,079 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-10-10 03:53:25,080 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-10-10 03:53:25,080 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-10-10 03:53:25,080 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-10-10 03:53:25,080 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-10-10 03:53:25,080 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-10-10 03:53:25,080 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-10-10 03:53:25,080 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-10-10 03:53:25,080 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-10-10 03:53:25,080 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-10-10 03:53:25,080 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-10-10 03:53:25,080 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-10-10 03:53:25,080 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-10-10 03:53:25,081 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-10-10 03:53:25,081 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-10-10 03:53:25,081 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-10-10 03:53:25,081 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-10-10 03:53:25,081 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-10-10 03:53:25,081 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-10-10 03:53:25,081 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-10-10 03:53:25,081 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-10-10 03:53:25,081 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-10-10 03:53:25,081 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-10-10 03:53:25,081 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-10-10 03:53:25,082 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-10-10 03:53:25,082 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-10-10 03:53:25,082 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-10-10 03:53:25,082 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-10-10 03:53:25,082 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-10-10 03:53:25,082 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-10-10 03:53:25,083 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-10-10 03:53:25,313 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.06666666666666667, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-10-10 03:53:25,313 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-10-10 03:53:25,314 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.9909252140407105, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.06666666666666667, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-10-10 03:53:25,678 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 575 ms to try 5000 different iterations.  Found a solution that moves 4651 regions; Going from a computed imbalance of 0.9909252140407105 to a new imbalance of 0.1862573273283724. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.03858709254641937, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06095388406035048, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.5167777777777778, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.03858709254641937, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.18166666666666667, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.24675, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-10-10 03:53:25,690 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1510725488:81 , srv1280346023:82 , srv237395721:82 , srv103843039:83 , srv1433475835:83 , srv1550728400:83 , srv264009359:83 , srv478121519:83 , srv888833276:83 , srv968019051:83 , srv1001915258:84 , srv1041501194:84 , srv131246678:84 , srv1573994403:84 , srv351670155:84 , srv594331907:84 , srv741848282:84 , srv896351227:84 , srv1329949423:85 , srv137601149:85 , srv1650145207:85 , srv169545304:85 , srv1855963861:85 , srv192609214:85 , srv2055003699:85 , srv247193072:85 , srv327434915:85 , srv488949057:85 , srv630689217:85 , srv707388674:85 , srv738053550:85 , srv752600893:85 , srv796937607:85 , srv809787814:85 , srv938847729:85 , srv1108679584:86 , srv1212879697:86 , srv1233633609:86 , srv1295503494:86 , srv1511777743:86 , srv15380488:86 , srv1578120724:86 , srv1600422716:86 , srv1860844098:86 , srv1989328678:86 , srv2046830471:86 , srv261309160:86 , srv289918775:86 , srv512536860:86 , srv54832089:86 , srv554122467:86 , srv564588100:86 , srv751530991:86 , srv877733259:86 , srv1411725638:87 , srv148654932:87 , srv1596863807:87 , srv1636593398:87 , srv164752786:87 , srv1933123806:87 , srv19793311:87 , srv1989126511:87 , srv520939050:87 , srv616204238:87 , srv889839640:87 , srv956014665:87 , srv1064931316:88 , srv1604733587:88 , srv1616951669:88 , srv1742072423:88 , srv1784653186:88 , srv560117044:88 , srv792283592:88 , srv796787921:88 , srv827801333:88 , srv873594518:88 , srv87537905:88 , srv1023025462:89 , srv139183708:89 , srv139782199:89 , srv1485161147:89 , srv1617900861:89 , srv1708271166:89 , srv362999829:89 , srv795607597:89 , srv932917251:89 , srv99134436:89 , srv1450787698:90 , srv1770058748:90 , srv292998868:90 , srv395566346:90 , srv47605244:90 , srv553573448:90 , srv667232182:90 , srv1303710663:91 , srv1421009350:91 , srv43452250:91 , srv583122128:91 , srv1795919635:94 , srv3576025:433 }
2023-10-10 03:53:25,694 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-10-10 03:53:25,695 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv583122128=73, srv1295503494=9, srv751530991=81, srv1742072423=38, srv1596863807=28, srv512536860=66, srv137601149=13, srv131246678=11, srv520939050=67, srv1550728400=25, srv1329949423=12, srv169545304=36, srv1708271166=37, srv554122467=70, srv1770058748=39, srv1784653186=40, srv1041501194=3, srv395566346=61, srv1485161147=20, srv292998868=56, srv560117044=71, srv877733259=91, srv1001915258=0, srv1617900861=32, srv237395721=51, srv1233633609=7, srv896351227=94, srv553573448=69, srv630689217=76, srv327434915=57, srv707388674=78, srv54832089=68, srv889839640=93, srv43452250=62, srv667232182=77, srv351670155=58, srv264009359=54, srv1616951669=31, srv1933123806=45, srv148654932=21, srv1636593398=33, srv1578120724=27, srv873594518=89, srv103843039=2, srv752600893=82, srv809787814=87, srv261309160=53, srv792283592=83, srv1511777743=23, srv1855963861=42, srv1450787698=19, srv1604733587=30, srv164752786=34, srv2046830471=49, srv1650145207=35, srv616204238=75, srv1573994403=26, srv1421009350=17, srv362999829=60, srv3576025=59, srv932917251=95, srv738053550=79, srv796787921=85, srv938847729=96, srv139183708=14, srv827801333=88, srv1023025462=1, srv1280346023=8, srv968019051=98, srv795607597=84, srv888833276=92, srv247193072=52, srv1212879697=6, srv2055003699=50, srv1411725638=16, srv796937607=86, srv478121519=64, srv564588100=72, srv87537905=90, srv1860844098=43, srv139782199=15, srv192609214=44, srv47605244=63, srv1064931316=4, srv1989126511=47, srv1989328678=48, srv741848282=80, srv1600422716=29, srv1795919635=41, srv956014665=97, srv1108679584=5, srv1510725488=22, srv289918775=55, srv1433475835=18, srv19793311=46, srv488949057=65, srv1303710663=10, srv15380488=24, srv594331907=74, srv99134436=99} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-10-10 03:53:25,715 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-10-10 03:53:25,715 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-10-10 03:53:25,716 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-10-10 03:53:25,716 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-10-10 03:53:25,716 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-10-10 03:53:25,716 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-10-10 03:53:25,716 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-10-10 03:53:25,716 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-10-10 03:53:25,717 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-10-10 03:53:25,717 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-10-10 03:53:25,717 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-10-10 03:53:25,717 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-10-10 03:53:25,717 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-10-10 03:53:25,717 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-10-10 03:53:25,718 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-10-10 03:53:25,718 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-10-10 03:53:25,718 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-10-10 03:53:25,718 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-10-10 03:53:25,718 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-10-10 03:53:25,718 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-10-10 03:53:25,718 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-10-10 03:53:25,718 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-10-10 03:53:25,719 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-10-10 03:53:25,719 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-10-10 03:53:25,719 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-10-10 03:53:25,719 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-10-10 03:53:25,719 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-10-10 03:53:25,719 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-10-10 03:53:25,719 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-10-10 03:53:25,720 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-10-10 03:53:25,720 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-10-10 03:53:25,720 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-10-10 03:53:25,720 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-10-10 03:53:25,720 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-10-10 03:53:25,720 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-10-10 03:53:25,720 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-10-10 03:53:25,720 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-10-10 03:53:25,721 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-10-10 03:53:25,721 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-10-10 03:53:25,721 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-10-10 03:53:25,721 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-10-10 03:53:25,721 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-10-10 03:53:25,721 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-10-10 03:53:25,721 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-10-10 03:53:25,721 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-10-10 03:53:25,722 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-10-10 03:53:25,722 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-10-10 03:53:25,722 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-10-10 03:53:25,722 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-10-10 03:53:25,722 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-10-10 03:53:25,722 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-10-10 03:53:25,722 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-10-10 03:53:25,722 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-10-10 03:53:25,723 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-10-10 03:53:25,723 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-10-10 03:53:25,723 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-10-10 03:53:25,723 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-10-10 03:53:25,723 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-10-10 03:53:25,723 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-10-10 03:53:25,723 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-10-10 03:53:25,724 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-10-10 03:53:25,724 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-10-10 03:53:25,724 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-10-10 03:53:25,724 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-10-10 03:53:25,724 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-10-10 03:53:25,724 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-10-10 03:53:25,724 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-10-10 03:53:25,724 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-10-10 03:53:25,725 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-10-10 03:53:25,725 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-10-10 03:53:25,725 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-10-10 03:53:25,725 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-10-10 03:53:25,725 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-10-10 03:53:25,726 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-10-10 03:53:25,726 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-10-10 03:53:25,726 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-10-10 03:53:25,726 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-10-10 03:53:25,726 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-10-10 03:53:25,727 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-10-10 03:53:25,727 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-10-10 03:53:25,727 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-10-10 03:53:25,728 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-10-10 03:53:25,728 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-10-10 03:53:25,728 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-10-10 03:53:25,728 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-10-10 03:53:25,728 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-10-10 03:53:25,729 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-10-10 03:53:25,729 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-10-10 03:53:25,729 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-10-10 03:53:25,729 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-10-10 03:53:25,729 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-10-10 03:53:25,729 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-10-10 03:53:25,729 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-10-10 03:53:25,729 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-10-10 03:53:25,729 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-10-10 03:53:25,730 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-10-10 03:53:25,730 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-10-10 03:53:25,730 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-10-10 03:53:25,731 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-10-10 03:53:25,731 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-10-10 03:53:25,731 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-10-10 03:53:25,882 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.03858709254641937, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06095388406035048, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.03858709254641937, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.18166666666666667, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.24675, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-10-10 03:53:25,882 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-10-10 03:53:25,883 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.186224760330304, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.03858709254641937, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06095388406035048, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.03858709254641937, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.18166666666666667, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.24675, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-10-10 03:53:26,272 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 498 ms to try 5000 different iterations.  Found a solution that moves 2656 regions; Going from a computed imbalance of 0.186224760330304 to a new imbalance of 0.016697791293557994. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.021265605172133578); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.04259537393934402, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.2951111111111111, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.021265605172133578); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.013583333333333333); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.04616666666666667, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-10-10 03:53:26,285 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1303710663:80 , srv1421009350:81 , srv1795919635:81 , srv395566346:81 , srv43452250:81 , srv667232182:81 , srv139183708:82 , srv139782199:82 , srv1485161147:82 , srv1784653186:82 , srv553573448:82 , srv1023025462:83 , srv1604733587:83 , srv1617900861:83 , srv1770058748:83 , srv1989126511:83 , srv362999829:83 , srv47605244:83 , srv560117044:83 , srv583122128:83 , srv792283592:83 , srv795607597:83 , srv932917251:83 , srv956014665:83 , srv99134436:83 , srv148654932:84 , srv1616951669:84 , srv1708271166:84 , srv520939050:84 , srv616204238:84 , srv827801333:84 , srv87537905:84 , srv1064931316:85 , srv1450787698:85 , srv1596863807:85 , srv164752786:85 , srv1860844098:85 , srv19793311:85 , srv1989328678:85 , srv2046830471:85 , srv261309160:85 , srv289918775:85 , srv512536860:85 , srv1212879697:86 , srv1295503494:86 , srv131246678:86 , srv1411725638:86 , srv1511777743:86 , srv1573994403:86 , srv1578120724:86 , srv1636593398:86 , srv1650145207:86 , srv1742072423:86 , srv327434915:86 , srv54832089:86 , srv554122467:86 , srv564588100:86 , srv873594518:86 , srv877733259:86 , srv1041501194:87 , srv1233633609:87 , srv137601149:87 , srv15380488:87 , srv1933123806:87 , srv247193072:87 , srv292998868:87 , srv351670155:87 , srv478121519:87 , srv488949057:87 , srv594331907:87 , srv630689217:87 , srv738053550:87 , srv752600893:87 , srv796787921:87 , srv796937607:87 , srv889839640:87 , srv896351227:87 , srv938847729:87 , srv1001915258:88 , srv1108679584:88 , srv1329949423:88 , srv1433475835:88 , srv169545304:88 , srv1855963861:88 , srv237395721:88 , srv264009359:88 , srv707388674:88 , srv741848282:88 , srv809787814:88 , srv103843039:89 , srv1280346023:89 , srv1510725488:89 , srv1550728400:89 , srv1600422716:89 , srv2055003699:89 , srv751530991:89 , srv888833276:89 , srv192609214:90 , srv968019051:91 , srv3576025:530 }
2023-10-10 03:53:26,289 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-10-10 03:53:26,289 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv583122128=73, srv1295503494=9, srv751530991=81, srv1742072423=38, srv1596863807=28, srv512536860=66, srv137601149=13, srv131246678=11, srv520939050=67, srv1550728400=25, srv1329949423=12, srv169545304=36, srv1708271166=37, srv554122467=70, srv1770058748=39, srv1784653186=40, srv1041501194=3, srv395566346=61, srv1485161147=20, srv292998868=56, srv560117044=71, srv877733259=91, srv1001915258=0, srv1617900861=32, srv237395721=51, srv1233633609=7, srv896351227=94, srv553573448=69, srv630689217=76, srv327434915=57, srv707388674=78, srv54832089=68, srv889839640=93, srv43452250=62, srv667232182=77, srv351670155=58, srv264009359=54, srv1616951669=31, srv1933123806=45, srv148654932=21, srv1636593398=33, srv1578120724=27, srv873594518=89, srv103843039=2, srv752600893=82, srv809787814=87, srv261309160=53, srv792283592=83, srv1511777743=23, srv1855963861=42, srv1450787698=19, srv1604733587=30, srv164752786=34, srv2046830471=49, srv1650145207=35, srv616204238=75, srv1573994403=26, srv1421009350=17, srv362999829=60, srv3576025=59, srv932917251=95, srv738053550=79, srv796787921=85, srv938847729=96, srv139183708=14, srv827801333=88, srv1023025462=1, srv1280346023=8, srv968019051=98, srv795607597=84, srv888833276=92, srv247193072=52, srv1212879697=6, srv2055003699=50, srv1411725638=16, srv796937607=86, srv478121519=64, srv564588100=72, srv87537905=90, srv1860844098=43, srv139782199=15, srv192609214=44, srv47605244=63, srv1064931316=4, srv1989126511=47, srv1989328678=48, srv741848282=80, srv1600422716=29, srv1795919635=41, srv956014665=97, srv1108679584=5, srv1510725488=22, srv289918775=55, srv1433475835=18, srv19793311=46, srv488949057=65, srv1303710663=10, srv15380488=24, srv594331907=74, srv99134436=99} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-10-10 03:53:26,301 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-10-10 03:53:26,301 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-10-10 03:53:26,301 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-10-10 03:53:26,301 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-10-10 03:53:26,301 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-10-10 03:53:26,301 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-10-10 03:53:26,301 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-10-10 03:53:26,301 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-10-10 03:53:26,302 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-10-10 03:53:26,302 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-10-10 03:53:26,302 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-10-10 03:53:26,302 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-10-10 03:53:26,302 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-10-10 03:53:26,302 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-10-10 03:53:26,302 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-10-10 03:53:26,302 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-10-10 03:53:26,302 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-10-10 03:53:26,302 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-10-10 03:53:26,302 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-10-10 03:53:26,302 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-10-10 03:53:26,302 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-10-10 03:53:26,302 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-10-10 03:53:26,302 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-10-10 03:53:26,302 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-10-10 03:53:26,303 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-10-10 03:53:26,303 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-10-10 03:53:26,303 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-10-10 03:53:26,303 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-10-10 03:53:26,303 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-10-10 03:53:26,303 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-10-10 03:53:26,303 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-10-10 03:53:26,303 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-10-10 03:53:26,303 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-10-10 03:53:26,303 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-10-10 03:53:26,303 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-10-10 03:53:26,303 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-10-10 03:53:26,303 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-10-10 03:53:26,303 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-10-10 03:53:26,303 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-10-10 03:53:26,304 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-10-10 03:53:26,304 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-10-10 03:53:26,304 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-10-10 03:53:26,304 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-10-10 03:53:26,304 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-10-10 03:53:26,304 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-10-10 03:53:26,304 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-10-10 03:53:26,304 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-10-10 03:53:26,304 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-10-10 03:53:26,304 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-10-10 03:53:26,304 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-10-10 03:53:26,304 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-10-10 03:53:26,304 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-10-10 03:53:26,304 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-10-10 03:53:26,304 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-10-10 03:53:26,304 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-10-10 03:53:26,305 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-10-10 03:53:26,305 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-10-10 03:53:26,305 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-10-10 03:53:26,305 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-10-10 03:53:26,305 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-10-10 03:53:26,305 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-10-10 03:53:26,305 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-10-10 03:53:26,305 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-10-10 03:53:26,305 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-10-10 03:53:26,305 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-10-10 03:53:26,305 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-10-10 03:53:26,305 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-10-10 03:53:26,305 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-10-10 03:53:26,305 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-10-10 03:53:26,305 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-10-10 03:53:26,306 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-10-10 03:53:26,306 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-10-10 03:53:26,306 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-10-10 03:53:26,306 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-10-10 03:53:26,306 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-10-10 03:53:26,306 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-10-10 03:53:26,306 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-10-10 03:53:26,306 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-10-10 03:53:26,306 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-10-10 03:53:26,306 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-10-10 03:53:26,306 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-10-10 03:53:26,306 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-10-10 03:53:26,306 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-10-10 03:53:26,306 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-10-10 03:53:26,306 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-10-10 03:53:26,306 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-10-10 03:53:26,307 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-10-10 03:53:26,307 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-10-10 03:53:26,307 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-10-10 03:53:26,307 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-10-10 03:53:26,307 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-10-10 03:53:26,307 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-10-10 03:53:26,307 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-10-10 03:53:26,307 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-10-10 03:53:26,307 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-10-10 03:53:26,307 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-10-10 03:53:26,307 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-10-10 03:53:26,307 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-10-10 03:53:26,307 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-10-10 03:53:26,307 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-10-10 03:53:26,307 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-10-10 03:53:26,423 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.021265605172133578); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.04259537393934402, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.021265605172133578); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.013583333333333333); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.04616666666666667, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-10-10 03:53:26,423 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-10-10 03:53:26,423 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.016679193584061176, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.021265605172133578); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.04259537393934402, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.021265605172133578); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.013583333333333333); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.04616666666666667, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-10-10 03:53:26,744 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 424 ms to try 5000 different iterations.  Found a solution that moves 1040 regions; Going from a computed imbalance of 0.016679193584061176 to a new imbalance of 4.8016062324541717E-4. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.006657307309718915); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.014595173163952058); MoveCostFunction : (multiplier=7.0, imbalance=0.11555555555555555, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.006657307309718915); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=8.333333333333333E-5); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0033333333333333335); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-10-10 03:53:26,748 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv292998868:80 , srv751530991:82 , srv1108679584:83 , srv1450787698:83 , srv1600422716:83 , srv1742072423:83 , srv1795919635:83 , srv192609214:83 , srv1933123806:83 , srv2055003699:83 , srv796787921:83 , srv889839640:83 , srv1329949423:84 , srv1411725638:84 , srv1596863807:84 , srv1636593398:84 , srv1708271166:84 , srv1770058748:84 , srv47605244:84 , srv564588100:84 , srv583122128:84 , srv809787814:84 , srv873594518:84 , srv968019051:84 , srv1001915258:85 , srv1023025462:85 , srv103843039:85 , srv1212879697:85 , srv1233633609:85 , srv1295503494:85 , srv1303710663:85 , srv1511777743:85 , srv15380488:85 , srv1550728400:85 , srv1578120724:85 , srv1616951669:85 , srv169545304:85 , srv1855963861:85 , srv362999829:85 , srv488949057:85 , srv553573448:85 , srv554122467:85 , srv630689217:85 , srv707388674:85 , srv738053550:85 , srv741848282:85 , srv795607597:85 , srv796937607:85 , srv877733259:85 , srv99134436:85 , srv1041501194:86 , srv1064931316:86 , srv1280346023:86 , srv137601149:86 , srv139183708:86 , srv1421009350:86 , srv1433475835:86 , srv1485161147:86 , srv148654932:86 , srv1617900861:86 , srv164752786:86 , srv1650145207:86 , srv19793311:86 , srv247193072:86 , srv261309160:86 , srv264009359:86 , srv289918775:86 , srv351670155:86 , srv395566346:86 , srv43452250:86 , srv520939050:86 , srv54832089:86 , srv560117044:86 , srv594331907:86 , srv752600893:86 , srv827801333:86 , srv888833276:86 , srv932917251:86 , srv938847729:86 , srv131246678:87 , srv139782199:87 , srv1510725488:87 , srv1573994403:87 , srv1784653186:87 , srv1860844098:87 , srv1989126511:87 , srv1989328678:87 , srv2046830471:87 , srv237395721:87 , srv478121519:87 , srv512536860:87 , srv616204238:87 , srv667232182:87 , srv792283592:87 , srv87537905:87 , srv896351227:87 , srv956014665:87 , srv1604733587:88 , srv327434915:88 , srv3576025:554 }
2023-10-10 03:53:26,754 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-10-10 03:53:26,756 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv583122128=73, srv1295503494=9, srv751530991=81, srv1742072423=38, srv1596863807=28, srv512536860=66, srv137601149=13, srv131246678=11, srv520939050=67, srv1550728400=25, srv1329949423=12, srv169545304=36, srv1708271166=37, srv554122467=70, srv1770058748=39, srv1784653186=40, srv1041501194=3, srv395566346=61, srv1485161147=20, srv292998868=56, srv560117044=71, srv877733259=91, srv1001915258=0, srv1617900861=32, srv237395721=51, srv1233633609=7, srv896351227=94, srv553573448=69, srv630689217=76, srv327434915=57, srv707388674=78, srv54832089=68, srv889839640=93, srv43452250=62, srv667232182=77, srv351670155=58, srv264009359=54, srv1616951669=31, srv1933123806=45, srv148654932=21, srv1636593398=33, srv1578120724=27, srv873594518=89, srv103843039=2, srv752600893=82, srv809787814=87, srv261309160=53, srv792283592=83, srv1511777743=23, srv1855963861=42, srv1450787698=19, srv1604733587=30, srv164752786=34, srv2046830471=49, srv1650145207=35, srv616204238=75, srv1573994403=26, srv1421009350=17, srv362999829=60, srv3576025=59, srv932917251=95, srv738053550=79, srv796787921=85, srv938847729=96, srv139183708=14, srv827801333=88, srv1023025462=1, srv1280346023=8, srv968019051=98, srv795607597=84, srv888833276=92, srv247193072=52, srv1212879697=6, srv2055003699=50, srv1411725638=16, srv796937607=86, srv478121519=64, srv564588100=72, srv87537905=90, srv1860844098=43, srv139782199=15, srv192609214=44, srv47605244=63, srv1064931316=4, srv1989126511=47, srv1989328678=48, srv741848282=80, srv1600422716=29, srv1795919635=41, srv956014665=97, srv1108679584=5, srv1510725488=22, srv289918775=55, srv1433475835=18, srv19793311=46, srv488949057=65, srv1303710663=10, srv15380488=24, srv594331907=74, srv99134436=99} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-10-10 03:53:26,780 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-10-10 03:53:26,780 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-10-10 03:53:26,780 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-10-10 03:53:26,780 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-10-10 03:53:26,780 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-10-10 03:53:26,781 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-10-10 03:53:26,781 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-10-10 03:53:26,781 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-10-10 03:53:26,781 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-10-10 03:53:26,781 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-10-10 03:53:26,781 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-10-10 03:53:26,781 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-10-10 03:53:26,781 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-10-10 03:53:26,781 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-10-10 03:53:26,782 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-10-10 03:53:26,782 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-10-10 03:53:26,782 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-10-10 03:53:26,782 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-10-10 03:53:26,782 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-10-10 03:53:26,782 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-10-10 03:53:26,782 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-10-10 03:53:26,782 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-10-10 03:53:26,782 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-10-10 03:53:26,782 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-10-10 03:53:26,783 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-10-10 03:53:26,783 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-10-10 03:53:26,783 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-10-10 03:53:26,783 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-10-10 03:53:26,783 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-10-10 03:53:26,783 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-10-10 03:53:26,783 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-10-10 03:53:26,783 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-10-10 03:53:26,783 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-10-10 03:53:26,784 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-10-10 03:53:26,784 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-10-10 03:53:26,784 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-10-10 03:53:26,784 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-10-10 03:53:26,784 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-10-10 03:53:26,784 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-10-10 03:53:26,784 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-10-10 03:53:26,784 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-10-10 03:53:26,784 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-10-10 03:53:26,785 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-10-10 03:53:26,785 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-10-10 03:53:26,785 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-10-10 03:53:26,785 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-10-10 03:53:26,785 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-10-10 03:53:26,785 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-10-10 03:53:26,785 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-10-10 03:53:26,785 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-10-10 03:53:26,786 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-10-10 03:53:26,786 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-10-10 03:53:26,786 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-10-10 03:53:26,786 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-10-10 03:53:26,786 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-10-10 03:53:26,787 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-10-10 03:53:26,787 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-10-10 03:53:26,788 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-10-10 03:53:26,788 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-10-10 03:53:26,788 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-10-10 03:53:26,788 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-10-10 03:53:26,788 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-10-10 03:53:26,788 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-10-10 03:53:26,788 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-10-10 03:53:26,788 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-10-10 03:53:26,788 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-10-10 03:53:26,789 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-10-10 03:53:26,789 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-10-10 03:53:26,789 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-10-10 03:53:26,789 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-10-10 03:53:26,789 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-10-10 03:53:26,789 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-10-10 03:53:26,789 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-10-10 03:53:26,789 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-10-10 03:53:26,789 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-10-10 03:53:26,790 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-10-10 03:53:26,790 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-10-10 03:53:26,790 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-10-10 03:53:26,790 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-10-10 03:53:26,790 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-10-10 03:53:26,790 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-10-10 03:53:26,790 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-10-10 03:53:26,790 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-10-10 03:53:26,790 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-10-10 03:53:26,791 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-10-10 03:53:26,791 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-10-10 03:53:26,791 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-10-10 03:53:26,791 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-10-10 03:53:26,791 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-10-10 03:53:26,791 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-10-10 03:53:26,791 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-10-10 03:53:26,791 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-10-10 03:53:26,791 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-10-10 03:53:26,792 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-10-10 03:53:26,792 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-10-10 03:53:26,792 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-10-10 03:53:26,792 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-10-10 03:53:26,792 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-10-10 03:53:26,792 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-10-10 03:53:26,792 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-10-10 03:53:26,792 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-10-10 03:53:26,933 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.006657307309718915); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.014595173163952058); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.006657307309718915); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=8.333333333333333E-5); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0033333333333333335); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-10-10 03:53:26,933 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-10-10 03:53:26,934 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=4.7287838759907375E-4, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.006657307309718915); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.014595173163952058); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.006657307309718915); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=8.333333333333333E-5); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0033333333333333335); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-10-10 03:53:27,267 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 454 ms to try 5000 different iterations.  Found a solution that moves 252 regions; Going from a computed imbalance of 4.7287838759907375E-4 to a new imbalance of 3.6425963695509235E-5. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=4.4668347344853864E-4); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0022222222222222222); MoveCostFunction : (multiplier=7.0, imbalance=0.028, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=4.4668347344853864E-4); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=2.5E-4); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-10-10 03:53:27,268 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1064931316:83 , srv1604733587:83 , srv19793311:83 , srv87537905:83 , srv1233633609:84 , srv137601149:84 , srv139183708:84 , srv139782199:84 , srv1421009350:84 , srv1450787698:84 , srv1578120724:84 , srv1600422716:84 , srv1617900861:84 , srv164752786:84 , srv1650145207:84 , srv169545304:84 , srv1795919635:84 , srv1855963861:84 , srv1860844098:84 , srv192609214:84 , srv1989328678:84 , srv2046830471:84 , srv247193072:84 , srv289918775:84 , srv327434915:84 , srv43452250:84 , srv512536860:84 , srv54832089:84 , srv560117044:84 , srv583122128:84 , srv616204238:84 , srv667232182:84 , srv707388674:84 , srv752600893:84 , srv792283592:84 , srv796787921:84 , srv827801333:84 , srv877733259:84 , srv888833276:84 , srv896351227:84 , srv932917251:84 , srv938847729:84 , srv968019051:84 , srv99134436:84 , srv1001915258:85 , srv1023025462:85 , srv1041501194:85 , srv1108679584:85 , srv1212879697:85 , srv1280346023:85 , srv1295503494:85 , srv131246678:85 , srv1329949423:85 , srv1411725638:85 , srv1485161147:85 , srv148654932:85 , srv1510725488:85 , srv1511777743:85 , srv15380488:85 , srv1550728400:85 , srv1573994403:85 , srv1616951669:85 , srv1636593398:85 , srv1708271166:85 , srv1742072423:85 , srv1770058748:85 , srv1933123806:85 , srv1989126511:85 , srv2055003699:85 , srv237395721:85 , srv261309160:85 , srv264009359:85 , srv292998868:85 , srv351670155:85 , srv362999829:85 , srv395566346:85 , srv47605244:85 , srv478121519:85 , srv488949057:85 , srv520939050:85 , srv553573448:85 , srv554122467:85 , srv594331907:85 , srv738053550:85 , srv741848282:85 , srv795607597:85 , srv796937607:85 , srv809787814:85 , srv873594518:85 , srv889839640:85 , srv956014665:85 , srv103843039:86 , srv1303710663:86 , srv1433475835:86 , srv1596863807:86 , srv1784653186:86 , srv564588100:86 , srv630689217:86 , srv751530991:86 , srv3576025:625 }
2023-10-10 03:53:27,274 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-10-10 03:53:27,275 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv583122128=73, srv1295503494=9, srv751530991=81, srv1742072423=38, srv1596863807=28, srv512536860=66, srv137601149=13, srv131246678=11, srv520939050=67, srv1550728400=25, srv1329949423=12, srv169545304=36, srv1708271166=37, srv554122467=70, srv1770058748=39, srv1784653186=40, srv1041501194=3, srv395566346=61, srv1485161147=20, srv292998868=56, srv560117044=71, srv877733259=91, srv1001915258=0, srv1617900861=32, srv237395721=51, srv1233633609=7, srv896351227=94, srv553573448=69, srv630689217=76, srv327434915=57, srv707388674=78, srv54832089=68, srv889839640=93, srv43452250=62, srv667232182=77, srv351670155=58, srv264009359=54, srv1616951669=31, srv1933123806=45, srv148654932=21, srv1636593398=33, srv1578120724=27, srv873594518=89, srv103843039=2, srv752600893=82, srv809787814=87, srv261309160=53, srv792283592=83, srv1511777743=23, srv1855963861=42, srv1450787698=19, srv1604733587=30, srv164752786=34, srv2046830471=49, srv1650145207=35, srv616204238=75, srv1573994403=26, srv1421009350=17, srv362999829=60, srv3576025=59, srv932917251=95, srv738053550=79, srv796787921=85, srv938847729=96, srv139183708=14, srv827801333=88, srv1023025462=1, srv1280346023=8, srv968019051=98, srv795607597=84, srv888833276=92, srv247193072=52, srv1212879697=6, srv2055003699=50, srv1411725638=16, srv796937607=86, srv478121519=64, srv564588100=72, srv87537905=90, srv1860844098=43, srv139782199=15, srv192609214=44, srv47605244=63, srv1064931316=4, srv1989126511=47, srv1989328678=48, srv741848282=80, srv1600422716=29, srv1795919635=41, srv956014665=97, srv1108679584=5, srv1510725488=22, srv289918775=55, srv1433475835=18, srv19793311=46, srv488949057=65, srv1303710663=10, srv15380488=24, srv594331907=74, srv99134436=99} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-10-10 03:53:27,292 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-10-10 03:53:27,292 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-10-10 03:53:27,292 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-10-10 03:53:27,293 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-10-10 03:53:27,293 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-10-10 03:53:27,293 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-10-10 03:53:27,293 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-10-10 03:53:27,293 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-10-10 03:53:27,293 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-10-10 03:53:27,293 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-10-10 03:53:27,293 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-10-10 03:53:27,293 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-10-10 03:53:27,293 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-10-10 03:53:27,293 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-10-10 03:53:27,293 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-10-10 03:53:27,294 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-10-10 03:53:27,294 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-10-10 03:53:27,294 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-10-10 03:53:27,294 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-10-10 03:53:27,294 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-10-10 03:53:27,294 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-10-10 03:53:27,294 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-10-10 03:53:27,294 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-10-10 03:53:27,294 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-10-10 03:53:27,294 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-10-10 03:53:27,294 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-10-10 03:53:27,294 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-10-10 03:53:27,294 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-10-10 03:53:27,295 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-10-10 03:53:27,295 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-10-10 03:53:27,295 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-10-10 03:53:27,295 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-10-10 03:53:27,295 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-10-10 03:53:27,295 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-10-10 03:53:27,295 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-10-10 03:53:27,295 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-10-10 03:53:27,295 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-10-10 03:53:27,295 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-10-10 03:53:27,295 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-10-10 03:53:27,295 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-10-10 03:53:27,295 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-10-10 03:53:27,296 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-10-10 03:53:27,296 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-10-10 03:53:27,296 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-10-10 03:53:27,296 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-10-10 03:53:27,296 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-10-10 03:53:27,296 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-10-10 03:53:27,296 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-10-10 03:53:27,296 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-10-10 03:53:27,296 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-10-10 03:53:27,296 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-10-10 03:53:27,296 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-10-10 03:53:27,296 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-10-10 03:53:27,297 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-10-10 03:53:27,297 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-10-10 03:53:27,297 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-10-10 03:53:27,297 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-10-10 03:53:27,297 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-10-10 03:53:27,297 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-10-10 03:53:27,297 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-10-10 03:53:27,297 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-10-10 03:53:27,297 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-10-10 03:53:27,297 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-10-10 03:53:27,297 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-10-10 03:53:27,297 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-10-10 03:53:27,297 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-10-10 03:53:27,298 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-10-10 03:53:27,298 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-10-10 03:53:27,298 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-10-10 03:53:27,298 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-10-10 03:53:27,298 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-10-10 03:53:27,298 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-10-10 03:53:27,298 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-10-10 03:53:27,299 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-10-10 03:53:27,299 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-10-10 03:53:27,299 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-10-10 03:53:27,299 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-10-10 03:53:27,299 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-10-10 03:53:27,299 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-10-10 03:53:27,299 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-10-10 03:53:27,299 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-10-10 03:53:27,299 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-10-10 03:53:27,299 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-10-10 03:53:27,299 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-10-10 03:53:27,299 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-10-10 03:53:27,299 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-10-10 03:53:27,300 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-10-10 03:53:27,300 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-10-10 03:53:27,300 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-10-10 03:53:27,300 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-10-10 03:53:27,300 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-10-10 03:53:27,300 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-10-10 03:53:27,300 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-10-10 03:53:27,300 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-10-10 03:53:27,300 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-10-10 03:53:27,300 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-10-10 03:53:27,300 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-10-10 03:53:27,300 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-10-10 03:53:27,300 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-10-10 03:53:27,301 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-10-10 03:53:27,301 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-10-10 03:53:27,441 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=4.4668347344853864E-4); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0022222222222222222); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=4.4668347344853864E-4); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=2.5E-4); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-10-10 03:53:27,442 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-10-10 03:53:27,442 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=3.466142198120294E-5, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=4.4668347344853864E-4); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0022222222222222222); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=4.4668347344853864E-4); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=2.5E-4); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-10-10 03:53:27,759 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 444 ms to try 5000 different iterations.  Found a solution that moves 31 regions; Going from a computed imbalance of 3.466142198120294E-5 to a new imbalance of 7.906488439809095E-6. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0017082358106351274); MoveCostFunction : (multiplier=7.0, imbalance=0.0034444444444444444); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-10-10 03:53:27,759 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv103843039:83 , srv1433475835:83 , srv15380488:83 , srv1784653186:83 , srv327434915:83 , srv630689217:83 , srv751530991:83 , srv873594518:83 , srv1001915258:84 , srv1023025462:84 , srv1041501194:84 , srv1064931316:84 , srv1108679584:84 , srv1212879697:84 , srv1233633609:84 , srv1280346023:84 , srv1295503494:84 , srv1303710663:84 , srv131246678:84 , srv1329949423:84 , srv137601149:84 , srv139782199:84 , srv1411725638:84 , srv1421009350:84 , srv1450787698:84 , srv1485161147:84 , srv148654932:84 , srv1510725488:84 , srv1511777743:84 , srv1550728400:84 , srv1573994403:84 , srv1596863807:84 , srv1600422716:84 , srv1604733587:84 , srv1616951669:84 , srv1617900861:84 , srv1636593398:84 , srv164752786:84 , srv169545304:84 , srv1708271166:84 , srv1742072423:84 , srv1770058748:84 , srv1795919635:84 , srv1855963861:84 , srv1860844098:84 , srv192609214:84 , srv1933123806:84 , srv1989126511:84 , srv1989328678:84 , srv2046830471:84 , srv2055003699:84 , srv237395721:84 , srv247193072:84 , srv261309160:84 , srv264009359:84 , srv292998868:84 , srv351670155:84 , srv362999829:84 , srv395566346:84 , srv43452250:84 , srv47605244:84 , srv478121519:84 , srv488949057:84 , srv512536860:84 , srv520939050:84 , srv54832089:84 , srv553573448:84 , srv554122467:84 , srv564588100:84 , srv583122128:84 , srv594331907:84 , srv616204238:84 , srv667232182:84 , srv707388674:84 , srv738053550:84 , srv741848282:84 , srv752600893:84 , srv792283592:84 , srv795607597:84 , srv796787921:84 , srv796937607:84 , srv809787814:84 , srv827801333:84 , srv87537905:84 , srv888833276:84 , srv889839640:84 , srv896351227:84 , srv932917251:84 , srv938847729:84 , srv956014665:84 , srv968019051:84 , srv139183708:85 , srv1578120724:85 , srv1650145207:85 , srv19793311:85 , srv289918775:85 , srv560117044:85 , srv877733259:85 , srv99134436:85 , srv3576025:684 }
2023-10-10 03:53:27,764 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-10-10 03:53:27,765 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv583122128=73, srv1295503494=9, srv751530991=81, srv1742072423=38, srv1596863807=28, srv512536860=66, srv137601149=13, srv131246678=11, srv520939050=67, srv1550728400=25, srv1329949423=12, srv169545304=36, srv1708271166=37, srv554122467=70, srv1770058748=39, srv1784653186=40, srv1041501194=3, srv395566346=61, srv1485161147=20, srv292998868=56, srv560117044=71, srv877733259=91, srv1001915258=0, srv1617900861=32, srv237395721=51, srv1233633609=7, srv896351227=94, srv553573448=69, srv630689217=76, srv327434915=57, srv707388674=78, srv54832089=68, srv889839640=93, srv43452250=62, srv667232182=77, srv351670155=58, srv264009359=54, srv1616951669=31, srv1933123806=45, srv148654932=21, srv1636593398=33, srv1578120724=27, srv873594518=89, srv103843039=2, srv752600893=82, srv809787814=87, srv261309160=53, srv792283592=83, srv1511777743=23, srv1855963861=42, srv1450787698=19, srv1604733587=30, srv164752786=34, srv2046830471=49, srv1650145207=35, srv616204238=75, srv1573994403=26, srv1421009350=17, srv362999829=60, srv3576025=59, srv932917251=95, srv738053550=79, srv796787921=85, srv938847729=96, srv139183708=14, srv827801333=88, srv1023025462=1, srv1280346023=8, srv968019051=98, srv795607597=84, srv888833276=92, srv247193072=52, srv1212879697=6, srv2055003699=50, srv1411725638=16, srv796937607=86, srv478121519=64, srv564588100=72, srv87537905=90, srv1860844098=43, srv139782199=15, srv192609214=44, srv47605244=63, srv1064931316=4, srv1989126511=47, srv1989328678=48, srv741848282=80, srv1600422716=29, srv1795919635=41, srv956014665=97, srv1108679584=5, srv1510725488=22, srv289918775=55, srv1433475835=18, srv19793311=46, srv488949057=65, srv1303710663=10, srv15380488=24, srv594331907=74, srv99134436=99} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-10-10 03:53:27,778 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-10-10 03:53:27,778 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-10-10 03:53:27,778 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-10-10 03:53:27,778 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-10-10 03:53:27,779 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-10-10 03:53:27,779 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-10-10 03:53:27,779 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-10-10 03:53:27,779 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-10-10 03:53:27,779 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-10-10 03:53:27,779 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-10-10 03:53:27,779 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-10-10 03:53:27,779 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-10-10 03:53:27,779 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-10-10 03:53:27,779 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-10-10 03:53:27,779 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-10-10 03:53:27,779 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-10-10 03:53:27,780 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-10-10 03:53:27,780 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-10-10 03:53:27,780 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-10-10 03:53:27,780 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-10-10 03:53:27,780 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-10-10 03:53:27,780 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-10-10 03:53:27,780 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-10-10 03:53:27,780 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-10-10 03:53:27,780 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-10-10 03:53:27,780 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-10-10 03:53:27,780 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-10-10 03:53:27,780 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-10-10 03:53:27,780 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-10-10 03:53:27,781 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-10-10 03:53:27,781 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-10-10 03:53:27,781 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-10-10 03:53:27,781 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-10-10 03:53:27,781 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-10-10 03:53:27,781 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-10-10 03:53:27,781 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-10-10 03:53:27,781 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-10-10 03:53:27,781 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-10-10 03:53:27,781 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-10-10 03:53:27,781 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-10-10 03:53:27,782 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-10-10 03:53:27,782 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-10-10 03:53:27,782 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-10-10 03:53:27,782 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-10-10 03:53:27,782 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-10-10 03:53:27,782 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-10-10 03:53:27,782 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-10-10 03:53:27,782 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-10-10 03:53:27,782 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-10-10 03:53:27,782 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-10-10 03:53:27,782 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-10-10 03:53:27,782 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-10-10 03:53:27,783 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-10-10 03:53:27,783 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-10-10 03:53:27,783 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-10-10 03:53:27,783 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-10-10 03:53:27,783 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-10-10 03:53:27,783 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-10-10 03:53:27,783 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-10-10 03:53:27,783 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-10-10 03:53:27,783 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-10-10 03:53:27,783 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-10-10 03:53:27,783 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-10-10 03:53:27,783 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-10-10 03:53:27,783 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-10-10 03:53:27,784 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-10-10 03:53:27,784 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-10-10 03:53:27,784 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-10-10 03:53:27,784 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-10-10 03:53:27,784 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-10-10 03:53:27,784 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-10-10 03:53:27,784 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-10-10 03:53:27,784 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-10-10 03:53:27,784 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-10-10 03:53:27,784 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-10-10 03:53:27,784 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-10-10 03:53:27,784 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-10-10 03:53:27,784 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-10-10 03:53:27,784 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-10-10 03:53:27,784 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-10-10 03:53:27,784 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-10-10 03:53:27,784 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-10-10 03:53:27,784 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-10-10 03:53:27,784 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-10-10 03:53:27,784 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-10-10 03:53:27,784 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-10-10 03:53:27,785 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-10-10 03:53:27,785 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-10-10 03:53:27,785 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-10-10 03:53:27,785 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-10-10 03:53:27,785 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-10-10 03:53:27,785 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-10-10 03:53:27,785 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-10-10 03:53:27,785 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-10-10 03:53:27,785 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-10-10 03:53:27,785 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-10-10 03:53:27,785 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-10-10 03:53:27,785 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-10-10 03:53:27,786 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-10-10 03:53:27,786 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-10-10 03:53:27,786 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-10-10 03:53:27,903 INFO  [Time-limited test] balancer.StochasticLoadBalancer(381): Cluster wide - skipping load balancing because weighted average imbalance=7.689421800350782E-6 <= threshold(0.025). If you want more aggressive balancing, either lower hbase.master.balancer.stochastic.minCostNeedBalance from 0.025 or increase the relative multiplier(s) of the specific cost function(s). functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0017082358106351274); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-10-10 03:53:27,903 INFO  [Time-limited test] balancer.BalancerTestBase(570): Mock Final balance: { srv103843039:83 , srv1433475835:83 , srv15380488:83 , srv1784653186:83 , srv327434915:83 , srv630689217:83 , srv751530991:83 , srv873594518:83 , srv1001915258:84 , srv1023025462:84 , srv1041501194:84 , srv1064931316:84 , srv1108679584:84 , srv1212879697:84 , srv1233633609:84 , srv1280346023:84 , srv1295503494:84 , srv1303710663:84 , srv131246678:84 , srv1329949423:84 , srv137601149:84 , srv139782199:84 , srv1411725638:84 , srv1421009350:84 , srv1450787698:84 , srv1485161147:84 , srv148654932:84 , srv1510725488:84 , srv1511777743:84 , srv1550728400:84 , srv1573994403:84 , srv1596863807:84 , srv1600422716:84 , srv1604733587:84 , srv1616951669:84 , srv1617900861:84 , srv1636593398:84 , srv164752786:84 , srv169545304:84 , srv1708271166:84 , srv1742072423:84 , srv1770058748:84 , srv1795919635:84 , srv1855963861:84 , srv1860844098:84 , srv192609214:84 , srv1933123806:84 , srv1989126511:84 , srv1989328678:84 , srv2046830471:84 , srv2055003699:84 , srv237395721:84 , srv247193072:84 , srv261309160:84 , srv264009359:84 , srv292998868:84 , srv351670155:84 , srv362999829:84 , srv395566346:84 , srv43452250:84 , srv47605244:84 , srv478121519:84 , srv488949057:84 , srv512536860:84 , srv520939050:84 , srv54832089:84 , srv553573448:84 , srv554122467:84 , srv564588100:84 , srv583122128:84 , srv594331907:84 , srv616204238:84 , srv667232182:84 , srv707388674:84 , srv738053550:84 , srv741848282:84 , srv752600893:84 , srv792283592:84 , srv795607597:84 , srv796787921:84 , srv796937607:84 , srv809787814:84 , srv827801333:84 , srv87537905:84 , srv888833276:84 , srv889839640:84 , srv896351227:84 , srv932917251:84 , srv938847729:84 , srv956014665:84 , srv968019051:84 , srv139183708:85 , srv1578120724:85 , srv1650145207:85 , srv19793311:85 , srv289918775:85 , srv560117044:85 , srv877733259:85 , srv99134436:85 , srv3576025:684 }
2023-10-10 03:53:27,931 INFO  [Time-limited test] hbase.ResourceChecker(175): after: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnLargeClusterWithRacks Thread=12 (was 12), OpenFileDescriptor=263 (was 263), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=307 (was 291) - SystemLoadAverage LEAK? -, ProcessCount=170 (was 170), AvailableMemoryMB=10423 (was 10323) - AvailableMemoryMB LEAK? -
2023-10-10 03:53:27,939 INFO  [Time-limited test] hbase.ResourceChecker(147): before: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnMidClusterWithRacks Thread=12, OpenFileDescriptor=263, MaxFileDescriptor=60000, SystemLoadAverage=307, ProcessCount=170, AvailableMemoryMB=10422
2023-10-10 03:53:27,940 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2023-10-10 03:53:27,941 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=5000, runMaxSteps=true, stepsPerRegion=800, maxRunningTime=120000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 111077.0 etc.
2023-10-10 03:53:27,950 INFO  [Time-limited test] balancer.BalancerTestBase(547): Mock Cluster : { srv1005919290:84 , srv1140480200:84 , srv1143927341:84 , srv1173348046:84 , srv12184815:84 , srv1259706343:84 , srv138181376:84 , srv1434377215:84 , srv1518421594:84 , srv1613123068:84 , srv1647599224:84 , srv1811568456:84 , srv1816104718:84 , srv1852713963:84 , srv1940143700:84 , srv1972198607:84 , srv249809801:84 , srv279877080:84 , srv282018818:84 , srv322922837:84 , srv458964669:84 , srv479063310:84 , srv574072964:84 , srv74365769:84 , srv754899769:84 , srv911181571:84 , srv943316857:84 , srv98744531:84 , srv988394530:84 , srv914670301:264 } [srvr=30 rgns=2700 avg=90.0 max=90 min=90]
2023-10-10 03:53:27,951 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-10-10 03:53:27,951 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1140480200=1, srv1434377215=7, srv754899769=24, srv1940143700=14, srv479063310=21, srv1972198607=15, srv1173348046=3, srv943316857=27, srv1143927341=2, srv574072964=22, srv249809801=16, srv458964669=20, srv914670301=26, srv911181571=25, srv1259706343=5, srv98744531=28, srv1005919290=0, srv1518421594=8, srv1852713963=13, srv1647599224=10, srv1816104718=12, srv74365769=23, srv1811568456=11, srv322922837=19, srv1613123068=9, srv282018818=18, srv988394530=29, srv138181376=6, srv279877080=17, srv12184815=4} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-10-10 03:53:27,962 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-10-10 03:53:27,962 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-10-10 03:53:27,963 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-10-10 03:53:27,963 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-10-10 03:53:27,963 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-10-10 03:53:27,963 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-10-10 03:53:27,963 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-10-10 03:53:27,963 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-10-10 03:53:27,963 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-10-10 03:53:27,963 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-10-10 03:53:27,963 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-10-10 03:53:27,963 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-10-10 03:53:27,963 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-10-10 03:53:27,963 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-10-10 03:53:27,963 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-10-10 03:53:27,963 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-10-10 03:53:27,963 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-10-10 03:53:27,963 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-10-10 03:53:27,963 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-10-10 03:53:27,963 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-10-10 03:53:27,963 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-10-10 03:53:27,963 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-10-10 03:53:27,963 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-10-10 03:53:27,963 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-10-10 03:53:27,963 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-10-10 03:53:27,964 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-10-10 03:53:27,964 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-10-10 03:53:27,964 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-10-10 03:53:27,964 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-10-10 03:53:27,964 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-10-10 03:53:27,964 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=10, number of hosts=30, number of racks=4
2023-10-10 03:53:27,981 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=1.1391389006936492, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-10-10 03:53:27,981 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.9912631465397063, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=1.1391389006936492, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=64800000
2023-10-10 03:55:27,967 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 120001 ms to try 5977226 different iterations.  Found a solution that moves 1860 regions; Going from a computed imbalance of 0.9912631465397063 to a new imbalance of 4.341332789166274E-5. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); MoveCostFunction : (multiplier=7.0, imbalance=0.6888888888888889, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-10-10 03:55:27,975 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1005919290:90 , srv1140480200:90 , srv1143927341:90 , srv1173348046:90 , srv12184815:90 , srv1259706343:90 , srv138181376:90 , srv1434377215:90 , srv1518421594:90 , srv1613123068:90 , srv1647599224:90 , srv1811568456:90 , srv1816104718:90 , srv1852713963:90 , srv1940143700:90 , srv1972198607:90 , srv249809801:90 , srv279877080:90 , srv282018818:90 , srv322922837:90 , srv458964669:90 , srv479063310:90 , srv574072964:90 , srv74365769:90 , srv754899769:90 , srv911181571:90 , srv914670301:90 , srv943316857:90 , srv98744531:90 , srv988394530:90 }
2023-10-10 03:55:27,976 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-10-10 03:55:27,977 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1140480200=1, srv1434377215=7, srv754899769=24, srv1940143700=14, srv479063310=21, srv1972198607=15, srv1173348046=3, srv943316857=27, srv1143927341=2, srv574072964=22, srv249809801=16, srv458964669=20, srv914670301=26, srv911181571=25, srv1259706343=5, srv98744531=28, srv1005919290=0, srv1518421594=8, srv1852713963=13, srv1647599224=10, srv1816104718=12, srv74365769=23, srv1811568456=11, srv322922837=19, srv1613123068=9, srv282018818=18, srv988394530=29, srv138181376=6, srv279877080=17, srv12184815=4} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-10-10 03:55:27,980 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-10-10 03:55:27,980 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-10-10 03:55:27,980 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-10-10 03:55:27,980 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-10-10 03:55:27,981 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-10-10 03:55:27,981 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-10-10 03:55:27,981 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-10-10 03:55:27,981 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-10-10 03:55:27,981 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-10-10 03:55:27,981 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-10-10 03:55:27,981 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-10-10 03:55:27,981 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-10-10 03:55:27,981 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-10-10 03:55:27,981 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-10-10 03:55:27,981 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-10-10 03:55:27,981 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-10-10 03:55:27,981 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-10-10 03:55:27,981 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-10-10 03:55:27,981 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-10-10 03:55:27,981 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-10-10 03:55:27,981 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-10-10 03:55:27,981 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-10-10 03:55:27,982 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-10-10 03:55:27,982 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-10-10 03:55:27,982 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-10-10 03:55:27,982 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-10-10 03:55:27,982 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-10-10 03:55:27,982 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-10-10 03:55:27,982 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-10-10 03:55:27,982 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-10-10 03:55:27,982 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=10, number of hosts=30, number of racks=4
2023-10-10 03:55:27,999 INFO  [Time-limited test] balancer.StochasticLoadBalancer(381): Cluster wide - skipping load balancing because weighted average imbalance=0.0 <= threshold(0.025). If you want more aggressive balancing, either lower hbase.master.balancer.stochastic.minCostNeedBalance from 0.025 or increase the relative multiplier(s) of the specific cost function(s). functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-10-10 03:55:27,999 INFO  [Time-limited test] balancer.BalancerTestBase(570): Mock Final balance: { srv1005919290:90 , srv1140480200:90 , srv1143927341:90 , srv1173348046:90 , srv12184815:90 , srv1259706343:90 , srv138181376:90 , srv1434377215:90 , srv1518421594:90 , srv1613123068:90 , srv1647599224:90 , srv1811568456:90 , srv1816104718:90 , srv1852713963:90 , srv1940143700:90 , srv1972198607:90 , srv249809801:90 , srv279877080:90 , srv282018818:90 , srv322922837:90 , srv458964669:90 , srv479063310:90 , srv574072964:90 , srv74365769:90 , srv754899769:90 , srv911181571:90 , srv914670301:90 , srv943316857:90 , srv98744531:90 , srv988394530:90 }
2023-10-10 03:55:28,015 INFO  [Time-limited test] hbase.ResourceChecker(175): after: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnMidClusterWithRacks Thread=11 (was 12), OpenFileDescriptor=263 (was 263), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=239 (was 307), ProcessCount=167 (was 170), AvailableMemoryMB=9340 (was 10422)