2023-08-07 14:53:13,020 INFO  [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks timeout: 13 mins
2023-08-07 14:53:13,345 WARN  [Time-limited test] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties
2023-08-07 14:53:13,463 INFO  [Time-limited test] metrics.MetricRegistriesLoader(60): Loaded MetricRegistries class org.apache.hadoop.hbase.metrics.impl.MetricRegistriesImpl
2023-08-07 14:53:13,527 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2023-08-07 14:53:13,537 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc.
2023-08-07 14:53:13,554 INFO  [Time-limited test] hbase.ResourceChecker(147): before: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnLargeClusterWithRacks Thread=12, OpenFileDescriptor=263, MaxFileDescriptor=60000, SystemLoadAverage=287, ProcessCount=179, AvailableMemoryMB=3195
2023-08-07 14:53:13,556 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2023-08-07 14:53:13,556 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=5000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=10000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc.
2023-08-07 14:53:13,706 INFO  [Time-limited test] balancer.BalancerTestBase(547): Mock Cluster : { srv1002563585:84 , srv1042283590:84 , srv1051355986:84 , srv1091027166:84 , srv1102556874:84 , srv1113140106:84 , srv1156577728:84 , srv1187383779:84 , srv1225619888:84 , srv124597303:84 , srv1262847851:84 , srv1306265314:84 , srv13112713:84 , srv1312794891:84 , srv1331124678:84 , srv1338520660:84 , srv1349935058:84 , srv1406376205:84 , srv1416257557:84 , srv1433744761:84 , srv1435560497:84 , srv1442532351:84 , srv1444040301:84 , srv1456291500:84 , srv1476006509:84 , srv1478630911:84 , srv1478671419:84 , srv150359648:84 , srv1504818127:84 , srv1528338384:84 , srv1555920424:84 , srv1561874403:84 , srv156737454:84 , srv1578520007:84 , srv157894075:84 , srv1609966169:84 , srv1625023056:84 , srv1635953726:84 , srv1652422149:84 , srv1663271571:84 , srv1745642762:84 , srv1748381110:84 , srv17531843:84 , srv1806098164:84 , srv1875074897:84 , srv1893008042:84 , srv1901414604:84 , srv190719580:84 , srv190950360:84 , srv1935056668:84 , srv193980750:84 , srv1941867673:84 , srv1981987646:84 , srv2005358841:84 , srv2042386764:84 , srv2054246542:84 , srv2081933286:84 , srv2084735977:84 , srv2105026021:84 , srv2115740843:84 , srv2143526330:84 , srv216749376:84 , srv23314977:84 , srv237604133:84 , srv242950639:84 , srv245026771:84 , srv34997794:84 , srv401268420:84 , srv409202013:84 , srv412048317:84 , srv41930352:84 , srv441155954:84 , srv485988736:84 , srv487549283:84 , srv518704871:84 , srv525364247:84 , srv541388589:84 , srv565644885:84 , srv574794389:84 , srv598096864:84 , srv602448835:84 , srv629246400:84 , srv633974976:84 , srv641247550:84 , srv657610703:84 , srv669148250:84 , srv681740706:84 , srv694193998:84 , srv710646804:84 , srv712892480:84 , srv757102613:84 , srv809313313:84 , srv87353146:84 , srv882735295:84 , srv91671127:84 , srv9277970:84 , srv940423010:84 , srv959310897:84 , srv967460038:84 , srv1724830292:684 } [srvr=100 rgns=9000 avg=90.0 max=90 min=90]
2023-08-07 14:53:13,717 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-08-07 14:53:13,724 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1578520007=33, srv1312794891=13, srv1561874403=31, srv1941867673=52, srv518704871=75, srv681740706=87, srv216749376=62, srv641247550=84, srv2143526330=61, srv2115740843=60, srv1478671419=26, srv669148250=86, srv1435560497=20, srv1504818127=28, srv1555920424=30, srv190950360=49, srv959310897=98, srv1002563585=0, srv565644885=78, srv1456291500=23, srv657610703=85, srv1187383779=7, srv1745642762=41, srv574794389=79, srv193980750=51, srv245026771=66, srv1406376205=17, srv487549283=74, srv1156577728=6, srv2105026021=59, srv190719580=48, srv602448835=81, srv150359648=27, srv1625023056=36, srv9277970=96, srv124597303=9, srv1306265314=11, srv1528338384=29, srv23314977=63, srv41930352=71, srv485988736=73, srv940423010=97, srv1724830292=40, srv1935056668=50, srv2081933286=57, srv409202013=69, srv157894075=34, srv1113140106=5, srv1748381110=42, srv1433744761=19, srv967460038=99, srv1893008042=46, srv882735295=94, srv1262847851=10, srv2084735977=58, srv1349935058=16, srv694193998=88, srv809313313=92, srv710646804=89, srv1225619888=8, srv441155954=72, srv1444040301=22, srv156737454=32, srv1875074897=45, srv2054246542=56, srv1981987646=53, srv34997794=67, srv1635953726=37, srv1663271571=39, srv1609966169=35, srv1652422149=38, srv712892480=90, srv1806098164=44, srv412048317=70, srv1091027166=3, srv1102556874=4, srv13112713=12, srv1478630911=25, srv17531843=43, srv87353146=93, srv91671127=95, srv237604133=64, srv1338520660=15, srv401268420=68, srv598096864=80, srv633974976=83, srv1331124678=14, srv541388589=77, srv629246400=82, srv1416257557=18, srv1901414604=47, srv525364247=76, srv2005358841=54, srv757102613=91, srv1042283590=1, srv2042386764=55, srv1476006509=24, srv1442532351=21, srv1051355986=2, srv242950639=65} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-08-07 14:53:13,793 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-08-07 14:53:13,793 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-08-07 14:53:13,793 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-08-07 14:53:13,793 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-08-07 14:53:13,793 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-08-07 14:53:13,793 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-08-07 14:53:13,793 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-08-07 14:53:13,793 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-08-07 14:53:13,793 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-08-07 14:53:13,793 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-08-07 14:53:13,794 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-08-07 14:53:13,794 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-08-07 14:53:13,794 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-08-07 14:53:13,794 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-08-07 14:53:13,794 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-08-07 14:53:13,794 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-08-07 14:53:13,794 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-08-07 14:53:13,794 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-08-07 14:53:13,794 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-08-07 14:53:13,794 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-08-07 14:53:13,794 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-08-07 14:53:13,795 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-08-07 14:53:13,795 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-08-07 14:53:13,795 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-08-07 14:53:13,795 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-08-07 14:53:13,795 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-08-07 14:53:13,795 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-08-07 14:53:13,795 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-08-07 14:53:13,795 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-08-07 14:53:13,795 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-08-07 14:53:13,795 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-08-07 14:53:13,795 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-08-07 14:53:13,796 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-08-07 14:53:13,796 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-08-07 14:53:13,796 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-08-07 14:53:13,796 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-08-07 14:53:13,796 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-08-07 14:53:13,796 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-08-07 14:53:13,796 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-08-07 14:53:13,796 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-08-07 14:53:13,796 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-08-07 14:53:13,796 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-08-07 14:53:13,796 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-08-07 14:53:13,796 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-08-07 14:53:13,797 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-08-07 14:53:13,797 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-08-07 14:53:13,797 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-08-07 14:53:13,797 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-08-07 14:53:13,797 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-08-07 14:53:13,797 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-08-07 14:53:13,797 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-08-07 14:53:13,797 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-08-07 14:53:13,797 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-08-07 14:53:13,798 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-08-07 14:53:13,798 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-08-07 14:53:13,798 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-08-07 14:53:13,798 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-08-07 14:53:13,798 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-08-07 14:53:13,798 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-08-07 14:53:13,798 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-08-07 14:53:13,798 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-08-07 14:53:13,799 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-08-07 14:53:13,799 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-08-07 14:53:13,799 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-08-07 14:53:13,799 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-08-07 14:53:13,799 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-08-07 14:53:13,799 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-08-07 14:53:13,799 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-08-07 14:53:13,799 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-08-07 14:53:13,799 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-08-07 14:53:13,800 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-08-07 14:53:13,800 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-08-07 14:53:13,800 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-08-07 14:53:13,800 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-08-07 14:53:13,800 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-08-07 14:53:13,800 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-08-07 14:53:13,800 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-08-07 14:53:13,800 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-08-07 14:53:13,800 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-08-07 14:53:13,800 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-08-07 14:53:13,800 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-08-07 14:53:13,800 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-08-07 14:53:13,801 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-08-07 14:53:13,801 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-08-07 14:53:13,801 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-08-07 14:53:13,801 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-08-07 14:53:13,801 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-08-07 14:53:13,801 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-08-07 14:53:13,801 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-08-07 14:53:13,801 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-08-07 14:53:13,801 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-08-07 14:53:13,801 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-08-07 14:53:13,801 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-08-07 14:53:13,801 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-08-07 14:53:13,801 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-08-07 14:53:13,802 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-08-07 14:53:13,802 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-08-07 14:53:13,802 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-08-07 14:53:13,802 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-08-07 14:53:13,802 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-08-07 14:53:13,802 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-08-07 14:53:14,022 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.06666666666666667, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-08-07 14:53:14,022 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-08-07 14:53:14,022 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.9909252140407105, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.06666666666666667, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-08-07 14:53:14,398 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 571 ms to try 5000 different iterations.  Found a solution that moves 4696 regions; Going from a computed imbalance of 0.9909252140407105 to a new imbalance of 0.17943513158290553. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.04028270220293284, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.05515817475609796, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.5217777777777778, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.04028270220293284, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.17508333333333334, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.237, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-08-07 14:53:14,413 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv412048317:81 , srv124597303:82 , srv1262847851:82 , srv1456291500:82 , srv633974976:82 , srv1002563585:83 , srv1187383779:83 , srv1555920424:83 , srv157894075:83 , srv2143526330:83 , srv487549283:83 , srv669148250:83 , srv1042283590:84 , srv1312794891:84 , srv1442532351:84 , srv1504818127:84 , srv190719580:84 , srv1935056668:84 , srv1941867673:84 , srv2081933286:84 , srv245026771:84 , srv518704871:84 , srv694193998:84 , srv87353146:84 , srv1051355986:85 , srv1113140106:85 , srv1416257557:85 , srv1433744761:85 , srv1478630911:85 , srv1478671419:85 , srv1561874403:85 , srv1578520007:85 , srv1625023056:85 , srv1663271571:85 , srv1748381110:85 , srv1806098164:85 , srv2005358841:85 , srv2084735977:85 , srv242950639:85 , srv681740706:85 , srv757102613:85 , srv1091027166:86 , srv1225619888:86 , srv1331124678:86 , srv1406376205:86 , srv1609966169:86 , srv17531843:86 , srv1875074897:86 , srv190950360:86 , srv193980750:86 , srv1981987646:86 , srv34997794:86 , srv409202013:86 , srv574794389:86 , srv710646804:86 , srv1306265314:87 , srv1338520660:87 , srv1444040301:87 , srv1635953726:87 , srv1745642762:87 , srv2105026021:87 , srv41930352:87 , srv441155954:87 , srv565644885:87 , srv641247550:87 , srv657610703:87 , srv809313313:87 , srv882735295:87 , srv940423010:87 , srv13112713:88 , srv1476006509:88 , srv1652422149:88 , srv1893008042:88 , srv1901414604:88 , srv237604133:88 , srv598096864:88 , srv602448835:88 , srv959310897:88 , srv1349935058:89 , srv1435560497:89 , srv2042386764:89 , srv401268420:89 , srv485988736:89 , srv629246400:89 , srv91671127:89 , srv9277970:89 , srv967460038:89 , srv1528338384:90 , srv541388589:90 , srv1102556874:91 , srv1156577728:91 , srv150359648:91 , srv2054246542:91 , srv2115740843:91 , srv216749376:91 , srv23314977:91 , srv712892480:91 , srv525364247:92 , srv156737454:94 , srv1724830292:448 }
2023-08-07 14:53:14,419 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-08-07 14:53:14,421 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1578520007=33, srv1312794891=13, srv1561874403=31, srv1941867673=52, srv518704871=75, srv681740706=87, srv216749376=62, srv641247550=84, srv2143526330=61, srv2115740843=60, srv1478671419=26, srv669148250=86, srv1435560497=20, srv1504818127=28, srv1555920424=30, srv190950360=49, srv959310897=98, srv1002563585=0, srv565644885=78, srv1456291500=23, srv657610703=85, srv1187383779=7, srv1745642762=41, srv574794389=79, srv193980750=51, srv245026771=66, srv1406376205=17, srv487549283=74, srv1156577728=6, srv2105026021=59, srv190719580=48, srv602448835=81, srv150359648=27, srv1625023056=36, srv9277970=96, srv124597303=9, srv1306265314=11, srv1528338384=29, srv23314977=63, srv41930352=71, srv485988736=73, srv940423010=97, srv1724830292=40, srv1935056668=50, srv2081933286=57, srv409202013=69, srv157894075=34, srv1113140106=5, srv1748381110=42, srv1433744761=19, srv967460038=99, srv1893008042=46, srv882735295=94, srv1262847851=10, srv2084735977=58, srv1349935058=16, srv694193998=88, srv809313313=92, srv710646804=89, srv1225619888=8, srv441155954=72, srv1444040301=22, srv156737454=32, srv1875074897=45, srv2054246542=56, srv1981987646=53, srv34997794=67, srv1635953726=37, srv1663271571=39, srv1609966169=35, srv1652422149=38, srv712892480=90, srv1806098164=44, srv412048317=70, srv1091027166=3, srv1102556874=4, srv13112713=12, srv1478630911=25, srv17531843=43, srv87353146=93, srv91671127=95, srv237604133=64, srv1338520660=15, srv401268420=68, srv598096864=80, srv633974976=83, srv1331124678=14, srv541388589=77, srv629246400=82, srv1416257557=18, srv1901414604=47, srv525364247=76, srv2005358841=54, srv757102613=91, srv1042283590=1, srv2042386764=55, srv1476006509=24, srv1442532351=21, srv1051355986=2, srv242950639=65} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-08-07 14:53:14,446 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-08-07 14:53:14,446 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-08-07 14:53:14,446 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-08-07 14:53:14,446 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-08-07 14:53:14,446 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-08-07 14:53:14,446 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-08-07 14:53:14,446 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-08-07 14:53:14,447 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-08-07 14:53:14,447 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-08-07 14:53:14,447 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-08-07 14:53:14,447 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-08-07 14:53:14,447 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-08-07 14:53:14,447 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-08-07 14:53:14,447 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-08-07 14:53:14,448 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-08-07 14:53:14,448 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-08-07 14:53:14,448 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-08-07 14:53:14,448 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-08-07 14:53:14,448 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-08-07 14:53:14,448 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-08-07 14:53:14,448 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-08-07 14:53:14,448 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-08-07 14:53:14,448 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-08-07 14:53:14,448 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-08-07 14:53:14,449 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-08-07 14:53:14,449 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-08-07 14:53:14,449 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-08-07 14:53:14,449 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-08-07 14:53:14,449 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-08-07 14:53:14,449 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-08-07 14:53:14,449 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-08-07 14:53:14,449 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-08-07 14:53:14,449 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-08-07 14:53:14,449 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-08-07 14:53:14,450 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-08-07 14:53:14,450 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-08-07 14:53:14,450 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-08-07 14:53:14,450 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-08-07 14:53:14,450 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-08-07 14:53:14,450 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-08-07 14:53:14,450 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-08-07 14:53:14,450 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-08-07 14:53:14,450 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-08-07 14:53:14,450 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-08-07 14:53:14,451 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-08-07 14:53:14,451 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-08-07 14:53:14,451 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-08-07 14:53:14,451 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-08-07 14:53:14,451 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-08-07 14:53:14,451 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-08-07 14:53:14,451 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-08-07 14:53:14,451 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-08-07 14:53:14,451 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-08-07 14:53:14,451 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-08-07 14:53:14,452 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-08-07 14:53:14,452 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-08-07 14:53:14,452 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-08-07 14:53:14,452 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-08-07 14:53:14,452 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-08-07 14:53:14,452 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-08-07 14:53:14,452 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-08-07 14:53:14,452 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-08-07 14:53:14,452 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-08-07 14:53:14,452 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-08-07 14:53:14,452 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-08-07 14:53:14,453 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-08-07 14:53:14,453 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-08-07 14:53:14,453 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-08-07 14:53:14,453 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-08-07 14:53:14,453 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-08-07 14:53:14,453 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-08-07 14:53:14,453 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-08-07 14:53:14,453 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-08-07 14:53:14,453 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-08-07 14:53:14,453 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-08-07 14:53:14,454 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-08-07 14:53:14,454 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-08-07 14:53:14,454 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-08-07 14:53:14,454 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-08-07 14:53:14,454 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-08-07 14:53:14,454 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-08-07 14:53:14,454 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-08-07 14:53:14,454 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-08-07 14:53:14,454 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-08-07 14:53:14,454 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-08-07 14:53:14,454 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-08-07 14:53:14,455 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-08-07 14:53:14,455 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-08-07 14:53:14,455 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-08-07 14:53:14,455 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-08-07 14:53:14,455 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-08-07 14:53:14,455 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-08-07 14:53:14,455 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-08-07 14:53:14,455 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-08-07 14:53:14,455 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-08-07 14:53:14,455 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-08-07 14:53:14,455 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-08-07 14:53:14,456 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-08-07 14:53:14,456 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-08-07 14:53:14,456 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-08-07 14:53:14,456 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-08-07 14:53:14,624 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.04028270220293284, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.05515817475609796, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.04028270220293284, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.17508333333333334, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.237, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-08-07 14:53:14,624 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-08-07 14:53:14,624 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.17940224948810243, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.04028270220293284, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.05515817475609796, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.04028270220293284, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.17508333333333334, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.237, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-08-07 14:53:14,985 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 510 ms to try 5000 different iterations.  Found a solution that moves 2605 regions; Going from a computed imbalance of 0.17940224948810243 to a new imbalance of 0.016756430279818067. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.02305077161569245); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.033791464531689186, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.28944444444444445, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.02305077161569245); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.013916666666666667); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.043833333333333335, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-08-07 14:53:15,000 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv156737454:78 , srv2054246542:79 , srv1102556874:80 , srv2115740843:80 , srv525364247:80 , srv1156577728:81 , srv1528338384:81 , srv1349935058:82 , srv150359648:82 , srv1901414604:82 , srv216749376:82 , srv23314977:82 , srv541388589:82 , srv602448835:82 , srv712892480:82 , srv91671127:82 , srv967460038:82 , srv13112713:83 , srv2042386764:83 , srv401268420:83 , srv598096864:83 , srv629246400:83 , srv882735295:83 , srv959310897:83 , srv1435560497:84 , srv1476006509:84 , srv1609966169:84 , srv1635953726:84 , srv1652422149:84 , srv237604133:84 , srv574794389:84 , srv809313313:84 , srv940423010:84 , srv1444040301:85 , srv1745642762:85 , srv17531843:85 , srv1806098164:85 , srv1893008042:85 , srv1981987646:85 , srv2084735977:85 , srv2105026021:85 , srv441155954:85 , srv485988736:85 , srv565644885:85 , srv641247550:85 , srv657610703:85 , srv1091027166:86 , srv1113140106:86 , srv1306265314:86 , srv1331124678:86 , srv1338520660:86 , srv1478630911:86 , srv1663271571:86 , srv1748381110:86 , srv1875074897:86 , srv41930352:86 , srv681740706:86 , srv1042283590:87 , srv1225619888:87 , srv1555920424:87 , srv1578520007:87 , srv190950360:87 , srv1935056668:87 , srv2005358841:87 , srv2143526330:87 , srv34997794:87 , srv409202013:87 , srv487549283:87 , srv518704871:87 , srv757102613:87 , srv87353146:87 , srv9277970:87 , srv1002563585:88 , srv1406376205:88 , srv1416257557:88 , srv1433744761:88 , srv1442532351:88 , srv1456291500:88 , srv1625023056:88 , srv193980750:88 , srv1941867673:88 , srv242950639:88 , srv694193998:88 , srv710646804:88 , srv1051355986:89 , srv1187383779:89 , srv1262847851:89 , srv1312794891:89 , srv1504818127:89 , srv157894075:89 , srv190719580:89 , srv2081933286:89 , srv245026771:89 , srv633974976:89 , srv669148250:89 , srv1561874403:90 , srv412048317:90 , srv124597303:91 , srv1478671419:91 , srv1724830292:531 }
2023-08-07 14:53:15,007 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-08-07 14:53:15,008 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1578520007=33, srv1312794891=13, srv1561874403=31, srv1941867673=52, srv518704871=75, srv681740706=87, srv216749376=62, srv641247550=84, srv2143526330=61, srv2115740843=60, srv1478671419=26, srv669148250=86, srv1435560497=20, srv1504818127=28, srv1555920424=30, srv190950360=49, srv959310897=98, srv1002563585=0, srv565644885=78, srv1456291500=23, srv657610703=85, srv1187383779=7, srv1745642762=41, srv574794389=79, srv193980750=51, srv245026771=66, srv1406376205=17, srv487549283=74, srv1156577728=6, srv2105026021=59, srv190719580=48, srv602448835=81, srv150359648=27, srv1625023056=36, srv9277970=96, srv124597303=9, srv1306265314=11, srv1528338384=29, srv23314977=63, srv41930352=71, srv485988736=73, srv940423010=97, srv1724830292=40, srv1935056668=50, srv2081933286=57, srv409202013=69, srv157894075=34, srv1113140106=5, srv1748381110=42, srv1433744761=19, srv967460038=99, srv1893008042=46, srv882735295=94, srv1262847851=10, srv2084735977=58, srv1349935058=16, srv694193998=88, srv809313313=92, srv710646804=89, srv1225619888=8, srv441155954=72, srv1444040301=22, srv156737454=32, srv1875074897=45, srv2054246542=56, srv1981987646=53, srv34997794=67, srv1635953726=37, srv1663271571=39, srv1609966169=35, srv1652422149=38, srv712892480=90, srv1806098164=44, srv412048317=70, srv1091027166=3, srv1102556874=4, srv13112713=12, srv1478630911=25, srv17531843=43, srv87353146=93, srv91671127=95, srv237604133=64, srv1338520660=15, srv401268420=68, srv598096864=80, srv633974976=83, srv1331124678=14, srv541388589=77, srv629246400=82, srv1416257557=18, srv1901414604=47, srv525364247=76, srv2005358841=54, srv757102613=91, srv1042283590=1, srv2042386764=55, srv1476006509=24, srv1442532351=21, srv1051355986=2, srv242950639=65} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-08-07 14:53:15,035 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-08-07 14:53:15,035 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-08-07 14:53:15,035 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-08-07 14:53:15,035 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-08-07 14:53:15,035 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-08-07 14:53:15,036 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-08-07 14:53:15,036 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-08-07 14:53:15,036 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-08-07 14:53:15,036 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-08-07 14:53:15,036 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-08-07 14:53:15,036 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-08-07 14:53:15,036 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-08-07 14:53:15,037 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-08-07 14:53:15,037 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-08-07 14:53:15,037 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-08-07 14:53:15,037 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-08-07 14:53:15,037 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-08-07 14:53:15,037 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-08-07 14:53:15,037 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-08-07 14:53:15,037 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-08-07 14:53:15,038 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-08-07 14:53:15,038 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-08-07 14:53:15,038 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-08-07 14:53:15,038 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-08-07 14:53:15,038 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-08-07 14:53:15,038 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-08-07 14:53:15,038 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-08-07 14:53:15,038 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-08-07 14:53:15,039 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-08-07 14:53:15,039 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-08-07 14:53:15,039 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-08-07 14:53:15,039 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-08-07 14:53:15,039 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-08-07 14:53:15,039 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-08-07 14:53:15,039 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-08-07 14:53:15,039 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-08-07 14:53:15,040 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-08-07 14:53:15,040 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-08-07 14:53:15,040 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-08-07 14:53:15,040 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-08-07 14:53:15,040 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-08-07 14:53:15,040 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-08-07 14:53:15,040 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-08-07 14:53:15,040 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-08-07 14:53:15,040 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-08-07 14:53:15,041 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-08-07 14:53:15,041 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-08-07 14:53:15,041 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-08-07 14:53:15,041 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-08-07 14:53:15,041 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-08-07 14:53:15,041 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-08-07 14:53:15,041 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-08-07 14:53:15,041 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-08-07 14:53:15,041 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-08-07 14:53:15,042 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-08-07 14:53:15,042 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-08-07 14:53:15,042 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-08-07 14:53:15,042 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-08-07 14:53:15,042 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-08-07 14:53:15,042 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-08-07 14:53:15,042 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-08-07 14:53:15,042 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-08-07 14:53:15,042 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-08-07 14:53:15,042 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-08-07 14:53:15,043 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-08-07 14:53:15,043 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-08-07 14:53:15,043 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-08-07 14:53:15,043 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-08-07 14:53:15,043 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-08-07 14:53:15,043 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-08-07 14:53:15,043 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-08-07 14:53:15,043 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-08-07 14:53:15,043 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-08-07 14:53:15,043 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-08-07 14:53:15,043 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-08-07 14:53:15,044 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-08-07 14:53:15,044 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-08-07 14:53:15,044 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-08-07 14:53:15,044 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-08-07 14:53:15,044 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-08-07 14:53:15,044 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-08-07 14:53:15,044 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-08-07 14:53:15,044 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-08-07 14:53:15,044 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-08-07 14:53:15,045 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-08-07 14:53:15,045 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-08-07 14:53:15,045 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-08-07 14:53:15,045 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-08-07 14:53:15,045 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-08-07 14:53:15,045 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-08-07 14:53:15,045 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-08-07 14:53:15,045 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-08-07 14:53:15,045 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-08-07 14:53:15,045 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-08-07 14:53:15,046 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-08-07 14:53:15,046 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-08-07 14:53:15,046 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-08-07 14:53:15,046 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-08-07 14:53:15,046 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-08-07 14:53:15,046 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-08-07 14:53:15,046 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-08-07 14:53:15,202 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.02305077161569245); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.033791464531689186, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.02305077161569245); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.013916666666666667); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.043833333333333335, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-08-07 14:53:15,202 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-08-07 14:53:15,202 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.016738189679953906, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.02305077161569245); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.033791464531689186, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.02305077161569245); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.013916666666666667); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.043833333333333335, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-08-07 14:53:15,531 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 462 ms to try 5000 different iterations.  Found a solution that moves 971 regions; Going from a computed imbalance of 0.016738189679953906 to a new imbalance of 8.426812945577846E-4. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.00813282918714976); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.010325781969828723); MoveCostFunction : (multiplier=7.0, imbalance=0.1078888888888889, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.00813282918714976); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=3.333333333333333E-4); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.005); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-08-07 14:53:15,533 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1478671419:82 , srv1561874403:82 , srv9277970:82 , srv1406376205:83 , srv1504818127:83 , srv2081933286:83 , srv710646804:83 , srv1091027166:84 , srv1225619888:84 , srv124597303:84 , srv1312794891:84 , srv1338520660:84 , srv1433744761:84 , srv1435560497:84 , srv1442532351:84 , srv1476006509:84 , srv150359648:84 , srv1625023056:84 , srv190950360:84 , srv2005358841:84 , srv2042386764:84 , srv216749376:84 , srv237604133:84 , srv242950639:84 , srv41930352:84 , srv485988736:84 , srv629246400:84 , srv1002563585:85 , srv1051355986:85 , srv1102556874:85 , srv1187383779:85 , srv1306265314:85 , srv1444040301:85 , srv156737454:85 , srv1578520007:85 , srv1652422149:85 , srv1745642762:85 , srv1875074897:85 , srv1893008042:85 , srv190719580:85 , srv193980750:85 , srv1941867673:85 , srv23314977:85 , srv245026771:85 , srv34997794:85 , srv409202013:85 , srv525364247:85 , srv541388589:85 , srv657610703:85 , srv694193998:85 , srv712892480:85 , srv757102613:85 , srv87353146:85 , srv1156577728:86 , srv13112713:86 , srv1349935058:86 , srv1416257557:86 , srv1456291500:86 , srv1478630911:86 , srv1609966169:86 , srv1635953726:86 , srv1663271571:86 , srv1748381110:86 , srv17531843:86 , srv1901414604:86 , srv1935056668:86 , srv1981987646:86 , srv2105026021:86 , srv401268420:86 , srv412048317:86 , srv441155954:86 , srv518704871:86 , srv565644885:86 , srv574794389:86 , srv641247550:86 , srv669148250:86 , srv681740706:86 , srv91671127:86 , srv940423010:86 , srv959310897:86 , srv967460038:86 , srv1042283590:87 , srv1113140106:87 , srv1262847851:87 , srv1331124678:87 , srv1555920424:87 , srv157894075:87 , srv2084735977:87 , srv2115740843:87 , srv487549283:87 , srv598096864:87 , srv602448835:87 , srv809313313:87 , srv1528338384:88 , srv2054246542:88 , srv2143526330:88 , srv633974976:88 , srv882735295:88 , srv1806098164:89 , srv1724830292:551 }
2023-08-07 14:53:15,537 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-08-07 14:53:15,537 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1578520007=33, srv1312794891=13, srv1561874403=31, srv1941867673=52, srv518704871=75, srv681740706=87, srv216749376=62, srv641247550=84, srv2143526330=61, srv2115740843=60, srv1478671419=26, srv669148250=86, srv1435560497=20, srv1504818127=28, srv1555920424=30, srv190950360=49, srv959310897=98, srv1002563585=0, srv565644885=78, srv1456291500=23, srv657610703=85, srv1187383779=7, srv1745642762=41, srv574794389=79, srv193980750=51, srv245026771=66, srv1406376205=17, srv487549283=74, srv1156577728=6, srv2105026021=59, srv190719580=48, srv602448835=81, srv150359648=27, srv1625023056=36, srv9277970=96, srv124597303=9, srv1306265314=11, srv1528338384=29, srv23314977=63, srv41930352=71, srv485988736=73, srv940423010=97, srv1724830292=40, srv1935056668=50, srv2081933286=57, srv409202013=69, srv157894075=34, srv1113140106=5, srv1748381110=42, srv1433744761=19, srv967460038=99, srv1893008042=46, srv882735295=94, srv1262847851=10, srv2084735977=58, srv1349935058=16, srv694193998=88, srv809313313=92, srv710646804=89, srv1225619888=8, srv441155954=72, srv1444040301=22, srv156737454=32, srv1875074897=45, srv2054246542=56, srv1981987646=53, srv34997794=67, srv1635953726=37, srv1663271571=39, srv1609966169=35, srv1652422149=38, srv712892480=90, srv1806098164=44, srv412048317=70, srv1091027166=3, srv1102556874=4, srv13112713=12, srv1478630911=25, srv17531843=43, srv87353146=93, srv91671127=95, srv237604133=64, srv1338520660=15, srv401268420=68, srv598096864=80, srv633974976=83, srv1331124678=14, srv541388589=77, srv629246400=82, srv1416257557=18, srv1901414604=47, srv525364247=76, srv2005358841=54, srv757102613=91, srv1042283590=1, srv2042386764=55, srv1476006509=24, srv1442532351=21, srv1051355986=2, srv242950639=65} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-08-07 14:53:15,548 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-08-07 14:53:15,548 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-08-07 14:53:15,548 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-08-07 14:53:15,549 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-08-07 14:53:15,549 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-08-07 14:53:15,549 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-08-07 14:53:15,549 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-08-07 14:53:15,549 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-08-07 14:53:15,549 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-08-07 14:53:15,549 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-08-07 14:53:15,549 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-08-07 14:53:15,549 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-08-07 14:53:15,549 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-08-07 14:53:15,549 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-08-07 14:53:15,549 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-08-07 14:53:15,549 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-08-07 14:53:15,549 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-08-07 14:53:15,549 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-08-07 14:53:15,549 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-08-07 14:53:15,549 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-08-07 14:53:15,549 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-08-07 14:53:15,550 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-08-07 14:53:15,550 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-08-07 14:53:15,550 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-08-07 14:53:15,550 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-08-07 14:53:15,550 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-08-07 14:53:15,550 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-08-07 14:53:15,550 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-08-07 14:53:15,550 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-08-07 14:53:15,550 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-08-07 14:53:15,550 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-08-07 14:53:15,550 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-08-07 14:53:15,550 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-08-07 14:53:15,550 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-08-07 14:53:15,550 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-08-07 14:53:15,550 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-08-07 14:53:15,550 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-08-07 14:53:15,551 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-08-07 14:53:15,551 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-08-07 14:53:15,551 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-08-07 14:53:15,551 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-08-07 14:53:15,551 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-08-07 14:53:15,551 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-08-07 14:53:15,551 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-08-07 14:53:15,551 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-08-07 14:53:15,551 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-08-07 14:53:15,551 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-08-07 14:53:15,551 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-08-07 14:53:15,551 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-08-07 14:53:15,551 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-08-07 14:53:15,551 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-08-07 14:53:15,551 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-08-07 14:53:15,551 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-08-07 14:53:15,552 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-08-07 14:53:15,552 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-08-07 14:53:15,552 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-08-07 14:53:15,552 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-08-07 14:53:15,552 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-08-07 14:53:15,552 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-08-07 14:53:15,552 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-08-07 14:53:15,552 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-08-07 14:53:15,552 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-08-07 14:53:15,552 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-08-07 14:53:15,552 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-08-07 14:53:15,552 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-08-07 14:53:15,552 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-08-07 14:53:15,552 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-08-07 14:53:15,552 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-08-07 14:53:15,552 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-08-07 14:53:15,552 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-08-07 14:53:15,552 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-08-07 14:53:15,553 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-08-07 14:53:15,553 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-08-07 14:53:15,553 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-08-07 14:53:15,553 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-08-07 14:53:15,553 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-08-07 14:53:15,553 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-08-07 14:53:15,553 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-08-07 14:53:15,553 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-08-07 14:53:15,553 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-08-07 14:53:15,553 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-08-07 14:53:15,553 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-08-07 14:53:15,553 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-08-07 14:53:15,553 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-08-07 14:53:15,553 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-08-07 14:53:15,553 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-08-07 14:53:15,553 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-08-07 14:53:15,553 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-08-07 14:53:15,553 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-08-07 14:53:15,554 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-08-07 14:53:15,554 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-08-07 14:53:15,554 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-08-07 14:53:15,554 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-08-07 14:53:15,554 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-08-07 14:53:15,554 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-08-07 14:53:15,554 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-08-07 14:53:15,554 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-08-07 14:53:15,554 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-08-07 14:53:15,554 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-08-07 14:53:15,554 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-08-07 14:53:15,554 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-08-07 14:53:15,664 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.00813282918714976); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.010325781969828723); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.00813282918714976); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=3.333333333333333E-4); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.005); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-08-07 14:53:15,664 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-08-07 14:53:15,665 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=8.358822072379775E-4, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.00813282918714976); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.010325781969828723); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.00813282918714976); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=3.333333333333333E-4); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.005); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-08-07 14:53:16,217 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 653 ms to try 5000 different iterations.  Found a solution that moves 325 regions; Going from a computed imbalance of 8.358822072379775E-4 to a new imbalance of 4.38092812260064E-5. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=3.158529131194229E-4); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0022222222222222222); MoveCostFunction : (multiplier=7.0, imbalance=0.03611111111111111, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=3.158529131194229E-4); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=3.333333333333333E-4); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-08-07 14:53:16,219 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1051355986:83 , srv1331124678:83 , srv1416257557:83 , srv1528338384:83 , srv157894075:83 , srv1806098164:83 , srv193980750:83 , srv633974976:83 , srv1042283590:84 , srv1113140106:84 , srv1225619888:84 , srv1262847851:84 , srv1306265314:84 , srv1478671419:84 , srv1893008042:84 , srv190719580:84 , srv2054246542:84 , srv2105026021:84 , srv2115740843:84 , srv2143526330:84 , srv23314977:84 , srv245026771:84 , srv34997794:84 , srv401268420:84 , srv409202013:84 , srv441155954:84 , srv485988736:84 , srv525364247:84 , srv565644885:84 , srv598096864:84 , srv641247550:84 , srv669148250:84 , srv712892480:84 , srv809313313:84 , srv882735295:84 , srv9277970:84 , srv1156577728:85 , srv1187383779:85 , srv124597303:85 , srv13112713:85 , srv1312794891:85 , srv1338520660:85 , srv1349935058:85 , srv1406376205:85 , srv1433744761:85 , srv1435560497:85 , srv1444040301:85 , srv1476006509:85 , srv1478630911:85 , srv1555920424:85 , srv1561874403:85 , srv156737454:85 , srv1578520007:85 , srv1609966169:85 , srv1625023056:85 , srv1635953726:85 , srv1652422149:85 , srv1663271571:85 , srv1745642762:85 , srv1748381110:85 , srv17531843:85 , srv1875074897:85 , srv190950360:85 , srv1935056668:85 , srv1941867673:85 , srv1981987646:85 , srv2084735977:85 , srv216749376:85 , srv242950639:85 , srv412048317:85 , srv41930352:85 , srv518704871:85 , srv541388589:85 , srv602448835:85 , srv657610703:85 , srv681740706:85 , srv694193998:85 , srv710646804:85 , srv757102613:85 , srv91671127:85 , srv940423010:85 , srv959310897:85 , srv967460038:85 , srv1002563585:86 , srv1091027166:86 , srv1102556874:86 , srv1442532351:86 , srv1456291500:86 , srv150359648:86 , srv1901414604:86 , srv2005358841:86 , srv2042386764:86 , srv2081933286:86 , srv237604133:86 , srv487549283:86 , srv574794389:86 , srv629246400:86 , srv87353146:86 , srv1504818127:87 , srv1724830292:612 }
2023-08-07 14:53:16,225 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-08-07 14:53:16,226 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1578520007=33, srv1312794891=13, srv1561874403=31, srv1941867673=52, srv518704871=75, srv681740706=87, srv216749376=62, srv641247550=84, srv2143526330=61, srv2115740843=60, srv1478671419=26, srv669148250=86, srv1435560497=20, srv1504818127=28, srv1555920424=30, srv190950360=49, srv959310897=98, srv1002563585=0, srv565644885=78, srv1456291500=23, srv657610703=85, srv1187383779=7, srv1745642762=41, srv574794389=79, srv193980750=51, srv245026771=66, srv1406376205=17, srv487549283=74, srv1156577728=6, srv2105026021=59, srv190719580=48, srv602448835=81, srv150359648=27, srv1625023056=36, srv9277970=96, srv124597303=9, srv1306265314=11, srv1528338384=29, srv23314977=63, srv41930352=71, srv485988736=73, srv940423010=97, srv1724830292=40, srv1935056668=50, srv2081933286=57, srv409202013=69, srv157894075=34, srv1113140106=5, srv1748381110=42, srv1433744761=19, srv967460038=99, srv1893008042=46, srv882735295=94, srv1262847851=10, srv2084735977=58, srv1349935058=16, srv694193998=88, srv809313313=92, srv710646804=89, srv1225619888=8, srv441155954=72, srv1444040301=22, srv156737454=32, srv1875074897=45, srv2054246542=56, srv1981987646=53, srv34997794=67, srv1635953726=37, srv1663271571=39, srv1609966169=35, srv1652422149=38, srv712892480=90, srv1806098164=44, srv412048317=70, srv1091027166=3, srv1102556874=4, srv13112713=12, srv1478630911=25, srv17531843=43, srv87353146=93, srv91671127=95, srv237604133=64, srv1338520660=15, srv401268420=68, srv598096864=80, srv633974976=83, srv1331124678=14, srv541388589=77, srv629246400=82, srv1416257557=18, srv1901414604=47, srv525364247=76, srv2005358841=54, srv757102613=91, srv1042283590=1, srv2042386764=55, srv1476006509=24, srv1442532351=21, srv1051355986=2, srv242950639=65} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-08-07 14:53:16,242 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-08-07 14:53:16,242 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-08-07 14:53:16,242 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-08-07 14:53:16,243 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-08-07 14:53:16,243 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-08-07 14:53:16,243 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-08-07 14:53:16,243 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-08-07 14:53:16,243 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-08-07 14:53:16,243 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-08-07 14:53:16,243 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-08-07 14:53:16,243 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-08-07 14:53:16,243 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-08-07 14:53:16,243 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-08-07 14:53:16,243 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-08-07 14:53:16,243 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-08-07 14:53:16,243 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-08-07 14:53:16,244 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-08-07 14:53:16,244 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-08-07 14:53:16,244 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-08-07 14:53:16,244 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-08-07 14:53:16,244 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-08-07 14:53:16,244 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-08-07 14:53:16,244 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-08-07 14:53:16,244 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-08-07 14:53:16,244 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-08-07 14:53:16,244 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-08-07 14:53:16,244 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-08-07 14:53:16,244 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-08-07 14:53:16,244 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-08-07 14:53:16,244 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-08-07 14:53:16,245 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-08-07 14:53:16,245 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-08-07 14:53:16,245 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-08-07 14:53:16,245 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-08-07 14:53:16,245 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-08-07 14:53:16,245 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-08-07 14:53:16,245 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-08-07 14:53:16,245 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-08-07 14:53:16,245 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-08-07 14:53:16,245 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-08-07 14:53:16,245 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-08-07 14:53:16,245 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-08-07 14:53:16,245 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-08-07 14:53:16,246 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-08-07 14:53:16,246 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-08-07 14:53:16,246 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-08-07 14:53:16,246 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-08-07 14:53:16,246 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-08-07 14:53:16,246 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-08-07 14:53:16,246 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-08-07 14:53:16,246 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-08-07 14:53:16,247 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-08-07 14:53:16,247 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-08-07 14:53:16,247 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-08-07 14:53:16,247 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-08-07 14:53:16,247 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-08-07 14:53:16,247 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-08-07 14:53:16,248 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-08-07 14:53:16,248 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-08-07 14:53:16,248 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-08-07 14:53:16,248 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-08-07 14:53:16,248 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-08-07 14:53:16,248 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-08-07 14:53:16,248 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-08-07 14:53:16,248 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-08-07 14:53:16,248 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-08-07 14:53:16,248 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-08-07 14:53:16,251 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-08-07 14:53:16,251 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-08-07 14:53:16,253 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-08-07 14:53:16,253 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-08-07 14:53:16,253 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-08-07 14:53:16,253 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-08-07 14:53:16,253 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-08-07 14:53:16,253 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-08-07 14:53:16,253 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-08-07 14:53:16,253 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-08-07 14:53:16,253 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-08-07 14:53:16,253 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-08-07 14:53:16,254 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-08-07 14:53:16,254 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-08-07 14:53:16,254 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-08-07 14:53:16,254 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-08-07 14:53:16,254 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-08-07 14:53:16,254 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-08-07 14:53:16,254 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-08-07 14:53:16,254 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-08-07 14:53:16,254 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-08-07 14:53:16,254 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-08-07 14:53:16,254 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-08-07 14:53:16,254 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-08-07 14:53:16,254 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-08-07 14:53:16,255 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-08-07 14:53:16,255 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-08-07 14:53:16,255 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-08-07 14:53:16,255 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-08-07 14:53:16,255 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-08-07 14:53:16,255 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-08-07 14:53:16,255 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-08-07 14:53:16,255 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-08-07 14:53:16,255 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-08-07 14:53:16,400 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=3.158529131194229E-4); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0022222222222222222); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=3.158529131194229E-4); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=3.333333333333333E-4); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-08-07 14:53:16,401 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-08-07 14:53:16,401 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=4.1533582586524084E-5, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=3.158529131194229E-4); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0022222222222222222); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=3.158529131194229E-4); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=3.333333333333333E-4); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-08-07 14:53:16,767 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 497 ms to try 5000 different iterations.  Found a solution that moves 30 regions; Going from a computed imbalance of 4.1533582586524084E-5 to a new imbalance of 7.899486290149148E-6. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0017082358106351274); MoveCostFunction : (multiplier=7.0, imbalance=0.0033333333333333335); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-08-07 14:53:16,767 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1156577728:83 , srv150359648:83 , srv1504818127:83 , srv487549283:83 , srv1002563585:84 , srv1042283590:84 , srv1051355986:84 , srv1091027166:84 , srv1102556874:84 , srv1113140106:84 , srv1187383779:84 , srv124597303:84 , srv1262847851:84 , srv1306265314:84 , srv13112713:84 , srv1312794891:84 , srv1331124678:84 , srv1338520660:84 , srv1349935058:84 , srv1406376205:84 , srv1416257557:84 , srv1433744761:84 , srv1435560497:84 , srv1442532351:84 , srv1444040301:84 , srv1456291500:84 , srv1478630911:84 , srv1478671419:84 , srv1528338384:84 , srv1555920424:84 , srv1561874403:84 , srv156737454:84 , srv1578520007:84 , srv157894075:84 , srv1625023056:84 , srv1635953726:84 , srv1652422149:84 , srv1663271571:84 , srv1745642762:84 , srv1748381110:84 , srv17531843:84 , srv1806098164:84 , srv1875074897:84 , srv1893008042:84 , srv1901414604:84 , srv190719580:84 , srv190950360:84 , srv1935056668:84 , srv193980750:84 , srv1941867673:84 , srv1981987646:84 , srv2005358841:84 , srv2042386764:84 , srv2054246542:84 , srv2081933286:84 , srv2084735977:84 , srv2105026021:84 , srv2115740843:84 , srv2143526330:84 , srv216749376:84 , srv23314977:84 , srv237604133:84 , srv242950639:84 , srv245026771:84 , srv34997794:84 , srv401268420:84 , srv409202013:84 , srv412048317:84 , srv41930352:84 , srv441155954:84 , srv485988736:84 , srv518704871:84 , srv541388589:84 , srv565644885:84 , srv574794389:84 , srv598096864:84 , srv602448835:84 , srv629246400:84 , srv633974976:84 , srv641247550:84 , srv657610703:84 , srv669148250:84 , srv681740706:84 , srv694193998:84 , srv710646804:84 , srv712892480:84 , srv757102613:84 , srv809313313:84 , srv87353146:84 , srv882735295:84 , srv91671127:84 , srv9277970:84 , srv940423010:84 , srv959310897:84 , srv967460038:84 , srv1225619888:85 , srv1476006509:85 , srv1609966169:85 , srv525364247:85 , srv1724830292:684 }
2023-08-07 14:53:16,773 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-08-07 14:53:16,773 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1578520007=33, srv1312794891=13, srv1561874403=31, srv1941867673=52, srv518704871=75, srv681740706=87, srv216749376=62, srv641247550=84, srv2143526330=61, srv2115740843=60, srv1478671419=26, srv669148250=86, srv1435560497=20, srv1504818127=28, srv1555920424=30, srv190950360=49, srv959310897=98, srv1002563585=0, srv565644885=78, srv1456291500=23, srv657610703=85, srv1187383779=7, srv1745642762=41, srv574794389=79, srv193980750=51, srv245026771=66, srv1406376205=17, srv487549283=74, srv1156577728=6, srv2105026021=59, srv190719580=48, srv602448835=81, srv150359648=27, srv1625023056=36, srv9277970=96, srv124597303=9, srv1306265314=11, srv1528338384=29, srv23314977=63, srv41930352=71, srv485988736=73, srv940423010=97, srv1724830292=40, srv1935056668=50, srv2081933286=57, srv409202013=69, srv157894075=34, srv1113140106=5, srv1748381110=42, srv1433744761=19, srv967460038=99, srv1893008042=46, srv882735295=94, srv1262847851=10, srv2084735977=58, srv1349935058=16, srv694193998=88, srv809313313=92, srv710646804=89, srv1225619888=8, srv441155954=72, srv1444040301=22, srv156737454=32, srv1875074897=45, srv2054246542=56, srv1981987646=53, srv34997794=67, srv1635953726=37, srv1663271571=39, srv1609966169=35, srv1652422149=38, srv712892480=90, srv1806098164=44, srv412048317=70, srv1091027166=3, srv1102556874=4, srv13112713=12, srv1478630911=25, srv17531843=43, srv87353146=93, srv91671127=95, srv237604133=64, srv1338520660=15, srv401268420=68, srv598096864=80, srv633974976=83, srv1331124678=14, srv541388589=77, srv629246400=82, srv1416257557=18, srv1901414604=47, srv525364247=76, srv2005358841=54, srv757102613=91, srv1042283590=1, srv2042386764=55, srv1476006509=24, srv1442532351=21, srv1051355986=2, srv242950639=65} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-08-07 14:53:16,791 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-08-07 14:53:16,791 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-08-07 14:53:16,791 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-08-07 14:53:16,791 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-08-07 14:53:16,791 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-08-07 14:53:16,791 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-08-07 14:53:16,791 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-08-07 14:53:16,791 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-08-07 14:53:16,791 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-08-07 14:53:16,792 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-08-07 14:53:16,796 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-08-07 14:53:16,796 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-08-07 14:53:16,796 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-08-07 14:53:16,796 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-08-07 14:53:16,796 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-08-07 14:53:16,796 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-08-07 14:53:16,796 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-08-07 14:53:16,796 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-08-07 14:53:16,797 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-08-07 14:53:16,797 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-08-07 14:53:16,797 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-08-07 14:53:16,797 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-08-07 14:53:16,797 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-08-07 14:53:16,797 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-08-07 14:53:16,797 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-08-07 14:53:16,797 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-08-07 14:53:16,797 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-08-07 14:53:16,797 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-08-07 14:53:16,797 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-08-07 14:53:16,797 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-08-07 14:53:16,797 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-08-07 14:53:16,798 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-08-07 14:53:16,798 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-08-07 14:53:16,798 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-08-07 14:53:16,798 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-08-07 14:53:16,798 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-08-07 14:53:16,798 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-08-07 14:53:16,798 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-08-07 14:53:16,798 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-08-07 14:53:16,798 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-08-07 14:53:16,798 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-08-07 14:53:16,798 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-08-07 14:53:16,798 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-08-07 14:53:16,798 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-08-07 14:53:16,798 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-08-07 14:53:16,799 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-08-07 14:53:16,799 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-08-07 14:53:16,799 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-08-07 14:53:16,799 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-08-07 14:53:16,799 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-08-07 14:53:16,799 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-08-07 14:53:16,799 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-08-07 14:53:16,799 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-08-07 14:53:16,799 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-08-07 14:53:16,799 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-08-07 14:53:16,799 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-08-07 14:53:16,799 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-08-07 14:53:16,799 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-08-07 14:53:16,799 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-08-07 14:53:16,800 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-08-07 14:53:16,800 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-08-07 14:53:16,800 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-08-07 14:53:16,800 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-08-07 14:53:16,800 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-08-07 14:53:16,800 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-08-07 14:53:16,800 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-08-07 14:53:16,800 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-08-07 14:53:16,800 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-08-07 14:53:16,800 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-08-07 14:53:16,800 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-08-07 14:53:16,800 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-08-07 14:53:16,800 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-08-07 14:53:16,800 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-08-07 14:53:16,801 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-08-07 14:53:16,801 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-08-07 14:53:16,801 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-08-07 14:53:16,801 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-08-07 14:53:16,801 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-08-07 14:53:16,801 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-08-07 14:53:16,801 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-08-07 14:53:16,801 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-08-07 14:53:16,801 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-08-07 14:53:16,801 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-08-07 14:53:16,801 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-08-07 14:53:16,801 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-08-07 14:53:16,801 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-08-07 14:53:16,801 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-08-07 14:53:16,802 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-08-07 14:53:16,802 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-08-07 14:53:16,802 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-08-07 14:53:16,802 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-08-07 14:53:16,802 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-08-07 14:53:16,802 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-08-07 14:53:16,802 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-08-07 14:53:16,802 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-08-07 14:53:16,802 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-08-07 14:53:16,802 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-08-07 14:53:16,802 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-08-07 14:53:16,802 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-08-07 14:53:16,802 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-08-07 14:53:16,803 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-08-07 14:53:16,937 INFO  [Time-limited test] balancer.StochasticLoadBalancer(381): Cluster wide - skipping load balancing because weighted average imbalance=7.689421800350782E-6 <= threshold(0.025). If you want more aggressive balancing, either lower hbase.master.balancer.stochastic.minCostNeedBalance from 0.025 or increase the relative multiplier(s) of the specific cost function(s). functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0017082358106351274); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-08-07 14:53:16,937 INFO  [Time-limited test] balancer.BalancerTestBase(570): Mock Final balance: { srv1156577728:83 , srv150359648:83 , srv1504818127:83 , srv487549283:83 , srv1002563585:84 , srv1042283590:84 , srv1051355986:84 , srv1091027166:84 , srv1102556874:84 , srv1113140106:84 , srv1187383779:84 , srv124597303:84 , srv1262847851:84 , srv1306265314:84 , srv13112713:84 , srv1312794891:84 , srv1331124678:84 , srv1338520660:84 , srv1349935058:84 , srv1406376205:84 , srv1416257557:84 , srv1433744761:84 , srv1435560497:84 , srv1442532351:84 , srv1444040301:84 , srv1456291500:84 , srv1478630911:84 , srv1478671419:84 , srv1528338384:84 , srv1555920424:84 , srv1561874403:84 , srv156737454:84 , srv1578520007:84 , srv157894075:84 , srv1625023056:84 , srv1635953726:84 , srv1652422149:84 , srv1663271571:84 , srv1745642762:84 , srv1748381110:84 , srv17531843:84 , srv1806098164:84 , srv1875074897:84 , srv1893008042:84 , srv1901414604:84 , srv190719580:84 , srv190950360:84 , srv1935056668:84 , srv193980750:84 , srv1941867673:84 , srv1981987646:84 , srv2005358841:84 , srv2042386764:84 , srv2054246542:84 , srv2081933286:84 , srv2084735977:84 , srv2105026021:84 , srv2115740843:84 , srv2143526330:84 , srv216749376:84 , srv23314977:84 , srv237604133:84 , srv242950639:84 , srv245026771:84 , srv34997794:84 , srv401268420:84 , srv409202013:84 , srv412048317:84 , srv41930352:84 , srv441155954:84 , srv485988736:84 , srv518704871:84 , srv541388589:84 , srv565644885:84 , srv574794389:84 , srv598096864:84 , srv602448835:84 , srv629246400:84 , srv633974976:84 , srv641247550:84 , srv657610703:84 , srv669148250:84 , srv681740706:84 , srv694193998:84 , srv710646804:84 , srv712892480:84 , srv757102613:84 , srv809313313:84 , srv87353146:84 , srv882735295:84 , srv91671127:84 , srv9277970:84 , srv940423010:84 , srv959310897:84 , srv967460038:84 , srv1225619888:85 , srv1476006509:85 , srv1609966169:85 , srv525364247:85 , srv1724830292:684 }
2023-08-07 14:53:16,966 INFO  [Time-limited test] hbase.ResourceChecker(175): after: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnLargeClusterWithRacks Thread=12 (was 12), OpenFileDescriptor=263 (was 263), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=304 (was 287) - SystemLoadAverage LEAK? -, ProcessCount=177 (was 179), AvailableMemoryMB=2317 (was 3195)
2023-08-07 14:53:16,976 INFO  [Time-limited test] hbase.ResourceChecker(147): before: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnMidClusterWithRacks Thread=12, OpenFileDescriptor=263, MaxFileDescriptor=60000, SystemLoadAverage=304, ProcessCount=177, AvailableMemoryMB=2315
2023-08-07 14:53:16,977 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2023-08-07 14:53:16,977 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=5000, runMaxSteps=true, stepsPerRegion=800, maxRunningTime=120000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 111077.0 etc.
2023-08-07 14:53:16,987 INFO  [Time-limited test] balancer.BalancerTestBase(547): Mock Cluster : { srv1008753402:84 , srv1093580843:84 , srv1161642922:84 , srv1267608383:84 , srv130191824:84 , srv1439069607:84 , srv1452496130:84 , srv1455238256:84 , srv1552458931:84 , srv15549450:84 , srv1582016512:84 , srv1713791560:84 , srv205550681:84 , srv2073051669:84 , srv2121157595:84 , srv214059045:84 , srv382768447:84 , srv399032713:84 , srv427756659:84 , srv43562143:84 , srv453759556:84 , srv677681017:84 , srv719815382:84 , srv795324521:84 , srv839549601:84 , srv840647615:84 , srv858876927:84 , srv882238350:84 , srv947087898:84 , srv1261853661:264 } [srvr=30 rgns=2700 avg=90.0 max=90 min=90]
2023-08-07 14:53:16,989 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-08-07 14:53:16,989 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv2073051669=14, srv1455238256=8, srv43562143=20, srv205550681=13, srv1713791560=12, srv427756659=19, srv677681017=22, srv2121157595=15, srv453759556=21, srv1439069607=6, srv15549450=10, srv882238350=28, srv1261853661=3, srv1267608383=4, srv1161642922=2, srv840647615=26, srv1008753402=0, srv858876927=27, srv1552458931=9, srv947087898=29, srv399032713=18, srv1452496130=7, srv214059045=16, srv719815382=23, srv1093580843=1, srv839549601=25, srv795324521=24, srv382768447=17, srv130191824=5, srv1582016512=11} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-08-07 14:53:17,001 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-08-07 14:53:17,001 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-08-07 14:53:17,001 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-08-07 14:53:17,001 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-08-07 14:53:17,001 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-08-07 14:53:17,001 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-08-07 14:53:17,002 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-08-07 14:53:17,002 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-08-07 14:53:17,002 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-08-07 14:53:17,002 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-08-07 14:53:17,002 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-08-07 14:53:17,002 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-08-07 14:53:17,002 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-08-07 14:53:17,002 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-08-07 14:53:17,002 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-08-07 14:53:17,002 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-08-07 14:53:17,002 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-08-07 14:53:17,002 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-08-07 14:53:17,002 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-08-07 14:53:17,002 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-08-07 14:53:17,003 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-08-07 14:53:17,003 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-08-07 14:53:17,003 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-08-07 14:53:17,003 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-08-07 14:53:17,003 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-08-07 14:53:17,003 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-08-07 14:53:17,003 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-08-07 14:53:17,003 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-08-07 14:53:17,003 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-08-07 14:53:17,003 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-08-07 14:53:17,003 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=10, number of hosts=30, number of racks=4
2023-08-07 14:53:17,027 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=1.1285893309231283, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-08-07 14:53:17,028 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.991259822404719, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=1.1285893309231283, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=64800000
2023-08-07 14:55:17,007 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 120001 ms to try 5489782 different iterations.  Found a solution that moves 1876 regions; Going from a computed imbalance of 0.991259822404719 to a new imbalance of 4.37867758735265E-5. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); MoveCostFunction : (multiplier=7.0, imbalance=0.6948148148148148, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-08-07 14:55:17,015 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1008753402:90 , srv1093580843:90 , srv1161642922:90 , srv1261853661:90 , srv1267608383:90 , srv130191824:90 , srv1439069607:90 , srv1452496130:90 , srv1455238256:90 , srv1552458931:90 , srv15549450:90 , srv1582016512:90 , srv1713791560:90 , srv205550681:90 , srv2073051669:90 , srv2121157595:90 , srv214059045:90 , srv382768447:90 , srv399032713:90 , srv427756659:90 , srv43562143:90 , srv453759556:90 , srv677681017:90 , srv719815382:90 , srv795324521:90 , srv839549601:90 , srv840647615:90 , srv858876927:90 , srv882238350:90 , srv947087898:90 }
2023-08-07 14:55:17,016 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-08-07 14:55:17,017 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv2073051669=14, srv1455238256=8, srv43562143=20, srv205550681=13, srv1713791560=12, srv427756659=19, srv677681017=22, srv2121157595=15, srv453759556=21, srv1439069607=6, srv15549450=10, srv882238350=28, srv1261853661=3, srv1267608383=4, srv1161642922=2, srv840647615=26, srv1008753402=0, srv858876927=27, srv1552458931=9, srv947087898=29, srv399032713=18, srv1452496130=7, srv214059045=16, srv719815382=23, srv1093580843=1, srv839549601=25, srv795324521=24, srv382768447=17, srv130191824=5, srv1582016512=11} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-08-07 14:55:17,020 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-08-07 14:55:17,020 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-08-07 14:55:17,020 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-08-07 14:55:17,020 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-08-07 14:55:17,020 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-08-07 14:55:17,020 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-08-07 14:55:17,020 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-08-07 14:55:17,020 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-08-07 14:55:17,020 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-08-07 14:55:17,020 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-08-07 14:55:17,021 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-08-07 14:55:17,021 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-08-07 14:55:17,021 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-08-07 14:55:17,021 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-08-07 14:55:17,021 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-08-07 14:55:17,021 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-08-07 14:55:17,021 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-08-07 14:55:17,021 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-08-07 14:55:17,021 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-08-07 14:55:17,021 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-08-07 14:55:17,021 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-08-07 14:55:17,021 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-08-07 14:55:17,021 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-08-07 14:55:17,021 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-08-07 14:55:17,021 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-08-07 14:55:17,021 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-08-07 14:55:17,021 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-08-07 14:55:17,021 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-08-07 14:55:17,021 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-08-07 14:55:17,021 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-08-07 14:55:17,021 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=10, number of hosts=30, number of racks=4
2023-08-07 14:55:17,033 INFO  [Time-limited test] balancer.StochasticLoadBalancer(381): Cluster wide - skipping load balancing because weighted average imbalance=0.0 <= threshold(0.025). If you want more aggressive balancing, either lower hbase.master.balancer.stochastic.minCostNeedBalance from 0.025 or increase the relative multiplier(s) of the specific cost function(s). functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-08-07 14:55:17,033 INFO  [Time-limited test] balancer.BalancerTestBase(570): Mock Final balance: { srv1008753402:90 , srv1093580843:90 , srv1161642922:90 , srv1261853661:90 , srv1267608383:90 , srv130191824:90 , srv1439069607:90 , srv1452496130:90 , srv1455238256:90 , srv1552458931:90 , srv15549450:90 , srv1582016512:90 , srv1713791560:90 , srv205550681:90 , srv2073051669:90 , srv2121157595:90 , srv214059045:90 , srv382768447:90 , srv399032713:90 , srv427756659:90 , srv43562143:90 , srv453759556:90 , srv677681017:90 , srv719815382:90 , srv795324521:90 , srv839549601:90 , srv840647615:90 , srv858876927:90 , srv882238350:90 , srv947087898:90 }
2023-08-07 14:55:17,046 INFO  [Time-limited test] hbase.ResourceChecker(175): after: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnMidClusterWithRacks Thread=11 (was 12), OpenFileDescriptor=263 (was 263), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=185 (was 304), ProcessCount=171 (was 177), AvailableMemoryMB=2285 (was 2315)