2023-11-16 18:55:16,071 INFO  [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks timeout: 13 mins
2023-11-16 18:55:16,350 WARN  [Time-limited test] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties
2023-11-16 18:55:16,460 INFO  [Time-limited test] metrics.MetricRegistriesLoader(60): Loaded MetricRegistries class org.apache.hadoop.hbase.metrics.impl.MetricRegistriesImpl
2023-11-16 18:55:16,528 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2023-11-16 18:55:16,534 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc.
2023-11-16 18:55:16,547 INFO  [Time-limited test] hbase.ResourceChecker(147): before: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnLargeClusterWithRacks Thread=12, OpenFileDescriptor=290, MaxFileDescriptor=60000, SystemLoadAverage=157, ProcessCount=173, AvailableMemoryMB=6331
2023-11-16 18:55:16,549 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2023-11-16 18:55:16,550 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=5000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=10000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc.
2023-11-16 18:55:16,693 INFO  [Time-limited test] balancer.BalancerTestBase(547): Mock Cluster : { srv1031244039:84 , srv104029339:84 , srv1045804137:84 , srv1072574883:84 , srv1086044497:84 , srv1110147940:84 , srv1146295073:84 , srv115749839:84 , srv1187291668:84 , srv1196870728:84 , srv1210847926:84 , srv1213189311:84 , srv1242801593:84 , srv126285887:84 , srv1272462689:84 , srv1282994050:84 , srv1312867600:84 , srv1330046908:84 , srv1364028296:84 , srv1371663074:84 , srv1395146572:84 , srv1403301110:84 , srv1427325232:84 , srv1427745222:84 , srv1467621881:84 , srv1474980274:84 , srv1507612306:84 , srv1512665721:84 , srv1577688284:84 , srv1583513732:84 , srv1606687939:84 , srv164463143:84 , srv1662509124:84 , srv1668018810:84 , srv1671271359:84 , srv1680360780:84 , srv16816660:84 , srv1712991170:84 , srv1715790553:84 , srv1717287468:84 , srv1717881288:84 , srv1756065947:84 , srv1768721478:84 , srv1800036266:84 , srv183119910:84 , srv1842311882:84 , srv187740751:84 , srv1897869943:84 , srv1912696699:84 , srv1924504773:84 , srv1966312793:84 , srv1977278662:84 , srv2002481673:84 , srv200299869:84 , srv2015964914:84 , srv2018758995:84 , srv2031756130:84 , srv2053195326:84 , srv2056350580:84 , srv2073573046:84 , srv2093948406:84 , srv2106151861:84 , srv2146967136:84 , srv221060621:84 , srv225265641:84 , srv232984373:84 , srv233528898:84 , srv242402231:84 , srv272356858:84 , srv280919499:84 , srv289157652:84 , srv309741263:84 , srv31647061:84 , srv327775745:84 , srv332379056:84 , srv347845530:84 , srv458519126:84 , srv464762098:84 , srv528448453:84 , srv541985215:84 , srv592263463:84 , srv606161785:84 , srv622193702:84 , srv624595724:84 , srv66266292:84 , srv733323558:84 , srv774083139:84 , srv782014385:84 , srv829963706:84 , srv837180484:84 , srv841030562:84 , srv84866546:84 , srv850716891:84 , srv8946044:84 , srv898316258:84 , srv918175415:84 , srv9387506:84 , srv97630959:84 , srv993530756:84 , srv1366357970:684 } [srvr=100 rgns=9000 avg=90.0 max=90 min=90]
2023-11-16 18:55:16,706 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-11-16 18:55:16,716 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1671271359=35, srv464762098=78, srv221060621=64, srv187740751=47, srv1662509124=33, srv309741263=72, srv1312867600=16, srv541985215=80, srv1966312793=51, srv1680360780=36, srv1403301110=22, srv183119910=45, srv1031244039=0, srv126285887=13, srv829963706=89, srv1756065947=42, srv733323558=86, srv1364028296=18, srv1196870728=9, srv2015964914=55, srv1512665721=28, srv1715790553=39, srv242402231=68, srv1072574883=3, srv1897869943=48, srv1467621881=25, srv289157652=71, srv1210847926=10, srv1242801593=12, srv1427745222=24, srv1924504773=50, srv1045804137=2, srv1272462689=14, srv528448453=79, srv1187291668=8, srv115749839=7, srv16816660=37, srv1668018810=34, srv9387506=97, srv993530756=99, srv622193702=83, srv233528898=67, srv232984373=66, srv850716891=93, srv1507612306=27, srv1712991170=38, srv2093948406=61, srv8946044=94, srv898316258=95, srv104029339=1, srv2106151861=62, srv1395146572=21, srv347845530=76, srv1086044497=4, srv1583513732=30, srv606161785=82, srv332379056=75, srv1768721478=43, srv1282994050=15, srv1606687939=31, srv1717881288=41, srv1366357970=19, srv2002481673=53, srv1474980274=26, srv1717287468=40, srv164463143=32, srv97630959=98, srv66266292=85, srv2146967136=63, srv225265641=65, srv327775745=74, srv1146295073=6, srv2056350580=59, srv624595724=84, srv1577688284=29, srv272356858=69, srv592263463=81, srv837180484=90, srv1800036266=44, srv1912696699=49, srv1977278662=52, srv782014385=88, srv1213189311=11, srv2073573046=60, srv84866546=92, srv1427325232=23, srv2031756130=57, srv200299869=54, srv1110147940=5, srv1371663074=20, srv918175415=96, srv31647061=73, srv774083139=87, srv458519126=77, srv841030562=91, srv2018758995=56, srv1842311882=46, srv2053195326=58, srv1330046908=17, srv280919499=70} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-11-16 18:55:16,820 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-11-16 18:55:16,820 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-11-16 18:55:16,821 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-11-16 18:55:16,821 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-11-16 18:55:16,821 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-11-16 18:55:16,821 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-11-16 18:55:16,821 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-11-16 18:55:16,821 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-11-16 18:55:16,822 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-11-16 18:55:16,822 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-11-16 18:55:16,822 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-11-16 18:55:16,822 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-11-16 18:55:16,822 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-11-16 18:55:16,822 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-11-16 18:55:16,822 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-11-16 18:55:16,823 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-11-16 18:55:16,823 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-11-16 18:55:16,823 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-11-16 18:55:16,823 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-11-16 18:55:16,823 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-11-16 18:55:16,823 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-11-16 18:55:16,824 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-11-16 18:55:16,824 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-11-16 18:55:16,824 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-11-16 18:55:16,824 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-11-16 18:55:16,824 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-11-16 18:55:16,824 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-11-16 18:55:16,824 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-11-16 18:55:16,825 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-11-16 18:55:16,825 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-11-16 18:55:16,825 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-11-16 18:55:16,825 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-11-16 18:55:16,825 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-11-16 18:55:16,826 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-11-16 18:55:16,826 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-11-16 18:55:16,826 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-11-16 18:55:16,826 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-11-16 18:55:16,826 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-11-16 18:55:16,826 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-11-16 18:55:16,826 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-11-16 18:55:16,827 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-11-16 18:55:16,827 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-11-16 18:55:16,827 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-11-16 18:55:16,827 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-11-16 18:55:16,827 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-11-16 18:55:16,827 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-11-16 18:55:16,828 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-11-16 18:55:16,828 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-11-16 18:55:16,828 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-11-16 18:55:16,828 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-11-16 18:55:16,828 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-11-16 18:55:16,828 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-11-16 18:55:16,829 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-11-16 18:55:16,829 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-11-16 18:55:16,829 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-11-16 18:55:16,829 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-11-16 18:55:16,829 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-11-16 18:55:16,829 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-11-16 18:55:16,829 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-11-16 18:55:16,829 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-11-16 18:55:16,830 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-11-16 18:55:16,830 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-11-16 18:55:16,830 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-11-16 18:55:16,830 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-11-16 18:55:16,830 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-11-16 18:55:16,830 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-11-16 18:55:16,830 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-11-16 18:55:16,830 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-11-16 18:55:16,830 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-11-16 18:55:16,831 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-11-16 18:55:16,831 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-11-16 18:55:16,831 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-11-16 18:55:16,831 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-11-16 18:55:16,831 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-11-16 18:55:16,831 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-11-16 18:55:16,831 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-11-16 18:55:16,831 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-11-16 18:55:16,832 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-11-16 18:55:16,832 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-11-16 18:55:16,832 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-11-16 18:55:16,832 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-11-16 18:55:16,832 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-11-16 18:55:16,832 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-11-16 18:55:16,832 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-11-16 18:55:16,833 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-11-16 18:55:16,833 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-11-16 18:55:16,833 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-11-16 18:55:16,833 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-11-16 18:55:16,833 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-11-16 18:55:16,834 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-11-16 18:55:16,834 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-11-16 18:55:16,834 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-11-16 18:55:16,834 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-11-16 18:55:16,834 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-11-16 18:55:16,835 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-11-16 18:55:16,835 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-11-16 18:55:16,835 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-11-16 18:55:16,835 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-11-16 18:55:16,835 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-11-16 18:55:16,835 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-11-16 18:55:16,836 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-11-16 18:55:17,155 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.06666666666666667, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-11-16 18:55:17,155 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-11-16 18:55:17,155 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.9909252140407105, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.06666666666666667, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-11-16 18:55:17,825 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 958 ms to try 5000 different iterations.  Found a solution that moves 4686 regions; Going from a computed imbalance of 0.9909252140407105 to a new imbalance of 0.17859229585276679. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.03703299641258691, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0564115867140825, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.5206666666666667, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.03703299641258691, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.17383333333333334, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.24025, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-11-16 18:55:17,848 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1768721478:82 , srv225265641:82 , srv280919499:82 , srv829963706:82 , srv918175415:82 , srv1031244039:83 , srv126285887:83 , srv1507612306:83 , srv1671271359:83 , srv1717881288:83 , srv541985215:83 , srv1210847926:84 , srv1668018810:84 , srv1800036266:84 , srv309741263:84 , srv841030562:84 , srv97630959:84 , srv104029339:85 , srv1371663074:85 , srv1395146572:85 , srv1577688284:85 , srv1583513732:85 , srv164463143:85 , srv16816660:85 , srv1712991170:85 , srv1842311882:85 , srv1912696699:85 , srv2015964914:85 , srv221060621:85 , srv347845530:85 , srv458519126:85 , srv464762098:85 , srv1146295073:86 , srv1187291668:86 , srv1196870728:86 , srv1330046908:86 , srv1403301110:86 , srv1474980274:86 , srv1606687939:86 , srv1662509124:86 , srv1680360780:86 , srv1924504773:86 , srv1977278662:86 , srv2018758995:86 , srv232984373:86 , srv233528898:86 , srv606161785:86 , srv850716891:86 , srv1045804137:87 , srv1072574883:87 , srv1110147940:87 , srv1213189311:87 , srv1242801593:87 , srv1272462689:87 , srv1282994050:87 , srv1512665721:87 , srv200299869:87 , srv2031756130:87 , srv2053195326:87 , srv2106151861:87 , srv327775745:87 , srv528448453:87 , srv592263463:87 , srv782014385:87 , srv9387506:87 , srv993530756:87 , srv115749839:88 , srv1427325232:88 , srv1467621881:88 , srv1715790553:88 , srv1756065947:88 , srv187740751:88 , srv2002481673:88 , srv2056350580:88 , srv2093948406:88 , srv622193702:88 , srv624595724:88 , srv66266292:88 , srv8946044:88 , srv1897869943:89 , srv242402231:89 , srv272356858:89 , srv289157652:89 , srv332379056:89 , srv837180484:89 , srv84866546:89 , srv1086044497:90 , srv1364028296:90 , srv1427745222:90 , srv1717287468:90 , srv2073573046:90 , srv31647061:90 , srv774083139:90 , srv898316258:90 , srv1966312793:92 , srv2146967136:92 , srv733323558:92 , srv183119910:94 , srv1312867600:95 , srv1366357970:419 }
2023-11-16 18:55:17,851 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-11-16 18:55:17,852 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1671271359=35, srv464762098=78, srv221060621=64, srv187740751=47, srv1662509124=33, srv309741263=72, srv1312867600=16, srv541985215=80, srv1966312793=51, srv1680360780=36, srv1403301110=22, srv183119910=45, srv1031244039=0, srv126285887=13, srv829963706=89, srv1756065947=42, srv733323558=86, srv1364028296=18, srv1196870728=9, srv2015964914=55, srv1512665721=28, srv1715790553=39, srv242402231=68, srv1072574883=3, srv1897869943=48, srv1467621881=25, srv289157652=71, srv1210847926=10, srv1242801593=12, srv1427745222=24, srv1924504773=50, srv1045804137=2, srv1272462689=14, srv528448453=79, srv1187291668=8, srv115749839=7, srv16816660=37, srv1668018810=34, srv9387506=97, srv993530756=99, srv622193702=83, srv233528898=67, srv232984373=66, srv850716891=93, srv1507612306=27, srv1712991170=38, srv2093948406=61, srv8946044=94, srv898316258=95, srv104029339=1, srv2106151861=62, srv1395146572=21, srv347845530=76, srv1086044497=4, srv1583513732=30, srv606161785=82, srv332379056=75, srv1768721478=43, srv1282994050=15, srv1606687939=31, srv1717881288=41, srv1366357970=19, srv2002481673=53, srv1474980274=26, srv1717287468=40, srv164463143=32, srv97630959=98, srv66266292=85, srv2146967136=63, srv225265641=65, srv327775745=74, srv1146295073=6, srv2056350580=59, srv624595724=84, srv1577688284=29, srv272356858=69, srv592263463=81, srv837180484=90, srv1800036266=44, srv1912696699=49, srv1977278662=52, srv782014385=88, srv1213189311=11, srv2073573046=60, srv84866546=92, srv1427325232=23, srv2031756130=57, srv200299869=54, srv1110147940=5, srv1371663074=20, srv918175415=96, srv31647061=73, srv774083139=87, srv458519126=77, srv841030562=91, srv2018758995=56, srv1842311882=46, srv2053195326=58, srv1330046908=17, srv280919499=70} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-11-16 18:55:17,870 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-11-16 18:55:17,870 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-11-16 18:55:17,870 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-11-16 18:55:17,870 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-11-16 18:55:17,871 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-11-16 18:55:17,871 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-11-16 18:55:17,871 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-11-16 18:55:17,871 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-11-16 18:55:17,871 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-11-16 18:55:17,871 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-11-16 18:55:17,871 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-11-16 18:55:17,872 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-11-16 18:55:17,872 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-11-16 18:55:17,872 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-11-16 18:55:17,872 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-11-16 18:55:17,872 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-11-16 18:55:17,872 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-11-16 18:55:17,872 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-11-16 18:55:17,873 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-11-16 18:55:17,873 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-11-16 18:55:17,873 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-11-16 18:55:17,873 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-11-16 18:55:17,873 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-11-16 18:55:17,873 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-11-16 18:55:17,873 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-11-16 18:55:17,873 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-11-16 18:55:17,874 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-11-16 18:55:17,874 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-11-16 18:55:17,874 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-11-16 18:55:17,874 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-11-16 18:55:17,874 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-11-16 18:55:17,874 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-11-16 18:55:17,874 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-11-16 18:55:17,874 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-11-16 18:55:17,874 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-11-16 18:55:17,874 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-11-16 18:55:17,874 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-11-16 18:55:17,874 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-11-16 18:55:17,875 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-11-16 18:55:17,875 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-11-16 18:55:17,875 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-11-16 18:55:17,875 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-11-16 18:55:17,875 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-11-16 18:55:17,875 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-11-16 18:55:17,875 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-11-16 18:55:17,875 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-11-16 18:55:17,875 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-11-16 18:55:17,875 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-11-16 18:55:17,875 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-11-16 18:55:17,875 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-11-16 18:55:17,875 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-11-16 18:55:17,875 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-11-16 18:55:17,875 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-11-16 18:55:17,876 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-11-16 18:55:17,876 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-11-16 18:55:17,876 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-11-16 18:55:17,876 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-11-16 18:55:17,876 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-11-16 18:55:17,876 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-11-16 18:55:17,876 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-11-16 18:55:17,876 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-11-16 18:55:17,876 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-11-16 18:55:17,877 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-11-16 18:55:17,877 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-11-16 18:55:17,877 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-11-16 18:55:17,877 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-11-16 18:55:17,877 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-11-16 18:55:17,877 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-11-16 18:55:17,877 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-11-16 18:55:17,877 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-11-16 18:55:17,877 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-11-16 18:55:17,877 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-11-16 18:55:17,877 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-11-16 18:55:17,877 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-11-16 18:55:17,878 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-11-16 18:55:17,878 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-11-16 18:55:17,878 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-11-16 18:55:17,878 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-11-16 18:55:17,878 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-11-16 18:55:17,878 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-11-16 18:55:17,878 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-11-16 18:55:17,878 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-11-16 18:55:17,878 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-11-16 18:55:17,878 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-11-16 18:55:17,878 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-11-16 18:55:17,878 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-11-16 18:55:17,879 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-11-16 18:55:17,879 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-11-16 18:55:17,879 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-11-16 18:55:17,879 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-11-16 18:55:17,879 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-11-16 18:55:17,879 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-11-16 18:55:17,879 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-11-16 18:55:17,879 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-11-16 18:55:17,879 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-11-16 18:55:17,879 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-11-16 18:55:17,880 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-11-16 18:55:17,880 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-11-16 18:55:17,880 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-11-16 18:55:17,880 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-11-16 18:55:17,880 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-11-16 18:55:18,016 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.03703299641258691, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0564115867140825, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.03703299641258691, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.17383333333333334, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.24025, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-11-16 18:55:18,016 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-11-16 18:55:18,016 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.1785594837794603, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.03703299641258691, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0564115867140825, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.03703299641258691, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.17383333333333334, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.24025, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-11-16 18:55:18,284 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 372 ms to try 5000 different iterations.  Found a solution that moves 2652 regions; Going from a computed imbalance of 0.1785594837794603 to a new imbalance of 0.015566418380071051. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.021604200724944934); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.03256694736394648, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.2946666666666667, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.021604200724944934); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0125); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.04491666666666667, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-11-16 18:55:18,295 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1312867600:77 , srv183119910:78 , srv2146967136:79 , srv2073573046:80 , srv1086044497:81 , srv1966312793:81 , srv272356858:81 , srv1427745222:82 , srv1717287468:82 , srv332379056:82 , srv774083139:82 , srv1110147940:83 , srv115749839:83 , srv1364028296:83 , srv1467621881:83 , srv1715790553:83 , srv2002481673:83 , srv242402231:83 , srv31647061:83 , srv528448453:83 , srv733323558:83 , srv837180484:83 , srv898316258:83 , srv1146295073:84 , srv1213189311:84 , srv1272462689:84 , srv1427325232:84 , srv1474980274:84 , srv1897869943:84 , srv2018758995:84 , srv2031756130:84 , srv592263463:84 , srv622193702:84 , srv84866546:84 , srv850716891:84 , srv993530756:84 , srv104029339:85 , srv1045804137:85 , srv1242801593:85 , srv1282994050:85 , srv1403301110:85 , srv1606687939:85 , srv1712991170:85 , srv1842311882:85 , srv187740751:85 , srv1912696699:85 , srv2053195326:85 , srv289157652:85 , srv624595724:85 , srv66266292:85 , srv8946044:85 , srv1072574883:86 , srv1210847926:86 , srv1583513732:86 , srv1680360780:86 , srv16816660:86 , srv200299869:86 , srv2056350580:86 , srv2106151861:86 , srv221060621:86 , srv232984373:86 , srv233528898:86 , srv327775745:86 , srv458519126:86 , srv782014385:86 , srv9387506:86 , srv1187291668:87 , srv1196870728:87 , srv1395146572:87 , srv1662509124:87 , srv1671271359:87 , srv1924504773:87 , srv2093948406:87 , srv347845530:87 , srv464762098:87 , srv97630959:87 , srv1031244039:88 , srv1330046908:88 , srv1371663074:88 , srv1507612306:88 , srv1577688284:88 , srv164463143:88 , srv1668018810:88 , srv1756065947:88 , srv2015964914:88 , srv309741263:88 , srv1512665721:89 , srv1717881288:89 , srv1800036266:89 , srv1977278662:89 , srv225265641:89 , srv606161785:89 , srv841030562:89 , srv918175415:89 , srv126285887:90 , srv829963706:90 , srv1768721478:91 , srv280919499:91 , srv541985215:91 , srv1366357970:547 }
2023-11-16 18:55:18,301 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-11-16 18:55:18,302 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1671271359=35, srv464762098=78, srv221060621=64, srv187740751=47, srv1662509124=33, srv309741263=72, srv1312867600=16, srv541985215=80, srv1966312793=51, srv1680360780=36, srv1403301110=22, srv183119910=45, srv1031244039=0, srv126285887=13, srv829963706=89, srv1756065947=42, srv733323558=86, srv1364028296=18, srv1196870728=9, srv2015964914=55, srv1512665721=28, srv1715790553=39, srv242402231=68, srv1072574883=3, srv1897869943=48, srv1467621881=25, srv289157652=71, srv1210847926=10, srv1242801593=12, srv1427745222=24, srv1924504773=50, srv1045804137=2, srv1272462689=14, srv528448453=79, srv1187291668=8, srv115749839=7, srv16816660=37, srv1668018810=34, srv9387506=97, srv993530756=99, srv622193702=83, srv233528898=67, srv232984373=66, srv850716891=93, srv1507612306=27, srv1712991170=38, srv2093948406=61, srv8946044=94, srv898316258=95, srv104029339=1, srv2106151861=62, srv1395146572=21, srv347845530=76, srv1086044497=4, srv1583513732=30, srv606161785=82, srv332379056=75, srv1768721478=43, srv1282994050=15, srv1606687939=31, srv1717881288=41, srv1366357970=19, srv2002481673=53, srv1474980274=26, srv1717287468=40, srv164463143=32, srv97630959=98, srv66266292=85, srv2146967136=63, srv225265641=65, srv327775745=74, srv1146295073=6, srv2056350580=59, srv624595724=84, srv1577688284=29, srv272356858=69, srv592263463=81, srv837180484=90, srv1800036266=44, srv1912696699=49, srv1977278662=52, srv782014385=88, srv1213189311=11, srv2073573046=60, srv84866546=92, srv1427325232=23, srv2031756130=57, srv200299869=54, srv1110147940=5, srv1371663074=20, srv918175415=96, srv31647061=73, srv774083139=87, srv458519126=77, srv841030562=91, srv2018758995=56, srv1842311882=46, srv2053195326=58, srv1330046908=17, srv280919499=70} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-11-16 18:55:18,322 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-11-16 18:55:18,323 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-11-16 18:55:18,323 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-11-16 18:55:18,323 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-11-16 18:55:18,323 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-11-16 18:55:18,323 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-11-16 18:55:18,323 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-11-16 18:55:18,323 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-11-16 18:55:18,324 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-11-16 18:55:18,324 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-11-16 18:55:18,324 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-11-16 18:55:18,324 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-11-16 18:55:18,324 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-11-16 18:55:18,324 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-11-16 18:55:18,324 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-11-16 18:55:18,324 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-11-16 18:55:18,324 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-11-16 18:55:18,325 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-11-16 18:55:18,325 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-11-16 18:55:18,325 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-11-16 18:55:18,325 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-11-16 18:55:18,325 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-11-16 18:55:18,325 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-11-16 18:55:18,325 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-11-16 18:55:18,325 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-11-16 18:55:18,325 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-11-16 18:55:18,325 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-11-16 18:55:18,325 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-11-16 18:55:18,326 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-11-16 18:55:18,326 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-11-16 18:55:18,326 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-11-16 18:55:18,326 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-11-16 18:55:18,326 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-11-16 18:55:18,326 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-11-16 18:55:18,326 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-11-16 18:55:18,327 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-11-16 18:55:18,327 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-11-16 18:55:18,327 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-11-16 18:55:18,327 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-11-16 18:55:18,327 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-11-16 18:55:18,327 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-11-16 18:55:18,327 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-11-16 18:55:18,327 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-11-16 18:55:18,327 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-11-16 18:55:18,328 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-11-16 18:55:18,328 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-11-16 18:55:18,328 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-11-16 18:55:18,328 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-11-16 18:55:18,328 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-11-16 18:55:18,328 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-11-16 18:55:18,328 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-11-16 18:55:18,328 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-11-16 18:55:18,329 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-11-16 18:55:18,329 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-11-16 18:55:18,329 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-11-16 18:55:18,329 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-11-16 18:55:18,329 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-11-16 18:55:18,329 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-11-16 18:55:18,329 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-11-16 18:55:18,329 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-11-16 18:55:18,329 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-11-16 18:55:18,330 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-11-16 18:55:18,330 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-11-16 18:55:18,330 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-11-16 18:55:18,330 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-11-16 18:55:18,330 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-11-16 18:55:18,330 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-11-16 18:55:18,330 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-11-16 18:55:18,330 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-11-16 18:55:18,330 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-11-16 18:55:18,330 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-11-16 18:55:18,331 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-11-16 18:55:18,331 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-11-16 18:55:18,331 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-11-16 18:55:18,331 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-11-16 18:55:18,331 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-11-16 18:55:18,331 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-11-16 18:55:18,331 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-11-16 18:55:18,331 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-11-16 18:55:18,331 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-11-16 18:55:18,332 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-11-16 18:55:18,332 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-11-16 18:55:18,332 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-11-16 18:55:18,332 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-11-16 18:55:18,332 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-11-16 18:55:18,332 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-11-16 18:55:18,332 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-11-16 18:55:18,332 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-11-16 18:55:18,332 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-11-16 18:55:18,333 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-11-16 18:55:18,333 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-11-16 18:55:18,333 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-11-16 18:55:18,333 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-11-16 18:55:18,333 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-11-16 18:55:18,333 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-11-16 18:55:18,333 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-11-16 18:55:18,333 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-11-16 18:55:18,333 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-11-16 18:55:18,333 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-11-16 18:55:18,334 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-11-16 18:55:18,334 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-11-16 18:55:18,454 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.021604200724944934); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.03256694736394648, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.021604200724944934); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0125); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.04491666666666667, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-11-16 18:55:18,454 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-11-16 18:55:18,454 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.015547848679172875, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.021604200724944934); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.03256694736394648, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.021604200724944934); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0125); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.04491666666666667, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-11-16 18:55:18,810 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 456 ms to try 5000 different iterations.  Found a solution that moves 1001 regions; Going from a computed imbalance of 0.015547848679172875 to a new imbalance of 3.48747011957101E-4. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.008352204595864103); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.010314906998965449); MoveCostFunction : (multiplier=7.0, imbalance=0.11122222222222222, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.008352204595864103); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0028333333333333335); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-11-16 18:55:18,814 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv2093948406:81 , srv1512665721:82 , srv1756065947:82 , srv1977278662:82 , srv606161785:82 , srv1196870728:83 , srv1662509124:83 , srv2015964914:83 , srv289157652:83 , srv541985215:83 , srv733323558:83 , srv782014385:83 , srv126285887:84 , srv1364028296:84 , srv1768721478:84 , srv187740751:84 , srv1924504773:84 , srv1966312793:84 , srv2053195326:84 , srv2056350580:84 , srv2106151861:84 , srv280919499:84 , srv309741263:84 , srv327775745:84 , srv841030562:84 , srv8946044:84 , srv898316258:84 , srv1045804137:85 , srv1072574883:85 , srv1272462689:85 , srv1282994050:85 , srv1330046908:85 , srv1371663074:85 , srv1395146572:85 , srv1427325232:85 , srv1577688284:85 , srv164463143:85 , srv1668018810:85 , srv1680360780:85 , srv1717881288:85 , srv1800036266:85 , srv183119910:85 , srv1897869943:85 , srv200299869:85 , srv225265641:85 , srv31647061:85 , srv332379056:85 , srv464762098:85 , srv592263463:85 , srv622193702:85 , srv624595724:85 , srv66266292:85 , srv774083139:85 , srv829963706:85 , srv837180484:85 , srv84866546:85 , srv9387506:85 , srv993530756:85 , srv1031244039:86 , srv1086044497:86 , srv1110147940:86 , srv115749839:86 , srv1187291668:86 , srv1213189311:86 , srv1242801593:86 , srv1312867600:86 , srv1467621881:86 , srv1474980274:86 , srv1507612306:86 , srv1583513732:86 , srv1606687939:86 , srv16816660:86 , srv1712991170:86 , srv1715790553:86 , srv2031756130:86 , srv2146967136:86 , srv232984373:86 , srv233528898:86 , srv918175415:86 , srv97630959:86 , srv104029339:87 , srv1210847926:87 , srv1403301110:87 , srv1427745222:87 , srv1717287468:87 , srv1842311882:87 , srv2002481673:87 , srv2018758995:87 , srv2073573046:87 , srv221060621:87 , srv242402231:87 , srv272356858:87 , srv347845530:87 , srv528448453:87 , srv850716891:87 , srv1146295073:88 , srv1671271359:88 , srv1912696699:88 , srv458519126:88 , srv1366357970:566 }
2023-11-16 18:55:18,820 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-11-16 18:55:18,821 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1671271359=35, srv464762098=78, srv221060621=64, srv187740751=47, srv1662509124=33, srv309741263=72, srv1312867600=16, srv541985215=80, srv1966312793=51, srv1680360780=36, srv1403301110=22, srv183119910=45, srv1031244039=0, srv126285887=13, srv829963706=89, srv1756065947=42, srv733323558=86, srv1364028296=18, srv1196870728=9, srv2015964914=55, srv1512665721=28, srv1715790553=39, srv242402231=68, srv1072574883=3, srv1897869943=48, srv1467621881=25, srv289157652=71, srv1210847926=10, srv1242801593=12, srv1427745222=24, srv1924504773=50, srv1045804137=2, srv1272462689=14, srv528448453=79, srv1187291668=8, srv115749839=7, srv16816660=37, srv1668018810=34, srv9387506=97, srv993530756=99, srv622193702=83, srv233528898=67, srv232984373=66, srv850716891=93, srv1507612306=27, srv1712991170=38, srv2093948406=61, srv8946044=94, srv898316258=95, srv104029339=1, srv2106151861=62, srv1395146572=21, srv347845530=76, srv1086044497=4, srv1583513732=30, srv606161785=82, srv332379056=75, srv1768721478=43, srv1282994050=15, srv1606687939=31, srv1717881288=41, srv1366357970=19, srv2002481673=53, srv1474980274=26, srv1717287468=40, srv164463143=32, srv97630959=98, srv66266292=85, srv2146967136=63, srv225265641=65, srv327775745=74, srv1146295073=6, srv2056350580=59, srv624595724=84, srv1577688284=29, srv272356858=69, srv592263463=81, srv837180484=90, srv1800036266=44, srv1912696699=49, srv1977278662=52, srv782014385=88, srv1213189311=11, srv2073573046=60, srv84866546=92, srv1427325232=23, srv2031756130=57, srv200299869=54, srv1110147940=5, srv1371663074=20, srv918175415=96, srv31647061=73, srv774083139=87, srv458519126=77, srv841030562=91, srv2018758995=56, srv1842311882=46, srv2053195326=58, srv1330046908=17, srv280919499=70} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-11-16 18:55:18,833 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-11-16 18:55:18,833 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-11-16 18:55:18,833 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-11-16 18:55:18,833 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-11-16 18:55:18,833 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-11-16 18:55:18,833 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-11-16 18:55:18,833 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-11-16 18:55:18,833 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-11-16 18:55:18,833 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-11-16 18:55:18,833 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-11-16 18:55:18,833 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-11-16 18:55:18,833 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-11-16 18:55:18,833 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-11-16 18:55:18,833 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-11-16 18:55:18,834 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-11-16 18:55:18,834 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-11-16 18:55:18,834 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-11-16 18:55:18,834 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-11-16 18:55:18,834 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-11-16 18:55:18,834 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-11-16 18:55:18,834 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-11-16 18:55:18,834 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-11-16 18:55:18,834 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-11-16 18:55:18,834 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-11-16 18:55:18,834 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-11-16 18:55:18,834 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-11-16 18:55:18,834 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-11-16 18:55:18,834 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-11-16 18:55:18,834 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-11-16 18:55:18,834 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-11-16 18:55:18,834 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-11-16 18:55:18,835 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-11-16 18:55:18,835 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-11-16 18:55:18,835 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-11-16 18:55:18,835 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-11-16 18:55:18,835 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-11-16 18:55:18,835 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-11-16 18:55:18,835 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-11-16 18:55:18,835 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-11-16 18:55:18,835 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-11-16 18:55:18,835 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-11-16 18:55:18,835 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-11-16 18:55:18,835 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-11-16 18:55:18,835 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-11-16 18:55:18,835 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-11-16 18:55:18,835 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-11-16 18:55:18,835 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-11-16 18:55:18,835 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-11-16 18:55:18,835 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-11-16 18:55:18,836 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-11-16 18:55:18,836 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-11-16 18:55:18,836 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-11-16 18:55:18,836 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-11-16 18:55:18,836 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-11-16 18:55:18,836 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-11-16 18:55:18,836 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-11-16 18:55:18,836 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-11-16 18:55:18,836 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-11-16 18:55:18,836 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-11-16 18:55:18,836 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-11-16 18:55:18,836 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-11-16 18:55:18,836 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-11-16 18:55:18,836 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-11-16 18:55:18,836 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-11-16 18:55:18,836 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-11-16 18:55:18,836 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-11-16 18:55:18,836 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-11-16 18:55:18,837 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-11-16 18:55:18,837 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-11-16 18:55:18,837 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-11-16 18:55:18,837 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-11-16 18:55:18,837 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-11-16 18:55:18,837 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-11-16 18:55:18,837 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-11-16 18:55:18,837 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-11-16 18:55:18,837 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-11-16 18:55:18,837 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-11-16 18:55:18,837 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-11-16 18:55:18,837 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-11-16 18:55:18,837 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-11-16 18:55:18,837 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-11-16 18:55:18,837 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-11-16 18:55:18,837 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-11-16 18:55:18,837 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-11-16 18:55:18,838 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-11-16 18:55:18,838 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-11-16 18:55:18,838 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-11-16 18:55:18,838 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-11-16 18:55:18,838 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-11-16 18:55:18,838 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-11-16 18:55:18,838 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-11-16 18:55:18,838 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-11-16 18:55:18,838 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-11-16 18:55:18,838 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-11-16 18:55:18,838 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-11-16 18:55:18,838 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-11-16 18:55:18,838 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-11-16 18:55:18,838 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-11-16 18:55:18,838 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-11-16 18:55:18,838 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-11-16 18:55:18,838 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-11-16 18:55:18,967 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.008352204595864103); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.010314906998965449); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.008352204595864103); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0028333333333333335); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-11-16 18:55:18,967 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-11-16 18:55:18,967 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=3.417378601474955E-4, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.008352204595864103); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.010314906998965449); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.008352204595864103); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0028333333333333335); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-11-16 18:55:19,205 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 357 ms to try 5000 different iterations.  Found a solution that moves 269 regions; Going from a computed imbalance of 3.417378601474955E-4 to a new imbalance of 3.398651585846604E-5. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=5.23782800878924E-4); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0015713484026367722); MoveCostFunction : (multiplier=7.0, imbalance=0.02988888888888889, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=5.23782800878924E-4); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=2.5E-4); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-11-16 18:55:19,206 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1330046908:83 , srv1427745222:83 , srv1671271359:83 , srv1717287468:83 , srv242402231:83 , srv347845530:83 , srv104029339:84 , srv1072574883:84 , srv1146295073:84 , srv1187291668:84 , srv1213189311:84 , srv1242801593:84 , srv1312867600:84 , srv1371663074:84 , srv1403301110:84 , srv1577688284:84 , srv164463143:84 , srv1756065947:84 , srv1912696699:84 , srv1966312793:84 , srv2002481673:84 , srv200299869:84 , srv2056350580:84 , srv2146967136:84 , srv221060621:84 , srv232984373:84 , srv233528898:84 , srv289157652:84 , srv31647061:84 , srv458519126:84 , srv464762098:84 , srv624595724:84 , srv66266292:84 , srv9387506:84 , srv97630959:84 , srv1031244039:85 , srv1045804137:85 , srv1086044497:85 , srv115749839:85 , srv1210847926:85 , srv126285887:85 , srv1272462689:85 , srv1282994050:85 , srv1364028296:85 , srv1395146572:85 , srv1427325232:85 , srv1507612306:85 , srv1512665721:85 , srv1583513732:85 , srv1606687939:85 , srv1668018810:85 , srv1680360780:85 , srv16816660:85 , srv1715790553:85 , srv1717881288:85 , srv1768721478:85 , srv1800036266:85 , srv183119910:85 , srv1842311882:85 , srv187740751:85 , srv1897869943:85 , srv1924504773:85 , srv1977278662:85 , srv2018758995:85 , srv2031756130:85 , srv2073573046:85 , srv2106151861:85 , srv272356858:85 , srv280919499:85 , srv327775745:85 , srv332379056:85 , srv528448453:85 , srv592263463:85 , srv606161785:85 , srv622193702:85 , srv733323558:85 , srv774083139:85 , srv829963706:85 , srv841030562:85 , srv84866546:85 , srv850716891:85 , srv8946044:85 , srv898316258:85 , srv918175415:85 , srv1110147940:86 , srv1196870728:86 , srv1467621881:86 , srv1474980274:86 , srv1662509124:86 , srv1712991170:86 , srv2015964914:86 , srv2053195326:86 , srv225265641:86 , srv309741263:86 , srv541985215:86 , srv782014385:86 , srv837180484:86 , srv993530756:86 , srv2093948406:87 , srv1366357970:610 }
2023-11-16 18:55:19,210 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-11-16 18:55:19,210 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1671271359=35, srv464762098=78, srv221060621=64, srv187740751=47, srv1662509124=33, srv309741263=72, srv1312867600=16, srv541985215=80, srv1966312793=51, srv1680360780=36, srv1403301110=22, srv183119910=45, srv1031244039=0, srv126285887=13, srv829963706=89, srv1756065947=42, srv733323558=86, srv1364028296=18, srv1196870728=9, srv2015964914=55, srv1512665721=28, srv1715790553=39, srv242402231=68, srv1072574883=3, srv1897869943=48, srv1467621881=25, srv289157652=71, srv1210847926=10, srv1242801593=12, srv1427745222=24, srv1924504773=50, srv1045804137=2, srv1272462689=14, srv528448453=79, srv1187291668=8, srv115749839=7, srv16816660=37, srv1668018810=34, srv9387506=97, srv993530756=99, srv622193702=83, srv233528898=67, srv232984373=66, srv850716891=93, srv1507612306=27, srv1712991170=38, srv2093948406=61, srv8946044=94, srv898316258=95, srv104029339=1, srv2106151861=62, srv1395146572=21, srv347845530=76, srv1086044497=4, srv1583513732=30, srv606161785=82, srv332379056=75, srv1768721478=43, srv1282994050=15, srv1606687939=31, srv1717881288=41, srv1366357970=19, srv2002481673=53, srv1474980274=26, srv1717287468=40, srv164463143=32, srv97630959=98, srv66266292=85, srv2146967136=63, srv225265641=65, srv327775745=74, srv1146295073=6, srv2056350580=59, srv624595724=84, srv1577688284=29, srv272356858=69, srv592263463=81, srv837180484=90, srv1800036266=44, srv1912696699=49, srv1977278662=52, srv782014385=88, srv1213189311=11, srv2073573046=60, srv84866546=92, srv1427325232=23, srv2031756130=57, srv200299869=54, srv1110147940=5, srv1371663074=20, srv918175415=96, srv31647061=73, srv774083139=87, srv458519126=77, srv841030562=91, srv2018758995=56, srv1842311882=46, srv2053195326=58, srv1330046908=17, srv280919499=70} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-11-16 18:55:19,221 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-11-16 18:55:19,221 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-11-16 18:55:19,221 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-11-16 18:55:19,221 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-11-16 18:55:19,221 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-11-16 18:55:19,221 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-11-16 18:55:19,221 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-11-16 18:55:19,221 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-11-16 18:55:19,221 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-11-16 18:55:19,221 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-11-16 18:55:19,221 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-11-16 18:55:19,222 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-11-16 18:55:19,222 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-11-16 18:55:19,222 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-11-16 18:55:19,222 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-11-16 18:55:19,222 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-11-16 18:55:19,222 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-11-16 18:55:19,222 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-11-16 18:55:19,222 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-11-16 18:55:19,222 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-11-16 18:55:19,222 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-11-16 18:55:19,222 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-11-16 18:55:19,222 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-11-16 18:55:19,222 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-11-16 18:55:19,222 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-11-16 18:55:19,222 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-11-16 18:55:19,222 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-11-16 18:55:19,222 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-11-16 18:55:19,222 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-11-16 18:55:19,223 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-11-16 18:55:19,223 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-11-16 18:55:19,223 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-11-16 18:55:19,223 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-11-16 18:55:19,223 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-11-16 18:55:19,223 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-11-16 18:55:19,223 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-11-16 18:55:19,223 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-11-16 18:55:19,223 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-11-16 18:55:19,223 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-11-16 18:55:19,223 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-11-16 18:55:19,223 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-11-16 18:55:19,223 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-11-16 18:55:19,223 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-11-16 18:55:19,223 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-11-16 18:55:19,223 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-11-16 18:55:19,223 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-11-16 18:55:19,223 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-11-16 18:55:19,223 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-11-16 18:55:19,223 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-11-16 18:55:19,224 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-11-16 18:55:19,224 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-11-16 18:55:19,224 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-11-16 18:55:19,224 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-11-16 18:55:19,224 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-11-16 18:55:19,224 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-11-16 18:55:19,224 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-11-16 18:55:19,224 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-11-16 18:55:19,224 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-11-16 18:55:19,224 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-11-16 18:55:19,224 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-11-16 18:55:19,224 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-11-16 18:55:19,224 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-11-16 18:55:19,224 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-11-16 18:55:19,224 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-11-16 18:55:19,224 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-11-16 18:55:19,224 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-11-16 18:55:19,224 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-11-16 18:55:19,224 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-11-16 18:55:19,225 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-11-16 18:55:19,225 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-11-16 18:55:19,225 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-11-16 18:55:19,225 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-11-16 18:55:19,225 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-11-16 18:55:19,225 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-11-16 18:55:19,225 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-11-16 18:55:19,226 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-11-16 18:55:19,226 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-11-16 18:55:19,226 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-11-16 18:55:19,226 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-11-16 18:55:19,226 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-11-16 18:55:19,226 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-11-16 18:55:19,226 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-11-16 18:55:19,226 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-11-16 18:55:19,226 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-11-16 18:55:19,226 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-11-16 18:55:19,226 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-11-16 18:55:19,227 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-11-16 18:55:19,227 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-11-16 18:55:19,227 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-11-16 18:55:19,227 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-11-16 18:55:19,227 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-11-16 18:55:19,227 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-11-16 18:55:19,227 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-11-16 18:55:19,227 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-11-16 18:55:19,227 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-11-16 18:55:19,227 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-11-16 18:55:19,227 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-11-16 18:55:19,228 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-11-16 18:55:19,228 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-11-16 18:55:19,228 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-11-16 18:55:19,228 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-11-16 18:55:19,339 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=5.23782800878924E-4); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0015713484026367722); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=5.23782800878924E-4); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=2.5E-4); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-11-16 18:55:19,339 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-11-16 18:55:19,339 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=3.210293759994068E-5, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=5.23782800878924E-4); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0015713484026367722); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=5.23782800878924E-4); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=2.5E-4); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-11-16 18:55:19,581 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 339 ms to try 5000 different iterations.  Found a solution that moves 25 regions; Going from a computed imbalance of 3.210293759994068E-5 to a new imbalance of 5.817546735025314E-6. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0012535023884839248); MoveCostFunction : (multiplier=7.0, imbalance=0.002777777777777778); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-11-16 18:55:19,581 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1187291668:83 , srv1467621881:83 , srv1512665721:83 , srv1800036266:83 , srv1897869943:83 , srv2093948406:83 , srv458519126:83 , srv541985215:83 , srv733323558:83 , srv837180484:83 , srv84866546:83 , srv1031244039:84 , srv1045804137:84 , srv1072574883:84 , srv1086044497:84 , srv1110147940:84 , srv1146295073:84 , srv115749839:84 , srv1196870728:84 , srv1210847926:84 , srv1242801593:84 , srv126285887:84 , srv1282994050:84 , srv1312867600:84 , srv1330046908:84 , srv1364028296:84 , srv1371663074:84 , srv1395146572:84 , srv1403301110:84 , srv1427325232:84 , srv1427745222:84 , srv1474980274:84 , srv1507612306:84 , srv1577688284:84 , srv1583513732:84 , srv1606687939:84 , srv164463143:84 , srv1662509124:84 , srv1668018810:84 , srv1680360780:84 , srv16816660:84 , srv1712991170:84 , srv1715790553:84 , srv1717287468:84 , srv1717881288:84 , srv1756065947:84 , srv1768721478:84 , srv183119910:84 , srv1842311882:84 , srv187740751:84 , srv1912696699:84 , srv1924504773:84 , srv1977278662:84 , srv2002481673:84 , srv200299869:84 , srv2015964914:84 , srv2018758995:84 , srv2031756130:84 , srv2053195326:84 , srv2056350580:84 , srv2073573046:84 , srv2106151861:84 , srv221060621:84 , srv225265641:84 , srv232984373:84 , srv233528898:84 , srv242402231:84 , srv272356858:84 , srv280919499:84 , srv309741263:84 , srv31647061:84 , srv327775745:84 , srv347845530:84 , srv528448453:84 , srv606161785:84 , srv622193702:84 , srv624595724:84 , srv66266292:84 , srv774083139:84 , srv782014385:84 , srv829963706:84 , srv841030562:84 , srv850716891:84 , srv8946044:84 , srv898316258:84 , srv918175415:84 , srv9387506:84 , srv993530756:84 , srv104029339:85 , srv1213189311:85 , srv1272462689:85 , srv1671271359:85 , srv1966312793:85 , srv2146967136:85 , srv289157652:85 , srv332379056:85 , srv464762098:85 , srv592263463:85 , srv97630959:85 , srv1366357970:684 }
2023-11-16 18:55:19,587 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-11-16 18:55:19,588 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1671271359=35, srv464762098=78, srv221060621=64, srv187740751=47, srv1662509124=33, srv309741263=72, srv1312867600=16, srv541985215=80, srv1966312793=51, srv1680360780=36, srv1403301110=22, srv183119910=45, srv1031244039=0, srv126285887=13, srv829963706=89, srv1756065947=42, srv733323558=86, srv1364028296=18, srv1196870728=9, srv2015964914=55, srv1512665721=28, srv1715790553=39, srv242402231=68, srv1072574883=3, srv1897869943=48, srv1467621881=25, srv289157652=71, srv1210847926=10, srv1242801593=12, srv1427745222=24, srv1924504773=50, srv1045804137=2, srv1272462689=14, srv528448453=79, srv1187291668=8, srv115749839=7, srv16816660=37, srv1668018810=34, srv9387506=97, srv993530756=99, srv622193702=83, srv233528898=67, srv232984373=66, srv850716891=93, srv1507612306=27, srv1712991170=38, srv2093948406=61, srv8946044=94, srv898316258=95, srv104029339=1, srv2106151861=62, srv1395146572=21, srv347845530=76, srv1086044497=4, srv1583513732=30, srv606161785=82, srv332379056=75, srv1768721478=43, srv1282994050=15, srv1606687939=31, srv1717881288=41, srv1366357970=19, srv2002481673=53, srv1474980274=26, srv1717287468=40, srv164463143=32, srv97630959=98, srv66266292=85, srv2146967136=63, srv225265641=65, srv327775745=74, srv1146295073=6, srv2056350580=59, srv624595724=84, srv1577688284=29, srv272356858=69, srv592263463=81, srv837180484=90, srv1800036266=44, srv1912696699=49, srv1977278662=52, srv782014385=88, srv1213189311=11, srv2073573046=60, srv84866546=92, srv1427325232=23, srv2031756130=57, srv200299869=54, srv1110147940=5, srv1371663074=20, srv918175415=96, srv31647061=73, srv774083139=87, srv458519126=77, srv841030562=91, srv2018758995=56, srv1842311882=46, srv2053195326=58, srv1330046908=17, srv280919499=70} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-11-16 18:55:19,607 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-11-16 18:55:19,607 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-11-16 18:55:19,607 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-11-16 18:55:19,607 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-11-16 18:55:19,607 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-11-16 18:55:19,607 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-11-16 18:55:19,607 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-11-16 18:55:19,607 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-11-16 18:55:19,607 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-11-16 18:55:19,608 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-11-16 18:55:19,608 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-11-16 18:55:19,608 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-11-16 18:55:19,608 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-11-16 18:55:19,608 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-11-16 18:55:19,608 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-11-16 18:55:19,608 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-11-16 18:55:19,608 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-11-16 18:55:19,608 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-11-16 18:55:19,608 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-11-16 18:55:19,608 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-11-16 18:55:19,608 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-11-16 18:55:19,608 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-11-16 18:55:19,608 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-11-16 18:55:19,608 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-11-16 18:55:19,608 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-11-16 18:55:19,608 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-11-16 18:55:19,608 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-11-16 18:55:19,608 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-11-16 18:55:19,608 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-11-16 18:55:19,608 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-11-16 18:55:19,609 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-11-16 18:55:19,609 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-11-16 18:55:19,609 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-11-16 18:55:19,609 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-11-16 18:55:19,609 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-11-16 18:55:19,609 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-11-16 18:55:19,609 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-11-16 18:55:19,609 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-11-16 18:55:19,609 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-11-16 18:55:19,609 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-11-16 18:55:19,609 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-11-16 18:55:19,609 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-11-16 18:55:19,609 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-11-16 18:55:19,609 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-11-16 18:55:19,609 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-11-16 18:55:19,609 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-11-16 18:55:19,609 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-11-16 18:55:19,609 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-11-16 18:55:19,609 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-11-16 18:55:19,609 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-11-16 18:55:19,609 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-11-16 18:55:19,610 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-11-16 18:55:19,610 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-11-16 18:55:19,610 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-11-16 18:55:19,610 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-11-16 18:55:19,610 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-11-16 18:55:19,610 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-11-16 18:55:19,610 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-11-16 18:55:19,610 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-11-16 18:55:19,610 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-11-16 18:55:19,610 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-11-16 18:55:19,610 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-11-16 18:55:19,610 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-11-16 18:55:19,610 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-11-16 18:55:19,610 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-11-16 18:55:19,610 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-11-16 18:55:19,610 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-11-16 18:55:19,610 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-11-16 18:55:19,610 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-11-16 18:55:19,610 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-11-16 18:55:19,610 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-11-16 18:55:19,610 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-11-16 18:55:19,611 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-11-16 18:55:19,611 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-11-16 18:55:19,611 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-11-16 18:55:19,611 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-11-16 18:55:19,611 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-11-16 18:55:19,611 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-11-16 18:55:19,611 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-11-16 18:55:19,611 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-11-16 18:55:19,611 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-11-16 18:55:19,611 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-11-16 18:55:19,611 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-11-16 18:55:19,611 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-11-16 18:55:19,611 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-11-16 18:55:19,611 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-11-16 18:55:19,611 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-11-16 18:55:19,611 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-11-16 18:55:19,611 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-11-16 18:55:19,611 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-11-16 18:55:19,611 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-11-16 18:55:19,612 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-11-16 18:55:19,612 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-11-16 18:55:19,612 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-11-16 18:55:19,612 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-11-16 18:55:19,612 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-11-16 18:55:19,612 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-11-16 18:55:19,612 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-11-16 18:55:19,612 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-11-16 18:55:19,612 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-11-16 18:55:19,612 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-11-16 18:55:19,735 INFO  [Time-limited test] balancer.StochasticLoadBalancer(381): Cluster wide - skipping load balancing because weighted average imbalance=5.642492993526674E-6 <= threshold(0.025). If you want more aggressive balancing, either lower hbase.master.balancer.stochastic.minCostNeedBalance from 0.025 or increase the relative multiplier(s) of the specific cost function(s). functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0012535023884839248); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-11-16 18:55:19,736 INFO  [Time-limited test] balancer.BalancerTestBase(570): Mock Final balance: { srv1187291668:83 , srv1467621881:83 , srv1512665721:83 , srv1800036266:83 , srv1897869943:83 , srv2093948406:83 , srv458519126:83 , srv541985215:83 , srv733323558:83 , srv837180484:83 , srv84866546:83 , srv1031244039:84 , srv1045804137:84 , srv1072574883:84 , srv1086044497:84 , srv1110147940:84 , srv1146295073:84 , srv115749839:84 , srv1196870728:84 , srv1210847926:84 , srv1242801593:84 , srv126285887:84 , srv1282994050:84 , srv1312867600:84 , srv1330046908:84 , srv1364028296:84 , srv1371663074:84 , srv1395146572:84 , srv1403301110:84 , srv1427325232:84 , srv1427745222:84 , srv1474980274:84 , srv1507612306:84 , srv1577688284:84 , srv1583513732:84 , srv1606687939:84 , srv164463143:84 , srv1662509124:84 , srv1668018810:84 , srv1680360780:84 , srv16816660:84 , srv1712991170:84 , srv1715790553:84 , srv1717287468:84 , srv1717881288:84 , srv1756065947:84 , srv1768721478:84 , srv183119910:84 , srv1842311882:84 , srv187740751:84 , srv1912696699:84 , srv1924504773:84 , srv1977278662:84 , srv2002481673:84 , srv200299869:84 , srv2015964914:84 , srv2018758995:84 , srv2031756130:84 , srv2053195326:84 , srv2056350580:84 , srv2073573046:84 , srv2106151861:84 , srv221060621:84 , srv225265641:84 , srv232984373:84 , srv233528898:84 , srv242402231:84 , srv272356858:84 , srv280919499:84 , srv309741263:84 , srv31647061:84 , srv327775745:84 , srv347845530:84 , srv528448453:84 , srv606161785:84 , srv622193702:84 , srv624595724:84 , srv66266292:84 , srv774083139:84 , srv782014385:84 , srv829963706:84 , srv841030562:84 , srv850716891:84 , srv8946044:84 , srv898316258:84 , srv918175415:84 , srv9387506:84 , srv993530756:84 , srv104029339:85 , srv1213189311:85 , srv1272462689:85 , srv1671271359:85 , srv1966312793:85 , srv2146967136:85 , srv289157652:85 , srv332379056:85 , srv464762098:85 , srv592263463:85 , srv97630959:85 , srv1366357970:684 }
2023-11-16 18:55:19,766 INFO  [Time-limited test] hbase.ResourceChecker(175): after: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnLargeClusterWithRacks Thread=12 (was 12), OpenFileDescriptor=290 (was 290), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=177 (was 157) - SystemLoadAverage LEAK? -, ProcessCount=173 (was 173), AvailableMemoryMB=5796 (was 6331)
2023-11-16 18:55:19,773 INFO  [Time-limited test] hbase.ResourceChecker(147): before: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnMidClusterWithRacks Thread=12, OpenFileDescriptor=290, MaxFileDescriptor=60000, SystemLoadAverage=177, ProcessCount=173, AvailableMemoryMB=5795
2023-11-16 18:55:19,774 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2023-11-16 18:55:19,774 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=5000, runMaxSteps=true, stepsPerRegion=800, maxRunningTime=120000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 111077.0 etc.
2023-11-16 18:55:19,788 INFO  [Time-limited test] balancer.BalancerTestBase(547): Mock Cluster : { srv1020510690:84 , srv1023502284:84 , srv10466335:84 , srv1083209255:84 , srv1222167517:84 , srv1451833175:84 , srv1561825320:84 , srv1636051577:84 , srv166611054:84 , srv200273710:84 , srv2045067505:84 , srv2045951068:84 , srv2144727758:84 , srv220116947:84 , srv335359466:84 , srv358082262:84 , srv402058965:84 , srv439127590:84 , srv444869184:84 , srv498637674:84 , srv509058537:84 , srv625426506:84 , srv64017686:84 , srv727005515:84 , srv783254616:84 , srv805463242:84 , srv852192858:84 , srv919449406:84 , srv922880:84 , srv141349792:264 } [srvr=30 rgns=2700 avg=90.0 max=90 min=90]
2023-11-16 18:55:19,790 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-11-16 18:55:19,790 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv166611054=9, srv498637674=20, srv141349792=5, srv625426506=22, srv2045951068=12, srv335359466=15, srv1451833175=6, srv200273710=10, srv220116947=14, srv2144727758=13, srv509058537=21, srv727005515=24, srv805463242=26, srv1023502284=1, srv439127590=18, srv444869184=19, srv402058965=17, srv64017686=23, srv919449406=28, srv1020510690=0, srv852192858=27, srv783254616=25, srv2045067505=11, srv1222167517=4, srv922880=29, srv358082262=16, srv10466335=2, srv1561825320=7, srv1083209255=3, srv1636051577=8} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-11-16 18:55:19,805 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-11-16 18:55:19,805 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-11-16 18:55:19,805 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-11-16 18:55:19,805 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-11-16 18:55:19,805 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-11-16 18:55:19,805 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-11-16 18:55:19,806 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-11-16 18:55:19,806 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-11-16 18:55:19,806 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-11-16 18:55:19,806 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-11-16 18:55:19,806 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-11-16 18:55:19,806 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-11-16 18:55:19,806 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-11-16 18:55:19,806 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-11-16 18:55:19,806 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-11-16 18:55:19,806 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-11-16 18:55:19,806 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-11-16 18:55:19,806 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-11-16 18:55:19,806 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-11-16 18:55:19,807 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-11-16 18:55:19,807 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-11-16 18:55:19,807 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-11-16 18:55:19,807 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-11-16 18:55:19,807 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-11-16 18:55:19,807 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-11-16 18:55:19,807 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-11-16 18:55:19,807 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-11-16 18:55:19,807 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-11-16 18:55:19,807 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-11-16 18:55:19,807 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-11-16 18:55:19,807 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=10, number of hosts=30, number of racks=4
2023-11-16 18:55:19,826 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=1.1582852746227974, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-11-16 18:55:19,826 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.9912691794996126, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=1.1582852746227974, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=64800000
2023-11-16 18:57:19,812 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 120001 ms to try 6069099 different iterations.  Found a solution that moves 1863 regions; Going from a computed imbalance of 0.9912691794996126 to a new imbalance of 4.3483349388262195E-5. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); MoveCostFunction : (multiplier=7.0, imbalance=0.69, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-11-16 18:57:19,819 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1020510690:90 , srv1023502284:90 , srv10466335:90 , srv1083209255:90 , srv1222167517:90 , srv141349792:90 , srv1451833175:90 , srv1561825320:90 , srv1636051577:90 , srv166611054:90 , srv200273710:90 , srv2045067505:90 , srv2045951068:90 , srv2144727758:90 , srv220116947:90 , srv335359466:90 , srv358082262:90 , srv402058965:90 , srv439127590:90 , srv444869184:90 , srv498637674:90 , srv509058537:90 , srv625426506:90 , srv64017686:90 , srv727005515:90 , srv783254616:90 , srv805463242:90 , srv852192858:90 , srv919449406:90 , srv922880:90 }
2023-11-16 18:57:19,820 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-11-16 18:57:19,820 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv166611054=9, srv498637674=20, srv141349792=5, srv625426506=22, srv2045951068=12, srv335359466=15, srv1451833175=6, srv200273710=10, srv220116947=14, srv2144727758=13, srv509058537=21, srv727005515=24, srv805463242=26, srv1023502284=1, srv439127590=18, srv444869184=19, srv402058965=17, srv64017686=23, srv919449406=28, srv1020510690=0, srv852192858=27, srv783254616=25, srv2045067505=11, srv1222167517=4, srv922880=29, srv358082262=16, srv10466335=2, srv1561825320=7, srv1083209255=3, srv1636051577=8} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-11-16 18:57:19,823 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-11-16 18:57:19,823 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-11-16 18:57:19,823 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-11-16 18:57:19,823 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-11-16 18:57:19,823 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-11-16 18:57:19,823 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-11-16 18:57:19,824 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-11-16 18:57:19,824 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-11-16 18:57:19,824 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-11-16 18:57:19,824 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-11-16 18:57:19,824 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-11-16 18:57:19,824 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-11-16 18:57:19,824 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-11-16 18:57:19,824 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-11-16 18:57:19,824 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-11-16 18:57:19,824 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-11-16 18:57:19,824 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-11-16 18:57:19,824 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-11-16 18:57:19,824 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-11-16 18:57:19,824 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-11-16 18:57:19,824 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-11-16 18:57:19,824 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-11-16 18:57:19,824 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-11-16 18:57:19,824 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-11-16 18:57:19,824 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-11-16 18:57:19,824 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-11-16 18:57:19,824 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-11-16 18:57:19,824 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-11-16 18:57:19,824 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-11-16 18:57:19,824 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-11-16 18:57:19,825 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=10, number of hosts=30, number of racks=4
2023-11-16 18:57:19,836 INFO  [Time-limited test] balancer.StochasticLoadBalancer(381): Cluster wide - skipping load balancing because weighted average imbalance=0.0 <= threshold(0.025). If you want more aggressive balancing, either lower hbase.master.balancer.stochastic.minCostNeedBalance from 0.025 or increase the relative multiplier(s) of the specific cost function(s). functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-11-16 18:57:19,836 INFO  [Time-limited test] balancer.BalancerTestBase(570): Mock Final balance: { srv1020510690:90 , srv1023502284:90 , srv10466335:90 , srv1083209255:90 , srv1222167517:90 , srv141349792:90 , srv1451833175:90 , srv1561825320:90 , srv1636051577:90 , srv166611054:90 , srv200273710:90 , srv2045067505:90 , srv2045951068:90 , srv2144727758:90 , srv220116947:90 , srv335359466:90 , srv358082262:90 , srv402058965:90 , srv439127590:90 , srv444869184:90 , srv498637674:90 , srv509058537:90 , srv625426506:90 , srv64017686:90 , srv727005515:90 , srv783254616:90 , srv805463242:90 , srv852192858:90 , srv919449406:90 , srv922880:90 }
2023-11-16 18:57:19,849 INFO  [Time-limited test] hbase.ResourceChecker(175): after: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnMidClusterWithRacks Thread=11 (was 12), OpenFileDescriptor=290 (was 290), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=225 (was 177) - SystemLoadAverage LEAK? -, ProcessCount=171 (was 173), AvailableMemoryMB=5961 (was 5795) - AvailableMemoryMB LEAK? -