2023-08-21 18:53:13,059 INFO  [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks timeout: 13 mins
2023-08-21 18:53:13,388 WARN  [Time-limited test] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties
2023-08-21 18:53:13,511 INFO  [Time-limited test] metrics.MetricRegistriesLoader(60): Loaded MetricRegistries class org.apache.hadoop.hbase.metrics.impl.MetricRegistriesImpl
2023-08-21 18:53:13,577 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2023-08-21 18:53:13,584 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc.
2023-08-21 18:53:13,599 INFO  [Time-limited test] hbase.ResourceChecker(147): before: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnLargeClusterWithRacks Thread=12, OpenFileDescriptor=263, MaxFileDescriptor=60000, SystemLoadAverage=222, ProcessCount=171, AvailableMemoryMB=11058
2023-08-21 18:53:13,601 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2023-08-21 18:53:13,601 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=5000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=10000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc.
2023-08-21 18:53:13,743 INFO  [Time-limited test] balancer.BalancerTestBase(547): Mock Cluster : { srv1020477570:84 , srv1091716508:84 , srv1095184065:84 , srv1116790797:84 , srv1157577231:84 , srv1162269062:84 , srv1229694972:84 , srv1244391675:84 , srv1247849487:84 , srv1251118478:84 , srv1254573551:84 , srv1265458679:84 , srv1271399833:84 , srv1274411289:84 , srv1320191333:84 , srv1339180680:84 , srv1372233510:84 , srv1385870678:84 , srv1423489566:84 , srv143255968:84 , srv1481964142:84 , srv1501102677:84 , srv1508097815:84 , srv1511567321:84 , srv1519589697:84 , srv1526587086:84 , srv1570510544:84 , srv1594675884:84 , srv1594731973:84 , srv1618876487:84 , srv1626420418:84 , srv1661112525:84 , srv1668275296:84 , srv1677936966:84 , srv1693791375:84 , srv1699626229:84 , srv1723945296:84 , srv1785014548:84 , srv1823371181:84 , srv1836788209:84 , srv1847054758:84 , srv1852461600:84 , srv1861494551:84 , srv1865198620:84 , srv1869335163:84 , srv1875998002:84 , srv1900692876:84 , srv190855489:84 , srv1948966056:84 , srv195214594:84 , srv2006393388:84 , srv2038279815:84 , srv2093888680:84 , srv2106200230:84 , srv2132708885:84 , srv2133701535:84 , srv24178342:84 , srv252956230:84 , srv266525240:84 , srv266901858:84 , srv356585373:84 , srv359848388:84 , srv362402651:84 , srv3975115:84 , srv422139457:84 , srv441909095:84 , srv482599234:84 , srv55752631:84 , srv612553940:84 , srv621301795:84 , srv65359781:84 , srv672750381:84 , srv703290359:84 , srv720463518:84 , srv745239468:84 , srv74620333:84 , srv748353155:84 , srv758106473:84 , srv76668779:84 , srv768916246:84 , srv821079934:84 , srv827328589:84 , srv827360475:84 , srv83740697:84 , srv852763738:84 , srv856104424:84 , srv871217895:84 , srv873594530:84 , srv883838147:84 , srv897891833:84 , srv91411790:84 , srv914222960:84 , srv934021764:84 , srv937113111:84 , srv941924726:84 , srv949956336:84 , srv952774503:84 , srv962909979:84 , srv99959611:84 , srv710154038:684 } [srvr=100 rgns=9000 avg=90.0 max=90 min=90]
2023-08-21 18:53:13,757 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-08-21 18:53:13,766 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv621301795=69, srv1847054758=40, srv1020477570=0, srv143255968=19, srv1162269062=5, srv1481964142=20, srv1372233510=16, srv1254573551=10, srv1251118478=9, srv710154038=73, srv1423489566=18, srv1875998002=45, srv1785014548=37, srv362402651=62, srv1274411289=13, srv1570510544=26, srv934021764=93, srv1900692876=46, srv55752631=67, srv190855489=47, srv1519589697=24, srv482599234=66, srv1823371181=38, srv962909979=98, srv703290359=72, srv914222960=92, srv1948966056=48, srv1861494551=42, srv1116790797=3, srv720463518=74, srv1320191333=14, srv1271399833=12, srv76668779=79, srv1594731973=28, srv2038279815=51, srv83740697=84, srv2006393388=50, srv65359781=70, srv873594530=88, srv1501102677=21, srv856104424=86, srv1661112525=31, srv1852461600=41, srv952774503=97, srv745239468=75, srv74620333=76, srv1091716508=1, srv1247849487=8, srv3975115=63, srv91411790=91, srv1699626229=35, srv359848388=61, srv1869335163=44, srv1265458679=11, srv1095184065=2, srv827328589=82, srv266901858=59, srv1244391675=7, srv827360475=83, srv2133701535=55, srv252956230=57, srv99959611=99, srv883838147=89, srv1594675884=27, srv1339180680=15, srv1526587086=25, srv422139457=64, srv1157577231=4, srv821079934=81, srv768916246=80, srv2132708885=54, srv1865198620=43, srv1693791375=34, srv1229694972=6, srv2106200230=53, srv758106473=78, srv1626420418=30, srv1836788209=39, srv1723945296=36, srv2093888680=52, srv748353155=77, srv937113111=94, srv195214594=49, srv441909095=65, srv1385870678=17, srv941924726=95, srv897891833=90, srv852763738=85, srv24178342=56, srv1508097815=22, srv266525240=58, srv949956336=96, srv871217895=87, srv612553940=68, srv1668275296=32, srv356585373=60, srv672750381=71, srv1618876487=29, srv1677936966=33, srv1511567321=23} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-08-21 18:53:13,842 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-08-21 18:53:13,842 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-08-21 18:53:13,842 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-08-21 18:53:13,842 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-08-21 18:53:13,842 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-08-21 18:53:13,842 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-08-21 18:53:13,842 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-08-21 18:53:13,843 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-08-21 18:53:13,843 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-08-21 18:53:13,843 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-08-21 18:53:13,843 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-08-21 18:53:13,843 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-08-21 18:53:13,843 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-08-21 18:53:13,843 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-08-21 18:53:13,843 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-08-21 18:53:13,843 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-08-21 18:53:13,844 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-08-21 18:53:13,844 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-08-21 18:53:13,844 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-08-21 18:53:13,844 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-08-21 18:53:13,844 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-08-21 18:53:13,844 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-08-21 18:53:13,844 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-08-21 18:53:13,844 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-08-21 18:53:13,844 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-08-21 18:53:13,844 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-08-21 18:53:13,844 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-08-21 18:53:13,845 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-08-21 18:53:13,845 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-08-21 18:53:13,845 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-08-21 18:53:13,845 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-08-21 18:53:13,845 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-08-21 18:53:13,845 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-08-21 18:53:13,845 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-08-21 18:53:13,845 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-08-21 18:53:13,846 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-08-21 18:53:13,846 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-08-21 18:53:13,846 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-08-21 18:53:13,846 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-08-21 18:53:13,846 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-08-21 18:53:13,846 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-08-21 18:53:13,847 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-08-21 18:53:13,847 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-08-21 18:53:13,847 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-08-21 18:53:13,847 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-08-21 18:53:13,847 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-08-21 18:53:13,847 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-08-21 18:53:13,847 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-08-21 18:53:13,847 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-08-21 18:53:13,848 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-08-21 18:53:13,848 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-08-21 18:53:13,848 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-08-21 18:53:13,848 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-08-21 18:53:13,848 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-08-21 18:53:13,848 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-08-21 18:53:13,848 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-08-21 18:53:13,849 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-08-21 18:53:13,849 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-08-21 18:53:13,849 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-08-21 18:53:13,849 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-08-21 18:53:13,849 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-08-21 18:53:13,849 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-08-21 18:53:13,849 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-08-21 18:53:13,849 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-08-21 18:53:13,849 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-08-21 18:53:13,850 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-08-21 18:53:13,850 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-08-21 18:53:13,850 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-08-21 18:53:13,850 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-08-21 18:53:13,850 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-08-21 18:53:13,850 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-08-21 18:53:13,850 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-08-21 18:53:13,850 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-08-21 18:53:13,851 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-08-21 18:53:13,851 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-08-21 18:53:13,851 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-08-21 18:53:13,851 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-08-21 18:53:13,851 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-08-21 18:53:13,851 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-08-21 18:53:13,851 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-08-21 18:53:13,852 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-08-21 18:53:13,852 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-08-21 18:53:13,852 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-08-21 18:53:13,852 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-08-21 18:53:13,852 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-08-21 18:53:13,852 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-08-21 18:53:13,852 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-08-21 18:53:13,853 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-08-21 18:53:13,853 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-08-21 18:53:13,853 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-08-21 18:53:13,853 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-08-21 18:53:13,853 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-08-21 18:53:13,853 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-08-21 18:53:13,853 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-08-21 18:53:13,854 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-08-21 18:53:13,854 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-08-21 18:53:13,854 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-08-21 18:53:13,854 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-08-21 18:53:13,854 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-08-21 18:53:13,854 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-08-21 18:53:13,855 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-08-21 18:53:14,029 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.06666666666666667, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-08-21 18:53:14,029 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-08-21 18:53:14,030 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.9909252140407105, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.06666666666666667, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-08-21 18:53:14,388 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 510 ms to try 5000 different iterations.  Found a solution that moves 4718 regions; Going from a computed imbalance of 0.9909252140407105 to a new imbalance of 0.17472976564378043. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.039260847436270924, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.054234805627144465, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.5242222222222223, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.039260847436270924, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.17, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.23566666666666666, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-08-21 18:53:14,407 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv190855489:81 , srv99959611:81 , srv1244391675:82 , srv1526587086:82 , srv1823371181:82 , srv1865198620:82 , srv1481964142:83 , srv1508097815:83 , srv1570510544:83 , srv871217895:83 , srv941924726:83 , srv1251118478:84 , srv3975115:84 , srv482599234:84 , srv55752631:84 , srv758106473:84 , srv897891833:84 , srv1385870678:85 , srv143255968:85 , srv1661112525:85 , srv1699626229:85 , srv1836788209:85 , srv1875998002:85 , srv195214594:85 , srv2093888680:85 , srv2133701535:85 , srv266901858:85 , srv362402651:85 , srv65359781:85 , srv914222960:85 , srv1229694972:86 , srv1265458679:86 , srv1271399833:86 , srv1320191333:86 , srv1339180680:86 , srv1519589697:86 , srv1618876487:86 , srv1668275296:86 , srv1723945296:86 , srv1785014548:86 , srv1852461600:86 , srv1861494551:86 , srv2132708885:86 , srv252956230:86 , srv422139457:86 , srv827328589:86 , srv827360475:86 , srv883838147:86 , srv91411790:86 , srv1020477570:87 , srv1091716508:87 , srv1116790797:87 , srv1254573551:87 , srv1274411289:87 , srv1372233510:87 , srv1423489566:87 , srv1501102677:87 , srv1511567321:87 , srv1594675884:87 , srv1626420418:87 , srv1677936966:87 , srv1693791375:87 , srv1869335163:87 , srv1900692876:87 , srv2106200230:87 , srv24178342:87 , srv359848388:87 , srv441909095:87 , srv612553940:87 , srv703290359:87 , srv720463518:87 , srv748353155:87 , srv937113111:87 , srv1095184065:88 , srv1157577231:88 , srv1162269062:88 , srv1948966056:88 , srv356585373:88 , srv672750381:88 , srv74620333:88 , srv76668779:88 , srv856104424:88 , srv934021764:88 , srv2038279815:89 , srv745239468:89 , srv768916246:89 , srv852763738:89 , srv949956336:89 , srv952774503:89 , srv1247849487:90 , srv1594731973:90 , srv2006393388:90 , srv821079934:90 , srv83740697:90 , srv962909979:90 , srv873594530:91 , srv266525240:93 , srv621301795:93 , srv1847054758:94 , srv710154038:439 }
2023-08-21 18:53:14,414 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-08-21 18:53:14,416 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv621301795=69, srv1847054758=40, srv1020477570=0, srv143255968=19, srv1162269062=5, srv1481964142=20, srv1372233510=16, srv1254573551=10, srv1251118478=9, srv710154038=73, srv1423489566=18, srv1875998002=45, srv1785014548=37, srv362402651=62, srv1274411289=13, srv1570510544=26, srv934021764=93, srv1900692876=46, srv55752631=67, srv190855489=47, srv1519589697=24, srv482599234=66, srv1823371181=38, srv962909979=98, srv703290359=72, srv914222960=92, srv1948966056=48, srv1861494551=42, srv1116790797=3, srv720463518=74, srv1320191333=14, srv1271399833=12, srv76668779=79, srv1594731973=28, srv2038279815=51, srv83740697=84, srv2006393388=50, srv65359781=70, srv873594530=88, srv1501102677=21, srv856104424=86, srv1661112525=31, srv1852461600=41, srv952774503=97, srv745239468=75, srv74620333=76, srv1091716508=1, srv1247849487=8, srv3975115=63, srv91411790=91, srv1699626229=35, srv359848388=61, srv1869335163=44, srv1265458679=11, srv1095184065=2, srv827328589=82, srv266901858=59, srv1244391675=7, srv827360475=83, srv2133701535=55, srv252956230=57, srv99959611=99, srv883838147=89, srv1594675884=27, srv1339180680=15, srv1526587086=25, srv422139457=64, srv1157577231=4, srv821079934=81, srv768916246=80, srv2132708885=54, srv1865198620=43, srv1693791375=34, srv1229694972=6, srv2106200230=53, srv758106473=78, srv1626420418=30, srv1836788209=39, srv1723945296=36, srv2093888680=52, srv748353155=77, srv937113111=94, srv195214594=49, srv441909095=65, srv1385870678=17, srv941924726=95, srv897891833=90, srv852763738=85, srv24178342=56, srv1508097815=22, srv266525240=58, srv949956336=96, srv871217895=87, srv612553940=68, srv1668275296=32, srv356585373=60, srv672750381=71, srv1618876487=29, srv1677936966=33, srv1511567321=23} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-08-21 18:53:14,451 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-08-21 18:53:14,451 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-08-21 18:53:14,451 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-08-21 18:53:14,451 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-08-21 18:53:14,451 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-08-21 18:53:14,452 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-08-21 18:53:14,452 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-08-21 18:53:14,452 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-08-21 18:53:14,452 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-08-21 18:53:14,452 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-08-21 18:53:14,452 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-08-21 18:53:14,452 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-08-21 18:53:14,453 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-08-21 18:53:14,453 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-08-21 18:53:14,453 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-08-21 18:53:14,453 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-08-21 18:53:14,453 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-08-21 18:53:14,453 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-08-21 18:53:14,453 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-08-21 18:53:14,453 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-08-21 18:53:14,454 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-08-21 18:53:14,454 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-08-21 18:53:14,454 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-08-21 18:53:14,454 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-08-21 18:53:14,454 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-08-21 18:53:14,454 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-08-21 18:53:14,454 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-08-21 18:53:14,454 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-08-21 18:53:14,455 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-08-21 18:53:14,455 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-08-21 18:53:14,455 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-08-21 18:53:14,455 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-08-21 18:53:14,455 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-08-21 18:53:14,455 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-08-21 18:53:14,455 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-08-21 18:53:14,455 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-08-21 18:53:14,456 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-08-21 18:53:14,456 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-08-21 18:53:14,456 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-08-21 18:53:14,456 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-08-21 18:53:14,456 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-08-21 18:53:14,456 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-08-21 18:53:14,456 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-08-21 18:53:14,456 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-08-21 18:53:14,456 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-08-21 18:53:14,457 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-08-21 18:53:14,457 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-08-21 18:53:14,457 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-08-21 18:53:14,457 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-08-21 18:53:14,457 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-08-21 18:53:14,457 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-08-21 18:53:14,457 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-08-21 18:53:14,457 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-08-21 18:53:14,458 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-08-21 18:53:14,458 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-08-21 18:53:14,458 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-08-21 18:53:14,458 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-08-21 18:53:14,458 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-08-21 18:53:14,458 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-08-21 18:53:14,458 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-08-21 18:53:14,458 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-08-21 18:53:14,459 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-08-21 18:53:14,459 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-08-21 18:53:14,459 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-08-21 18:53:14,459 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-08-21 18:53:14,459 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-08-21 18:53:14,459 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-08-21 18:53:14,459 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-08-21 18:53:14,459 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-08-21 18:53:14,460 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-08-21 18:53:14,460 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-08-21 18:53:14,460 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-08-21 18:53:14,460 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-08-21 18:53:14,460 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-08-21 18:53:14,460 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-08-21 18:53:14,460 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-08-21 18:53:14,460 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-08-21 18:53:14,460 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-08-21 18:53:14,461 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-08-21 18:53:14,461 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-08-21 18:53:14,461 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-08-21 18:53:14,461 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-08-21 18:53:14,461 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-08-21 18:53:14,461 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-08-21 18:53:14,461 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-08-21 18:53:14,461 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-08-21 18:53:14,461 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-08-21 18:53:14,462 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-08-21 18:53:14,462 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-08-21 18:53:14,462 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-08-21 18:53:14,462 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-08-21 18:53:14,462 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-08-21 18:53:14,462 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-08-21 18:53:14,462 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-08-21 18:53:14,462 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-08-21 18:53:14,462 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-08-21 18:53:14,463 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-08-21 18:53:14,463 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-08-21 18:53:14,463 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-08-21 18:53:14,463 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-08-21 18:53:14,463 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-08-21 18:53:14,620 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.039260847436270924, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.054234805627144465, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.039260847436270924, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.17, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.23566666666666666, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-08-21 18:53:14,620 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-08-21 18:53:14,620 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.17469672950168483, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.039260847436270924, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.054234805627144465, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.039260847436270924, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.17, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.23566666666666666, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-08-21 18:53:14,931 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 442 ms to try 5000 different iterations.  Found a solution that moves 2652 regions; Going from a computed imbalance of 0.17469672950168483 to a new imbalance of 0.013301831513025074. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.02351142553238549); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.03243918595825301, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.2946666666666667, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.02351142553238549); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.009916666666666667); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0455, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-08-21 18:53:14,946 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1847054758:77 , srv621301795:79 , srv1247849487:80 , srv1594731973:81 , srv2006393388:81 , srv768916246:81 , srv83740697:81 , srv266525240:82 , srv356585373:82 , srv748353155:82 , srv873594530:82 , srv952774503:82 , srv1162269062:83 , srv1501102677:83 , srv65359781:83 , srv672750381:83 , srv703290359:83 , srv745239468:83 , srv76668779:83 , srv962909979:83 , srv1095184065:84 , srv1116790797:84 , srv1229694972:84 , srv1254573551:84 , srv1265458679:84 , srv1423489566:84 , srv1511567321:84 , srv1723945296:84 , srv1869335163:84 , srv2038279815:84 , srv2106200230:84 , srv441909095:84 , srv612553940:84 , srv821079934:84 , srv827360475:84 , srv949956336:84 , srv1091716508:85 , srv1271399833:85 , srv1274411289:85 , srv1320191333:85 , srv1372233510:85 , srv1618876487:85 , srv1626420418:85 , srv1661112525:85 , srv1668275296:85 , srv1900692876:85 , srv2132708885:85 , srv24178342:85 , srv252956230:85 , srv720463518:85 , srv74620333:85 , srv827328589:85 , srv852763738:85 , srv856104424:85 , srv883838147:85 , srv91411790:85 , srv1020477570:86 , srv1339180680:86 , srv1519589697:86 , srv1594675884:86 , srv1693791375:86 , srv1785014548:86 , srv1836788209:86 , srv1861494551:86 , srv1875998002:86 , srv1948966056:86 , srv2093888680:86 , srv359848388:86 , srv3975115:86 , srv934021764:86 , srv1157577231:87 , srv1251118478:87 , srv1570510544:87 , srv1677936966:87 , srv1852461600:87 , srv195214594:87 , srv2133701535:87 , srv266901858:87 , srv422139457:87 , srv758106473:87 , srv897891833:87 , srv1385870678:88 , srv55752631:88 , srv937113111:88 , srv143255968:89 , srv1481964142:89 , srv362402651:89 , srv482599234:89 , srv871217895:89 , srv914222960:89 , srv1508097815:90 , srv1526587086:90 , srv1699626229:90 , srv99959611:90 , srv1865198620:91 , srv1244391675:92 , srv1823371181:92 , srv190855489:92 , srv941924726:92 , srv710154038:544 }
2023-08-21 18:53:14,952 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-08-21 18:53:14,953 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv621301795=69, srv1847054758=40, srv1020477570=0, srv143255968=19, srv1162269062=5, srv1481964142=20, srv1372233510=16, srv1254573551=10, srv1251118478=9, srv710154038=73, srv1423489566=18, srv1875998002=45, srv1785014548=37, srv362402651=62, srv1274411289=13, srv1570510544=26, srv934021764=93, srv1900692876=46, srv55752631=67, srv190855489=47, srv1519589697=24, srv482599234=66, srv1823371181=38, srv962909979=98, srv703290359=72, srv914222960=92, srv1948966056=48, srv1861494551=42, srv1116790797=3, srv720463518=74, srv1320191333=14, srv1271399833=12, srv76668779=79, srv1594731973=28, srv2038279815=51, srv83740697=84, srv2006393388=50, srv65359781=70, srv873594530=88, srv1501102677=21, srv856104424=86, srv1661112525=31, srv1852461600=41, srv952774503=97, srv745239468=75, srv74620333=76, srv1091716508=1, srv1247849487=8, srv3975115=63, srv91411790=91, srv1699626229=35, srv359848388=61, srv1869335163=44, srv1265458679=11, srv1095184065=2, srv827328589=82, srv266901858=59, srv1244391675=7, srv827360475=83, srv2133701535=55, srv252956230=57, srv99959611=99, srv883838147=89, srv1594675884=27, srv1339180680=15, srv1526587086=25, srv422139457=64, srv1157577231=4, srv821079934=81, srv768916246=80, srv2132708885=54, srv1865198620=43, srv1693791375=34, srv1229694972=6, srv2106200230=53, srv758106473=78, srv1626420418=30, srv1836788209=39, srv1723945296=36, srv2093888680=52, srv748353155=77, srv937113111=94, srv195214594=49, srv441909095=65, srv1385870678=17, srv941924726=95, srv897891833=90, srv852763738=85, srv24178342=56, srv1508097815=22, srv266525240=58, srv949956336=96, srv871217895=87, srv612553940=68, srv1668275296=32, srv356585373=60, srv672750381=71, srv1618876487=29, srv1677936966=33, srv1511567321=23} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-08-21 18:53:14,975 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-08-21 18:53:14,976 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-08-21 18:53:14,976 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-08-21 18:53:14,976 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-08-21 18:53:14,976 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-08-21 18:53:14,976 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-08-21 18:53:14,976 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-08-21 18:53:14,976 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-08-21 18:53:14,976 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-08-21 18:53:14,976 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-08-21 18:53:14,976 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-08-21 18:53:14,977 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-08-21 18:53:14,977 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-08-21 18:53:14,977 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-08-21 18:53:14,977 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-08-21 18:53:14,977 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-08-21 18:53:14,977 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-08-21 18:53:14,977 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-08-21 18:53:14,977 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-08-21 18:53:14,977 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-08-21 18:53:14,977 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-08-21 18:53:14,978 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-08-21 18:53:14,978 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-08-21 18:53:14,978 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-08-21 18:53:14,978 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-08-21 18:53:14,978 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-08-21 18:53:14,978 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-08-21 18:53:14,978 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-08-21 18:53:14,978 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-08-21 18:53:14,978 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-08-21 18:53:14,978 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-08-21 18:53:14,978 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-08-21 18:53:14,979 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-08-21 18:53:14,979 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-08-21 18:53:14,979 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-08-21 18:53:14,979 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-08-21 18:53:14,979 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-08-21 18:53:14,979 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-08-21 18:53:14,979 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-08-21 18:53:14,979 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-08-21 18:53:14,979 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-08-21 18:53:14,979 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-08-21 18:53:14,979 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-08-21 18:53:14,980 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-08-21 18:53:14,980 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-08-21 18:53:14,980 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-08-21 18:53:14,980 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-08-21 18:53:14,980 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-08-21 18:53:14,980 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-08-21 18:53:14,980 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-08-21 18:53:14,980 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-08-21 18:53:14,980 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-08-21 18:53:14,980 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-08-21 18:53:14,980 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-08-21 18:53:14,980 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-08-21 18:53:14,981 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-08-21 18:53:14,981 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-08-21 18:53:14,981 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-08-21 18:53:14,981 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-08-21 18:53:14,981 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-08-21 18:53:14,981 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-08-21 18:53:14,981 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-08-21 18:53:14,981 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-08-21 18:53:14,981 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-08-21 18:53:14,981 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-08-21 18:53:14,981 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-08-21 18:53:14,982 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-08-21 18:53:14,982 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-08-21 18:53:14,982 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-08-21 18:53:14,982 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-08-21 18:53:14,982 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-08-21 18:53:14,982 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-08-21 18:53:14,982 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-08-21 18:53:14,982 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-08-21 18:53:14,982 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-08-21 18:53:14,982 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-08-21 18:53:14,982 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-08-21 18:53:14,983 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-08-21 18:53:14,983 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-08-21 18:53:14,983 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-08-21 18:53:14,983 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-08-21 18:53:14,983 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-08-21 18:53:14,983 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-08-21 18:53:14,983 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-08-21 18:53:14,983 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-08-21 18:53:14,983 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-08-21 18:53:14,983 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-08-21 18:53:14,983 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-08-21 18:53:14,984 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-08-21 18:53:14,984 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-08-21 18:53:14,984 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-08-21 18:53:14,984 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-08-21 18:53:14,984 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-08-21 18:53:14,984 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-08-21 18:53:14,984 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-08-21 18:53:14,984 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-08-21 18:53:14,984 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-08-21 18:53:14,984 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-08-21 18:53:14,984 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-08-21 18:53:14,985 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-08-21 18:53:14,985 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-08-21 18:53:15,142 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.02351142553238549); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.03243918595825301, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.02351142553238549); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.009916666666666667); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0455, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-08-21 18:53:15,142 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-08-21 18:53:15,143 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.013283261812126896, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.02351142553238549); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.03243918595825301, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.02351142553238549); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.009916666666666667); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0455, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-08-21 18:53:15,477 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 466 ms to try 5000 different iterations.  Found a solution that moves 1010 regions; Going from a computed imbalance of 0.013283261812126896 to a new imbalance of 4.84445745070218E-4. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.006993485647474662); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.008567419296420211); MoveCostFunction : (multiplier=7.0, imbalance=0.11222222222222222, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.006993485647474662); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=8.333333333333333E-5); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0036666666666666666); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-08-21 18:53:15,480 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv937113111:81 , srv1157577231:82 , srv1244391675:83 , srv1677936966:83 , srv1699626229:83 , srv1823371181:83 , srv266525240:83 , srv362402651:83 , srv821079934:83 , srv852763738:83 , srv934021764:83 , srv1385870678:84 , srv1508097815:84 , srv1594675884:84 , srv1693791375:84 , srv1852461600:84 , srv1865198620:84 , srv1948966056:84 , srv24178342:84 , srv359848388:84 , srv422139457:84 , srv482599234:84 , srv856104424:84 , srv914222960:84 , srv941924726:84 , srv962909979:84 , srv1020477570:85 , srv1091716508:85 , srv1274411289:85 , srv1339180680:85 , srv143255968:85 , srv1481964142:85 , srv1519589697:85 , srv1526587086:85 , srv1785014548:85 , srv1861494551:85 , srv1869335163:85 , srv190855489:85 , srv195214594:85 , srv2038279815:85 , srv266901858:85 , srv55752631:85 , srv720463518:85 , srv745239468:85 , srv74620333:85 , srv873594530:85 , srv949956336:85 , srv1095184065:86 , srv1116790797:86 , srv1247849487:86 , srv1251118478:86 , srv1271399833:86 , srv1320191333:86 , srv1618876487:86 , srv1626420418:86 , srv1668275296:86 , srv1847054758:86 , srv1875998002:86 , srv1900692876:86 , srv2006393388:86 , srv2106200230:86 , srv2132708885:86 , srv2133701535:86 , srv441909095:86 , srv612553940:86 , srv621301795:86 , srv758106473:86 , srv827328589:86 , srv871217895:86 , srv897891833:86 , srv99959611:86 , srv1162269062:87 , srv1229694972:87 , srv1254573551:87 , srv1265458679:87 , srv1372233510:87 , srv1423489566:87 , srv1501102677:87 , srv1511567321:87 , srv1570510544:87 , srv1594731973:87 , srv1661112525:87 , srv2093888680:87 , srv252956230:87 , srv356585373:87 , srv672750381:87 , srv703290359:87 , srv76668779:87 , srv768916246:87 , srv83740697:87 , srv883838147:87 , srv91411790:87 , srv952774503:87 , srv1723945296:88 , srv1836788209:88 , srv3975115:88 , srv748353155:88 , srv827360475:88 , srv65359781:90 , srv710154038:537 }
2023-08-21 18:53:15,486 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-08-21 18:53:15,487 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv621301795=69, srv1847054758=40, srv1020477570=0, srv143255968=19, srv1162269062=5, srv1481964142=20, srv1372233510=16, srv1254573551=10, srv1251118478=9, srv710154038=73, srv1423489566=18, srv1875998002=45, srv1785014548=37, srv362402651=62, srv1274411289=13, srv1570510544=26, srv934021764=93, srv1900692876=46, srv55752631=67, srv190855489=47, srv1519589697=24, srv482599234=66, srv1823371181=38, srv962909979=98, srv703290359=72, srv914222960=92, srv1948966056=48, srv1861494551=42, srv1116790797=3, srv720463518=74, srv1320191333=14, srv1271399833=12, srv76668779=79, srv1594731973=28, srv2038279815=51, srv83740697=84, srv2006393388=50, srv65359781=70, srv873594530=88, srv1501102677=21, srv856104424=86, srv1661112525=31, srv1852461600=41, srv952774503=97, srv745239468=75, srv74620333=76, srv1091716508=1, srv1247849487=8, srv3975115=63, srv91411790=91, srv1699626229=35, srv359848388=61, srv1869335163=44, srv1265458679=11, srv1095184065=2, srv827328589=82, srv266901858=59, srv1244391675=7, srv827360475=83, srv2133701535=55, srv252956230=57, srv99959611=99, srv883838147=89, srv1594675884=27, srv1339180680=15, srv1526587086=25, srv422139457=64, srv1157577231=4, srv821079934=81, srv768916246=80, srv2132708885=54, srv1865198620=43, srv1693791375=34, srv1229694972=6, srv2106200230=53, srv758106473=78, srv1626420418=30, srv1836788209=39, srv1723945296=36, srv2093888680=52, srv748353155=77, srv937113111=94, srv195214594=49, srv441909095=65, srv1385870678=17, srv941924726=95, srv897891833=90, srv852763738=85, srv24178342=56, srv1508097815=22, srv266525240=58, srv949956336=96, srv871217895=87, srv612553940=68, srv1668275296=32, srv356585373=60, srv672750381=71, srv1618876487=29, srv1677936966=33, srv1511567321=23} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-08-21 18:53:15,504 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-08-21 18:53:15,504 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-08-21 18:53:15,504 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-08-21 18:53:15,504 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-08-21 18:53:15,504 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-08-21 18:53:15,504 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-08-21 18:53:15,504 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-08-21 18:53:15,504 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-08-21 18:53:15,504 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-08-21 18:53:15,504 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-08-21 18:53:15,505 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-08-21 18:53:15,505 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-08-21 18:53:15,505 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-08-21 18:53:15,505 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-08-21 18:53:15,505 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-08-21 18:53:15,505 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-08-21 18:53:15,505 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-08-21 18:53:15,505 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-08-21 18:53:15,505 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-08-21 18:53:15,505 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-08-21 18:53:15,505 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-08-21 18:53:15,505 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-08-21 18:53:15,505 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-08-21 18:53:15,505 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-08-21 18:53:15,506 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-08-21 18:53:15,506 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-08-21 18:53:15,506 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-08-21 18:53:15,506 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-08-21 18:53:15,506 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-08-21 18:53:15,506 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-08-21 18:53:15,506 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-08-21 18:53:15,506 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-08-21 18:53:15,506 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-08-21 18:53:15,506 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-08-21 18:53:15,506 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-08-21 18:53:15,506 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-08-21 18:53:15,506 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-08-21 18:53:15,506 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-08-21 18:53:15,506 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-08-21 18:53:15,507 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-08-21 18:53:15,507 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-08-21 18:53:15,507 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-08-21 18:53:15,507 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-08-21 18:53:15,507 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-08-21 18:53:15,507 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-08-21 18:53:15,507 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-08-21 18:53:15,507 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-08-21 18:53:15,507 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-08-21 18:53:15,507 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-08-21 18:53:15,507 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-08-21 18:53:15,507 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-08-21 18:53:15,507 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-08-21 18:53:15,507 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-08-21 18:53:15,508 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-08-21 18:53:15,508 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-08-21 18:53:15,508 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-08-21 18:53:15,508 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-08-21 18:53:15,508 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-08-21 18:53:15,508 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-08-21 18:53:15,508 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-08-21 18:53:15,508 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-08-21 18:53:15,508 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-08-21 18:53:15,508 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-08-21 18:53:15,508 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-08-21 18:53:15,508 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-08-21 18:53:15,508 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-08-21 18:53:15,508 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-08-21 18:53:15,508 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-08-21 18:53:15,509 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-08-21 18:53:15,509 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-08-21 18:53:15,509 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-08-21 18:53:15,509 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-08-21 18:53:15,509 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-08-21 18:53:15,509 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-08-21 18:53:15,509 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-08-21 18:53:15,509 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-08-21 18:53:15,509 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-08-21 18:53:15,509 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-08-21 18:53:15,509 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-08-21 18:53:15,509 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-08-21 18:53:15,509 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-08-21 18:53:15,509 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-08-21 18:53:15,509 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-08-21 18:53:15,509 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-08-21 18:53:15,509 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-08-21 18:53:15,510 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-08-21 18:53:15,510 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-08-21 18:53:15,510 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-08-21 18:53:15,510 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-08-21 18:53:15,510 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-08-21 18:53:15,510 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-08-21 18:53:15,510 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-08-21 18:53:15,510 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-08-21 18:53:15,510 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-08-21 18:53:15,510 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-08-21 18:53:15,510 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-08-21 18:53:15,510 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-08-21 18:53:15,510 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-08-21 18:53:15,510 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-08-21 18:53:15,510 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-08-21 18:53:15,511 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-08-21 18:53:15,628 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.006993485647474662); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.008567419296420211); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.006993485647474662); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=8.333333333333333E-5); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0036666666666666666); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-08-21 18:53:15,628 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-08-21 18:53:15,628 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=4.7737357391367294E-4, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.006993485647474662); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.008567419296420211); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.006993485647474662); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=8.333333333333333E-5); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0036666666666666666); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-08-21 18:53:15,909 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 385 ms to try 5000 different iterations.  Found a solution that moves 244 regions; Going from a computed imbalance of 4.7737357391367294E-4 to a new imbalance of 2.1139578631038604E-5. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=3.5313429231318235E-4); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0022721660362024225); MoveCostFunction : (multiplier=7.0, imbalance=0.02711111111111111, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=3.5313429231318235E-4); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=8.333333333333333E-5); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-08-21 18:53:15,910 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1372233510:83 , srv143255968:83 , srv1836788209:83 , srv252956230:83 , srv1020477570:84 , srv1095184065:84 , srv1162269062:84 , srv1254573551:84 , srv1385870678:84 , srv1423489566:84 , srv1511567321:84 , srv1594731973:84 , srv1618876487:84 , srv1626420418:84 , srv1699626229:84 , srv1785014548:84 , srv1900692876:84 , srv190855489:84 , srv1948966056:84 , srv2038279815:84 , srv2093888680:84 , srv2133701535:84 , srv266525240:84 , srv621301795:84 , srv65359781:84 , srv672750381:84 , srv74620333:84 , srv76668779:84 , srv827360475:84 , srv83740697:84 , srv871217895:84 , srv873594530:84 , srv883838147:84 , srv91411790:84 , srv914222960:84 , srv941924726:84 , srv949956336:84 , srv952774503:84 , srv962909979:84 , srv1091716508:85 , srv1116790797:85 , srv1157577231:85 , srv1229694972:85 , srv1244391675:85 , srv1251118478:85 , srv1265458679:85 , srv1271399833:85 , srv1274411289:85 , srv1320191333:85 , srv1339180680:85 , srv1481964142:85 , srv1501102677:85 , srv1508097815:85 , srv1519589697:85 , srv1526587086:85 , srv1570510544:85 , srv1594675884:85 , srv1661112525:85 , srv1668275296:85 , srv1677936966:85 , srv1693791375:85 , srv1723945296:85 , srv1823371181:85 , srv1847054758:85 , srv1852461600:85 , srv1861494551:85 , srv1865198620:85 , srv1875998002:85 , srv195214594:85 , srv2106200230:85 , srv2132708885:85 , srv266901858:85 , srv356585373:85 , srv359848388:85 , srv362402651:85 , srv3975115:85 , srv422139457:85 , srv441909095:85 , srv482599234:85 , srv55752631:85 , srv612553940:85 , srv703290359:85 , srv720463518:85 , srv745239468:85 , srv748353155:85 , srv758106473:85 , srv768916246:85 , srv821079934:85 , srv827328589:85 , srv852763738:85 , srv856104424:85 , srv897891833:85 , srv934021764:85 , srv99959611:85 , srv1247849487:86 , srv1869335163:86 , srv2006393388:86 , srv24178342:86 , srv937113111:86 , srv710154038:623 }
2023-08-21 18:53:15,915 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-08-21 18:53:15,916 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv621301795=69, srv1847054758=40, srv1020477570=0, srv143255968=19, srv1162269062=5, srv1481964142=20, srv1372233510=16, srv1254573551=10, srv1251118478=9, srv710154038=73, srv1423489566=18, srv1875998002=45, srv1785014548=37, srv362402651=62, srv1274411289=13, srv1570510544=26, srv934021764=93, srv1900692876=46, srv55752631=67, srv190855489=47, srv1519589697=24, srv482599234=66, srv1823371181=38, srv962909979=98, srv703290359=72, srv914222960=92, srv1948966056=48, srv1861494551=42, srv1116790797=3, srv720463518=74, srv1320191333=14, srv1271399833=12, srv76668779=79, srv1594731973=28, srv2038279815=51, srv83740697=84, srv2006393388=50, srv65359781=70, srv873594530=88, srv1501102677=21, srv856104424=86, srv1661112525=31, srv1852461600=41, srv952774503=97, srv745239468=75, srv74620333=76, srv1091716508=1, srv1247849487=8, srv3975115=63, srv91411790=91, srv1699626229=35, srv359848388=61, srv1869335163=44, srv1265458679=11, srv1095184065=2, srv827328589=82, srv266901858=59, srv1244391675=7, srv827360475=83, srv2133701535=55, srv252956230=57, srv99959611=99, srv883838147=89, srv1594675884=27, srv1339180680=15, srv1526587086=25, srv422139457=64, srv1157577231=4, srv821079934=81, srv768916246=80, srv2132708885=54, srv1865198620=43, srv1693791375=34, srv1229694972=6, srv2106200230=53, srv758106473=78, srv1626420418=30, srv1836788209=39, srv1723945296=36, srv2093888680=52, srv748353155=77, srv937113111=94, srv195214594=49, srv441909095=65, srv1385870678=17, srv941924726=95, srv897891833=90, srv852763738=85, srv24178342=56, srv1508097815=22, srv266525240=58, srv949956336=96, srv871217895=87, srv612553940=68, srv1668275296=32, srv356585373=60, srv672750381=71, srv1618876487=29, srv1677936966=33, srv1511567321=23} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-08-21 18:53:15,929 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-08-21 18:53:15,930 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-08-21 18:53:15,930 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-08-21 18:53:15,930 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-08-21 18:53:15,930 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-08-21 18:53:15,930 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-08-21 18:53:15,930 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-08-21 18:53:15,930 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-08-21 18:53:15,930 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-08-21 18:53:15,930 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-08-21 18:53:15,930 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-08-21 18:53:15,930 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-08-21 18:53:15,930 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-08-21 18:53:15,930 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-08-21 18:53:15,930 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-08-21 18:53:15,930 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-08-21 18:53:15,930 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-08-21 18:53:15,930 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-08-21 18:53:15,930 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-08-21 18:53:15,931 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-08-21 18:53:15,931 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-08-21 18:53:15,931 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-08-21 18:53:15,931 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-08-21 18:53:15,931 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-08-21 18:53:15,931 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-08-21 18:53:15,931 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-08-21 18:53:15,931 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-08-21 18:53:15,931 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-08-21 18:53:15,931 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-08-21 18:53:15,931 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-08-21 18:53:15,931 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-08-21 18:53:15,931 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-08-21 18:53:15,931 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-08-21 18:53:15,931 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-08-21 18:53:15,931 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-08-21 18:53:15,931 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-08-21 18:53:15,931 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-08-21 18:53:15,931 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-08-21 18:53:15,931 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-08-21 18:53:15,932 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-08-21 18:53:15,932 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-08-21 18:53:15,932 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-08-21 18:53:15,932 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-08-21 18:53:15,932 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-08-21 18:53:15,932 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-08-21 18:53:15,932 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-08-21 18:53:15,932 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-08-21 18:53:15,932 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-08-21 18:53:15,932 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-08-21 18:53:15,932 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-08-21 18:53:15,932 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-08-21 18:53:15,932 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-08-21 18:53:15,932 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-08-21 18:53:15,932 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-08-21 18:53:15,932 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-08-21 18:53:15,932 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-08-21 18:53:15,932 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-08-21 18:53:15,932 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-08-21 18:53:15,933 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-08-21 18:53:15,933 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-08-21 18:53:15,933 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-08-21 18:53:15,933 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-08-21 18:53:15,933 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-08-21 18:53:15,933 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-08-21 18:53:15,933 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-08-21 18:53:15,933 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-08-21 18:53:15,933 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-08-21 18:53:15,933 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-08-21 18:53:15,933 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-08-21 18:53:15,933 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-08-21 18:53:15,933 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-08-21 18:53:15,933 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-08-21 18:53:15,933 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-08-21 18:53:15,934 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-08-21 18:53:15,934 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-08-21 18:53:15,934 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-08-21 18:53:15,934 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-08-21 18:53:15,934 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-08-21 18:53:15,934 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-08-21 18:53:15,934 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-08-21 18:53:15,934 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-08-21 18:53:15,934 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-08-21 18:53:15,934 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-08-21 18:53:15,934 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-08-21 18:53:15,934 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-08-21 18:53:15,934 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-08-21 18:53:15,934 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-08-21 18:53:15,934 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-08-21 18:53:15,934 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-08-21 18:53:15,934 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-08-21 18:53:15,934 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-08-21 18:53:15,934 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-08-21 18:53:15,934 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-08-21 18:53:15,935 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-08-21 18:53:15,935 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-08-21 18:53:15,935 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-08-21 18:53:15,935 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-08-21 18:53:15,935 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-08-21 18:53:15,935 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-08-21 18:53:15,935 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-08-21 18:53:15,935 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-08-21 18:53:16,075 INFO  [Time-limited test] balancer.StochasticLoadBalancer(381): Cluster wide - skipping load balancing because weighted average imbalance=1.9431054114011873E-5 <= threshold(0.025). If you want more aggressive balancing, either lower hbase.master.balancer.stochastic.minCostNeedBalance from 0.025 or increase the relative multiplier(s) of the specific cost function(s). functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=3.5313429231318235E-4); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0022721660362024225); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=3.5313429231318235E-4); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=8.333333333333333E-5); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-08-21 18:53:16,076 INFO  [Time-limited test] balancer.BalancerTestBase(570): Mock Final balance: { srv1372233510:83 , srv143255968:83 , srv1836788209:83 , srv252956230:83 , srv1020477570:84 , srv1095184065:84 , srv1162269062:84 , srv1254573551:84 , srv1385870678:84 , srv1423489566:84 , srv1511567321:84 , srv1594731973:84 , srv1618876487:84 , srv1626420418:84 , srv1699626229:84 , srv1785014548:84 , srv1900692876:84 , srv190855489:84 , srv1948966056:84 , srv2038279815:84 , srv2093888680:84 , srv2133701535:84 , srv266525240:84 , srv621301795:84 , srv65359781:84 , srv672750381:84 , srv74620333:84 , srv76668779:84 , srv827360475:84 , srv83740697:84 , srv871217895:84 , srv873594530:84 , srv883838147:84 , srv91411790:84 , srv914222960:84 , srv941924726:84 , srv949956336:84 , srv952774503:84 , srv962909979:84 , srv1091716508:85 , srv1116790797:85 , srv1157577231:85 , srv1229694972:85 , srv1244391675:85 , srv1251118478:85 , srv1265458679:85 , srv1271399833:85 , srv1274411289:85 , srv1320191333:85 , srv1339180680:85 , srv1481964142:85 , srv1501102677:85 , srv1508097815:85 , srv1519589697:85 , srv1526587086:85 , srv1570510544:85 , srv1594675884:85 , srv1661112525:85 , srv1668275296:85 , srv1677936966:85 , srv1693791375:85 , srv1723945296:85 , srv1823371181:85 , srv1847054758:85 , srv1852461600:85 , srv1861494551:85 , srv1865198620:85 , srv1875998002:85 , srv195214594:85 , srv2106200230:85 , srv2132708885:85 , srv266901858:85 , srv356585373:85 , srv359848388:85 , srv362402651:85 , srv3975115:85 , srv422139457:85 , srv441909095:85 , srv482599234:85 , srv55752631:85 , srv612553940:85 , srv703290359:85 , srv720463518:85 , srv745239468:85 , srv748353155:85 , srv758106473:85 , srv768916246:85 , srv821079934:85 , srv827328589:85 , srv852763738:85 , srv856104424:85 , srv897891833:85 , srv934021764:85 , srv99959611:85 , srv1247849487:86 , srv1869335163:86 , srv2006393388:86 , srv24178342:86 , srv937113111:86 , srv710154038:623 }
2023-08-21 18:53:16,106 INFO  [Time-limited test] hbase.ResourceChecker(175): after: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnLargeClusterWithRacks Thread=12 (was 12), OpenFileDescriptor=263 (was 263), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=229 (was 222) - SystemLoadAverage LEAK? -, ProcessCount=171 (was 171), AvailableMemoryMB=10277 (was 11058)
2023-08-21 18:53:16,114 INFO  [Time-limited test] hbase.ResourceChecker(147): before: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnMidClusterWithRacks Thread=12, OpenFileDescriptor=263, MaxFileDescriptor=60000, SystemLoadAverage=229, ProcessCount=171, AvailableMemoryMB=10275
2023-08-21 18:53:16,115 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2023-08-21 18:53:16,115 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=5000, runMaxSteps=true, stepsPerRegion=800, maxRunningTime=120000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 111077.0 etc.
2023-08-21 18:53:16,128 INFO  [Time-limited test] balancer.BalancerTestBase(547): Mock Cluster : { srv1120203893:84 , srv1149164427:84 , srv1265137828:84 , srv1299882977:84 , srv1325009334:84 , srv1377213076:84 , srv1394497618:84 , srv1456791295:84 , srv1539520544:84 , srv1547534141:84 , srv1584683544:84 , srv1658551910:84 , srv1684046811:84 , srv1685885646:84 , srv1750243235:84 , srv1827732581:84 , srv1878899050:84 , srv1886394530:84 , srv271175469:84 , srv424120933:84 , srv467731219:84 , srv479030595:84 , srv541901353:84 , srv547024971:84 , srv657148466:84 , srv807744509:84 , srv939488861:84 , srv948298330:84 , srv953024634:84 , srv1729678536:264 } [srvr=30 rgns=2700 avg=90.0 max=90 min=90]
2023-08-21 18:53:16,130 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-08-21 18:53:16,130 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1456791295=7, srv1878899050=17, srv939488861=27, srv1325009334=4, srv541901353=23, srv1394497618=6, srv1584683544=10, srv1750243235=15, srv1547534141=9, srv953024634=29, srv547024971=24, srv1265137828=2, srv1886394530=18, srv467731219=21, srv1827732581=16, srv948298330=28, srv1539520544=8, srv1658551910=11, srv1120203893=0, srv1729678536=14, srv1299882977=3, srv424120933=20, srv271175469=19, srv1377213076=5, srv479030595=22, srv1685885646=13, srv657148466=25, srv807744509=26, srv1684046811=12, srv1149164427=1} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-08-21 18:53:16,141 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-08-21 18:53:16,142 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-08-21 18:53:16,142 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-08-21 18:53:16,142 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-08-21 18:53:16,142 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-08-21 18:53:16,142 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-08-21 18:53:16,142 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-08-21 18:53:16,142 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-08-21 18:53:16,142 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-08-21 18:53:16,142 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-08-21 18:53:16,142 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-08-21 18:53:16,142 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-08-21 18:53:16,142 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-08-21 18:53:16,142 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-08-21 18:53:16,142 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-08-21 18:53:16,142 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-08-21 18:53:16,142 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-08-21 18:53:16,142 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-08-21 18:53:16,143 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-08-21 18:53:16,143 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-08-21 18:53:16,143 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-08-21 18:53:16,143 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-08-21 18:53:16,143 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-08-21 18:53:16,143 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-08-21 18:53:16,143 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-08-21 18:53:16,143 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-08-21 18:53:16,143 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-08-21 18:53:16,143 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-08-21 18:53:16,143 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-08-21 18:53:16,143 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-08-21 18:53:16,143 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=10, number of hosts=30, number of racks=4
2023-08-21 18:53:16,173 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=1.0759198835960906, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-08-21 18:53:16,173 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.991243226433848, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=1.0759198835960906, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=64800000
2023-08-21 18:55:16,148 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 120001 ms to try 6249240 different iterations.  Found a solution that moves 1849 regions; Going from a computed imbalance of 0.991243226433848 to a new imbalance of 4.3156582404131396E-5. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); MoveCostFunction : (multiplier=7.0, imbalance=0.6848148148148148, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-08-21 18:55:16,153 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1120203893:90 , srv1149164427:90 , srv1265137828:90 , srv1299882977:90 , srv1325009334:90 , srv1377213076:90 , srv1394497618:90 , srv1456791295:90 , srv1539520544:90 , srv1547534141:90 , srv1584683544:90 , srv1658551910:90 , srv1684046811:90 , srv1685885646:90 , srv1729678536:90 , srv1750243235:90 , srv1827732581:90 , srv1878899050:90 , srv1886394530:90 , srv271175469:90 , srv424120933:90 , srv467731219:90 , srv479030595:90 , srv541901353:90 , srv547024971:90 , srv657148466:90 , srv807744509:90 , srv939488861:90 , srv948298330:90 , srv953024634:90 }
2023-08-21 18:55:16,154 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-08-21 18:55:16,155 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1456791295=7, srv1878899050=17, srv939488861=27, srv1325009334=4, srv541901353=23, srv1394497618=6, srv1584683544=10, srv1750243235=15, srv1547534141=9, srv953024634=29, srv547024971=24, srv1265137828=2, srv1886394530=18, srv467731219=21, srv1827732581=16, srv948298330=28, srv1539520544=8, srv1658551910=11, srv1120203893=0, srv1729678536=14, srv1299882977=3, srv424120933=20, srv271175469=19, srv1377213076=5, srv479030595=22, srv1685885646=13, srv657148466=25, srv807744509=26, srv1684046811=12, srv1149164427=1} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-08-21 18:55:16,158 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-08-21 18:55:16,158 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-08-21 18:55:16,158 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-08-21 18:55:16,158 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-08-21 18:55:16,158 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-08-21 18:55:16,158 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-08-21 18:55:16,158 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-08-21 18:55:16,158 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-08-21 18:55:16,158 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-08-21 18:55:16,158 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-08-21 18:55:16,158 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-08-21 18:55:16,158 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-08-21 18:55:16,158 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-08-21 18:55:16,159 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-08-21 18:55:16,159 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-08-21 18:55:16,159 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-08-21 18:55:16,159 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-08-21 18:55:16,159 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-08-21 18:55:16,159 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-08-21 18:55:16,159 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-08-21 18:55:16,159 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-08-21 18:55:16,159 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-08-21 18:55:16,159 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-08-21 18:55:16,159 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-08-21 18:55:16,159 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-08-21 18:55:16,159 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-08-21 18:55:16,159 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-08-21 18:55:16,159 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-08-21 18:55:16,159 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-08-21 18:55:16,159 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-08-21 18:55:16,159 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=10, number of hosts=30, number of racks=4
2023-08-21 18:55:16,173 INFO  [Time-limited test] balancer.StochasticLoadBalancer(381): Cluster wide - skipping load balancing because weighted average imbalance=0.0 <= threshold(0.025). If you want more aggressive balancing, either lower hbase.master.balancer.stochastic.minCostNeedBalance from 0.025 or increase the relative multiplier(s) of the specific cost function(s). functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-08-21 18:55:16,173 INFO  [Time-limited test] balancer.BalancerTestBase(570): Mock Final balance: { srv1120203893:90 , srv1149164427:90 , srv1265137828:90 , srv1299882977:90 , srv1325009334:90 , srv1377213076:90 , srv1394497618:90 , srv1456791295:90 , srv1539520544:90 , srv1547534141:90 , srv1584683544:90 , srv1658551910:90 , srv1684046811:90 , srv1685885646:90 , srv1729678536:90 , srv1750243235:90 , srv1827732581:90 , srv1878899050:90 , srv1886394530:90 , srv271175469:90 , srv424120933:90 , srv467731219:90 , srv479030595:90 , srv541901353:90 , srv547024971:90 , srv657148466:90 , srv807744509:90 , srv939488861:90 , srv948298330:90 , srv953024634:90 }
2023-08-21 18:55:16,185 INFO  [Time-limited test] hbase.ResourceChecker(175): after: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnMidClusterWithRacks Thread=11 (was 12), OpenFileDescriptor=263 (was 263), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=206 (was 229), ProcessCount=169 (was 171), AvailableMemoryMB=10324 (was 10275) - AvailableMemoryMB LEAK? -