2023-02-23 10:54:01,541 INFO  [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks timeout: 13 mins
2023-02-23 10:54:01,923 WARN  [Time-limited test] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties
2023-02-23 10:54:02,072 INFO  [Time-limited test] metrics.MetricRegistriesLoader(60): Loaded MetricRegistries class org.apache.hadoop.hbase.metrics.impl.MetricRegistriesImpl
2023-02-23 10:54:02,134 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2023-02-23 10:54:02,142 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc.
2023-02-23 10:54:02,155 INFO  [Time-limited test] hbase.ResourceChecker(147): before: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnLargeClusterWithRacks Thread=10, OpenFileDescriptor=260, MaxFileDescriptor=60000, SystemLoadAverage=320, ProcessCount=172, AvailableMemoryMB=7770
2023-02-23 10:54:02,157 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2023-02-23 10:54:02,157 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=5000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=10000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc.
2023-02-23 10:54:02,294 INFO  [Time-limited test] balancer.BalancerTestBase(547): Mock Cluster : { srv1014657286:84 , srv1015150743:84 , srv1026116011:84 , srv110609191:84 , srv111395243:84 , srv114818248:84 , srv1161224672:84 , srv116280702:84 , srv1173494654:84 , srv1201101942:84 , srv1208989070:84 , srv1223994069:84 , srv1224407664:84 , srv1227569994:84 , srv1228013203:84 , srv1233286948:84 , srv127096881:84 , srv128533792:84 , srv1318246358:84 , srv1320960133:84 , srv1323625103:84 , srv1329274429:84 , srv1339956951:84 , srv1360945880:84 , srv1424785087:84 , srv1432328918:84 , srv1566365794:84 , srv1593193339:84 , srv1600361837:84 , srv1610663784:84 , srv163422215:84 , srv1649106475:84 , srv165285872:84 , srv1657866375:84 , srv1658126924:84 , srv1661838224:84 , srv1698915479:84 , srv1727830843:84 , srv1770758276:84 , srv1797599669:84 , srv1865932588:84 , srv1868781887:84 , srv1879444384:84 , srv1903841341:84 , srv1904959225:84 , srv1944368228:84 , srv1959411466:84 , srv1967355124:84 , srv2050216108:84 , srv2074894421:84 , srv2114116054:84 , srv2145302537:84 , srv229779051:84 , srv310977875:84 , srv321173164:84 , srv342634923:84 , srv360210205:84 , srv407813031:84 , srv418399064:84 , srv450553549:84 , srv46297646:84 , srv464431648:84 , srv487478320:84 , srv499143668:84 , srv517116812:84 , srv518742430:84 , srv520163589:84 , srv537429263:84 , srv548531592:84 , srv582111944:84 , srv584432100:84 , srv602062828:84 , srv605965917:84 , srv617470075:84 , srv638140675:84 , srv641456953:84 , srv657837921:84 , srv659470063:84 , srv672625654:84 , srv689130410:84 , srv699413260:84 , srv699947926:84 , srv709023557:84 , srv740157847:84 , srv74732695:84 , srv757675525:84 , srv770894971:84 , srv802151095:84 , srv806714697:84 , srv810788125:84 , srv814486647:84 , srv84182119:84 , srv875545421:84 , srv877499664:84 , srv895425619:84 , srv896545871:84 , srv901142213:84 , srv90446787:84 , srv921739293:84 , srv1765914468:684 } [srvr=100 rgns=9000 avg=90.0 max=90 min=90]
2023-02-23 10:54:02,308 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-02-23 10:54:02,317 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1610663784=29, srv641456953=76, srv802151095=88, srv537429263=68, srv2145302537=52, srv1967355124=48, srv699947926=82, srv520163589=67, srv499143668=64, srv1223994069=11, srv110609191=3, srv1770758276=39, srv657837921=77, srv582111944=70, srv659470063=78, srv1868781887=42, srv1026116011=2, srv1329274429=21, srv90446787=98, srv672625654=79, srv321173164=55, srv1959411466=47, srv342634923=56, srv1657866375=33, srv806714697=89, srv1879444384=43, srv2114116054=51, srv1424785087=24, srv127096881=16, srv1432328918=25, srv699413260=81, srv1600361837=28, srv770894971=87, srv310977875=54, srv1797599669=40, srv689130410=80, srv875545421=93, srv1320960133=19, srv740157847=84, srv418399064=59, srv1173494654=8, srv548531592=69, srv1904959225=45, srv1765914468=38, srv518742430=66, srv163422215=30, srv1318246358=18, srv638140675=75, srv1224407664=12, srv111395243=4, srv1698915479=36, srv1903841341=44, srv360210205=57, srv921739293=99, srv1339956951=22, srv709023557=83, srv464431648=62, srv84182119=92, srv1233286948=15, srv1593193339=27, srv1228013203=14, srv810788125=90, srv895425619=95, srv487478320=63, srv602062828=72, srv114818248=5, srv1161224672=6, srv2074894421=50, srv1201101942=9, srv74732695=85, srv407813031=58, srv46297646=61, srv128533792=17, srv1865932588=41, srv1944368228=46, srv584432100=71, srv896545871=96, srv1015150743=1, srv116280702=7, srv1014657286=0, srv450553549=60, srv1323625103=20, srv165285872=32, srv229779051=53, srv2050216108=49, srv517116812=65, srv1649106475=31, srv1661838224=35, srv877499664=94, srv757675525=86, srv605965917=73, srv1727830843=37, srv814486647=91, srv1658126924=34, srv1208989070=10, srv1227569994=13, srv1360945880=23, srv617470075=74, srv1566365794=26, srv901142213=97} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-02-23 10:54:02,416 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-02-23 10:54:02,417 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-02-23 10:54:02,417 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-02-23 10:54:02,417 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-02-23 10:54:02,417 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-02-23 10:54:02,417 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-02-23 10:54:02,417 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-02-23 10:54:02,418 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-02-23 10:54:02,418 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-02-23 10:54:02,418 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-02-23 10:54:02,418 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-02-23 10:54:02,418 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-02-23 10:54:02,418 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-02-23 10:54:02,418 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-02-23 10:54:02,419 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-02-23 10:54:02,419 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-02-23 10:54:02,419 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-02-23 10:54:02,419 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-02-23 10:54:02,419 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-02-23 10:54:02,419 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-02-23 10:54:02,419 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-02-23 10:54:02,420 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-02-23 10:54:02,420 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-02-23 10:54:02,420 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-02-23 10:54:02,420 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-02-23 10:54:02,420 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-02-23 10:54:02,420 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-02-23 10:54:02,420 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-02-23 10:54:02,420 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-02-23 10:54:02,421 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-02-23 10:54:02,421 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-02-23 10:54:02,421 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-02-23 10:54:02,421 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-02-23 10:54:02,421 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-02-23 10:54:02,421 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-02-23 10:54:02,421 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-02-23 10:54:02,422 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-02-23 10:54:02,422 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-02-23 10:54:02,422 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-02-23 10:54:02,422 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-02-23 10:54:02,422 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-02-23 10:54:02,422 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-02-23 10:54:02,422 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-02-23 10:54:02,423 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-02-23 10:54:02,423 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-02-23 10:54:02,423 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-02-23 10:54:02,423 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-02-23 10:54:02,423 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-02-23 10:54:02,423 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-02-23 10:54:02,423 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-02-23 10:54:02,423 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-02-23 10:54:02,424 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-02-23 10:54:02,424 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-02-23 10:54:02,424 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-02-23 10:54:02,424 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-02-23 10:54:02,424 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-02-23 10:54:02,424 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-02-23 10:54:02,424 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-02-23 10:54:02,424 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-02-23 10:54:02,425 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-02-23 10:54:02,425 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-02-23 10:54:02,425 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-02-23 10:54:02,425 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-02-23 10:54:02,425 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-02-23 10:54:02,425 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-02-23 10:54:02,425 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-02-23 10:54:02,425 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-02-23 10:54:02,426 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-02-23 10:54:02,426 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-02-23 10:54:02,426 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-02-23 10:54:02,426 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-02-23 10:54:02,426 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-02-23 10:54:02,426 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-02-23 10:54:02,426 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-02-23 10:54:02,427 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-02-23 10:54:02,427 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-02-23 10:54:02,427 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-02-23 10:54:02,427 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-02-23 10:54:02,427 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-02-23 10:54:02,427 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-02-23 10:54:02,427 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-02-23 10:54:02,427 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-02-23 10:54:02,428 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-02-23 10:54:02,428 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-02-23 10:54:02,428 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-02-23 10:54:02,428 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-02-23 10:54:02,428 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-02-23 10:54:02,428 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-02-23 10:54:02,428 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-02-23 10:54:02,428 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-02-23 10:54:02,428 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-02-23 10:54:02,429 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-02-23 10:54:02,429 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-02-23 10:54:02,429 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-02-23 10:54:02,429 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-02-23 10:54:02,429 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-02-23 10:54:02,429 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-02-23 10:54:02,429 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-02-23 10:54:02,430 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-02-23 10:54:02,430 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-02-23 10:54:02,430 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-02-23 10:54:02,692 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.06666666666666667, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-02-23 10:54:02,692 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-02-23 10:54:02,692 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.9909252140407105, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.06666666666666667, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-02-23 10:54:03,446 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 993 ms to try 5000 different iterations.  Found a solution that moves 4688 regions; Going from a computed imbalance of 0.9909252140407105 to a new imbalance of 0.18132329492075758. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.03981532377718696, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.05513375227327303, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.5208888888888888, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.03981532377718696, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.17658333333333334, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.243, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-02-23 10:54:03,477 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1227569994:83 , srv1360945880:83 , srv1770758276:83 , srv814486647:83 , srv116280702:84 , srv1201101942:84 , srv1233286948:84 , srv1323625103:84 , srv1339956951:84 , srv1649106475:84 , srv1904959225:84 , srv2050216108:84 , srv418399064:84 , srv46297646:84 , srv517116812:84 , srv520163589:84 , srv584432100:84 , srv84182119:84 , srv875545421:84 , srv877499664:84 , srv1015150743:85 , srv110609191:85 , srv1208989070:85 , srv1593193339:85 , srv1657866375:85 , srv1879444384:85 , srv2074894421:85 , srv2114116054:85 , srv450553549:85 , srv499143668:85 , srv548531592:85 , srv617470075:85 , srv638140675:85 , srv74732695:85 , srv757675525:85 , srv770894971:85 , srv802151095:85 , srv806714697:85 , srv895425619:85 , srv127096881:86 , srv1318246358:86 , srv1320960133:86 , srv1658126924:86 , srv1661838224:86 , srv1698915479:86 , srv1797599669:86 , srv1865932588:86 , srv1959411466:86 , srv1967355124:86 , srv321173164:86 , srv342634923:86 , srv360210205:86 , srv407813031:86 , srv582111944:86 , srv641456953:86 , srv657837921:86 , srv659470063:86 , srv699413260:86 , srv699947926:86 , srv709023557:86 , srv810788125:86 , srv90446787:86 , srv1026116011:87 , srv1223994069:87 , srv1228013203:87 , srv1424785087:87 , srv1432328918:87 , srv487478320:87 , srv518742430:87 , srv740157847:87 , srv1014657286:88 , srv111395243:88 , srv114818248:88 , srv1173494654:88 , srv1224407664:88 , srv128533792:88 , srv1566365794:88 , srv1727830843:88 , srv1868781887:88 , srv1944368228:88 , srv464431648:88 , srv605965917:88 , srv921739293:88 , srv1329274429:89 , srv1610663784:89 , srv163422215:89 , srv165285872:89 , srv2145302537:89 , srv537429263:89 , srv672625654:89 , srv229779051:90 , srv602062828:90 , srv689130410:90 , srv1903841341:91 , srv310977875:91 , srv901142213:91 , srv1161224672:92 , srv896545871:92 , srv1600361837:97 , srv1765914468:444 }
2023-02-23 10:54:03,481 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-02-23 10:54:03,482 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1610663784=29, srv641456953=76, srv802151095=88, srv537429263=68, srv2145302537=52, srv1967355124=48, srv699947926=82, srv520163589=67, srv499143668=64, srv1223994069=11, srv110609191=3, srv1770758276=39, srv657837921=77, srv582111944=70, srv659470063=78, srv1868781887=42, srv1026116011=2, srv1329274429=21, srv90446787=98, srv672625654=79, srv321173164=55, srv1959411466=47, srv342634923=56, srv1657866375=33, srv806714697=89, srv1879444384=43, srv2114116054=51, srv1424785087=24, srv127096881=16, srv1432328918=25, srv699413260=81, srv1600361837=28, srv770894971=87, srv310977875=54, srv1797599669=40, srv689130410=80, srv875545421=93, srv1320960133=19, srv740157847=84, srv418399064=59, srv1173494654=8, srv548531592=69, srv1904959225=45, srv1765914468=38, srv518742430=66, srv163422215=30, srv1318246358=18, srv638140675=75, srv1224407664=12, srv111395243=4, srv1698915479=36, srv1903841341=44, srv360210205=57, srv921739293=99, srv1339956951=22, srv709023557=83, srv464431648=62, srv84182119=92, srv1233286948=15, srv1593193339=27, srv1228013203=14, srv810788125=90, srv895425619=95, srv487478320=63, srv602062828=72, srv114818248=5, srv1161224672=6, srv2074894421=50, srv1201101942=9, srv74732695=85, srv407813031=58, srv46297646=61, srv128533792=17, srv1865932588=41, srv1944368228=46, srv584432100=71, srv896545871=96, srv1015150743=1, srv116280702=7, srv1014657286=0, srv450553549=60, srv1323625103=20, srv165285872=32, srv229779051=53, srv2050216108=49, srv517116812=65, srv1649106475=31, srv1661838224=35, srv877499664=94, srv757675525=86, srv605965917=73, srv1727830843=37, srv814486647=91, srv1658126924=34, srv1208989070=10, srv1227569994=13, srv1360945880=23, srv617470075=74, srv1566365794=26, srv901142213=97} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-02-23 10:54:03,504 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-02-23 10:54:03,504 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-02-23 10:54:03,504 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-02-23 10:54:03,504 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-02-23 10:54:03,504 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-02-23 10:54:03,504 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-02-23 10:54:03,504 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-02-23 10:54:03,504 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-02-23 10:54:03,504 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-02-23 10:54:03,505 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-02-23 10:54:03,505 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-02-23 10:54:03,505 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-02-23 10:54:03,505 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-02-23 10:54:03,505 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-02-23 10:54:03,505 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-02-23 10:54:03,505 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-02-23 10:54:03,505 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-02-23 10:54:03,505 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-02-23 10:54:03,505 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-02-23 10:54:03,505 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-02-23 10:54:03,505 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-02-23 10:54:03,505 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-02-23 10:54:03,506 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-02-23 10:54:03,506 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-02-23 10:54:03,506 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-02-23 10:54:03,506 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-02-23 10:54:03,506 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-02-23 10:54:03,506 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-02-23 10:54:03,506 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-02-23 10:54:03,506 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-02-23 10:54:03,506 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-02-23 10:54:03,506 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-02-23 10:54:03,506 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-02-23 10:54:03,506 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-02-23 10:54:03,506 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-02-23 10:54:03,506 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-02-23 10:54:03,507 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-02-23 10:54:03,507 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-02-23 10:54:03,507 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-02-23 10:54:03,507 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-02-23 10:54:03,507 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-02-23 10:54:03,507 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-02-23 10:54:03,507 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-02-23 10:54:03,507 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-02-23 10:54:03,507 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-02-23 10:54:03,507 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-02-23 10:54:03,507 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-02-23 10:54:03,507 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-02-23 10:54:03,507 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-02-23 10:54:03,507 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-02-23 10:54:03,507 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-02-23 10:54:03,508 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-02-23 10:54:03,508 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-02-23 10:54:03,508 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-02-23 10:54:03,508 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-02-23 10:54:03,508 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-02-23 10:54:03,508 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-02-23 10:54:03,508 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-02-23 10:54:03,508 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-02-23 10:54:03,508 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-02-23 10:54:03,508 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-02-23 10:54:03,508 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-02-23 10:54:03,508 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-02-23 10:54:03,508 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-02-23 10:54:03,509 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-02-23 10:54:03,509 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-02-23 10:54:03,509 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-02-23 10:54:03,509 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-02-23 10:54:03,509 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-02-23 10:54:03,509 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-02-23 10:54:03,509 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-02-23 10:54:03,509 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-02-23 10:54:03,509 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-02-23 10:54:03,509 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-02-23 10:54:03,509 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-02-23 10:54:03,509 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-02-23 10:54:03,509 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-02-23 10:54:03,509 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-02-23 10:54:03,509 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-02-23 10:54:03,510 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-02-23 10:54:03,510 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-02-23 10:54:03,510 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-02-23 10:54:03,510 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-02-23 10:54:03,510 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-02-23 10:54:03,510 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-02-23 10:54:03,510 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-02-23 10:54:03,510 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-02-23 10:54:03,510 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-02-23 10:54:03,510 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-02-23 10:54:03,510 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-02-23 10:54:03,510 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-02-23 10:54:03,510 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-02-23 10:54:03,510 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-02-23 10:54:03,511 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-02-23 10:54:03,511 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-02-23 10:54:03,511 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-02-23 10:54:03,511 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-02-23 10:54:03,511 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-02-23 10:54:03,511 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-02-23 10:54:03,511 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-02-23 10:54:03,511 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-02-23 10:54:03,669 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.03981532377718696, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.05513375227327303, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.03981532377718696, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.17658333333333334, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.243, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-02-23 10:54:03,670 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-02-23 10:54:03,670 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.18129046884315178, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.03981532377718696, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.05513375227327303, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.03981532377718696, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.17658333333333334, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.243, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-02-23 10:54:04,028 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 492 ms to try 5000 different iterations.  Found a solution that moves 2667 regions; Going from a computed imbalance of 0.18129046884315178 to a new imbalance of 0.016003155432349175. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.021287291318232343); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0332389235409237, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.29633333333333334, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.021287291318232343); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.012666666666666666); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.04808333333333333, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-02-23 10:54:04,041 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1600361837:75 , srv310977875:79 , srv111395243:81 , srv1329274429:81 , srv229779051:81 , srv114818248:82 , srv1161224672:82 , srv165285872:82 , srv1903841341:82 , srv602062828:82 , srv1014657286:83 , srv1223994069:83 , srv128533792:83 , srv1432328918:83 , srv1566365794:83 , srv163422215:83 , srv1944368228:83 , srv2145302537:83 , srv689130410:83 , srv921739293:83 , srv1228013203:84 , srv127096881:84 , srv1610663784:84 , srv1967355124:84 , srv321173164:84 , srv657837921:84 , srv672625654:84 , srv896545871:84 , srv901142213:84 , srv1015150743:85 , srv1173494654:85 , srv1233286948:85 , srv1318246358:85 , srv1868781887:85 , srv2050216108:85 , srv2074894421:85 , srv342634923:85 , srv464431648:85 , srv487478320:85 , srv518742430:85 , srv582111944:85 , srv605965917:85 , srv617470075:85 , srv659470063:85 , srv74732695:85 , srv810788125:85 , srv110609191:86 , srv116280702:86 , srv1224407664:86 , srv1424785087:86 , srv1593193339:86 , srv1658126924:86 , srv1698915479:86 , srv1797599669:86 , srv1865932588:86 , srv537429263:86 , srv699413260:86 , srv740157847:86 , srv806714697:86 , srv1208989070:87 , srv1320960133:87 , srv1661838224:87 , srv1727830843:87 , srv1879444384:87 , srv1959411466:87 , srv2114116054:87 , srv450553549:87 , srv517116812:87 , srv520163589:87 , srv641456953:87 , srv709023557:87 , srv770894971:87 , srv802151095:87 , srv875545421:87 , srv895425619:87 , srv1201101942:88 , srv1323625103:88 , srv1649106475:88 , srv1904959225:88 , srv407813031:88 , srv46297646:88 , srv499143668:88 , srv584432100:88 , srv638140675:88 , srv84182119:88 , srv877499664:88 , srv90446787:88 , srv1026116011:89 , srv1227569994:89 , srv1360945880:89 , srv360210205:89 , srv548531592:89 , srv699947926:89 , srv757675525:89 , srv1339956951:90 , srv418399064:90 , srv1657866375:91 , srv814486647:91 , srv1770758276:92 , srv1765914468:519 }
2023-02-23 10:54:04,047 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-02-23 10:54:04,048 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1610663784=29, srv641456953=76, srv802151095=88, srv537429263=68, srv2145302537=52, srv1967355124=48, srv699947926=82, srv520163589=67, srv499143668=64, srv1223994069=11, srv110609191=3, srv1770758276=39, srv657837921=77, srv582111944=70, srv659470063=78, srv1868781887=42, srv1026116011=2, srv1329274429=21, srv90446787=98, srv672625654=79, srv321173164=55, srv1959411466=47, srv342634923=56, srv1657866375=33, srv806714697=89, srv1879444384=43, srv2114116054=51, srv1424785087=24, srv127096881=16, srv1432328918=25, srv699413260=81, srv1600361837=28, srv770894971=87, srv310977875=54, srv1797599669=40, srv689130410=80, srv875545421=93, srv1320960133=19, srv740157847=84, srv418399064=59, srv1173494654=8, srv548531592=69, srv1904959225=45, srv1765914468=38, srv518742430=66, srv163422215=30, srv1318246358=18, srv638140675=75, srv1224407664=12, srv111395243=4, srv1698915479=36, srv1903841341=44, srv360210205=57, srv921739293=99, srv1339956951=22, srv709023557=83, srv464431648=62, srv84182119=92, srv1233286948=15, srv1593193339=27, srv1228013203=14, srv810788125=90, srv895425619=95, srv487478320=63, srv602062828=72, srv114818248=5, srv1161224672=6, srv2074894421=50, srv1201101942=9, srv74732695=85, srv407813031=58, srv46297646=61, srv128533792=17, srv1865932588=41, srv1944368228=46, srv584432100=71, srv896545871=96, srv1015150743=1, srv116280702=7, srv1014657286=0, srv450553549=60, srv1323625103=20, srv165285872=32, srv229779051=53, srv2050216108=49, srv517116812=65, srv1649106475=31, srv1661838224=35, srv877499664=94, srv757675525=86, srv605965917=73, srv1727830843=37, srv814486647=91, srv1658126924=34, srv1208989070=10, srv1227569994=13, srv1360945880=23, srv617470075=74, srv1566365794=26, srv901142213=97} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-02-23 10:54:04,071 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-02-23 10:54:04,071 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-02-23 10:54:04,071 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-02-23 10:54:04,071 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-02-23 10:54:04,071 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-02-23 10:54:04,072 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-02-23 10:54:04,072 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-02-23 10:54:04,072 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-02-23 10:54:04,072 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-02-23 10:54:04,072 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-02-23 10:54:04,072 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-02-23 10:54:04,072 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-02-23 10:54:04,072 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-02-23 10:54:04,072 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-02-23 10:54:04,073 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-02-23 10:54:04,073 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-02-23 10:54:04,073 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-02-23 10:54:04,073 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-02-23 10:54:04,073 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-02-23 10:54:04,073 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-02-23 10:54:04,073 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-02-23 10:54:04,073 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-02-23 10:54:04,073 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-02-23 10:54:04,074 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-02-23 10:54:04,074 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-02-23 10:54:04,074 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-02-23 10:54:04,074 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-02-23 10:54:04,074 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-02-23 10:54:04,074 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-02-23 10:54:04,074 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-02-23 10:54:04,074 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-02-23 10:54:04,075 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-02-23 10:54:04,075 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-02-23 10:54:04,075 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-02-23 10:54:04,075 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-02-23 10:54:04,075 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-02-23 10:54:04,075 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-02-23 10:54:04,075 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-02-23 10:54:04,075 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-02-23 10:54:04,075 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-02-23 10:54:04,076 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-02-23 10:54:04,076 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-02-23 10:54:04,076 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-02-23 10:54:04,076 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-02-23 10:54:04,076 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-02-23 10:54:04,076 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-02-23 10:54:04,076 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-02-23 10:54:04,076 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-02-23 10:54:04,077 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-02-23 10:54:04,077 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-02-23 10:54:04,077 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-02-23 10:54:04,077 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-02-23 10:54:04,077 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-02-23 10:54:04,077 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-02-23 10:54:04,077 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-02-23 10:54:04,077 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-02-23 10:54:04,077 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-02-23 10:54:04,078 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-02-23 10:54:04,078 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-02-23 10:54:04,078 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-02-23 10:54:04,078 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-02-23 10:54:04,078 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-02-23 10:54:04,078 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-02-23 10:54:04,078 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-02-23 10:54:04,078 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-02-23 10:54:04,078 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-02-23 10:54:04,078 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-02-23 10:54:04,079 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-02-23 10:54:04,079 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-02-23 10:54:04,079 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-02-23 10:54:04,079 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-02-23 10:54:04,079 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-02-23 10:54:04,079 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-02-23 10:54:04,079 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-02-23 10:54:04,079 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-02-23 10:54:04,079 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-02-23 10:54:04,079 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-02-23 10:54:04,080 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-02-23 10:54:04,080 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-02-23 10:54:04,080 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-02-23 10:54:04,080 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-02-23 10:54:04,080 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-02-23 10:54:04,080 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-02-23 10:54:04,080 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-02-23 10:54:04,080 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-02-23 10:54:04,080 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-02-23 10:54:04,080 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-02-23 10:54:04,081 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-02-23 10:54:04,081 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-02-23 10:54:04,081 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-02-23 10:54:04,081 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-02-23 10:54:04,081 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-02-23 10:54:04,081 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-02-23 10:54:04,081 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-02-23 10:54:04,081 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-02-23 10:54:04,081 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-02-23 10:54:04,081 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-02-23 10:54:04,082 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-02-23 10:54:04,082 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-02-23 10:54:04,082 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-02-23 10:54:04,082 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-02-23 10:54:04,231 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.021287291318232343); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0332389235409237, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.021287291318232343); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.012666666666666666); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.04808333333333333, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-02-23 10:54:04,231 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-02-23 10:54:04,231 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.0159844806992061, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.021287291318232343); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0332389235409237, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.021287291318232343); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.012666666666666666); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.04808333333333333, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-02-23 10:54:04,534 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 429 ms to try 5000 different iterations.  Found a solution that moves 1021 regions; Going from a computed imbalance of 0.0159844806992061 to a new imbalance of 0.001374643628322851. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0056567660698823964); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.007741618689438271); MoveCostFunction : (multiplier=7.0, imbalance=0.11344444444444444, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0056567660698823964); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=9.166666666666666E-4); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.005333333333333333); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-02-23 10:54:04,537 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1026116011:81 , srv896545871:81 , srv1657866375:82 , srv699947926:82 , srv1224407664:83 , srv1339956951:83 , srv1727830843:83 , srv1770758276:83 , srv360210205:83 , srv407813031:83 , srv537429263:83 , srv548531592:83 , srv757675525:83 , srv814486647:83 , srv901142213:83 , srv90446787:83 , srv1161224672:84 , srv1173494654:84 , srv1320960133:84 , srv1868781887:84 , srv418399064:84 , srv499143668:84 , srv605965917:84 , srv638140675:84 , srv895425619:84 , srv1201101942:85 , srv1360945880:85 , srv1424785087:85 , srv1593193339:85 , srv1610663784:85 , srv1658126924:85 , srv1661838224:85 , srv1698915479:85 , srv1865932588:85 , srv1879444384:85 , srv1903841341:85 , srv1904959225:85 , srv1959411466:85 , srv2145302537:85 , srv464431648:85 , srv487478320:85 , srv584432100:85 , srv602062828:85 , srv641456953:85 , srv689130410:85 , srv699413260:85 , srv709023557:85 , srv84182119:85 , srv877499664:85 , srv1208989070:86 , srv128533792:86 , srv1323625103:86 , srv1566365794:86 , srv163422215:86 , srv1649106475:86 , srv165285872:86 , srv1797599669:86 , srv1944368228:86 , srv2114116054:86 , srv46297646:86 , srv517116812:86 , srv518742430:86 , srv520163589:86 , srv659470063:86 , srv672625654:86 , srv740157847:86 , srv770894971:86 , srv802151095:86 , srv806714697:86 , srv810788125:86 , srv875545421:86 , srv1014657286:87 , srv1015150743:87 , srv110609191:87 , srv114818248:87 , srv1223994069:87 , srv1227569994:87 , srv1228013203:87 , srv127096881:87 , srv1329274429:87 , srv1432328918:87 , srv1600361837:87 , srv1967355124:87 , srv229779051:87 , srv310977875:87 , srv342634923:87 , srv450553549:87 , srv582111944:87 , srv617470075:87 , srv657837921:87 , srv921739293:87 , srv111395243:88 , srv116280702:88 , srv1318246358:88 , srv2050216108:88 , srv2074894421:88 , srv321173164:88 , srv74732695:88 , srv1233286948:89 , srv1765914468:545 }
2023-02-23 10:54:04,542 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-02-23 10:54:04,544 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1610663784=29, srv641456953=76, srv802151095=88, srv537429263=68, srv2145302537=52, srv1967355124=48, srv699947926=82, srv520163589=67, srv499143668=64, srv1223994069=11, srv110609191=3, srv1770758276=39, srv657837921=77, srv582111944=70, srv659470063=78, srv1868781887=42, srv1026116011=2, srv1329274429=21, srv90446787=98, srv672625654=79, srv321173164=55, srv1959411466=47, srv342634923=56, srv1657866375=33, srv806714697=89, srv1879444384=43, srv2114116054=51, srv1424785087=24, srv127096881=16, srv1432328918=25, srv699413260=81, srv1600361837=28, srv770894971=87, srv310977875=54, srv1797599669=40, srv689130410=80, srv875545421=93, srv1320960133=19, srv740157847=84, srv418399064=59, srv1173494654=8, srv548531592=69, srv1904959225=45, srv1765914468=38, srv518742430=66, srv163422215=30, srv1318246358=18, srv638140675=75, srv1224407664=12, srv111395243=4, srv1698915479=36, srv1903841341=44, srv360210205=57, srv921739293=99, srv1339956951=22, srv709023557=83, srv464431648=62, srv84182119=92, srv1233286948=15, srv1593193339=27, srv1228013203=14, srv810788125=90, srv895425619=95, srv487478320=63, srv602062828=72, srv114818248=5, srv1161224672=6, srv2074894421=50, srv1201101942=9, srv74732695=85, srv407813031=58, srv46297646=61, srv128533792=17, srv1865932588=41, srv1944368228=46, srv584432100=71, srv896545871=96, srv1015150743=1, srv116280702=7, srv1014657286=0, srv450553549=60, srv1323625103=20, srv165285872=32, srv229779051=53, srv2050216108=49, srv517116812=65, srv1649106475=31, srv1661838224=35, srv877499664=94, srv757675525=86, srv605965917=73, srv1727830843=37, srv814486647=91, srv1658126924=34, srv1208989070=10, srv1227569994=13, srv1360945880=23, srv617470075=74, srv1566365794=26, srv901142213=97} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-02-23 10:54:04,568 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-02-23 10:54:04,568 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-02-23 10:54:04,568 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-02-23 10:54:04,569 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-02-23 10:54:04,569 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-02-23 10:54:04,569 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-02-23 10:54:04,569 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-02-23 10:54:04,569 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-02-23 10:54:04,569 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-02-23 10:54:04,569 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-02-23 10:54:04,569 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-02-23 10:54:04,569 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-02-23 10:54:04,569 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-02-23 10:54:04,569 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-02-23 10:54:04,570 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-02-23 10:54:04,570 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-02-23 10:54:04,570 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-02-23 10:54:04,570 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-02-23 10:54:04,570 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-02-23 10:54:04,570 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-02-23 10:54:04,570 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-02-23 10:54:04,570 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-02-23 10:54:04,570 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-02-23 10:54:04,570 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-02-23 10:54:04,570 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-02-23 10:54:04,571 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-02-23 10:54:04,571 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-02-23 10:54:04,571 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-02-23 10:54:04,571 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-02-23 10:54:04,571 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-02-23 10:54:04,571 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-02-23 10:54:04,571 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-02-23 10:54:04,571 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-02-23 10:54:04,571 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-02-23 10:54:04,571 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-02-23 10:54:04,571 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-02-23 10:54:04,572 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-02-23 10:54:04,572 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-02-23 10:54:04,572 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-02-23 10:54:04,572 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-02-23 10:54:04,572 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-02-23 10:54:04,572 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-02-23 10:54:04,572 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-02-23 10:54:04,572 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-02-23 10:54:04,572 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-02-23 10:54:04,573 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-02-23 10:54:04,573 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-02-23 10:54:04,573 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-02-23 10:54:04,573 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-02-23 10:54:04,573 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-02-23 10:54:04,573 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-02-23 10:54:04,573 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-02-23 10:54:04,573 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-02-23 10:54:04,574 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-02-23 10:54:04,574 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-02-23 10:54:04,574 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-02-23 10:54:04,574 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-02-23 10:54:04,574 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-02-23 10:54:04,574 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-02-23 10:54:04,574 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-02-23 10:54:04,574 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-02-23 10:54:04,574 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-02-23 10:54:04,575 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-02-23 10:54:04,575 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-02-23 10:54:04,575 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-02-23 10:54:04,575 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-02-23 10:54:04,575 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-02-23 10:54:04,575 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-02-23 10:54:04,575 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-02-23 10:54:04,575 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-02-23 10:54:04,575 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-02-23 10:54:04,575 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-02-23 10:54:04,575 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-02-23 10:54:04,576 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-02-23 10:54:04,576 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-02-23 10:54:04,576 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-02-23 10:54:04,576 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-02-23 10:54:04,576 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-02-23 10:54:04,576 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-02-23 10:54:04,576 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-02-23 10:54:04,576 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-02-23 10:54:04,576 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-02-23 10:54:04,576 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-02-23 10:54:04,576 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-02-23 10:54:04,577 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-02-23 10:54:04,577 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-02-23 10:54:04,577 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-02-23 10:54:04,577 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-02-23 10:54:04,577 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-02-23 10:54:04,577 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-02-23 10:54:04,577 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-02-23 10:54:04,577 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-02-23 10:54:04,577 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-02-23 10:54:04,577 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-02-23 10:54:04,577 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-02-23 10:54:04,578 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-02-23 10:54:04,578 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-02-23 10:54:04,578 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-02-23 10:54:04,578 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-02-23 10:54:04,578 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-02-23 10:54:04,578 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-02-23 10:54:04,719 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0056567660698823964); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.007741618689438271); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0056567660698823964); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=9.166666666666666E-4); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.005333333333333333); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-02-23 10:54:04,719 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-02-23 10:54:04,719 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.0013674944335200466, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0056567660698823964); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.007741618689438271); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0056567660698823964); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=9.166666666666666E-4); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.005333333333333333); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-02-23 10:54:05,004 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 407 ms to try 5000 different iterations.  Found a solution that moves 267 regions; Going from a computed imbalance of 0.0013674944335200466 to a new imbalance of 2.6655243174772377E-5. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=3.158529131194229E-4); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0018349396085439343); MoveCostFunction : (multiplier=7.0, imbalance=0.029666666666666668, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=3.158529131194229E-4); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.6666666666666666E-4); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-02-23 10:54:05,005 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1227569994:83 , srv1318246358:83 , srv1600361837:83 , srv450553549:83 , srv582111944:83 , srv672625654:83 , srv740157847:83 , srv1014657286:84 , srv110609191:84 , srv114818248:84 , srv1161224672:84 , srv116280702:84 , srv1208989070:84 , srv1228013203:84 , srv1233286948:84 , srv1424785087:84 , srv1566365794:84 , srv1610663784:84 , srv163422215:84 , srv1657866375:84 , srv1661838224:84 , srv1727830843:84 , srv1770758276:84 , srv1797599669:84 , srv1903841341:84 , srv1959411466:84 , srv2074894421:84 , srv2114116054:84 , srv229779051:84 , srv321173164:84 , srv342634923:84 , srv360210205:84 , srv418399064:84 , srv46297646:84 , srv464431648:84 , srv518742430:84 , srv537429263:84 , srv641456953:84 , srv689130410:84 , srv709023557:84 , srv74732695:84 , srv770894971:84 , srv877499664:84 , srv901142213:84 , srv921739293:84 , srv1015150743:85 , srv1026116011:85 , srv111395243:85 , srv1173494654:85 , srv1201101942:85 , srv1223994069:85 , srv1224407664:85 , srv127096881:85 , srv128533792:85 , srv1320960133:85 , srv1323625103:85 , srv1329274429:85 , srv1339956951:85 , srv1360945880:85 , srv1432328918:85 , srv1649106475:85 , srv1658126924:85 , srv1698915479:85 , srv1865932588:85 , srv1868781887:85 , srv1879444384:85 , srv1904959225:85 , srv1944368228:85 , srv1967355124:85 , srv2050216108:85 , srv2145302537:85 , srv310977875:85 , srv407813031:85 , srv487478320:85 , srv499143668:85 , srv517116812:85 , srv520163589:85 , srv548531592:85 , srv584432100:85 , srv602062828:85 , srv605965917:85 , srv617470075:85 , srv638140675:85 , srv657837921:85 , srv659470063:85 , srv699413260:85 , srv699947926:85 , srv757675525:85 , srv802151095:85 , srv806714697:85 , srv810788125:85 , srv814486647:85 , srv84182119:85 , srv875545421:85 , srv896545871:85 , srv90446787:85 , srv1593193339:86 , srv165285872:86 , srv895425619:86 , srv1765914468:634 }
2023-02-23 10:54:05,010 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-02-23 10:54:05,010 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1610663784=29, srv641456953=76, srv802151095=88, srv537429263=68, srv2145302537=52, srv1967355124=48, srv699947926=82, srv520163589=67, srv499143668=64, srv1223994069=11, srv110609191=3, srv1770758276=39, srv657837921=77, srv582111944=70, srv659470063=78, srv1868781887=42, srv1026116011=2, srv1329274429=21, srv90446787=98, srv672625654=79, srv321173164=55, srv1959411466=47, srv342634923=56, srv1657866375=33, srv806714697=89, srv1879444384=43, srv2114116054=51, srv1424785087=24, srv127096881=16, srv1432328918=25, srv699413260=81, srv1600361837=28, srv770894971=87, srv310977875=54, srv1797599669=40, srv689130410=80, srv875545421=93, srv1320960133=19, srv740157847=84, srv418399064=59, srv1173494654=8, srv548531592=69, srv1904959225=45, srv1765914468=38, srv518742430=66, srv163422215=30, srv1318246358=18, srv638140675=75, srv1224407664=12, srv111395243=4, srv1698915479=36, srv1903841341=44, srv360210205=57, srv921739293=99, srv1339956951=22, srv709023557=83, srv464431648=62, srv84182119=92, srv1233286948=15, srv1593193339=27, srv1228013203=14, srv810788125=90, srv895425619=95, srv487478320=63, srv602062828=72, srv114818248=5, srv1161224672=6, srv2074894421=50, srv1201101942=9, srv74732695=85, srv407813031=58, srv46297646=61, srv128533792=17, srv1865932588=41, srv1944368228=46, srv584432100=71, srv896545871=96, srv1015150743=1, srv116280702=7, srv1014657286=0, srv450553549=60, srv1323625103=20, srv165285872=32, srv229779051=53, srv2050216108=49, srv517116812=65, srv1649106475=31, srv1661838224=35, srv877499664=94, srv757675525=86, srv605965917=73, srv1727830843=37, srv814486647=91, srv1658126924=34, srv1208989070=10, srv1227569994=13, srv1360945880=23, srv617470075=74, srv1566365794=26, srv901142213=97} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-02-23 10:54:05,023 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-02-23 10:54:05,023 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-02-23 10:54:05,023 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-02-23 10:54:05,023 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-02-23 10:54:05,023 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-02-23 10:54:05,024 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-02-23 10:54:05,024 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-02-23 10:54:05,024 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-02-23 10:54:05,024 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-02-23 10:54:05,024 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-02-23 10:54:05,024 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-02-23 10:54:05,024 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-02-23 10:54:05,024 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-02-23 10:54:05,024 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-02-23 10:54:05,024 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-02-23 10:54:05,024 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-02-23 10:54:05,024 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-02-23 10:54:05,024 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-02-23 10:54:05,024 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-02-23 10:54:05,024 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-02-23 10:54:05,024 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-02-23 10:54:05,024 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-02-23 10:54:05,024 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-02-23 10:54:05,024 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-02-23 10:54:05,024 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-02-23 10:54:05,024 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-02-23 10:54:05,025 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-02-23 10:54:05,025 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-02-23 10:54:05,025 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-02-23 10:54:05,025 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-02-23 10:54:05,025 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-02-23 10:54:05,025 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-02-23 10:54:05,025 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-02-23 10:54:05,025 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-02-23 10:54:05,025 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-02-23 10:54:05,025 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-02-23 10:54:05,025 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-02-23 10:54:05,025 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-02-23 10:54:05,025 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-02-23 10:54:05,025 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-02-23 10:54:05,025 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-02-23 10:54:05,025 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-02-23 10:54:05,025 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-02-23 10:54:05,025 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-02-23 10:54:05,025 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-02-23 10:54:05,025 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-02-23 10:54:05,025 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-02-23 10:54:05,026 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-02-23 10:54:05,026 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-02-23 10:54:05,026 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-02-23 10:54:05,026 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-02-23 10:54:05,026 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-02-23 10:54:05,026 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-02-23 10:54:05,026 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-02-23 10:54:05,026 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-02-23 10:54:05,026 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-02-23 10:54:05,026 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-02-23 10:54:05,026 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-02-23 10:54:05,026 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-02-23 10:54:05,026 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-02-23 10:54:05,026 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-02-23 10:54:05,026 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-02-23 10:54:05,026 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-02-23 10:54:05,026 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-02-23 10:54:05,026 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-02-23 10:54:05,026 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-02-23 10:54:05,026 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-02-23 10:54:05,026 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-02-23 10:54:05,027 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-02-23 10:54:05,027 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-02-23 10:54:05,027 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-02-23 10:54:05,027 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-02-23 10:54:05,027 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-02-23 10:54:05,027 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-02-23 10:54:05,027 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-02-23 10:54:05,027 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-02-23 10:54:05,027 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-02-23 10:54:05,027 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-02-23 10:54:05,027 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-02-23 10:54:05,027 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-02-23 10:54:05,027 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-02-23 10:54:05,027 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-02-23 10:54:05,027 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-02-23 10:54:05,027 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-02-23 10:54:05,027 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-02-23 10:54:05,027 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-02-23 10:54:05,028 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-02-23 10:54:05,028 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-02-23 10:54:05,028 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-02-23 10:54:05,028 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-02-23 10:54:05,028 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-02-23 10:54:05,028 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-02-23 10:54:05,028 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-02-23 10:54:05,028 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-02-23 10:54:05,028 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-02-23 10:54:05,028 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-02-23 10:54:05,028 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-02-23 10:54:05,028 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-02-23 10:54:05,028 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-02-23 10:54:05,028 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-02-23 10:54:05,028 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-02-23 10:54:05,134 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=3.158529131194229E-4); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0018349396085439343); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=3.158529131194229E-4); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.6666666666666666E-4); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-02-23 10:54:05,134 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-02-23 10:54:05,134 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=2.47856692155669E-5, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=3.158529131194229E-4); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0018349396085439343); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=3.158529131194229E-4); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.6666666666666666E-4); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-02-23 10:54:05,341 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 305 ms to try 5000 different iterations.  Found a solution that moves 24 regions; Going from a computed imbalance of 2.47856692155669E-5 to a new imbalance of 6.566037264108393E-6. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0014213381090374027); MoveCostFunction : (multiplier=7.0, imbalance=0.0026666666666666666); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-02-23 10:54:05,342 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1323625103:83 , srv1649106475:83 , srv165285872:83 , srv802151095:83 , srv1014657286:84 , srv1015150743:84 , srv1026116011:84 , srv110609191:84 , srv111395243:84 , srv1161224672:84 , srv116280702:84 , srv1173494654:84 , srv1201101942:84 , srv1208989070:84 , srv1223994069:84 , srv1224407664:84 , srv1227569994:84 , srv1228013203:84 , srv1233286948:84 , srv127096881:84 , srv128533792:84 , srv1318246358:84 , srv1320960133:84 , srv1329274429:84 , srv1339956951:84 , srv1360945880:84 , srv1424785087:84 , srv1432328918:84 , srv1593193339:84 , srv1600361837:84 , srv1610663784:84 , srv163422215:84 , srv1657866375:84 , srv1658126924:84 , srv1661838224:84 , srv1698915479:84 , srv1727830843:84 , srv1770758276:84 , srv1797599669:84 , srv1865932588:84 , srv1868781887:84 , srv1879444384:84 , srv1903841341:84 , srv1904959225:84 , srv1944368228:84 , srv1959411466:84 , srv1967355124:84 , srv2050216108:84 , srv2074894421:84 , srv2114116054:84 , srv2145302537:84 , srv229779051:84 , srv310977875:84 , srv321173164:84 , srv342634923:84 , srv360210205:84 , srv407813031:84 , srv418399064:84 , srv450553549:84 , srv46297646:84 , srv464431648:84 , srv487478320:84 , srv499143668:84 , srv517116812:84 , srv518742430:84 , srv520163589:84 , srv537429263:84 , srv548531592:84 , srv584432100:84 , srv602062828:84 , srv605965917:84 , srv617470075:84 , srv638140675:84 , srv641456953:84 , srv657837921:84 , srv659470063:84 , srv672625654:84 , srv689130410:84 , srv699413260:84 , srv699947926:84 , srv709023557:84 , srv740157847:84 , srv74732695:84 , srv757675525:84 , srv770894971:84 , srv806714697:84 , srv810788125:84 , srv814486647:84 , srv84182119:84 , srv875545421:84 , srv895425619:84 , srv896545871:84 , srv901142213:84 , srv90446787:84 , srv921739293:84 , srv114818248:85 , srv1566365794:85 , srv582111944:85 , srv877499664:85 , srv1765914468:684 }
2023-02-23 10:54:05,345 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-02-23 10:54:05,345 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1610663784=29, srv641456953=76, srv802151095=88, srv537429263=68, srv2145302537=52, srv1967355124=48, srv699947926=82, srv520163589=67, srv499143668=64, srv1223994069=11, srv110609191=3, srv1770758276=39, srv657837921=77, srv582111944=70, srv659470063=78, srv1868781887=42, srv1026116011=2, srv1329274429=21, srv90446787=98, srv672625654=79, srv321173164=55, srv1959411466=47, srv342634923=56, srv1657866375=33, srv806714697=89, srv1879444384=43, srv2114116054=51, srv1424785087=24, srv127096881=16, srv1432328918=25, srv699413260=81, srv1600361837=28, srv770894971=87, srv310977875=54, srv1797599669=40, srv689130410=80, srv875545421=93, srv1320960133=19, srv740157847=84, srv418399064=59, srv1173494654=8, srv548531592=69, srv1904959225=45, srv1765914468=38, srv518742430=66, srv163422215=30, srv1318246358=18, srv638140675=75, srv1224407664=12, srv111395243=4, srv1698915479=36, srv1903841341=44, srv360210205=57, srv921739293=99, srv1339956951=22, srv709023557=83, srv464431648=62, srv84182119=92, srv1233286948=15, srv1593193339=27, srv1228013203=14, srv810788125=90, srv895425619=95, srv487478320=63, srv602062828=72, srv114818248=5, srv1161224672=6, srv2074894421=50, srv1201101942=9, srv74732695=85, srv407813031=58, srv46297646=61, srv128533792=17, srv1865932588=41, srv1944368228=46, srv584432100=71, srv896545871=96, srv1015150743=1, srv116280702=7, srv1014657286=0, srv450553549=60, srv1323625103=20, srv165285872=32, srv229779051=53, srv2050216108=49, srv517116812=65, srv1649106475=31, srv1661838224=35, srv877499664=94, srv757675525=86, srv605965917=73, srv1727830843=37, srv814486647=91, srv1658126924=34, srv1208989070=10, srv1227569994=13, srv1360945880=23, srv617470075=74, srv1566365794=26, srv901142213=97} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-02-23 10:54:05,356 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-02-23 10:54:05,356 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-02-23 10:54:05,356 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-02-23 10:54:05,356 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-02-23 10:54:05,356 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-02-23 10:54:05,356 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-02-23 10:54:05,356 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-02-23 10:54:05,356 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-02-23 10:54:05,356 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-02-23 10:54:05,357 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-02-23 10:54:05,357 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-02-23 10:54:05,357 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-02-23 10:54:05,357 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-02-23 10:54:05,357 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-02-23 10:54:05,357 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-02-23 10:54:05,357 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-02-23 10:54:05,357 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-02-23 10:54:05,357 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-02-23 10:54:05,357 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-02-23 10:54:05,357 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-02-23 10:54:05,357 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-02-23 10:54:05,357 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-02-23 10:54:05,357 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-02-23 10:54:05,357 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-02-23 10:54:05,357 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-02-23 10:54:05,357 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-02-23 10:54:05,357 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-02-23 10:54:05,357 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-02-23 10:54:05,357 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-02-23 10:54:05,357 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-02-23 10:54:05,357 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-02-23 10:54:05,357 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-02-23 10:54:05,358 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-02-23 10:54:05,358 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-02-23 10:54:05,358 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-02-23 10:54:05,358 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-02-23 10:54:05,358 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-02-23 10:54:05,358 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-02-23 10:54:05,358 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-02-23 10:54:05,358 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-02-23 10:54:05,358 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-02-23 10:54:05,358 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-02-23 10:54:05,358 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-02-23 10:54:05,358 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-02-23 10:54:05,358 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-02-23 10:54:05,358 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-02-23 10:54:05,358 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-02-23 10:54:05,358 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-02-23 10:54:05,358 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-02-23 10:54:05,358 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-02-23 10:54:05,358 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-02-23 10:54:05,358 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-02-23 10:54:05,358 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-02-23 10:54:05,359 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-02-23 10:54:05,359 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-02-23 10:54:05,359 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-02-23 10:54:05,359 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-02-23 10:54:05,359 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-02-23 10:54:05,359 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-02-23 10:54:05,359 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-02-23 10:54:05,359 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-02-23 10:54:05,359 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-02-23 10:54:05,359 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-02-23 10:54:05,359 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-02-23 10:54:05,359 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-02-23 10:54:05,359 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-02-23 10:54:05,359 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-02-23 10:54:05,359 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-02-23 10:54:05,359 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-02-23 10:54:05,359 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-02-23 10:54:05,359 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-02-23 10:54:05,359 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-02-23 10:54:05,359 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-02-23 10:54:05,359 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-02-23 10:54:05,359 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-02-23 10:54:05,360 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-02-23 10:54:05,360 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-02-23 10:54:05,360 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-02-23 10:54:05,360 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-02-23 10:54:05,360 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-02-23 10:54:05,360 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-02-23 10:54:05,360 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-02-23 10:54:05,360 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-02-23 10:54:05,360 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-02-23 10:54:05,360 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-02-23 10:54:05,360 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-02-23 10:54:05,360 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-02-23 10:54:05,360 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-02-23 10:54:05,360 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-02-23 10:54:05,360 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-02-23 10:54:05,360 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-02-23 10:54:05,360 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-02-23 10:54:05,361 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-02-23 10:54:05,361 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-02-23 10:54:05,361 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-02-23 10:54:05,361 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-02-23 10:54:05,361 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-02-23 10:54:05,361 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-02-23 10:54:05,361 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-02-23 10:54:05,361 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-02-23 10:54:05,361 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-02-23 10:54:05,471 INFO  [Time-limited test] balancer.StochasticLoadBalancer(381): Cluster wide - skipping load balancing because weighted average imbalance=6.397985672269699E-6 <= threshold(0.025). If you want more aggressive balancing, either lower hbase.master.balancer.stochastic.minCostNeedBalance from 0.025 or increase the relative multiplier(s) of the specific cost function(s). functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0014213381090374027); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-02-23 10:54:05,471 INFO  [Time-limited test] balancer.BalancerTestBase(570): Mock Final balance: { srv1323625103:83 , srv1649106475:83 , srv165285872:83 , srv802151095:83 , srv1014657286:84 , srv1015150743:84 , srv1026116011:84 , srv110609191:84 , srv111395243:84 , srv1161224672:84 , srv116280702:84 , srv1173494654:84 , srv1201101942:84 , srv1208989070:84 , srv1223994069:84 , srv1224407664:84 , srv1227569994:84 , srv1228013203:84 , srv1233286948:84 , srv127096881:84 , srv128533792:84 , srv1318246358:84 , srv1320960133:84 , srv1329274429:84 , srv1339956951:84 , srv1360945880:84 , srv1424785087:84 , srv1432328918:84 , srv1593193339:84 , srv1600361837:84 , srv1610663784:84 , srv163422215:84 , srv1657866375:84 , srv1658126924:84 , srv1661838224:84 , srv1698915479:84 , srv1727830843:84 , srv1770758276:84 , srv1797599669:84 , srv1865932588:84 , srv1868781887:84 , srv1879444384:84 , srv1903841341:84 , srv1904959225:84 , srv1944368228:84 , srv1959411466:84 , srv1967355124:84 , srv2050216108:84 , srv2074894421:84 , srv2114116054:84 , srv2145302537:84 , srv229779051:84 , srv310977875:84 , srv321173164:84 , srv342634923:84 , srv360210205:84 , srv407813031:84 , srv418399064:84 , srv450553549:84 , srv46297646:84 , srv464431648:84 , srv487478320:84 , srv499143668:84 , srv517116812:84 , srv518742430:84 , srv520163589:84 , srv537429263:84 , srv548531592:84 , srv584432100:84 , srv602062828:84 , srv605965917:84 , srv617470075:84 , srv638140675:84 , srv641456953:84 , srv657837921:84 , srv659470063:84 , srv672625654:84 , srv689130410:84 , srv699413260:84 , srv699947926:84 , srv709023557:84 , srv740157847:84 , srv74732695:84 , srv757675525:84 , srv770894971:84 , srv806714697:84 , srv810788125:84 , srv814486647:84 , srv84182119:84 , srv875545421:84 , srv895425619:84 , srv896545871:84 , srv901142213:84 , srv90446787:84 , srv921739293:84 , srv114818248:85 , srv1566365794:85 , srv582111944:85 , srv877499664:85 , srv1765914468:684 }
2023-02-23 10:54:05,497 INFO  [Time-limited test] hbase.ResourceChecker(175): after: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnLargeClusterWithRacks Thread=10 (was 10), OpenFileDescriptor=260 (was 260), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=318 (was 320), ProcessCount=172 (was 172), AvailableMemoryMB=7261 (was 7770)
2023-02-23 10:54:05,505 INFO  [Time-limited test] hbase.ResourceChecker(147): before: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnMidClusterWithRacks Thread=10, OpenFileDescriptor=260, MaxFileDescriptor=60000, SystemLoadAverage=318, ProcessCount=172, AvailableMemoryMB=7261
2023-02-23 10:54:05,505 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2023-02-23 10:54:05,506 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=5000, runMaxSteps=true, stepsPerRegion=800, maxRunningTime=120000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 111077.0 etc.
2023-02-23 10:54:05,517 INFO  [Time-limited test] balancer.BalancerTestBase(547): Mock Cluster : { srv1026312655:84 , srv1175817895:84 , srv1209243389:84 , srv1209846101:84 , srv1298268721:84 , srv140208109:84 , srv1403088891:84 , srv1449982749:84 , srv1505718752:84 , srv1525022807:84 , srv1550168536:84 , srv1596806761:84 , srv1849813920:84 , srv1889650728:84 , srv1990890380:84 , srv1997832038:84 , srv210253179:84 , srv2136070035:84 , srv259579735:84 , srv292452721:84 , srv461991075:84 , srv474671303:84 , srv631724315:84 , srv6389743:84 , srv712136527:84 , srv713072585:84 , srv792857184:84 , srv834302023:84 , srv906372354:84 , srv998956978:264 } [srvr=30 rgns=2700 avg=90.0 max=90 min=90]
2023-02-23 10:54:05,518 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-02-23 10:54:05,518 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1449982749=7, srv461991075=20, srv1849813920=12, srv834302023=27, srv998956978=29, srv906372354=28, srv140208109=5, srv2136070035=17, srv1298268721=4, srv210253179=16, srv292452721=19, srv1209243389=2, srv1209846101=3, srv1175817895=1, srv1997832038=15, srv6389743=23, srv1525022807=9, srv792857184=26, srv1550168536=10, srv474671303=21, srv712136527=24, srv1596806761=11, srv259579735=18, srv1505718752=8, srv631724315=22, srv1990890380=14, srv1403088891=6, srv713072585=25, srv1026312655=0, srv1889650728=13} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-02-23 10:54:05,528 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-02-23 10:54:05,528 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-02-23 10:54:05,528 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-02-23 10:54:05,528 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-02-23 10:54:05,528 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-02-23 10:54:05,528 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-02-23 10:54:05,528 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-02-23 10:54:05,528 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-02-23 10:54:05,529 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-02-23 10:54:05,529 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-02-23 10:54:05,529 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-02-23 10:54:05,529 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-02-23 10:54:05,529 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-02-23 10:54:05,529 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-02-23 10:54:05,529 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-02-23 10:54:05,529 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-02-23 10:54:05,529 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-02-23 10:54:05,529 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-02-23 10:54:05,529 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-02-23 10:54:05,529 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-02-23 10:54:05,529 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-02-23 10:54:05,529 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-02-23 10:54:05,529 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-02-23 10:54:05,530 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-02-23 10:54:05,530 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-02-23 10:54:05,530 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-02-23 10:54:05,530 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-02-23 10:54:05,530 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-02-23 10:54:05,530 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-02-23 10:54:05,530 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-02-23 10:54:05,530 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=10, number of hosts=30, number of racks=4
2023-02-23 10:54:05,548 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=1.1334297868257175, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-02-23 10:54:05,548 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.9912613476165684, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=1.1334297868257175, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=64800000
2023-02-23 10:56:05,533 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 120001 ms to try 6702787 different iterations.  Found a solution that moves 1853 regions; Going from a computed imbalance of 0.9912613476165684 to a new imbalance of 4.324994439959734E-5. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); MoveCostFunction : (multiplier=7.0, imbalance=0.6862962962962963, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-02-23 10:56:05,541 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1026312655:90 , srv1175817895:90 , srv1209243389:90 , srv1209846101:90 , srv1298268721:90 , srv140208109:90 , srv1403088891:90 , srv1449982749:90 , srv1505718752:90 , srv1525022807:90 , srv1550168536:90 , srv1596806761:90 , srv1849813920:90 , srv1889650728:90 , srv1990890380:90 , srv1997832038:90 , srv210253179:90 , srv2136070035:90 , srv259579735:90 , srv292452721:90 , srv461991075:90 , srv474671303:90 , srv631724315:90 , srv6389743:90 , srv712136527:90 , srv713072585:90 , srv792857184:90 , srv834302023:90 , srv906372354:90 , srv998956978:90 }
2023-02-23 10:56:05,542 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-02-23 10:56:05,543 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1449982749=7, srv461991075=20, srv1849813920=12, srv834302023=27, srv998956978=29, srv906372354=28, srv140208109=5, srv2136070035=17, srv1298268721=4, srv210253179=16, srv292452721=19, srv1209243389=2, srv1209846101=3, srv1175817895=1, srv1997832038=15, srv6389743=23, srv1525022807=9, srv792857184=26, srv1550168536=10, srv474671303=21, srv712136527=24, srv1596806761=11, srv259579735=18, srv1505718752=8, srv631724315=22, srv1990890380=14, srv1403088891=6, srv713072585=25, srv1026312655=0, srv1889650728=13} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-02-23 10:56:05,546 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-02-23 10:56:05,546 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-02-23 10:56:05,546 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-02-23 10:56:05,546 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-02-23 10:56:05,546 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-02-23 10:56:05,546 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-02-23 10:56:05,546 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-02-23 10:56:05,546 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-02-23 10:56:05,546 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-02-23 10:56:05,546 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-02-23 10:56:05,546 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-02-23 10:56:05,546 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-02-23 10:56:05,546 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-02-23 10:56:05,546 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-02-23 10:56:05,546 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-02-23 10:56:05,546 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-02-23 10:56:05,546 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-02-23 10:56:05,546 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-02-23 10:56:05,546 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-02-23 10:56:05,546 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-02-23 10:56:05,547 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-02-23 10:56:05,547 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-02-23 10:56:05,547 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-02-23 10:56:05,547 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-02-23 10:56:05,547 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-02-23 10:56:05,547 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-02-23 10:56:05,547 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-02-23 10:56:05,547 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-02-23 10:56:05,547 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-02-23 10:56:05,547 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-02-23 10:56:05,547 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=10, number of hosts=30, number of racks=4
2023-02-23 10:56:05,560 INFO  [Time-limited test] balancer.StochasticLoadBalancer(381): Cluster wide - skipping load balancing because weighted average imbalance=0.0 <= threshold(0.025). If you want more aggressive balancing, either lower hbase.master.balancer.stochastic.minCostNeedBalance from 0.025 or increase the relative multiplier(s) of the specific cost function(s). functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-02-23 10:56:05,560 INFO  [Time-limited test] balancer.BalancerTestBase(570): Mock Final balance: { srv1026312655:90 , srv1175817895:90 , srv1209243389:90 , srv1209846101:90 , srv1298268721:90 , srv140208109:90 , srv1403088891:90 , srv1449982749:90 , srv1505718752:90 , srv1525022807:90 , srv1550168536:90 , srv1596806761:90 , srv1849813920:90 , srv1889650728:90 , srv1990890380:90 , srv1997832038:90 , srv210253179:90 , srv2136070035:90 , srv259579735:90 , srv292452721:90 , srv461991075:90 , srv474671303:90 , srv631724315:90 , srv6389743:90 , srv712136527:90 , srv713072585:90 , srv792857184:90 , srv834302023:90 , srv906372354:90 , srv998956978:90 }
2023-02-23 10:56:05,573 INFO  [Time-limited test] hbase.ResourceChecker(175): after: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnMidClusterWithRacks Thread=9 (was 10), OpenFileDescriptor=260 (was 260), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=181 (was 318), ProcessCount=172 (was 172), AvailableMemoryMB=7235 (was 7261)