2023-02-09 17:55:56,195 INFO  [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks timeout: 13 mins
2023-02-09 17:55:56,504 WARN  [Time-limited test] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties
2023-02-09 17:55:56,605 INFO  [Time-limited test] metrics.MetricRegistriesLoader(60): Loaded MetricRegistries class org.apache.hadoop.hbase.metrics.impl.MetricRegistriesImpl
2023-02-09 17:55:56,659 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2023-02-09 17:55:56,666 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc.
2023-02-09 17:55:56,679 INFO  [Time-limited test] hbase.ResourceChecker(147): before: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnLargeClusterWithRacks Thread=10, OpenFileDescriptor=260, MaxFileDescriptor=60000, SystemLoadAverage=204, ProcessCount=168, AvailableMemoryMB=3794
2023-02-09 17:55:56,680 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2023-02-09 17:55:56,681 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=5000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=10000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc.
2023-02-09 17:55:56,810 INFO  [Time-limited test] balancer.BalancerTestBase(547): Mock Cluster : { srv1034986013:84 , srv1035876911:84 , srv1065395874:84 , srv1095848334:84 , srv109929747:84 , srv1154071059:84 , srv1164776052:84 , srv1176956283:84 , srv1178018902:84 , srv1208280762:84 , srv1242155549:84 , srv1248138405:84 , srv1289634959:84 , srv131446337:84 , srv1319566050:84 , srv1335004214:84 , srv1352321031:84 , srv1365427017:84 , srv1366876271:84 , srv1368981817:84 , srv1377075429:84 , srv1408209108:84 , srv1419375416:84 , srv1423080754:84 , srv1433278119:84 , srv1453898025:84 , srv1453968307:84 , srv1477745002:84 , srv1489656746:84 , srv1499129728:84 , srv150816151:84 , srv1526790271:84 , srv1535062672:84 , srv1547798939:84 , srv1586525916:84 , srv1602546255:84 , srv1608443083:84 , srv16845643:84 , srv1693266995:84 , srv1736322632:84 , srv1772735338:84 , srv1776128264:84 , srv1798137567:84 , srv1798393833:84 , srv1802230462:84 , srv1822433229:84 , srv1823750975:84 , srv1852206786:84 , srv1883392442:84 , srv1885995011:84 , srv1905104421:84 , srv191436427:84 , srv192339124:84 , srv1954877207:84 , srv1978753995:84 , srv1985261122:84 , srv1985757910:84 , srv2018045570:84 , srv2038931226:84 , srv2070038956:84 , srv217744436:84 , srv242725835:84 , srv262389026:84 , srv270637148:84 , srv294598634:84 , srv297855834:84 , srv298975670:84 , srv324189800:84 , srv337843474:84 , srv349167907:84 , srv401886502:84 , srv407699499:84 , srv467690640:84 , srv490252766:84 , srv503557749:84 , srv513634201:84 , srv513780355:84 , srv521573287:84 , srv556444421:84 , srv557237963:84 , srv558439295:84 , srv592905865:84 , srv592988540:84 , srv598348796:84 , srv649358650:84 , srv710290152:84 , srv779744196:84 , srv795745801:84 , srv801360261:84 , srv802467941:84 , srv826923170:84 , srv834267535:84 , srv869615705:84 , srv872628003:84 , srv873973298:84 , srv876828349:84 , srv907972496:84 , srv967656474:84 , srv994208241:84 , srv1684653654:684 } [srvr=100 rgns=9000 avg=90.0 max=90 min=90]
2023-02-09 17:55:56,817 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-02-09 17:55:56,823 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1586525916=34, srv1176956283=7, srv294598634=65, srv16845643=37, srv598348796=84, srv1377075429=20, srv521573287=78, srv1693266995=39, srv710290152=86, srv1978753995=55, srv907972496=97, srv869615705=93, srv109929747=4, srv1602546255=35, srv1419375416=22, srv401886502=71, srv150816151=30, srv270637148=64, srv2018045570=58, srv1408209108=21, srv217744436=61, srv349167907=70, srv558439295=81, srv1178018902=8, srv1547798939=33, srv1208280762=9, srv1065395874=2, srv324189800=68, srv513634201=76, srv1352321031=16, srv801360261=89, srv1798137567=43, srv1776128264=42, srv1335004214=15, srv1885995011=50, srv1772735338=41, srv131446337=13, srv1736322632=40, srv802467941=90, srv297855834=66, srv490252766=74, srv1883392442=49, srv592905865=82, srv592988540=83, srv1535062672=32, srv1823750975=47, srv1453968307=26, srv1822433229=46, srv994208241=99, srv1985757910=57, srv1164776052=6, srv1319566050=14, srv1477745002=27, srv1423080754=23, srv337843474=69, srv192339124=53, srv1248138405=11, srv298975670=67, srv1095848334=3, srv1453898025=25, srv1368981817=19, srv2070038956=60, srv779744196=87, srv1035876911=1, srv513780355=77, srv649358650=85, srv967656474=98, srv2038931226=59, srv876828349=96, srv1034986013=0, srv826923170=91, srv795745801=88, srv1802230462=45, srv1154071059=5, srv556444421=79, srv834267535=92, srv1242155549=10, srv1985261122=56, srv872628003=94, srv1798393833=44, srv873973298=95, srv191436427=52, srv1365427017=17, srv1499129728=29, srv503557749=75, srv1684653654=38, srv467690640=73, srv557237963=80, srv1608443083=36, srv407699499=72, srv1489656746=28, srv262389026=63, srv1289634959=12, srv1954877207=54, srv1433278119=24, srv1526790271=31, srv1905104421=51, srv1852206786=48, srv1366876271=18, srv242725835=62} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-02-09 17:55:56,900 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-02-09 17:55:56,900 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-02-09 17:55:56,900 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-02-09 17:55:56,901 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-02-09 17:55:56,901 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-02-09 17:55:56,901 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-02-09 17:55:56,901 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-02-09 17:55:56,901 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-02-09 17:55:56,901 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-02-09 17:55:56,901 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-02-09 17:55:56,901 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-02-09 17:55:56,901 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-02-09 17:55:56,901 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-02-09 17:55:56,901 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-02-09 17:55:56,902 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-02-09 17:55:56,902 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-02-09 17:55:56,902 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-02-09 17:55:56,902 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-02-09 17:55:56,902 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-02-09 17:55:56,902 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-02-09 17:55:56,902 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-02-09 17:55:56,902 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-02-09 17:55:56,902 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-02-09 17:55:56,902 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-02-09 17:55:56,902 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-02-09 17:55:56,903 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-02-09 17:55:56,903 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-02-09 17:55:56,903 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-02-09 17:55:56,903 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-02-09 17:55:56,903 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-02-09 17:55:56,903 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-02-09 17:55:56,903 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-02-09 17:55:56,903 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-02-09 17:55:56,903 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-02-09 17:55:56,903 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-02-09 17:55:56,903 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-02-09 17:55:56,904 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-02-09 17:55:56,904 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-02-09 17:55:56,904 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-02-09 17:55:56,904 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-02-09 17:55:56,904 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-02-09 17:55:56,904 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-02-09 17:55:56,904 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-02-09 17:55:56,904 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-02-09 17:55:56,904 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-02-09 17:55:56,904 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-02-09 17:55:56,904 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-02-09 17:55:56,904 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-02-09 17:55:56,905 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-02-09 17:55:56,905 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-02-09 17:55:56,905 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-02-09 17:55:56,905 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-02-09 17:55:56,905 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-02-09 17:55:56,905 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-02-09 17:55:56,905 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-02-09 17:55:56,905 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-02-09 17:55:56,905 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-02-09 17:55:56,905 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-02-09 17:55:56,905 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-02-09 17:55:56,905 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-02-09 17:55:56,906 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-02-09 17:55:56,906 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-02-09 17:55:56,906 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-02-09 17:55:56,906 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-02-09 17:55:56,906 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-02-09 17:55:56,906 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-02-09 17:55:56,906 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-02-09 17:55:56,906 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-02-09 17:55:56,906 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-02-09 17:55:56,906 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-02-09 17:55:56,906 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-02-09 17:55:56,907 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-02-09 17:55:56,907 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-02-09 17:55:56,907 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-02-09 17:55:56,907 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-02-09 17:55:56,907 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-02-09 17:55:56,907 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-02-09 17:55:56,907 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-02-09 17:55:56,907 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-02-09 17:55:56,907 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-02-09 17:55:56,907 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-02-09 17:55:56,907 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-02-09 17:55:56,907 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-02-09 17:55:56,907 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-02-09 17:55:56,908 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-02-09 17:55:56,908 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-02-09 17:55:56,908 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-02-09 17:55:56,908 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-02-09 17:55:56,908 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-02-09 17:55:56,908 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-02-09 17:55:56,908 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-02-09 17:55:56,908 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-02-09 17:55:56,908 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-02-09 17:55:56,908 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-02-09 17:55:56,909 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-02-09 17:55:56,909 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-02-09 17:55:56,909 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-02-09 17:55:56,909 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-02-09 17:55:56,909 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-02-09 17:55:56,909 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-02-09 17:55:56,909 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-02-09 17:55:57,205 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.06666666666666667, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-02-09 17:55:57,205 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-02-09 17:55:57,205 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.9909252140407105, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.06666666666666667, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-02-09 17:55:57,859 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 928 ms to try 5000 different iterations.  Found a solution that moves 4692 regions; Going from a computed imbalance of 0.9909252140407105 to a new imbalance of 0.17923244754922144. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0410320166130071, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.05766889507381594, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.5213333333333333, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0410320166130071, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.17466666666666666, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.23875, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-02-09 17:55:57,880 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv337843474:78 , srv490252766:79 , srv1883392442:80 , srv1035876911:81 , srv1693266995:81 , srv1798393833:81 , srv1823750975:81 , srv192339124:81 , srv521573287:81 , srv592988540:81 , srv1208280762:82 , srv1335004214:82 , srv297855834:82 , srv1176956283:83 , srv1178018902:83 , srv1453898025:83 , srv1453968307:83 , srv1477745002:83 , srv1547798939:83 , srv1798137567:83 , srv270637148:83 , srv467690640:83 , srv558439295:83 , srv801360261:83 , srv1377075429:84 , srv1499129728:84 , srv1905104421:84 , srv1978753995:84 , srv1065395874:85 , srv1164776052:85 , srv1242155549:85 , srv1366876271:85 , srv1608443083:85 , srv191436427:85 , srv2038931226:85 , srv401886502:85 , srv557237963:85 , srv795745801:85 , srv802467941:85 , srv869615705:85 , srv876828349:85 , srv994208241:85 , srv1419375416:86 , srv1489656746:86 , srv1772735338:86 , srv1802230462:86 , srv324189800:86 , srv649358650:86 , srv872628003:86 , srv907972496:86 , srv1034986013:87 , srv1154071059:87 , srv1352321031:87 , srv1408209108:87 , srv16845643:87 , srv1985757910:87 , srv513780355:87 , srv779744196:87 , srv826923170:87 , srv873973298:87 , srv1095848334:88 , srv109929747:88 , srv1433278119:88 , srv1535062672:88 , srv1586525916:88 , srv1776128264:88 , srv1822433229:88 , srv2070038956:88 , srv298975670:88 , srv503557749:88 , srv598348796:88 , srv834267535:88 , srv1289634959:89 , srv1365427017:89 , srv1423080754:89 , srv1885995011:89 , srv1985261122:89 , srv2018045570:89 , srv407699499:89 , srv513634201:89 , srv131446337:90 , srv1526790271:90 , srv1602546255:90 , srv1736322632:90 , srv1954877207:90 , srv217744436:90 , srv349167907:90 , srv556444421:90 , srv967656474:90 , srv1248138405:91 , srv1368981817:91 , srv150816151:91 , srv242725835:91 , srv262389026:91 , srv294598634:91 , srv710290152:91 , srv1852206786:92 , srv1319566050:96 , srv592905865:96 , srv1684653654:454 }
2023-02-09 17:55:57,884 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-02-09 17:55:57,885 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1586525916=34, srv1176956283=7, srv294598634=65, srv16845643=37, srv598348796=84, srv1377075429=20, srv521573287=78, srv1693266995=39, srv710290152=86, srv1978753995=55, srv907972496=97, srv869615705=93, srv109929747=4, srv1602546255=35, srv1419375416=22, srv401886502=71, srv150816151=30, srv270637148=64, srv2018045570=58, srv1408209108=21, srv217744436=61, srv349167907=70, srv558439295=81, srv1178018902=8, srv1547798939=33, srv1208280762=9, srv1065395874=2, srv324189800=68, srv513634201=76, srv1352321031=16, srv801360261=89, srv1798137567=43, srv1776128264=42, srv1335004214=15, srv1885995011=50, srv1772735338=41, srv131446337=13, srv1736322632=40, srv802467941=90, srv297855834=66, srv490252766=74, srv1883392442=49, srv592905865=82, srv592988540=83, srv1535062672=32, srv1823750975=47, srv1453968307=26, srv1822433229=46, srv994208241=99, srv1985757910=57, srv1164776052=6, srv1319566050=14, srv1477745002=27, srv1423080754=23, srv337843474=69, srv192339124=53, srv1248138405=11, srv298975670=67, srv1095848334=3, srv1453898025=25, srv1368981817=19, srv2070038956=60, srv779744196=87, srv1035876911=1, srv513780355=77, srv649358650=85, srv967656474=98, srv2038931226=59, srv876828349=96, srv1034986013=0, srv826923170=91, srv795745801=88, srv1802230462=45, srv1154071059=5, srv556444421=79, srv834267535=92, srv1242155549=10, srv1985261122=56, srv872628003=94, srv1798393833=44, srv873973298=95, srv191436427=52, srv1365427017=17, srv1499129728=29, srv503557749=75, srv1684653654=38, srv467690640=73, srv557237963=80, srv1608443083=36, srv407699499=72, srv1489656746=28, srv262389026=63, srv1289634959=12, srv1954877207=54, srv1433278119=24, srv1526790271=31, srv1905104421=51, srv1852206786=48, srv1366876271=18, srv242725835=62} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-02-09 17:55:57,899 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-02-09 17:55:57,899 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-02-09 17:55:57,899 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-02-09 17:55:57,899 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-02-09 17:55:57,899 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-02-09 17:55:57,899 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-02-09 17:55:57,899 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-02-09 17:55:57,900 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-02-09 17:55:57,900 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-02-09 17:55:57,900 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-02-09 17:55:57,900 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-02-09 17:55:57,900 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-02-09 17:55:57,900 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-02-09 17:55:57,900 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-02-09 17:55:57,900 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-02-09 17:55:57,900 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-02-09 17:55:57,900 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-02-09 17:55:57,900 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-02-09 17:55:57,900 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-02-09 17:55:57,900 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-02-09 17:55:57,901 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-02-09 17:55:57,901 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-02-09 17:55:57,901 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-02-09 17:55:57,901 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-02-09 17:55:57,901 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-02-09 17:55:57,901 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-02-09 17:55:57,901 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-02-09 17:55:57,901 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-02-09 17:55:57,901 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-02-09 17:55:57,901 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-02-09 17:55:57,901 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-02-09 17:55:57,901 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-02-09 17:55:57,901 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-02-09 17:55:57,901 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-02-09 17:55:57,902 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-02-09 17:55:57,902 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-02-09 17:55:57,902 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-02-09 17:55:57,902 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-02-09 17:55:57,902 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-02-09 17:55:57,902 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-02-09 17:55:57,902 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-02-09 17:55:57,902 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-02-09 17:55:57,902 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-02-09 17:55:57,902 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-02-09 17:55:57,902 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-02-09 17:55:57,902 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-02-09 17:55:57,902 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-02-09 17:55:57,902 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-02-09 17:55:57,902 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-02-09 17:55:57,903 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-02-09 17:55:57,903 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-02-09 17:55:57,903 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-02-09 17:55:57,903 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-02-09 17:55:57,903 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-02-09 17:55:57,903 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-02-09 17:55:57,903 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-02-09 17:55:57,903 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-02-09 17:55:57,903 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-02-09 17:55:57,903 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-02-09 17:55:57,903 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-02-09 17:55:57,903 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-02-09 17:55:57,903 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-02-09 17:55:57,903 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-02-09 17:55:57,903 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-02-09 17:55:57,904 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-02-09 17:55:57,904 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-02-09 17:55:57,904 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-02-09 17:55:57,904 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-02-09 17:55:57,904 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-02-09 17:55:57,904 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-02-09 17:55:57,904 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-02-09 17:55:57,904 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-02-09 17:55:57,904 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-02-09 17:55:57,904 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-02-09 17:55:57,904 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-02-09 17:55:57,904 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-02-09 17:55:57,904 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-02-09 17:55:57,904 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-02-09 17:55:57,904 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-02-09 17:55:57,905 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-02-09 17:55:57,905 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-02-09 17:55:57,905 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-02-09 17:55:57,905 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-02-09 17:55:57,905 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-02-09 17:55:57,905 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-02-09 17:55:57,905 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-02-09 17:55:57,905 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-02-09 17:55:57,905 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-02-09 17:55:57,905 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-02-09 17:55:57,905 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-02-09 17:55:57,905 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-02-09 17:55:57,905 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-02-09 17:55:57,905 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-02-09 17:55:57,906 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-02-09 17:55:57,906 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-02-09 17:55:57,906 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-02-09 17:55:57,906 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-02-09 17:55:57,906 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-02-09 17:55:57,906 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-02-09 17:55:57,906 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-02-09 17:55:57,906 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-02-09 17:55:58,050 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0410320166130071, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.05766889507381594, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0410320166130071, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.17466666666666666, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.23875, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-02-09 17:55:58,050 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-02-09 17:55:58,050 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.17919959346301695, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0410320166130071, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.05766889507381594, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0410320166130071, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.17466666666666666, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.23875, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-02-09 17:55:58,329 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 404 ms to try 5000 different iterations.  Found a solution that moves 2619 regions; Going from a computed imbalance of 0.17919959346301695 to a new imbalance of 0.01340875620848661. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.02170727725949758); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.03317470673913839, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.291, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.02170727725949758); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.01025); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.043416666666666666, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-02-09 17:55:58,337 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1319566050:77 , srv592905865:77 , srv710290152:79 , srv1736322632:80 , srv1852206786:80 , srv242725835:80 , srv1368981817:81 , srv150816151:81 , srv1954877207:81 , srv217744436:81 , srv262389026:81 , srv1248138405:82 , srv1526790271:82 , srv1535062672:82 , srv1602546255:82 , srv1776128264:82 , srv1885995011:82 , srv2070038956:82 , srv349167907:82 , srv967656474:82 , srv1095848334:83 , srv109929747:83 , srv1423080754:83 , srv1586525916:83 , srv298975670:83 , srv1154071059:84 , srv1289634959:84 , srv1433278119:84 , srv294598634:84 , srv407699499:84 , srv503557749:84 , srv513634201:84 , srv556444421:84 , srv131446337:85 , srv1365427017:85 , srv1419375416:85 , srv1489656746:85 , srv1802230462:85 , srv1985261122:85 , srv2018045570:85 , srv598348796:85 , srv779744196:85 , srv834267535:85 , srv872628003:85 , srv873973298:85 , srv1034986013:86 , srv1065395874:86 , srv1608443083:86 , srv16845643:86 , srv1822433229:86 , srv1978753995:86 , srv1985757910:86 , srv2038931226:86 , srv513780355:86 , srv826923170:86 , srv907972496:86 , srv1178018902:87 , srv1242155549:87 , srv1352321031:87 , srv1366876271:87 , srv1408209108:87 , srv1499129728:87 , srv1772735338:87 , srv191436427:87 , srv467690640:87 , srv649358650:87 , srv795745801:87 , srv802467941:87 , srv1164776052:88 , srv1176956283:88 , srv1377075429:88 , srv1453968307:88 , srv1798137567:88 , srv1905104421:88 , srv401886502:88 , srv801360261:88 , srv876828349:88 , srv1335004214:89 , srv1453898025:89 , srv1547798939:89 , srv270637148:89 , srv557237963:89 , srv558439295:89 , srv592988540:89 , srv869615705:89 , srv994208241:89 , srv1035876911:90 , srv1208280762:90 , srv1693266995:90 , srv1798393833:90 , srv1823750975:90 , srv192339124:90 , srv297855834:90 , srv324189800:90 , srv1477745002:91 , srv1883392442:92 , srv490252766:92 , srv521573287:92 , srv337843474:94 , srv1684653654:513 }
2023-02-09 17:55:58,341 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-02-09 17:55:58,342 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1586525916=34, srv1176956283=7, srv294598634=65, srv16845643=37, srv598348796=84, srv1377075429=20, srv521573287=78, srv1693266995=39, srv710290152=86, srv1978753995=55, srv907972496=97, srv869615705=93, srv109929747=4, srv1602546255=35, srv1419375416=22, srv401886502=71, srv150816151=30, srv270637148=64, srv2018045570=58, srv1408209108=21, srv217744436=61, srv349167907=70, srv558439295=81, srv1178018902=8, srv1547798939=33, srv1208280762=9, srv1065395874=2, srv324189800=68, srv513634201=76, srv1352321031=16, srv801360261=89, srv1798137567=43, srv1776128264=42, srv1335004214=15, srv1885995011=50, srv1772735338=41, srv131446337=13, srv1736322632=40, srv802467941=90, srv297855834=66, srv490252766=74, srv1883392442=49, srv592905865=82, srv592988540=83, srv1535062672=32, srv1823750975=47, srv1453968307=26, srv1822433229=46, srv994208241=99, srv1985757910=57, srv1164776052=6, srv1319566050=14, srv1477745002=27, srv1423080754=23, srv337843474=69, srv192339124=53, srv1248138405=11, srv298975670=67, srv1095848334=3, srv1453898025=25, srv1368981817=19, srv2070038956=60, srv779744196=87, srv1035876911=1, srv513780355=77, srv649358650=85, srv967656474=98, srv2038931226=59, srv876828349=96, srv1034986013=0, srv826923170=91, srv795745801=88, srv1802230462=45, srv1154071059=5, srv556444421=79, srv834267535=92, srv1242155549=10, srv1985261122=56, srv872628003=94, srv1798393833=44, srv873973298=95, srv191436427=52, srv1365427017=17, srv1499129728=29, srv503557749=75, srv1684653654=38, srv467690640=73, srv557237963=80, srv1608443083=36, srv407699499=72, srv1489656746=28, srv262389026=63, srv1289634959=12, srv1954877207=54, srv1433278119=24, srv1526790271=31, srv1905104421=51, srv1852206786=48, srv1366876271=18, srv242725835=62} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-02-09 17:55:58,361 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-02-09 17:55:58,361 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-02-09 17:55:58,361 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-02-09 17:55:58,361 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-02-09 17:55:58,361 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-02-09 17:55:58,361 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-02-09 17:55:58,361 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-02-09 17:55:58,361 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-02-09 17:55:58,361 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-02-09 17:55:58,361 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-02-09 17:55:58,361 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-02-09 17:55:58,362 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-02-09 17:55:58,362 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-02-09 17:55:58,362 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-02-09 17:55:58,362 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-02-09 17:55:58,362 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-02-09 17:55:58,362 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-02-09 17:55:58,362 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-02-09 17:55:58,362 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-02-09 17:55:58,362 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-02-09 17:55:58,362 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-02-09 17:55:58,362 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-02-09 17:55:58,362 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-02-09 17:55:58,362 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-02-09 17:55:58,362 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-02-09 17:55:58,362 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-02-09 17:55:58,363 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-02-09 17:55:58,363 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-02-09 17:55:58,363 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-02-09 17:55:58,363 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-02-09 17:55:58,363 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-02-09 17:55:58,363 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-02-09 17:55:58,363 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-02-09 17:55:58,363 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-02-09 17:55:58,363 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-02-09 17:55:58,363 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-02-09 17:55:58,363 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-02-09 17:55:58,363 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-02-09 17:55:58,363 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-02-09 17:55:58,363 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-02-09 17:55:58,363 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-02-09 17:55:58,364 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-02-09 17:55:58,364 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-02-09 17:55:58,364 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-02-09 17:55:58,364 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-02-09 17:55:58,364 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-02-09 17:55:58,364 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-02-09 17:55:58,364 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-02-09 17:55:58,364 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-02-09 17:55:58,364 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-02-09 17:55:58,364 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-02-09 17:55:58,364 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-02-09 17:55:58,364 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-02-09 17:55:58,364 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-02-09 17:55:58,364 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-02-09 17:55:58,364 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-02-09 17:55:58,364 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-02-09 17:55:58,365 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-02-09 17:55:58,365 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-02-09 17:55:58,365 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-02-09 17:55:58,365 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-02-09 17:55:58,365 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-02-09 17:55:58,365 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-02-09 17:55:58,365 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-02-09 17:55:58,365 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-02-09 17:55:58,365 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-02-09 17:55:58,365 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-02-09 17:55:58,365 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-02-09 17:55:58,365 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-02-09 17:55:58,365 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-02-09 17:55:58,365 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-02-09 17:55:58,365 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-02-09 17:55:58,366 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-02-09 17:55:58,366 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-02-09 17:55:58,366 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-02-09 17:55:58,366 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-02-09 17:55:58,366 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-02-09 17:55:58,366 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-02-09 17:55:58,366 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-02-09 17:55:58,366 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-02-09 17:55:58,366 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-02-09 17:55:58,366 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-02-09 17:55:58,366 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-02-09 17:55:58,366 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-02-09 17:55:58,366 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-02-09 17:55:58,366 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-02-09 17:55:58,366 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-02-09 17:55:58,366 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-02-09 17:55:58,367 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-02-09 17:55:58,367 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-02-09 17:55:58,367 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-02-09 17:55:58,367 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-02-09 17:55:58,367 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-02-09 17:55:58,367 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-02-09 17:55:58,367 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-02-09 17:55:58,367 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-02-09 17:55:58,367 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-02-09 17:55:58,367 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-02-09 17:55:58,367 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-02-09 17:55:58,367 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-02-09 17:55:58,367 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-02-09 17:55:58,492 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.02170727725949758); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.03317470673913839, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.02170727725949758); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.01025); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.043416666666666666, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-02-09 17:55:58,493 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-02-09 17:55:58,493 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.013390417578527212, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.02170727725949758); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.03317470673913839, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.02170727725949758); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.01025); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.043416666666666666, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-02-09 17:55:58,774 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 388 ms to try 5000 different iterations.  Found a solution that moves 957 regions; Going from a computed imbalance of 0.013390417578527212 to a new imbalance of 5.13836110919848E-4. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0063288916631981705); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.009223499972332542); MoveCostFunction : (multiplier=7.0, imbalance=0.10633333333333334, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0063288916631981705); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=8.333333333333333E-5); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.004); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-02-09 17:55:58,778 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1985261122:82 , srv294598634:82 , srv324189800:82 , srv1365427017:83 , srv1408209108:83 , srv1477745002:83 , srv1822433229:83 , srv2018045570:83 , srv994208241:83 , srv1164776052:84 , srv131446337:84 , srv1319566050:84 , srv407699499:84 , srv513634201:84 , srv513780355:84 , srv556444421:84 , srv557237963:84 , srv649358650:84 , srv779744196:84 , srv826923170:84 , srv869615705:84 , srv1034986013:85 , srv1208280762:85 , srv1242155549:85 , srv1248138405:85 , srv1289634959:85 , srv1352321031:85 , srv1377075429:85 , srv1423080754:85 , srv1433278119:85 , srv150816151:85 , srv1526790271:85 , srv1586525916:85 , srv1602546255:85 , srv16845643:85 , srv1772735338:85 , srv1852206786:85 , srv1883392442:85 , srv191436427:85 , srv297855834:85 , srv337843474:85 , srv401886502:85 , srv490252766:85 , srv521573287:85 , srv592905865:85 , srv598348796:85 , srv834267535:85 , srv873973298:85 , srv876828349:85 , srv967656474:85 , srv1035876911:86 , srv1065395874:86 , srv1095848334:86 , srv1154071059:86 , srv1176956283:86 , srv1335004214:86 , srv1366876271:86 , srv1368981817:86 , srv1419375416:86 , srv1453968307:86 , srv1489656746:86 , srv1499129728:86 , srv1547798939:86 , srv1608443083:86 , srv1693266995:86 , srv1802230462:86 , srv1885995011:86 , srv1905104421:86 , srv1954877207:86 , srv1985757910:86 , srv262389026:86 , srv270637148:86 , srv298975670:86 , srv349167907:86 , srv503557749:86 , srv558439295:86 , srv795745801:86 , srv802467941:86 , srv872628003:86 , srv907972496:86 , srv109929747:87 , srv1178018902:87 , srv1535062672:87 , srv1736322632:87 , srv1776128264:87 , srv1798137567:87 , srv1798393833:87 , srv1823750975:87 , srv192339124:87 , srv1978753995:87 , srv2038931226:87 , srv217744436:87 , srv242725835:87 , srv592988540:87 , srv710290152:87 , srv801360261:87 , srv1453898025:88 , srv2070038956:88 , srv467690640:88 , srv1684653654:547 }
2023-02-09 17:55:58,783 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-02-09 17:55:58,785 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1586525916=34, srv1176956283=7, srv294598634=65, srv16845643=37, srv598348796=84, srv1377075429=20, srv521573287=78, srv1693266995=39, srv710290152=86, srv1978753995=55, srv907972496=97, srv869615705=93, srv109929747=4, srv1602546255=35, srv1419375416=22, srv401886502=71, srv150816151=30, srv270637148=64, srv2018045570=58, srv1408209108=21, srv217744436=61, srv349167907=70, srv558439295=81, srv1178018902=8, srv1547798939=33, srv1208280762=9, srv1065395874=2, srv324189800=68, srv513634201=76, srv1352321031=16, srv801360261=89, srv1798137567=43, srv1776128264=42, srv1335004214=15, srv1885995011=50, srv1772735338=41, srv131446337=13, srv1736322632=40, srv802467941=90, srv297855834=66, srv490252766=74, srv1883392442=49, srv592905865=82, srv592988540=83, srv1535062672=32, srv1823750975=47, srv1453968307=26, srv1822433229=46, srv994208241=99, srv1985757910=57, srv1164776052=6, srv1319566050=14, srv1477745002=27, srv1423080754=23, srv337843474=69, srv192339124=53, srv1248138405=11, srv298975670=67, srv1095848334=3, srv1453898025=25, srv1368981817=19, srv2070038956=60, srv779744196=87, srv1035876911=1, srv513780355=77, srv649358650=85, srv967656474=98, srv2038931226=59, srv876828349=96, srv1034986013=0, srv826923170=91, srv795745801=88, srv1802230462=45, srv1154071059=5, srv556444421=79, srv834267535=92, srv1242155549=10, srv1985261122=56, srv872628003=94, srv1798393833=44, srv873973298=95, srv191436427=52, srv1365427017=17, srv1499129728=29, srv503557749=75, srv1684653654=38, srv467690640=73, srv557237963=80, srv1608443083=36, srv407699499=72, srv1489656746=28, srv262389026=63, srv1289634959=12, srv1954877207=54, srv1433278119=24, srv1526790271=31, srv1905104421=51, srv1852206786=48, srv1366876271=18, srv242725835=62} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-02-09 17:55:58,803 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-02-09 17:55:58,803 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-02-09 17:55:58,803 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-02-09 17:55:58,803 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-02-09 17:55:58,803 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-02-09 17:55:58,803 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-02-09 17:55:58,804 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-02-09 17:55:58,804 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-02-09 17:55:58,804 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-02-09 17:55:58,804 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-02-09 17:55:58,804 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-02-09 17:55:58,804 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-02-09 17:55:58,804 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-02-09 17:55:58,804 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-02-09 17:55:58,804 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-02-09 17:55:58,804 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-02-09 17:55:58,804 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-02-09 17:55:58,805 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-02-09 17:55:58,805 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-02-09 17:55:58,805 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-02-09 17:55:58,805 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-02-09 17:55:58,805 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-02-09 17:55:58,805 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-02-09 17:55:58,805 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-02-09 17:55:58,805 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-02-09 17:55:58,805 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-02-09 17:55:58,805 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-02-09 17:55:58,805 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-02-09 17:55:58,806 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-02-09 17:55:58,806 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-02-09 17:55:58,806 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-02-09 17:55:58,806 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-02-09 17:55:58,806 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-02-09 17:55:58,806 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-02-09 17:55:58,806 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-02-09 17:55:58,806 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-02-09 17:55:58,806 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-02-09 17:55:58,806 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-02-09 17:55:58,806 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-02-09 17:55:58,807 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-02-09 17:55:58,807 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-02-09 17:55:58,807 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-02-09 17:55:58,807 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-02-09 17:55:58,807 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-02-09 17:55:58,807 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-02-09 17:55:58,807 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-02-09 17:55:58,807 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-02-09 17:55:58,807 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-02-09 17:55:58,807 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-02-09 17:55:58,808 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-02-09 17:55:58,808 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-02-09 17:55:58,808 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-02-09 17:55:58,808 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-02-09 17:55:58,808 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-02-09 17:55:58,808 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-02-09 17:55:58,808 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-02-09 17:55:58,808 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-02-09 17:55:58,808 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-02-09 17:55:58,808 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-02-09 17:55:58,808 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-02-09 17:55:58,808 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-02-09 17:55:58,809 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-02-09 17:55:58,809 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-02-09 17:55:58,809 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-02-09 17:55:58,809 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-02-09 17:55:58,809 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-02-09 17:55:58,809 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-02-09 17:55:58,809 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-02-09 17:55:58,809 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-02-09 17:55:58,809 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-02-09 17:55:58,809 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-02-09 17:55:58,809 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-02-09 17:55:58,809 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-02-09 17:55:58,810 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-02-09 17:55:58,810 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-02-09 17:55:58,810 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-02-09 17:55:58,810 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-02-09 17:55:58,810 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-02-09 17:55:58,810 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-02-09 17:55:58,810 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-02-09 17:55:58,810 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-02-09 17:55:58,810 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-02-09 17:55:58,810 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-02-09 17:55:58,810 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-02-09 17:55:58,810 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-02-09 17:55:58,811 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-02-09 17:55:58,811 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-02-09 17:55:58,811 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-02-09 17:55:58,811 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-02-09 17:55:58,811 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-02-09 17:55:58,811 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-02-09 17:55:58,811 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-02-09 17:55:58,811 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-02-09 17:55:58,811 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-02-09 17:55:58,811 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-02-09 17:55:58,811 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-02-09 17:55:58,811 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-02-09 17:55:58,812 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-02-09 17:55:58,812 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-02-09 17:55:58,812 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-02-09 17:55:58,812 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-02-09 17:55:58,961 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0063288916631981705); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.009223499972332542); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0063288916631981705); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=8.333333333333333E-5); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.004); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-02-09 17:55:58,961 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-02-09 17:55:58,961 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=5.071350536952801E-4, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0063288916631981705); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.009223499972332542); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0063288916631981705); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=8.333333333333333E-5); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.004); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-02-09 17:55:59,287 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 463 ms to try 5000 different iterations.  Found a solution that moves 237 regions; Going from a computed imbalance of 5.071350536952801E-4 to a new imbalance of 4.272757503466158E-5. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=3.158529131194229E-4); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.002118805753879094); MoveCostFunction : (multiplier=7.0, imbalance=0.026333333333333334, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=3.158529131194229E-4); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=3.333333333333333E-4); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-02-09 17:55:59,288 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1453898025:82 , srv1352321031:83 , srv1985757910:83 , srv349167907:83 , srv1034986013:84 , srv109929747:84 , srv1242155549:84 , srv1248138405:84 , srv1289634959:84 , srv131446337:84 , srv1366876271:84 , srv1368981817:84 , srv1453968307:84 , srv1547798939:84 , srv16845643:84 , srv1772735338:84 , srv1798137567:84 , srv1798393833:84 , srv1823750975:84 , srv1885995011:84 , srv1905104421:84 , srv192339124:84 , srv2070038956:84 , srv217744436:84 , srv242725835:84 , srv270637148:84 , srv324189800:84 , srv401886502:84 , srv467690640:84 , srv521573287:84 , srv556444421:84 , srv557237963:84 , srv558439295:84 , srv592905865:84 , srv598348796:84 , srv795745801:84 , srv801360261:84 , srv802467941:84 , srv834267535:84 , srv869615705:84 , srv876828349:84 , srv907972496:84 , srv1035876911:85 , srv1065395874:85 , srv1095848334:85 , srv1154071059:85 , srv1164776052:85 , srv1176956283:85 , srv1178018902:85 , srv1208280762:85 , srv1319566050:85 , srv1335004214:85 , srv1365427017:85 , srv1377075429:85 , srv1408209108:85 , srv1419375416:85 , srv1423080754:85 , srv1433278119:85 , srv1477745002:85 , srv1489656746:85 , srv1499129728:85 , srv150816151:85 , srv1526790271:85 , srv1535062672:85 , srv1602546255:85 , srv1608443083:85 , srv1693266995:85 , srv1736322632:85 , srv1776128264:85 , srv1802230462:85 , srv1822433229:85 , srv1852206786:85 , srv1883392442:85 , srv191436427:85 , srv1954877207:85 , srv1978753995:85 , srv2018045570:85 , srv2038931226:85 , srv262389026:85 , srv294598634:85 , srv297855834:85 , srv298975670:85 , srv337843474:85 , srv407699499:85 , srv503557749:85 , srv513634201:85 , srv513780355:85 , srv592988540:85 , srv649358650:85 , srv710290152:85 , srv826923170:85 , srv872628003:85 , srv873973298:85 , srv967656474:85 , srv994208241:85 , srv1586525916:86 , srv1985261122:86 , srv490252766:86 , srv779744196:86 , srv1684653654:628 }
2023-02-09 17:55:59,291 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-02-09 17:55:59,292 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1586525916=34, srv1176956283=7, srv294598634=65, srv16845643=37, srv598348796=84, srv1377075429=20, srv521573287=78, srv1693266995=39, srv710290152=86, srv1978753995=55, srv907972496=97, srv869615705=93, srv109929747=4, srv1602546255=35, srv1419375416=22, srv401886502=71, srv150816151=30, srv270637148=64, srv2018045570=58, srv1408209108=21, srv217744436=61, srv349167907=70, srv558439295=81, srv1178018902=8, srv1547798939=33, srv1208280762=9, srv1065395874=2, srv324189800=68, srv513634201=76, srv1352321031=16, srv801360261=89, srv1798137567=43, srv1776128264=42, srv1335004214=15, srv1885995011=50, srv1772735338=41, srv131446337=13, srv1736322632=40, srv802467941=90, srv297855834=66, srv490252766=74, srv1883392442=49, srv592905865=82, srv592988540=83, srv1535062672=32, srv1823750975=47, srv1453968307=26, srv1822433229=46, srv994208241=99, srv1985757910=57, srv1164776052=6, srv1319566050=14, srv1477745002=27, srv1423080754=23, srv337843474=69, srv192339124=53, srv1248138405=11, srv298975670=67, srv1095848334=3, srv1453898025=25, srv1368981817=19, srv2070038956=60, srv779744196=87, srv1035876911=1, srv513780355=77, srv649358650=85, srv967656474=98, srv2038931226=59, srv876828349=96, srv1034986013=0, srv826923170=91, srv795745801=88, srv1802230462=45, srv1154071059=5, srv556444421=79, srv834267535=92, srv1242155549=10, srv1985261122=56, srv872628003=94, srv1798393833=44, srv873973298=95, srv191436427=52, srv1365427017=17, srv1499129728=29, srv503557749=75, srv1684653654=38, srv467690640=73, srv557237963=80, srv1608443083=36, srv407699499=72, srv1489656746=28, srv262389026=63, srv1289634959=12, srv1954877207=54, srv1433278119=24, srv1526790271=31, srv1905104421=51, srv1852206786=48, srv1366876271=18, srv242725835=62} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-02-09 17:55:59,302 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-02-09 17:55:59,302 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-02-09 17:55:59,303 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-02-09 17:55:59,303 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-02-09 17:55:59,303 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-02-09 17:55:59,303 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-02-09 17:55:59,303 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-02-09 17:55:59,303 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-02-09 17:55:59,303 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-02-09 17:55:59,303 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-02-09 17:55:59,303 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-02-09 17:55:59,303 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-02-09 17:55:59,303 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-02-09 17:55:59,303 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-02-09 17:55:59,303 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-02-09 17:55:59,303 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-02-09 17:55:59,303 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-02-09 17:55:59,303 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-02-09 17:55:59,303 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-02-09 17:55:59,303 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-02-09 17:55:59,304 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-02-09 17:55:59,304 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-02-09 17:55:59,304 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-02-09 17:55:59,304 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-02-09 17:55:59,304 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-02-09 17:55:59,304 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-02-09 17:55:59,304 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-02-09 17:55:59,304 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-02-09 17:55:59,304 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-02-09 17:55:59,304 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-02-09 17:55:59,304 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-02-09 17:55:59,304 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-02-09 17:55:59,304 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-02-09 17:55:59,304 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-02-09 17:55:59,304 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-02-09 17:55:59,304 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-02-09 17:55:59,304 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-02-09 17:55:59,304 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-02-09 17:55:59,304 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-02-09 17:55:59,305 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-02-09 17:55:59,305 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-02-09 17:55:59,305 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-02-09 17:55:59,305 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-02-09 17:55:59,305 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-02-09 17:55:59,305 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-02-09 17:55:59,305 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-02-09 17:55:59,305 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-02-09 17:55:59,305 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-02-09 17:55:59,305 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-02-09 17:55:59,305 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-02-09 17:55:59,305 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-02-09 17:55:59,305 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-02-09 17:55:59,305 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-02-09 17:55:59,306 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-02-09 17:55:59,306 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-02-09 17:55:59,306 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-02-09 17:55:59,306 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-02-09 17:55:59,306 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-02-09 17:55:59,306 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-02-09 17:55:59,306 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-02-09 17:55:59,306 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-02-09 17:55:59,306 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-02-09 17:55:59,306 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-02-09 17:55:59,306 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-02-09 17:55:59,306 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-02-09 17:55:59,306 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-02-09 17:55:59,306 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-02-09 17:55:59,306 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-02-09 17:55:59,306 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-02-09 17:55:59,307 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-02-09 17:55:59,307 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-02-09 17:55:59,307 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-02-09 17:55:59,307 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-02-09 17:55:59,307 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-02-09 17:55:59,307 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-02-09 17:55:59,308 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-02-09 17:55:59,308 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-02-09 17:55:59,308 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-02-09 17:55:59,308 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-02-09 17:55:59,308 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-02-09 17:55:59,308 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-02-09 17:55:59,308 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-02-09 17:55:59,308 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-02-09 17:55:59,308 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-02-09 17:55:59,308 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-02-09 17:55:59,309 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-02-09 17:55:59,309 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-02-09 17:55:59,309 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-02-09 17:55:59,309 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-02-09 17:55:59,309 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-02-09 17:55:59,309 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-02-09 17:55:59,309 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-02-09 17:55:59,309 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-02-09 17:55:59,309 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-02-09 17:55:59,309 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-02-09 17:55:59,310 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-02-09 17:55:59,310 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-02-09 17:55:59,310 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-02-09 17:55:59,310 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-02-09 17:55:59,310 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-02-09 17:55:59,310 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-02-09 17:55:59,420 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=3.158529131194229E-4); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.002118805753879094); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=3.158529131194229E-4); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=3.333333333333333E-4); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-02-09 17:55:59,420 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-02-09 17:55:59,420 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=4.106806556525447E-5, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=3.158529131194229E-4); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.002118805753879094); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=3.158529131194229E-4); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=3.333333333333333E-4); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-02-09 17:55:59,635 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 316 ms to try 5000 different iterations.  Found a solution that moves 22 regions; Going from a computed imbalance of 4.106806556525447E-5 to a new imbalance of 8.133737409559391E-6. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0017727200782610348); MoveCostFunction : (multiplier=7.0, imbalance=0.0024444444444444444); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-02-09 17:55:59,636 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv131446337:83 , srv2038931226:83 , srv262389026:83 , srv503557749:83 , srv1034986013:84 , srv1035876911:84 , srv1065395874:84 , srv1095848334:84 , srv109929747:84 , srv1154071059:84 , srv1164776052:84 , srv1176956283:84 , srv1178018902:84 , srv1208280762:84 , srv1248138405:84 , srv1289634959:84 , srv1319566050:84 , srv1335004214:84 , srv1352321031:84 , srv1365427017:84 , srv1366876271:84 , srv1368981817:84 , srv1377075429:84 , srv1408209108:84 , srv1419375416:84 , srv1423080754:84 , srv1433278119:84 , srv1453898025:84 , srv1477745002:84 , srv1489656746:84 , srv1499129728:84 , srv150816151:84 , srv1526790271:84 , srv1535062672:84 , srv1547798939:84 , srv1586525916:84 , srv1602546255:84 , srv1608443083:84 , srv16845643:84 , srv1693266995:84 , srv1736322632:84 , srv1772735338:84 , srv1776128264:84 , srv1798137567:84 , srv1798393833:84 , srv1802230462:84 , srv1822433229:84 , srv1823750975:84 , srv1852206786:84 , srv1883392442:84 , srv1905104421:84 , srv191436427:84 , srv192339124:84 , srv1954877207:84 , srv1978753995:84 , srv1985261122:84 , srv1985757910:84 , srv2018045570:84 , srv2070038956:84 , srv217744436:84 , srv242725835:84 , srv270637148:84 , srv294598634:84 , srv297855834:84 , srv298975670:84 , srv324189800:84 , srv337843474:84 , srv401886502:84 , srv407699499:84 , srv467690640:84 , srv490252766:84 , srv513634201:84 , srv513780355:84 , srv521573287:84 , srv556444421:84 , srv557237963:84 , srv558439295:84 , srv592905865:84 , srv592988540:84 , srv598348796:84 , srv649358650:84 , srv710290152:84 , srv779744196:84 , srv795745801:84 , srv801360261:84 , srv802467941:84 , srv826923170:84 , srv834267535:84 , srv869615705:84 , srv872628003:84 , srv873973298:84 , srv876828349:84 , srv907972496:84 , srv967656474:84 , srv994208241:84 , srv1242155549:85 , srv1453968307:85 , srv1885995011:85 , srv349167907:85 , srv1684653654:684 }
2023-02-09 17:55:59,641 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-02-09 17:55:59,642 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1586525916=34, srv1176956283=7, srv294598634=65, srv16845643=37, srv598348796=84, srv1377075429=20, srv521573287=78, srv1693266995=39, srv710290152=86, srv1978753995=55, srv907972496=97, srv869615705=93, srv109929747=4, srv1602546255=35, srv1419375416=22, srv401886502=71, srv150816151=30, srv270637148=64, srv2018045570=58, srv1408209108=21, srv217744436=61, srv349167907=70, srv558439295=81, srv1178018902=8, srv1547798939=33, srv1208280762=9, srv1065395874=2, srv324189800=68, srv513634201=76, srv1352321031=16, srv801360261=89, srv1798137567=43, srv1776128264=42, srv1335004214=15, srv1885995011=50, srv1772735338=41, srv131446337=13, srv1736322632=40, srv802467941=90, srv297855834=66, srv490252766=74, srv1883392442=49, srv592905865=82, srv592988540=83, srv1535062672=32, srv1823750975=47, srv1453968307=26, srv1822433229=46, srv994208241=99, srv1985757910=57, srv1164776052=6, srv1319566050=14, srv1477745002=27, srv1423080754=23, srv337843474=69, srv192339124=53, srv1248138405=11, srv298975670=67, srv1095848334=3, srv1453898025=25, srv1368981817=19, srv2070038956=60, srv779744196=87, srv1035876911=1, srv513780355=77, srv649358650=85, srv967656474=98, srv2038931226=59, srv876828349=96, srv1034986013=0, srv826923170=91, srv795745801=88, srv1802230462=45, srv1154071059=5, srv556444421=79, srv834267535=92, srv1242155549=10, srv1985261122=56, srv872628003=94, srv1798393833=44, srv873973298=95, srv191436427=52, srv1365427017=17, srv1499129728=29, srv503557749=75, srv1684653654=38, srv467690640=73, srv557237963=80, srv1608443083=36, srv407699499=72, srv1489656746=28, srv262389026=63, srv1289634959=12, srv1954877207=54, srv1433278119=24, srv1526790271=31, srv1905104421=51, srv1852206786=48, srv1366876271=18, srv242725835=62} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-02-09 17:55:59,659 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-02-09 17:55:59,659 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-02-09 17:55:59,659 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-02-09 17:55:59,659 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-02-09 17:55:59,659 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-02-09 17:55:59,659 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-02-09 17:55:59,659 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-02-09 17:55:59,659 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-02-09 17:55:59,660 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-02-09 17:55:59,660 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-02-09 17:55:59,660 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-02-09 17:55:59,660 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-02-09 17:55:59,660 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-02-09 17:55:59,660 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-02-09 17:55:59,660 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-02-09 17:55:59,660 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-02-09 17:55:59,660 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-02-09 17:55:59,660 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-02-09 17:55:59,660 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-02-09 17:55:59,660 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-02-09 17:55:59,660 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-02-09 17:55:59,661 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-02-09 17:55:59,661 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-02-09 17:55:59,661 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-02-09 17:55:59,661 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-02-09 17:55:59,661 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-02-09 17:55:59,661 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-02-09 17:55:59,661 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-02-09 17:55:59,661 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-02-09 17:55:59,661 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-02-09 17:55:59,661 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-02-09 17:55:59,661 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-02-09 17:55:59,661 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-02-09 17:55:59,662 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-02-09 17:55:59,662 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-02-09 17:55:59,662 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-02-09 17:55:59,662 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-02-09 17:55:59,662 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-02-09 17:55:59,662 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-02-09 17:55:59,662 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-02-09 17:55:59,662 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-02-09 17:55:59,662 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-02-09 17:55:59,662 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-02-09 17:55:59,662 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-02-09 17:55:59,662 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-02-09 17:55:59,663 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-02-09 17:55:59,663 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-02-09 17:55:59,663 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-02-09 17:55:59,663 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-02-09 17:55:59,663 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-02-09 17:55:59,663 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-02-09 17:55:59,663 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-02-09 17:55:59,663 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-02-09 17:55:59,663 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-02-09 17:55:59,663 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-02-09 17:55:59,663 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-02-09 17:55:59,663 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-02-09 17:55:59,663 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-02-09 17:55:59,664 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-02-09 17:55:59,664 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-02-09 17:55:59,664 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-02-09 17:55:59,664 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-02-09 17:55:59,664 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-02-09 17:55:59,664 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-02-09 17:55:59,664 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-02-09 17:55:59,664 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-02-09 17:55:59,664 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-02-09 17:55:59,664 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-02-09 17:55:59,664 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-02-09 17:55:59,664 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-02-09 17:55:59,664 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-02-09 17:55:59,665 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-02-09 17:55:59,665 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-02-09 17:55:59,665 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-02-09 17:55:59,665 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-02-09 17:55:59,665 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-02-09 17:55:59,665 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-02-09 17:55:59,665 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-02-09 17:55:59,665 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-02-09 17:55:59,665 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-02-09 17:55:59,665 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-02-09 17:55:59,665 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-02-09 17:55:59,665 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-02-09 17:55:59,665 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-02-09 17:55:59,666 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-02-09 17:55:59,666 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-02-09 17:55:59,666 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-02-09 17:55:59,666 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-02-09 17:55:59,666 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-02-09 17:55:59,666 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-02-09 17:55:59,666 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-02-09 17:55:59,666 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-02-09 17:55:59,666 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-02-09 17:55:59,666 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-02-09 17:55:59,667 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-02-09 17:55:59,667 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-02-09 17:55:59,667 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-02-09 17:55:59,667 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-02-09 17:55:59,667 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-02-09 17:55:59,667 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-02-09 17:55:59,667 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-02-09 17:55:59,773 INFO  [Time-limited test] balancer.StochasticLoadBalancer(381): Cluster wide - skipping load balancing because weighted average imbalance=7.979690117040589E-6 <= threshold(0.025). If you want more aggressive balancing, either lower hbase.master.balancer.stochastic.minCostNeedBalance from 0.025 or increase the relative multiplier(s) of the specific cost function(s). functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0017727200782610348); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-02-09 17:55:59,774 INFO  [Time-limited test] balancer.BalancerTestBase(570): Mock Final balance: { srv131446337:83 , srv2038931226:83 , srv262389026:83 , srv503557749:83 , srv1034986013:84 , srv1035876911:84 , srv1065395874:84 , srv1095848334:84 , srv109929747:84 , srv1154071059:84 , srv1164776052:84 , srv1176956283:84 , srv1178018902:84 , srv1208280762:84 , srv1248138405:84 , srv1289634959:84 , srv1319566050:84 , srv1335004214:84 , srv1352321031:84 , srv1365427017:84 , srv1366876271:84 , srv1368981817:84 , srv1377075429:84 , srv1408209108:84 , srv1419375416:84 , srv1423080754:84 , srv1433278119:84 , srv1453898025:84 , srv1477745002:84 , srv1489656746:84 , srv1499129728:84 , srv150816151:84 , srv1526790271:84 , srv1535062672:84 , srv1547798939:84 , srv1586525916:84 , srv1602546255:84 , srv1608443083:84 , srv16845643:84 , srv1693266995:84 , srv1736322632:84 , srv1772735338:84 , srv1776128264:84 , srv1798137567:84 , srv1798393833:84 , srv1802230462:84 , srv1822433229:84 , srv1823750975:84 , srv1852206786:84 , srv1883392442:84 , srv1905104421:84 , srv191436427:84 , srv192339124:84 , srv1954877207:84 , srv1978753995:84 , srv1985261122:84 , srv1985757910:84 , srv2018045570:84 , srv2070038956:84 , srv217744436:84 , srv242725835:84 , srv270637148:84 , srv294598634:84 , srv297855834:84 , srv298975670:84 , srv324189800:84 , srv337843474:84 , srv401886502:84 , srv407699499:84 , srv467690640:84 , srv490252766:84 , srv513634201:84 , srv513780355:84 , srv521573287:84 , srv556444421:84 , srv557237963:84 , srv558439295:84 , srv592905865:84 , srv592988540:84 , srv598348796:84 , srv649358650:84 , srv710290152:84 , srv779744196:84 , srv795745801:84 , srv801360261:84 , srv802467941:84 , srv826923170:84 , srv834267535:84 , srv869615705:84 , srv872628003:84 , srv873973298:84 , srv876828349:84 , srv907972496:84 , srv967656474:84 , srv994208241:84 , srv1242155549:85 , srv1453968307:85 , srv1885995011:85 , srv349167907:85 , srv1684653654:684 }
2023-02-09 17:55:59,801 INFO  [Time-limited test] hbase.ResourceChecker(175): after: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnLargeClusterWithRacks Thread=10 (was 10), OpenFileDescriptor=260 (was 260), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=221 (was 204) - SystemLoadAverage LEAK? -, ProcessCount=168 (was 168), AvailableMemoryMB=3290 (was 3794)
2023-02-09 17:55:59,809 INFO  [Time-limited test] hbase.ResourceChecker(147): before: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnMidClusterWithRacks Thread=10, OpenFileDescriptor=260, MaxFileDescriptor=60000, SystemLoadAverage=221, ProcessCount=168, AvailableMemoryMB=3290
2023-02-09 17:55:59,810 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2023-02-09 17:55:59,810 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=5000, runMaxSteps=true, stepsPerRegion=800, maxRunningTime=120000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 111077.0 etc.
2023-02-09 17:55:59,821 INFO  [Time-limited test] balancer.BalancerTestBase(547): Mock Cluster : { srv1010396192:84 , srv1095025724:84 , srv1130702677:84 , srv1164236854:84 , srv139673055:84 , srv1588075495:84 , srv1599923965:84 , srv1721001449:84 , srv1772025883:84 , srv1797341690:84 , srv1939267705:84 , srv200077306:84 , srv2061355202:84 , srv2074572206:84 , srv2100632453:84 , srv2103665908:84 , srv228997348:84 , srv237327989:84 , srv2570076:84 , srv302837118:84 , srv320247263:84 , srv416962467:84 , srv438265336:84 , srv528740113:84 , srv717199040:84 , srv903654514:84 , srv948584255:84 , srv967186023:84 , srv996159107:84 , srv1449958115:264 } [srvr=30 rgns=2700 avg=90.0 max=90 min=90]
2023-02-09 17:55:59,823 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-02-09 17:55:59,823 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv139673055=4, srv2103665908=16, srv438265336=23, srv416962467=22, srv1095025724=1, srv200077306=12, srv1721001449=8, srv996159107=29, srv2100632453=15, srv237327989=18, srv302837118=20, srv948584255=27, srv228997348=17, srv1130702677=2, srv2061355202=13, srv2570076=19, srv1588075495=6, srv1939267705=11, srv717199040=25, srv1797341690=10, srv1010396192=0, srv1772025883=9, srv1599923965=7, srv528740113=24, srv1164236854=3, srv903654514=26, srv1449958115=5, srv2074572206=14, srv967186023=28, srv320247263=21} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-02-09 17:55:59,836 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-02-09 17:55:59,837 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-02-09 17:55:59,837 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-02-09 17:55:59,837 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-02-09 17:55:59,837 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-02-09 17:55:59,837 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-02-09 17:55:59,837 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-02-09 17:55:59,837 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-02-09 17:55:59,837 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-02-09 17:55:59,837 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-02-09 17:55:59,837 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-02-09 17:55:59,837 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-02-09 17:55:59,837 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-02-09 17:55:59,838 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-02-09 17:55:59,838 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-02-09 17:55:59,838 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-02-09 17:55:59,838 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-02-09 17:55:59,838 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-02-09 17:55:59,838 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-02-09 17:55:59,838 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-02-09 17:55:59,838 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-02-09 17:55:59,838 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-02-09 17:55:59,838 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-02-09 17:55:59,838 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-02-09 17:55:59,838 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-02-09 17:55:59,838 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-02-09 17:55:59,839 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-02-09 17:55:59,839 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-02-09 17:55:59,839 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-02-09 17:55:59,839 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-02-09 17:55:59,839 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=10, number of hosts=30, number of racks=4
2023-02-09 17:55:59,861 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=1.1186450091419389, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-02-09 17:55:59,861 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.9912566889813971, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=1.1186450091419389, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=64800000
2023-02-09 17:57:59,843 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 120001 ms to try 6561917 different iterations.  Found a solution that moves 1844 regions; Going from a computed imbalance of 0.9912566889813971 to a new imbalance of 4.303987990979898E-5. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); MoveCostFunction : (multiplier=7.0, imbalance=0.682962962962963, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-02-09 17:57:59,849 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1010396192:90 , srv1095025724:90 , srv1130702677:90 , srv1164236854:90 , srv139673055:90 , srv1449958115:90 , srv1588075495:90 , srv1599923965:90 , srv1721001449:90 , srv1772025883:90 , srv1797341690:90 , srv1939267705:90 , srv200077306:90 , srv2061355202:90 , srv2074572206:90 , srv2100632453:90 , srv2103665908:90 , srv228997348:90 , srv237327989:90 , srv2570076:90 , srv302837118:90 , srv320247263:90 , srv416962467:90 , srv438265336:90 , srv528740113:90 , srv717199040:90 , srv903654514:90 , srv948584255:90 , srv967186023:90 , srv996159107:90 }
2023-02-09 17:57:59,850 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-02-09 17:57:59,850 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv139673055=4, srv2103665908=16, srv438265336=23, srv416962467=22, srv1095025724=1, srv200077306=12, srv1721001449=8, srv996159107=29, srv2100632453=15, srv237327989=18, srv302837118=20, srv948584255=27, srv228997348=17, srv1130702677=2, srv2061355202=13, srv2570076=19, srv1588075495=6, srv1939267705=11, srv717199040=25, srv1797341690=10, srv1010396192=0, srv1772025883=9, srv1599923965=7, srv528740113=24, srv1164236854=3, srv903654514=26, srv1449958115=5, srv2074572206=14, srv967186023=28, srv320247263=21} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-02-09 17:57:59,853 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-02-09 17:57:59,854 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-02-09 17:57:59,854 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-02-09 17:57:59,854 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-02-09 17:57:59,854 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-02-09 17:57:59,854 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-02-09 17:57:59,854 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-02-09 17:57:59,854 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-02-09 17:57:59,854 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-02-09 17:57:59,854 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-02-09 17:57:59,854 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-02-09 17:57:59,854 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-02-09 17:57:59,854 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-02-09 17:57:59,854 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-02-09 17:57:59,854 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-02-09 17:57:59,854 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-02-09 17:57:59,854 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-02-09 17:57:59,854 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-02-09 17:57:59,854 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-02-09 17:57:59,854 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-02-09 17:57:59,854 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-02-09 17:57:59,854 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-02-09 17:57:59,854 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-02-09 17:57:59,854 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-02-09 17:57:59,855 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-02-09 17:57:59,855 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-02-09 17:57:59,855 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-02-09 17:57:59,855 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-02-09 17:57:59,855 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-02-09 17:57:59,855 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-02-09 17:57:59,855 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=10, number of hosts=30, number of racks=4
2023-02-09 17:57:59,866 INFO  [Time-limited test] balancer.StochasticLoadBalancer(381): Cluster wide - skipping load balancing because weighted average imbalance=0.0 <= threshold(0.025). If you want more aggressive balancing, either lower hbase.master.balancer.stochastic.minCostNeedBalance from 0.025 or increase the relative multiplier(s) of the specific cost function(s). functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-02-09 17:57:59,866 INFO  [Time-limited test] balancer.BalancerTestBase(570): Mock Final balance: { srv1010396192:90 , srv1095025724:90 , srv1130702677:90 , srv1164236854:90 , srv139673055:90 , srv1449958115:90 , srv1588075495:90 , srv1599923965:90 , srv1721001449:90 , srv1772025883:90 , srv1797341690:90 , srv1939267705:90 , srv200077306:90 , srv2061355202:90 , srv2074572206:90 , srv2100632453:90 , srv2103665908:90 , srv228997348:90 , srv237327989:90 , srv2570076:90 , srv302837118:90 , srv320247263:90 , srv416962467:90 , srv438265336:90 , srv528740113:90 , srv717199040:90 , srv903654514:90 , srv948584255:90 , srv967186023:90 , srv996159107:90 }
2023-02-09 17:57:59,880 INFO  [Time-limited test] hbase.ResourceChecker(175): after: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnMidClusterWithRacks Thread=9 (was 10), OpenFileDescriptor=260 (was 260), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=246 (was 221) - SystemLoadAverage LEAK? -, ProcessCount=167 (was 168), AvailableMemoryMB=2955 (was 3290)