2023-05-15 09:53:25,138 INFO  [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks timeout: 13 mins
2023-05-15 09:53:25,463 WARN  [Time-limited test] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties
2023-05-15 09:53:25,576 INFO  [Time-limited test] metrics.MetricRegistriesLoader(60): Loaded MetricRegistries class org.apache.hadoop.hbase.metrics.impl.MetricRegistriesImpl
2023-05-15 09:53:25,641 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2023-05-15 09:53:25,649 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc.
2023-05-15 09:53:25,663 INFO  [Time-limited test] hbase.ResourceChecker(147): before: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnLargeClusterWithRacks Thread=12, OpenFileDescriptor=264, MaxFileDescriptor=60000, SystemLoadAverage=314, ProcessCount=175, AvailableMemoryMB=14961
2023-05-15 09:53:25,665 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2023-05-15 09:53:25,665 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=5000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=10000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc.
2023-05-15 09:53:25,809 INFO  [Time-limited test] balancer.BalancerTestBase(547): Mock Cluster : { srv1000028679:84 , srv1013138842:84 , srv1021727201:84 , srv103378159:84 , srv1090949773:84 , srv1115179140:84 , srv1180291281:84 , srv1185353999:84 , srv1218009805:84 , srv1220587394:84 , srv1288748187:84 , srv1311726376:84 , srv1325449235:84 , srv136017469:84 , srv1412556826:84 , srv1420632899:84 , srv1488958991:84 , srv1504571368:84 , srv1531432944:84 , srv1546162945:84 , srv155820188:84 , srv1563736076:84 , srv1564578:84 , srv1570688131:84 , srv1586265343:84 , srv1590608416:84 , srv1595878483:84 , srv1638977023:84 , srv1656282634:84 , srv1664747299:84 , srv1700094486:84 , srv1717551499:84 , srv1725671440:84 , srv1726790232:84 , srv1737837795:84 , srv1765167247:84 , srv1776415908:84 , srv1792242392:84 , srv1820282394:84 , srv1869515610:84 , srv1887693476:84 , srv1888878396:84 , srv1891229972:84 , srv1912751025:84 , srv1941577141:84 , srv1945738852:84 , srv1955739524:84 , srv1967990235:84 , srv1977697839:84 , srv2002530000:84 , srv2013040226:84 , srv2031967376:84 , srv2041767317:84 , srv2065222998:84 , srv2079624031:84 , srv2082379688:84 , srv2113139742:84 , srv2129886385:84 , srv2137102168:84 , srv23465099:84 , srv27466080:84 , srv329487003:84 , srv355263033:84 , srv355837064:84 , srv378333956:84 , srv392648348:84 , srv400298135:84 , srv43201036:84 , srv463494826:84 , srv474090528:84 , srv508668615:84 , srv516947963:84 , srv520395537:84 , srv530505355:84 , srv538035692:84 , srv641696287:84 , srv651704512:84 , srv668159518:84 , srv695800229:84 , srv707536259:84 , srv728934160:84 , srv740860015:84 , srv765244377:84 , srv788098735:84 , srv80577413:84 , srv807321902:84 , srv816340964:84 , srv850158309:84 , srv860457984:84 , srv861600765:84 , srv862342612:84 , srv864793520:84 , srv891475210:84 , srv899504500:84 , srv900166379:84 , srv935934412:84 , srv967681246:84 , srv968828761:84 , srv989381387:84 , srv240850332:684 } [srvr=100 rgns=9000 avg=90.0 max=90 min=90]
2023-05-15 09:53:25,824 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-05-15 09:53:25,832 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1717551499=31, srv2113139742=56, srv740860015=82, srv850158309=88, srv1564578=22, srv329487003=62, srv27466080=61, srv1531432944=18, srv765244377=83, srv1570688131=23, srv155820188=20, srv1776415908=36, srv2129886385=57, srv1115179140=5, srv2065222998=53, srv1412556826=14, srv891475210=93, srv1945738852=45, srv728934160=81, srv1504571368=17, srv651704512=77, srv1967990235=47, srv103378159=3, srv530505355=74, srv967681246=97, srv1218009805=8, srv1288748187=10, srv520395537=73, srv23465099=59, srv860457984=89, srv968828761=98, srv1013138842=1, srv2079624031=54, srv463494826=69, srv474090528=70, srv1586265343=24, srv1977697839=48, srv355837064=64, srv1488958991=16, srv1180291281=6, srv1820282394=38, srv538035692=75, srv2031967376=51, srv1891229972=42, srv1185353999=7, srv1325449235=12, srv1955739524=46, srv2002530000=49, srv2013040226=50, srv1638977023=27, srv1090949773=4, srv1725671440=32, srv1888878396=41, srv43201036=68, srv899504500=94, srv1792242392=37, srv1941577141=44, srv1869515610=39, srv1546162945=19, srv989381387=99, srv1726790232=33, srv1220587394=9, srv1656282634=28, srv668159518=78, srv136017469=13, srv400298135=67, srv392648348=66, srv80577413=85, srv355263033=63, srv864793520=92, srv1420632899=15, srv516947963=72, srv861600765=90, srv788098735=84, srv2082379688=55, srv1311726376=11, srv1590608416=25, srv2137102168=58, srv641696287=76, srv1664747299=29, srv1700094486=30, srv1021727201=2, srv862342612=91, srv935934412=96, srv1000028679=0, srv1737837795=34, srv2041767317=52, srv1912751025=43, srv707536259=80, srv1765167247=35, srv1887693476=40, srv240850332=60, srv378333956=65, srv900166379=95, srv508668615=71, srv816340964=87, srv1595878483=26, srv807321902=86, srv1563736076=21, srv695800229=79} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-05-15 09:53:25,921 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-05-15 09:53:25,921 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-05-15 09:53:25,921 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-05-15 09:53:25,922 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-05-15 09:53:25,922 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-05-15 09:53:25,922 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-05-15 09:53:25,922 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-05-15 09:53:25,922 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-05-15 09:53:25,922 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-05-15 09:53:25,923 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-05-15 09:53:25,923 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-05-15 09:53:25,923 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-05-15 09:53:25,923 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-05-15 09:53:25,923 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-05-15 09:53:25,923 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-05-15 09:53:25,924 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-05-15 09:53:25,924 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-05-15 09:53:25,924 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-05-15 09:53:25,924 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-05-15 09:53:25,924 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-05-15 09:53:25,924 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-05-15 09:53:25,924 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-05-15 09:53:25,925 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-05-15 09:53:25,925 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-05-15 09:53:25,925 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-05-15 09:53:25,925 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-05-15 09:53:25,925 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-05-15 09:53:25,925 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-05-15 09:53:25,925 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-05-15 09:53:25,926 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-05-15 09:53:25,926 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-05-15 09:53:25,926 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-05-15 09:53:25,926 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-05-15 09:53:25,926 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-05-15 09:53:25,926 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-05-15 09:53:25,927 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-05-15 09:53:25,927 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-05-15 09:53:25,927 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-05-15 09:53:25,927 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-05-15 09:53:25,927 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-05-15 09:53:25,927 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-05-15 09:53:25,928 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-05-15 09:53:25,928 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-05-15 09:53:25,928 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-05-15 09:53:25,928 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-05-15 09:53:25,928 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-05-15 09:53:25,928 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-05-15 09:53:25,928 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-05-15 09:53:25,928 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-05-15 09:53:25,929 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-05-15 09:53:25,929 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-05-15 09:53:25,929 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-05-15 09:53:25,929 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-05-15 09:53:25,929 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-05-15 09:53:25,929 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-05-15 09:53:25,929 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-05-15 09:53:25,930 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-05-15 09:53:25,930 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-05-15 09:53:25,930 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-05-15 09:53:25,930 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-05-15 09:53:25,930 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-05-15 09:53:25,930 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-05-15 09:53:25,930 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-05-15 09:53:25,931 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-05-15 09:53:25,931 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-05-15 09:53:25,931 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-05-15 09:53:25,931 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-05-15 09:53:25,931 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-05-15 09:53:25,932 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-05-15 09:53:25,932 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-05-15 09:53:25,932 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-05-15 09:53:25,932 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-05-15 09:53:25,932 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-05-15 09:53:25,932 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-05-15 09:53:25,932 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-05-15 09:53:25,933 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-05-15 09:53:25,933 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-05-15 09:53:25,933 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-05-15 09:53:25,933 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-05-15 09:53:25,933 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-05-15 09:53:25,933 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-05-15 09:53:25,933 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-05-15 09:53:25,933 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-05-15 09:53:25,934 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-05-15 09:53:25,934 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-05-15 09:53:25,934 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-05-15 09:53:25,934 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-05-15 09:53:25,934 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-05-15 09:53:25,934 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-05-15 09:53:25,934 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-05-15 09:53:25,935 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-05-15 09:53:25,935 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-05-15 09:53:25,935 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-05-15 09:53:25,935 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-05-15 09:53:25,935 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-05-15 09:53:25,936 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-05-15 09:53:25,936 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-05-15 09:53:25,936 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-05-15 09:53:25,936 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-05-15 09:53:25,936 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-05-15 09:53:25,936 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-05-15 09:53:26,324 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.06666666666666667, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-05-15 09:53:26,325 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-05-15 09:53:26,325 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.9909252140407105, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.06666666666666667, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-05-15 09:53:26,699 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 734 ms to try 5000 different iterations.  Found a solution that moves 4681 regions; Going from a computed imbalance of 0.9909252140407105 to a new imbalance of 0.17848893867795498. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.03716342073032432, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.053318600658743005, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.5201111111111111, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.03716342073032432, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.17383333333333334, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.23925, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-05-15 09:53:26,714 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv2002530000:81 , srv2065222998:82 , srv1090949773:83 , srv1218009805:83 , srv1638977023:83 , srv1664747299:83 , srv1820282394:83 , srv27466080:83 , srv463494826:83 , srv765244377:83 , srv816340964:83 , srv1021727201:84 , srv1504571368:84 , srv1531432944:84 , srv1564578:84 , srv1586265343:84 , srv1726790232:84 , srv1977697839:84 , srv474090528:84 , srv641696287:84 , srv850158309:84 , srv891475210:84 , srv1000028679:85 , srv103378159:85 , srv1325449235:85 , srv1412556826:85 , srv1420632899:85 , srv1488958991:85 , srv1546162945:85 , srv1595878483:85 , srv1717551499:85 , srv1776415908:85 , srv1869515610:85 , srv668159518:85 , srv707536259:85 , srv80577413:85 , srv900166379:85 , srv1185353999:86 , srv1570688131:86 , srv1656282634:86 , srv1955739524:86 , srv1967990235:86 , srv2079624031:86 , srv2113139742:86 , srv355263033:86 , srv392648348:86 , srv508668615:86 , srv516947963:86 , srv530505355:86 , srv728934160:86 , srv860457984:86 , srv899504500:86 , srv967681246:86 , srv1013138842:87 , srv136017469:87 , srv155820188:87 , srv1700094486:87 , srv1737837795:87 , srv1888878396:87 , srv1945738852:87 , srv2013040226:87 , srv2041767317:87 , srv23465099:87 , srv43201036:87 , srv968828761:87 , srv1115179140:88 , srv1288748187:88 , srv1792242392:88 , srv1891229972:88 , srv329487003:88 , srv355837064:88 , srv651704512:88 , srv695800229:88 , srv788098735:88 , srv861600765:88 , srv862342612:88 , srv864793520:88 , srv1180291281:89 , srv1563736076:89 , srv1590608416:89 , srv1941577141:89 , srv2082379688:89 , srv400298135:89 , srv520395537:89 , srv807321902:89 , srv1887693476:90 , srv1912751025:90 , srv538035692:90 , srv989381387:90 , srv1220587394:91 , srv1311726376:91 , srv1765167247:91 , srv740860015:91 , srv935934412:91 , srv2137102168:92 , srv2031967376:93 , srv1725671440:94 , srv378333956:94 , srv2129886385:95 , srv240850332:420 }
2023-05-15 09:53:26,720 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-05-15 09:53:26,722 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1717551499=31, srv2113139742=56, srv740860015=82, srv850158309=88, srv1564578=22, srv329487003=62, srv27466080=61, srv1531432944=18, srv765244377=83, srv1570688131=23, srv155820188=20, srv1776415908=36, srv2129886385=57, srv1115179140=5, srv2065222998=53, srv1412556826=14, srv891475210=93, srv1945738852=45, srv728934160=81, srv1504571368=17, srv651704512=77, srv1967990235=47, srv103378159=3, srv530505355=74, srv967681246=97, srv1218009805=8, srv1288748187=10, srv520395537=73, srv23465099=59, srv860457984=89, srv968828761=98, srv1013138842=1, srv2079624031=54, srv463494826=69, srv474090528=70, srv1586265343=24, srv1977697839=48, srv355837064=64, srv1488958991=16, srv1180291281=6, srv1820282394=38, srv538035692=75, srv2031967376=51, srv1891229972=42, srv1185353999=7, srv1325449235=12, srv1955739524=46, srv2002530000=49, srv2013040226=50, srv1638977023=27, srv1090949773=4, srv1725671440=32, srv1888878396=41, srv43201036=68, srv899504500=94, srv1792242392=37, srv1941577141=44, srv1869515610=39, srv1546162945=19, srv989381387=99, srv1726790232=33, srv1220587394=9, srv1656282634=28, srv668159518=78, srv136017469=13, srv400298135=67, srv392648348=66, srv80577413=85, srv355263033=63, srv864793520=92, srv1420632899=15, srv516947963=72, srv861600765=90, srv788098735=84, srv2082379688=55, srv1311726376=11, srv1590608416=25, srv2137102168=58, srv641696287=76, srv1664747299=29, srv1700094486=30, srv1021727201=2, srv862342612=91, srv935934412=96, srv1000028679=0, srv1737837795=34, srv2041767317=52, srv1912751025=43, srv707536259=80, srv1765167247=35, srv1887693476=40, srv240850332=60, srv378333956=65, srv900166379=95, srv508668615=71, srv816340964=87, srv1595878483=26, srv807321902=86, srv1563736076=21, srv695800229=79} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-05-15 09:53:26,749 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-05-15 09:53:26,750 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-05-15 09:53:26,750 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-05-15 09:53:26,750 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-05-15 09:53:26,750 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-05-15 09:53:26,750 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-05-15 09:53:26,750 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-05-15 09:53:26,750 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-05-15 09:53:26,751 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-05-15 09:53:26,751 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-05-15 09:53:26,751 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-05-15 09:53:26,751 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-05-15 09:53:26,751 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-05-15 09:53:26,751 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-05-15 09:53:26,751 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-05-15 09:53:26,751 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-05-15 09:53:26,751 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-05-15 09:53:26,752 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-05-15 09:53:26,752 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-05-15 09:53:26,752 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-05-15 09:53:26,752 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-05-15 09:53:26,752 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-05-15 09:53:26,752 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-05-15 09:53:26,752 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-05-15 09:53:26,752 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-05-15 09:53:26,752 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-05-15 09:53:26,752 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-05-15 09:53:26,753 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-05-15 09:53:26,753 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-05-15 09:53:26,753 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-05-15 09:53:26,753 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-05-15 09:53:26,753 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-05-15 09:53:26,753 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-05-15 09:53:26,753 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-05-15 09:53:26,753 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-05-15 09:53:26,753 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-05-15 09:53:26,753 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-05-15 09:53:26,754 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-05-15 09:53:26,754 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-05-15 09:53:26,754 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-05-15 09:53:26,754 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-05-15 09:53:26,754 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-05-15 09:53:26,754 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-05-15 09:53:26,754 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-05-15 09:53:26,754 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-05-15 09:53:26,754 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-05-15 09:53:26,754 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-05-15 09:53:26,755 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-05-15 09:53:26,755 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-05-15 09:53:26,755 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-05-15 09:53:26,755 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-05-15 09:53:26,755 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-05-15 09:53:26,755 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-05-15 09:53:26,755 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-05-15 09:53:26,755 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-05-15 09:53:26,755 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-05-15 09:53:26,755 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-05-15 09:53:26,756 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-05-15 09:53:26,756 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-05-15 09:53:26,756 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-05-15 09:53:26,756 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-05-15 09:53:26,756 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-05-15 09:53:26,756 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-05-15 09:53:26,756 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-05-15 09:53:26,756 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-05-15 09:53:26,756 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-05-15 09:53:26,757 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-05-15 09:53:26,757 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-05-15 09:53:26,757 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-05-15 09:53:26,757 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-05-15 09:53:26,757 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-05-15 09:53:26,757 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-05-15 09:53:26,757 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-05-15 09:53:26,757 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-05-15 09:53:26,757 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-05-15 09:53:26,757 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-05-15 09:53:26,757 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-05-15 09:53:26,758 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-05-15 09:53:26,758 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-05-15 09:53:26,758 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-05-15 09:53:26,758 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-05-15 09:53:26,758 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-05-15 09:53:26,758 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-05-15 09:53:26,758 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-05-15 09:53:26,758 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-05-15 09:53:26,758 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-05-15 09:53:26,758 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-05-15 09:53:26,759 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-05-15 09:53:26,759 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-05-15 09:53:26,759 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-05-15 09:53:26,759 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-05-15 09:53:26,759 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-05-15 09:53:26,759 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-05-15 09:53:26,759 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-05-15 09:53:26,759 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-05-15 09:53:26,759 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-05-15 09:53:26,759 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-05-15 09:53:26,760 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-05-15 09:53:26,760 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-05-15 09:53:26,760 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-05-15 09:53:26,760 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-05-15 09:53:26,921 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.03716342073032432, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.053318600658743005, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.03716342073032432, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.17383333333333334, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.23925, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-05-15 09:53:26,922 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-05-15 09:53:26,922 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.17845616161539682, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.03716342073032432, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.053318600658743005, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.03716342073032432, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.17383333333333334, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.23925, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-05-15 09:53:27,288 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 504 ms to try 5000 different iterations.  Found a solution that moves 2703 regions; Going from a computed imbalance of 0.17845616161539682 to a new imbalance of 0.0153938940271642. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.01903128474977021); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.02858032569504793, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.30033333333333334, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.01903128474977021); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0125); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.043333333333333335, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-05-15 09:53:27,302 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1725671440:77 , srv378333956:77 , srv2129886385:78 , srv2031967376:79 , srv2137102168:81 , srv538035692:81 , srv740860015:81 , srv1311726376:82 , srv1563736076:82 , srv1765167247:82 , srv1912751025:82 , srv2082379688:82 , srv864793520:82 , srv935934412:82 , srv1180291281:83 , srv1220587394:83 , srv155820188:83 , srv1792242392:83 , srv520395537:83 , srv1000028679:84 , srv1013138842:84 , srv1288748187:84 , srv1590608416:84 , srv1887693476:84 , srv1945738852:84 , srv1955739524:84 , srv1967990235:84 , srv43201036:84 , srv651704512:84 , srv861600765:84 , srv862342612:84 , srv989381387:84 , srv1115179140:85 , srv1700094486:85 , srv1717551499:85 , srv1737837795:85 , srv1869515610:85 , srv1941577141:85 , srv2041767317:85 , srv2079624031:85 , srv2113139742:85 , srv355837064:85 , srv400298135:85 , srv508668615:85 , srv516947963:85 , srv788098735:85 , srv899504500:85 , srv1412556826:86 , srv1586265343:86 , srv1595878483:86 , srv1656282634:86 , srv1776415908:86 , srv23465099:86 , srv329487003:86 , srv668159518:86 , srv707536259:86 , srv728934160:86 , srv807321902:86 , srv967681246:86 , srv968828761:86 , srv103378159:87 , srv1185353999:87 , srv1325449235:87 , srv136017469:87 , srv1420632899:87 , srv1488958991:87 , srv1546162945:87 , srv1570688131:87 , srv1888878396:87 , srv1891229972:87 , srv355263033:87 , srv530505355:87 , srv1090949773:88 , srv2013040226:88 , srv474090528:88 , srv695800229:88 , srv765244377:88 , srv80577413:88 , srv891475210:88 , srv900166379:88 , srv1021727201:89 , srv1218009805:89 , srv1504571368:89 , srv1564578:89 , srv1726790232:89 , srv1977697839:89 , srv2002530000:89 , srv392648348:89 , srv463494826:89 , srv641696287:89 , srv1531432944:90 , srv1638977023:90 , srv1664747299:90 , srv1820282394:90 , srv2065222998:90 , srv27466080:90 , srv816340964:90 , srv860457984:90 , srv850158309:91 , srv240850332:523 }
2023-05-15 09:53:27,309 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-05-15 09:53:27,310 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1717551499=31, srv2113139742=56, srv740860015=82, srv850158309=88, srv1564578=22, srv329487003=62, srv27466080=61, srv1531432944=18, srv765244377=83, srv1570688131=23, srv155820188=20, srv1776415908=36, srv2129886385=57, srv1115179140=5, srv2065222998=53, srv1412556826=14, srv891475210=93, srv1945738852=45, srv728934160=81, srv1504571368=17, srv651704512=77, srv1967990235=47, srv103378159=3, srv530505355=74, srv967681246=97, srv1218009805=8, srv1288748187=10, srv520395537=73, srv23465099=59, srv860457984=89, srv968828761=98, srv1013138842=1, srv2079624031=54, srv463494826=69, srv474090528=70, srv1586265343=24, srv1977697839=48, srv355837064=64, srv1488958991=16, srv1180291281=6, srv1820282394=38, srv538035692=75, srv2031967376=51, srv1891229972=42, srv1185353999=7, srv1325449235=12, srv1955739524=46, srv2002530000=49, srv2013040226=50, srv1638977023=27, srv1090949773=4, srv1725671440=32, srv1888878396=41, srv43201036=68, srv899504500=94, srv1792242392=37, srv1941577141=44, srv1869515610=39, srv1546162945=19, srv989381387=99, srv1726790232=33, srv1220587394=9, srv1656282634=28, srv668159518=78, srv136017469=13, srv400298135=67, srv392648348=66, srv80577413=85, srv355263033=63, srv864793520=92, srv1420632899=15, srv516947963=72, srv861600765=90, srv788098735=84, srv2082379688=55, srv1311726376=11, srv1590608416=25, srv2137102168=58, srv641696287=76, srv1664747299=29, srv1700094486=30, srv1021727201=2, srv862342612=91, srv935934412=96, srv1000028679=0, srv1737837795=34, srv2041767317=52, srv1912751025=43, srv707536259=80, srv1765167247=35, srv1887693476=40, srv240850332=60, srv378333956=65, srv900166379=95, srv508668615=71, srv816340964=87, srv1595878483=26, srv807321902=86, srv1563736076=21, srv695800229=79} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-05-15 09:53:27,324 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-05-15 09:53:27,324 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-05-15 09:53:27,324 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-05-15 09:53:27,324 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-05-15 09:53:27,324 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-05-15 09:53:27,324 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-05-15 09:53:27,324 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-05-15 09:53:27,325 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-05-15 09:53:27,325 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-05-15 09:53:27,325 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-05-15 09:53:27,325 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-05-15 09:53:27,325 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-05-15 09:53:27,325 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-05-15 09:53:27,325 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-05-15 09:53:27,325 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-05-15 09:53:27,325 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-05-15 09:53:27,325 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-05-15 09:53:27,325 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-05-15 09:53:27,325 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-05-15 09:53:27,325 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-05-15 09:53:27,325 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-05-15 09:53:27,325 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-05-15 09:53:27,325 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-05-15 09:53:27,326 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-05-15 09:53:27,326 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-05-15 09:53:27,326 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-05-15 09:53:27,326 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-05-15 09:53:27,326 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-05-15 09:53:27,326 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-05-15 09:53:27,326 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-05-15 09:53:27,326 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-05-15 09:53:27,326 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-05-15 09:53:27,326 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-05-15 09:53:27,326 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-05-15 09:53:27,326 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-05-15 09:53:27,326 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-05-15 09:53:27,326 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-05-15 09:53:27,326 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-05-15 09:53:27,327 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-05-15 09:53:27,327 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-05-15 09:53:27,327 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-05-15 09:53:27,327 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-05-15 09:53:27,327 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-05-15 09:53:27,327 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-05-15 09:53:27,327 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-05-15 09:53:27,327 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-05-15 09:53:27,327 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-05-15 09:53:27,327 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-05-15 09:53:27,327 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-05-15 09:53:27,327 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-05-15 09:53:27,327 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-05-15 09:53:27,327 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-05-15 09:53:27,327 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-05-15 09:53:27,327 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-05-15 09:53:27,328 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-05-15 09:53:27,328 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-05-15 09:53:27,328 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-05-15 09:53:27,328 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-05-15 09:53:27,328 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-05-15 09:53:27,328 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-05-15 09:53:27,328 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-05-15 09:53:27,328 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-05-15 09:53:27,328 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-05-15 09:53:27,328 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-05-15 09:53:27,328 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-05-15 09:53:27,328 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-05-15 09:53:27,328 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-05-15 09:53:27,328 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-05-15 09:53:27,328 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-05-15 09:53:27,328 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-05-15 09:53:27,328 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-05-15 09:53:27,329 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-05-15 09:53:27,329 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-05-15 09:53:27,329 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-05-15 09:53:27,329 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-05-15 09:53:27,329 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-05-15 09:53:27,329 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-05-15 09:53:27,329 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-05-15 09:53:27,329 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-05-15 09:53:27,329 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-05-15 09:53:27,329 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-05-15 09:53:27,329 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-05-15 09:53:27,329 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-05-15 09:53:27,329 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-05-15 09:53:27,329 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-05-15 09:53:27,329 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-05-15 09:53:27,329 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-05-15 09:53:27,329 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-05-15 09:53:27,329 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-05-15 09:53:27,330 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-05-15 09:53:27,330 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-05-15 09:53:27,330 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-05-15 09:53:27,330 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-05-15 09:53:27,330 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-05-15 09:53:27,330 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-05-15 09:53:27,330 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-05-15 09:53:27,330 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-05-15 09:53:27,330 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-05-15 09:53:27,330 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-05-15 09:53:27,330 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-05-15 09:53:27,330 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-05-15 09:53:27,453 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.01903128474977021); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.02858032569504793, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.01903128474977021); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0125); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.043333333333333335, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-05-15 09:53:27,453 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-05-15 09:53:27,453 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.015374967216633367, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.01903128474977021); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.02858032569504793, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.01903128474977021); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0125); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.043333333333333335, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-05-15 09:53:27,814 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 471 ms to try 5000 different iterations.  Found a solution that moves 971 regions; Going from a computed imbalance of 0.015374967216633367 to a new imbalance of 6.188369326482943E-4. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.004544332072404845); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.006104220173631567); MoveCostFunction : (multiplier=7.0, imbalance=0.1078888888888889, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.004544332072404845); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=2.5E-4); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.00375); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-05-15 09:53:27,815 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1891229972:82 , srv2013040226:82 , srv695800229:82 , srv807321902:82 , srv850158309:82 , srv860457984:82 , srv1220587394:83 , srv1531432944:83 , srv1887693476:83 , srv392648348:83 , srv400298135:83 , srv989381387:83 , srv1185353999:84 , srv136017469:84 , srv1570688131:84 , srv1638977023:84 , srv1765167247:84 , srv1941577141:84 , srv2137102168:84 , srv23465099:84 , srv329487003:84 , srv355263033:84 , srv530505355:84 , srv641696287:84 , srv788098735:84 , srv935934412:84 , srv968828761:84 , srv1021727201:85 , srv103378159:85 , srv1180291281:85 , srv1325449235:85 , srv1488958991:85 , srv1504571368:85 , srv1564578:85 , srv1656282634:85 , srv1664747299:85 , srv1726790232:85 , srv1737837795:85 , srv1888878396:85 , srv1977697839:85 , srv2031967376:85 , srv2065222998:85 , srv2129886385:85 , srv27466080:85 , srv355837064:85 , srv474090528:85 , srv520395537:85 , srv80577413:85 , srv900166379:85 , srv1090949773:86 , srv1115179140:86 , srv1218009805:86 , srv1288748187:86 , srv1311726376:86 , srv1412556826:86 , srv1420632899:86 , srv1546162945:86 , srv1563736076:86 , srv1590608416:86 , srv1595878483:86 , srv1700094486:86 , srv1725671440:86 , srv1820282394:86 , srv1912751025:86 , srv2041767317:86 , srv2079624031:86 , srv2113139742:86 , srv463494826:86 , srv516947963:86 , srv538035692:86 , srv651704512:86 , srv707536259:86 , srv816340964:86 , srv861600765:86 , srv862342612:86 , srv891475210:86 , srv967681246:86 , srv1013138842:87 , srv1586265343:87 , srv1776415908:87 , srv1792242392:87 , srv1869515610:87 , srv1945738852:87 , srv1955739524:87 , srv1967990235:87 , srv2002530000:87 , srv2082379688:87 , srv378333956:87 , srv43201036:87 , srv508668615:87 , srv668159518:87 , srv728934160:87 , srv740860015:87 , srv765244377:87 , srv864793520:87 , srv899504500:87 , srv1000028679:88 , srv155820188:88 , srv1717551499:88 , srv240850332:555 }
2023-05-15 09:53:27,819 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-05-15 09:53:27,820 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1717551499=31, srv2113139742=56, srv740860015=82, srv850158309=88, srv1564578=22, srv329487003=62, srv27466080=61, srv1531432944=18, srv765244377=83, srv1570688131=23, srv155820188=20, srv1776415908=36, srv2129886385=57, srv1115179140=5, srv2065222998=53, srv1412556826=14, srv891475210=93, srv1945738852=45, srv728934160=81, srv1504571368=17, srv651704512=77, srv1967990235=47, srv103378159=3, srv530505355=74, srv967681246=97, srv1218009805=8, srv1288748187=10, srv520395537=73, srv23465099=59, srv860457984=89, srv968828761=98, srv1013138842=1, srv2079624031=54, srv463494826=69, srv474090528=70, srv1586265343=24, srv1977697839=48, srv355837064=64, srv1488958991=16, srv1180291281=6, srv1820282394=38, srv538035692=75, srv2031967376=51, srv1891229972=42, srv1185353999=7, srv1325449235=12, srv1955739524=46, srv2002530000=49, srv2013040226=50, srv1638977023=27, srv1090949773=4, srv1725671440=32, srv1888878396=41, srv43201036=68, srv899504500=94, srv1792242392=37, srv1941577141=44, srv1869515610=39, srv1546162945=19, srv989381387=99, srv1726790232=33, srv1220587394=9, srv1656282634=28, srv668159518=78, srv136017469=13, srv400298135=67, srv392648348=66, srv80577413=85, srv355263033=63, srv864793520=92, srv1420632899=15, srv516947963=72, srv861600765=90, srv788098735=84, srv2082379688=55, srv1311726376=11, srv1590608416=25, srv2137102168=58, srv641696287=76, srv1664747299=29, srv1700094486=30, srv1021727201=2, srv862342612=91, srv935934412=96, srv1000028679=0, srv1737837795=34, srv2041767317=52, srv1912751025=43, srv707536259=80, srv1765167247=35, srv1887693476=40, srv240850332=60, srv378333956=65, srv900166379=95, srv508668615=71, srv816340964=87, srv1595878483=26, srv807321902=86, srv1563736076=21, srv695800229=79} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-05-15 09:53:27,840 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-05-15 09:53:27,840 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-05-15 09:53:27,840 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-05-15 09:53:27,840 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-05-15 09:53:27,840 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-05-15 09:53:27,841 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-05-15 09:53:27,841 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-05-15 09:53:27,841 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-05-15 09:53:27,841 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-05-15 09:53:27,841 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-05-15 09:53:27,841 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-05-15 09:53:27,841 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-05-15 09:53:27,841 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-05-15 09:53:27,841 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-05-15 09:53:27,841 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-05-15 09:53:27,841 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-05-15 09:53:27,841 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-05-15 09:53:27,841 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-05-15 09:53:27,841 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-05-15 09:53:27,841 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-05-15 09:53:27,841 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-05-15 09:53:27,841 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-05-15 09:53:27,842 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-05-15 09:53:27,842 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-05-15 09:53:27,842 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-05-15 09:53:27,842 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-05-15 09:53:27,842 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-05-15 09:53:27,842 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-05-15 09:53:27,842 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-05-15 09:53:27,842 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-05-15 09:53:27,842 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-05-15 09:53:27,842 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-05-15 09:53:27,842 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-05-15 09:53:27,842 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-05-15 09:53:27,842 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-05-15 09:53:27,842 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-05-15 09:53:27,842 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-05-15 09:53:27,842 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-05-15 09:53:27,843 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-05-15 09:53:27,843 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-05-15 09:53:27,843 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-05-15 09:53:27,843 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-05-15 09:53:27,843 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-05-15 09:53:27,843 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-05-15 09:53:27,843 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-05-15 09:53:27,843 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-05-15 09:53:27,843 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-05-15 09:53:27,843 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-05-15 09:53:27,843 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-05-15 09:53:27,843 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-05-15 09:53:27,843 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-05-15 09:53:27,843 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-05-15 09:53:27,843 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-05-15 09:53:27,844 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-05-15 09:53:27,844 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-05-15 09:53:27,844 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-05-15 09:53:27,844 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-05-15 09:53:27,844 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-05-15 09:53:27,844 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-05-15 09:53:27,844 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-05-15 09:53:27,844 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-05-15 09:53:27,844 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-05-15 09:53:27,844 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-05-15 09:53:27,844 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-05-15 09:53:27,844 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-05-15 09:53:27,844 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-05-15 09:53:27,844 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-05-15 09:53:27,844 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-05-15 09:53:27,844 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-05-15 09:53:27,844 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-05-15 09:53:27,844 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-05-15 09:53:27,845 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-05-15 09:53:27,845 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-05-15 09:53:27,845 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-05-15 09:53:27,845 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-05-15 09:53:27,845 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-05-15 09:53:27,845 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-05-15 09:53:27,845 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-05-15 09:53:27,845 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-05-15 09:53:27,845 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-05-15 09:53:27,845 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-05-15 09:53:27,845 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-05-15 09:53:27,845 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-05-15 09:53:27,845 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-05-15 09:53:27,845 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-05-15 09:53:27,845 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-05-15 09:53:27,845 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-05-15 09:53:27,845 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-05-15 09:53:27,845 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-05-15 09:53:27,846 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-05-15 09:53:27,846 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-05-15 09:53:27,846 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-05-15 09:53:27,846 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-05-15 09:53:27,846 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-05-15 09:53:27,846 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-05-15 09:53:27,846 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-05-15 09:53:27,846 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-05-15 09:53:27,846 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-05-15 09:53:27,846 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-05-15 09:53:27,846 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-05-15 09:53:27,846 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-05-15 09:53:27,974 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.004544332072404845); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.006104220173631567); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.004544332072404845); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=2.5E-4); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.00375); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-05-15 09:53:27,975 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-05-15 09:53:27,975 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=6.120378453284872E-4, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.004544332072404845); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.006104220173631567); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.004544332072404845); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=2.5E-4); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.00375); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-05-15 09:53:28,364 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 504 ms to try 5000 different iterations.  Found a solution that moves 221 regions; Going from a computed imbalance of 6.120378453284872E-4 to a new imbalance of 1.0554380296087835E-5. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=2.735366466207394E-4); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0017082358106351274); MoveCostFunction : (multiplier=7.0, imbalance=0.024555555555555556); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=2.735366466207394E-4); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-05-15 09:53:28,365 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1115179140:83 , srv1311726376:83 , srv1590608416:83 , srv1820282394:83 , srv1888878396:83 , srv2041767317:83 , srv740860015:83 , srv816340964:83 , srv1013138842:84 , srv1021727201:84 , srv1218009805:84 , srv1288748187:84 , srv136017469:84 , srv1420632899:84 , srv1504571368:84 , srv1546162945:84 , srv1564578:84 , srv1586265343:84 , srv1664747299:84 , srv1700094486:84 , srv1717551499:84 , srv1726790232:84 , srv1776415908:84 , srv1792242392:84 , srv1912751025:84 , srv1941577141:84 , srv1945738852:84 , srv1977697839:84 , srv2082379688:84 , srv2129886385:84 , srv27466080:84 , srv355837064:84 , srv378333956:84 , srv392648348:84 , srv43201036:84 , srv463494826:84 , srv508668615:84 , srv516947963:84 , srv651704512:84 , srv668159518:84 , srv695800229:84 , srv728934160:84 , srv765244377:84 , srv80577413:84 , srv860457984:84 , srv861600765:84 , srv862342612:84 , srv891475210:84 , srv899504500:84 , srv900166379:84 , srv967681246:84 , srv1000028679:85 , srv103378159:85 , srv1090949773:85 , srv1180291281:85 , srv1185353999:85 , srv1220587394:85 , srv1325449235:85 , srv1412556826:85 , srv1488958991:85 , srv1531432944:85 , srv155820188:85 , srv1563736076:85 , srv1570688131:85 , srv1595878483:85 , srv1638977023:85 , srv1656282634:85 , srv1725671440:85 , srv1737837795:85 , srv1765167247:85 , srv1869515610:85 , srv1887693476:85 , srv1891229972:85 , srv1955739524:85 , srv1967990235:85 , srv2002530000:85 , srv2013040226:85 , srv2031967376:85 , srv2065222998:85 , srv2079624031:85 , srv2113139742:85 , srv2137102168:85 , srv23465099:85 , srv329487003:85 , srv355263033:85 , srv400298135:85 , srv474090528:85 , srv520395537:85 , srv530505355:85 , srv538035692:85 , srv641696287:85 , srv707536259:85 , srv788098735:85 , srv807321902:85 , srv850158309:85 , srv864793520:85 , srv935934412:85 , srv968828761:85 , srv989381387:85 , srv240850332:644 }
2023-05-15 09:53:28,371 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-05-15 09:53:28,372 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1717551499=31, srv2113139742=56, srv740860015=82, srv850158309=88, srv1564578=22, srv329487003=62, srv27466080=61, srv1531432944=18, srv765244377=83, srv1570688131=23, srv155820188=20, srv1776415908=36, srv2129886385=57, srv1115179140=5, srv2065222998=53, srv1412556826=14, srv891475210=93, srv1945738852=45, srv728934160=81, srv1504571368=17, srv651704512=77, srv1967990235=47, srv103378159=3, srv530505355=74, srv967681246=97, srv1218009805=8, srv1288748187=10, srv520395537=73, srv23465099=59, srv860457984=89, srv968828761=98, srv1013138842=1, srv2079624031=54, srv463494826=69, srv474090528=70, srv1586265343=24, srv1977697839=48, srv355837064=64, srv1488958991=16, srv1180291281=6, srv1820282394=38, srv538035692=75, srv2031967376=51, srv1891229972=42, srv1185353999=7, srv1325449235=12, srv1955739524=46, srv2002530000=49, srv2013040226=50, srv1638977023=27, srv1090949773=4, srv1725671440=32, srv1888878396=41, srv43201036=68, srv899504500=94, srv1792242392=37, srv1941577141=44, srv1869515610=39, srv1546162945=19, srv989381387=99, srv1726790232=33, srv1220587394=9, srv1656282634=28, srv668159518=78, srv136017469=13, srv400298135=67, srv392648348=66, srv80577413=85, srv355263033=63, srv864793520=92, srv1420632899=15, srv516947963=72, srv861600765=90, srv788098735=84, srv2082379688=55, srv1311726376=11, srv1590608416=25, srv2137102168=58, srv641696287=76, srv1664747299=29, srv1700094486=30, srv1021727201=2, srv862342612=91, srv935934412=96, srv1000028679=0, srv1737837795=34, srv2041767317=52, srv1912751025=43, srv707536259=80, srv1765167247=35, srv1887693476=40, srv240850332=60, srv378333956=65, srv900166379=95, srv508668615=71, srv816340964=87, srv1595878483=26, srv807321902=86, srv1563736076=21, srv695800229=79} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-05-15 09:53:28,389 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-05-15 09:53:28,389 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-05-15 09:53:28,390 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-05-15 09:53:28,390 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-05-15 09:53:28,390 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-05-15 09:53:28,390 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-05-15 09:53:28,390 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-05-15 09:53:28,390 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-05-15 09:53:28,390 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-05-15 09:53:28,390 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-05-15 09:53:28,390 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-05-15 09:53:28,390 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-05-15 09:53:28,390 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-05-15 09:53:28,391 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-05-15 09:53:28,391 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-05-15 09:53:28,391 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-05-15 09:53:28,391 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-05-15 09:53:28,391 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-05-15 09:53:28,391 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-05-15 09:53:28,391 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-05-15 09:53:28,391 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-05-15 09:53:28,391 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-05-15 09:53:28,391 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-05-15 09:53:28,391 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-05-15 09:53:28,392 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-05-15 09:53:28,392 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-05-15 09:53:28,392 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-05-15 09:53:28,392 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-05-15 09:53:28,392 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-05-15 09:53:28,392 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-05-15 09:53:28,392 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-05-15 09:53:28,392 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-05-15 09:53:28,392 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-05-15 09:53:28,392 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-05-15 09:53:28,392 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-05-15 09:53:28,392 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-05-15 09:53:28,392 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-05-15 09:53:28,393 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-05-15 09:53:28,393 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-05-15 09:53:28,393 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-05-15 09:53:28,393 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-05-15 09:53:28,393 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-05-15 09:53:28,393 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-05-15 09:53:28,393 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-05-15 09:53:28,393 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-05-15 09:53:28,393 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-05-15 09:53:28,393 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-05-15 09:53:28,393 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-05-15 09:53:28,393 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-05-15 09:53:28,394 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-05-15 09:53:28,394 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-05-15 09:53:28,394 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-05-15 09:53:28,394 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-05-15 09:53:28,394 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-05-15 09:53:28,394 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-05-15 09:53:28,394 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-05-15 09:53:28,394 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-05-15 09:53:28,394 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-05-15 09:53:28,394 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-05-15 09:53:28,394 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-05-15 09:53:28,394 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-05-15 09:53:28,395 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-05-15 09:53:28,395 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-05-15 09:53:28,395 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-05-15 09:53:28,395 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-05-15 09:53:28,395 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-05-15 09:53:28,395 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-05-15 09:53:28,395 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-05-15 09:53:28,395 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-05-15 09:53:28,396 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-05-15 09:53:28,396 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-05-15 09:53:28,396 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-05-15 09:53:28,396 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-05-15 09:53:28,396 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-05-15 09:53:28,396 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-05-15 09:53:28,396 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-05-15 09:53:28,396 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-05-15 09:53:28,396 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-05-15 09:53:28,397 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-05-15 09:53:28,397 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-05-15 09:53:28,397 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-05-15 09:53:28,397 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-05-15 09:53:28,397 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-05-15 09:53:28,397 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-05-15 09:53:28,397 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-05-15 09:53:28,397 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-05-15 09:53:28,397 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-05-15 09:53:28,397 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-05-15 09:53:28,397 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-05-15 09:53:28,397 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-05-15 09:53:28,397 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-05-15 09:53:28,398 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-05-15 09:53:28,398 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-05-15 09:53:28,398 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-05-15 09:53:28,398 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-05-15 09:53:28,398 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-05-15 09:53:28,398 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-05-15 09:53:28,398 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-05-15 09:53:28,398 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-05-15 09:53:28,398 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-05-15 09:53:28,398 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-05-15 09:53:28,515 INFO  [Time-limited test] balancer.StochasticLoadBalancer(381): Cluster wide - skipping load balancing because weighted average imbalance=9.006905221239855E-6 <= threshold(0.025). If you want more aggressive balancing, either lower hbase.master.balancer.stochastic.minCostNeedBalance from 0.025 or increase the relative multiplier(s) of the specific cost function(s). functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=2.735366466207394E-4); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0017082358106351274); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=2.735366466207394E-4); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-05-15 09:53:28,515 INFO  [Time-limited test] balancer.BalancerTestBase(570): Mock Final balance: { srv1115179140:83 , srv1311726376:83 , srv1590608416:83 , srv1820282394:83 , srv1888878396:83 , srv2041767317:83 , srv740860015:83 , srv816340964:83 , srv1013138842:84 , srv1021727201:84 , srv1218009805:84 , srv1288748187:84 , srv136017469:84 , srv1420632899:84 , srv1504571368:84 , srv1546162945:84 , srv1564578:84 , srv1586265343:84 , srv1664747299:84 , srv1700094486:84 , srv1717551499:84 , srv1726790232:84 , srv1776415908:84 , srv1792242392:84 , srv1912751025:84 , srv1941577141:84 , srv1945738852:84 , srv1977697839:84 , srv2082379688:84 , srv2129886385:84 , srv27466080:84 , srv355837064:84 , srv378333956:84 , srv392648348:84 , srv43201036:84 , srv463494826:84 , srv508668615:84 , srv516947963:84 , srv651704512:84 , srv668159518:84 , srv695800229:84 , srv728934160:84 , srv765244377:84 , srv80577413:84 , srv860457984:84 , srv861600765:84 , srv862342612:84 , srv891475210:84 , srv899504500:84 , srv900166379:84 , srv967681246:84 , srv1000028679:85 , srv103378159:85 , srv1090949773:85 , srv1180291281:85 , srv1185353999:85 , srv1220587394:85 , srv1325449235:85 , srv1412556826:85 , srv1488958991:85 , srv1531432944:85 , srv155820188:85 , srv1563736076:85 , srv1570688131:85 , srv1595878483:85 , srv1638977023:85 , srv1656282634:85 , srv1725671440:85 , srv1737837795:85 , srv1765167247:85 , srv1869515610:85 , srv1887693476:85 , srv1891229972:85 , srv1955739524:85 , srv1967990235:85 , srv2002530000:85 , srv2013040226:85 , srv2031967376:85 , srv2065222998:85 , srv2079624031:85 , srv2113139742:85 , srv2137102168:85 , srv23465099:85 , srv329487003:85 , srv355263033:85 , srv400298135:85 , srv474090528:85 , srv520395537:85 , srv530505355:85 , srv538035692:85 , srv641696287:85 , srv707536259:85 , srv788098735:85 , srv807321902:85 , srv850158309:85 , srv864793520:85 , srv935934412:85 , srv968828761:85 , srv989381387:85 , srv240850332:644 }
2023-05-15 09:53:28,548 INFO  [Time-limited test] hbase.ResourceChecker(175): after: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnLargeClusterWithRacks Thread=12 (was 12), OpenFileDescriptor=264 (was 264), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=314 (was 314), ProcessCount=175 (was 175), AvailableMemoryMB=14159 (was 14961)
2023-05-15 09:53:28,559 INFO  [Time-limited test] hbase.ResourceChecker(147): before: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnMidClusterWithRacks Thread=12, OpenFileDescriptor=264, MaxFileDescriptor=60000, SystemLoadAverage=314, ProcessCount=175, AvailableMemoryMB=14158
2023-05-15 09:53:28,560 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2023-05-15 09:53:28,561 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=5000, runMaxSteps=true, stepsPerRegion=800, maxRunningTime=120000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 111077.0 etc.
2023-05-15 09:53:28,573 INFO  [Time-limited test] balancer.BalancerTestBase(547): Mock Cluster : { srv1038089603:84 , srv1058842634:84 , srv1135621408:84 , srv1179045167:84 , srv1290777007:84 , srv1462582911:84 , srv1504118116:84 , srv1572114606:84 , srv1650105332:84 , srv1679152270:84 , srv1686064833:84 , srv1887591620:84 , srv1900932199:84 , srv1950160545:84 , srv1958627899:84 , srv2006768776:84 , srv2134253106:84 , srv315959505:84 , srv354029687:84 , srv404771377:84 , srv46581728:84 , srv475829304:84 , srv534135352:84 , srv698392571:84 , srv851028838:84 , srv895562950:84 , srv929053827:84 , srv949404526:84 , srv971533450:84 , srv213912140:264 } [srvr=30 rgns=2700 avg=90.0 max=90 min=90]
2023-05-15 09:53:28,575 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-05-15 09:53:28,576 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1572114606=7, srv895562950=26, srv1950160545=13, srv475829304=22, srv1462582911=5, srv851028838=25, srv1179045167=3, srv534135352=23, srv315959505=18, srv971533450=29, srv1650105332=8, srv1958627899=14, srv1679152270=9, srv404771377=20, srv949404526=28, srv1058842634=1, srv354029687=19, srv1504118116=6, srv1900932199=12, srv1686064833=10, srv1887591620=11, srv1135621408=2, srv46581728=21, srv698392571=24, srv213912140=17, srv1038089603=0, srv2134253106=16, srv1290777007=4, srv2006768776=15, srv929053827=27} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-05-15 09:53:28,589 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-05-15 09:53:28,589 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-05-15 09:53:28,590 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-05-15 09:53:28,590 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-05-15 09:53:28,590 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-05-15 09:53:28,590 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-05-15 09:53:28,590 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-05-15 09:53:28,590 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-05-15 09:53:28,590 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-05-15 09:53:28,590 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-05-15 09:53:28,590 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-05-15 09:53:28,590 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-05-15 09:53:28,590 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-05-15 09:53:28,590 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-05-15 09:53:28,590 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-05-15 09:53:28,591 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-05-15 09:53:28,591 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-05-15 09:53:28,591 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-05-15 09:53:28,591 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-05-15 09:53:28,591 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-05-15 09:53:28,591 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-05-15 09:53:28,591 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-05-15 09:53:28,591 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-05-15 09:53:28,591 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-05-15 09:53:28,591 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-05-15 09:53:28,591 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-05-15 09:53:28,591 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-05-15 09:53:28,591 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-05-15 09:53:28,592 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-05-15 09:53:28,592 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-05-15 09:53:28,592 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=10, number of hosts=30, number of racks=4
2023-05-15 09:53:28,616 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=1.1100408302863785, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-05-15 09:53:28,617 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.9912539778327348, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=1.1100408302863785, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=64800000
2023-05-15 09:55:28,596 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 120001 ms to try 6459158 different iterations.  Found a solution that moves 1860 regions; Going from a computed imbalance of 0.9912539778327348 to a new imbalance of 4.341332789166274E-5. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); MoveCostFunction : (multiplier=7.0, imbalance=0.6888888888888889, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-05-15 09:55:28,601 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1038089603:90 , srv1058842634:90 , srv1135621408:90 , srv1179045167:90 , srv1290777007:90 , srv1462582911:90 , srv1504118116:90 , srv1572114606:90 , srv1650105332:90 , srv1679152270:90 , srv1686064833:90 , srv1887591620:90 , srv1900932199:90 , srv1950160545:90 , srv1958627899:90 , srv2006768776:90 , srv2134253106:90 , srv213912140:90 , srv315959505:90 , srv354029687:90 , srv404771377:90 , srv46581728:90 , srv475829304:90 , srv534135352:90 , srv698392571:90 , srv851028838:90 , srv895562950:90 , srv929053827:90 , srv949404526:90 , srv971533450:90 }
2023-05-15 09:55:28,602 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-05-15 09:55:28,603 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1572114606=7, srv895562950=26, srv1950160545=13, srv475829304=22, srv1462582911=5, srv851028838=25, srv1179045167=3, srv534135352=23, srv315959505=18, srv971533450=29, srv1650105332=8, srv1958627899=14, srv1679152270=9, srv404771377=20, srv949404526=28, srv1058842634=1, srv354029687=19, srv1504118116=6, srv1900932199=12, srv1686064833=10, srv1887591620=11, srv1135621408=2, srv46581728=21, srv698392571=24, srv213912140=17, srv1038089603=0, srv2134253106=16, srv1290777007=4, srv2006768776=15, srv929053827=27} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-05-15 09:55:28,606 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-05-15 09:55:28,607 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-05-15 09:55:28,607 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-05-15 09:55:28,607 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-05-15 09:55:28,607 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-05-15 09:55:28,607 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-05-15 09:55:28,607 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-05-15 09:55:28,607 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-05-15 09:55:28,607 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-05-15 09:55:28,607 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-05-15 09:55:28,607 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-05-15 09:55:28,607 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-05-15 09:55:28,608 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-05-15 09:55:28,608 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-05-15 09:55:28,608 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-05-15 09:55:28,608 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-05-15 09:55:28,608 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-05-15 09:55:28,608 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-05-15 09:55:28,608 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-05-15 09:55:28,608 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-05-15 09:55:28,608 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-05-15 09:55:28,608 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-05-15 09:55:28,608 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-05-15 09:55:28,608 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-05-15 09:55:28,609 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-05-15 09:55:28,609 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-05-15 09:55:28,609 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-05-15 09:55:28,609 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-05-15 09:55:28,609 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-05-15 09:55:28,609 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-05-15 09:55:28,609 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=10, number of hosts=30, number of racks=4
2023-05-15 09:55:28,622 INFO  [Time-limited test] balancer.StochasticLoadBalancer(381): Cluster wide - skipping load balancing because weighted average imbalance=0.0 <= threshold(0.025). If you want more aggressive balancing, either lower hbase.master.balancer.stochastic.minCostNeedBalance from 0.025 or increase the relative multiplier(s) of the specific cost function(s). functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-05-15 09:55:28,623 INFO  [Time-limited test] balancer.BalancerTestBase(570): Mock Final balance: { srv1038089603:90 , srv1058842634:90 , srv1135621408:90 , srv1179045167:90 , srv1290777007:90 , srv1462582911:90 , srv1504118116:90 , srv1572114606:90 , srv1650105332:90 , srv1679152270:90 , srv1686064833:90 , srv1887591620:90 , srv1900932199:90 , srv1950160545:90 , srv1958627899:90 , srv2006768776:90 , srv2134253106:90 , srv213912140:90 , srv315959505:90 , srv354029687:90 , srv404771377:90 , srv46581728:90 , srv475829304:90 , srv534135352:90 , srv698392571:90 , srv851028838:90 , srv895562950:90 , srv929053827:90 , srv949404526:90 , srv971533450:90 }
2023-05-15 09:55:28,640 INFO  [Time-limited test] hbase.ResourceChecker(175): after: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnMidClusterWithRacks Thread=11 (was 12), OpenFileDescriptor=264 (was 264), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=173 (was 314), ProcessCount=175 (was 175), AvailableMemoryMB=14295 (was 14158) - AvailableMemoryMB LEAK? -