2023-02-20 04:54:06,683 INFO  [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks timeout: 13 mins
2023-02-20 04:54:07,025 WARN  [Time-limited test] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties
2023-02-20 04:54:07,145 INFO  [Time-limited test] metrics.MetricRegistriesLoader(60): Loaded MetricRegistries class org.apache.hadoop.hbase.metrics.impl.MetricRegistriesImpl
2023-02-20 04:54:07,227 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2023-02-20 04:54:07,237 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc.
2023-02-20 04:54:07,258 INFO  [Time-limited test] hbase.ResourceChecker(147): before: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnLargeClusterWithRacks Thread=10, OpenFileDescriptor=260, MaxFileDescriptor=60000, SystemLoadAverage=280, ProcessCount=170, AvailableMemoryMB=10594
2023-02-20 04:54:07,261 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2023-02-20 04:54:07,261 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=5000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=10000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc.
2023-02-20 04:54:07,405 INFO  [Time-limited test] balancer.BalancerTestBase(547): Mock Cluster : { srv1001028641:84 , srv1021636496:84 , srv102339600:84 , srv1037103432:84 , srv1045064231:84 , srv1053016140:84 , srv1093822897:84 , srv1136775719:84 , srv116682383:84 , srv1191816648:84 , srv1216621493:84 , srv1267052388:84 , srv1307298572:84 , srv1331596021:84 , srv136057180:84 , srv1375437145:84 , srv1380661261:84 , srv1447608378:84 , srv1460717755:84 , srv1468321466:84 , srv149043850:84 , srv150380283:84 , srv153277784:84 , srv1570661133:84 , srv1570679747:84 , srv1571315951:84 , srv1578554824:84 , srv1604095839:84 , srv1627549954:84 , srv1633385715:84 , srv1654146394:84 , srv1693068960:84 , srv1757911292:84 , srv1789616070:84 , srv1834103401:84 , srv1870478132:84 , srv1872482050:84 , srv188309014:84 , srv1927222974:84 , srv1932860592:84 , srv1942973879:84 , srv1944101832:84 , srv2009891601:84 , srv2033231839:84 , srv2040297559:84 , srv2047608210:84 , srv2057987976:84 , srv2079792599:84 , srv2112723071:84 , srv2131774782:84 , srv2137113824:84 , srv245547134:84 , srv250638167:84 , srv27037668:84 , srv270840347:84 , srv298840446:84 , srv315662129:84 , srv323056541:84 , srv368414753:84 , srv375492728:84 , srv378056701:84 , srv380078989:84 , srv393952785:84 , srv419698151:84 , srv439125012:84 , srv45210208:84 , srv462942746:84 , srv481102254:84 , srv482484591:84 , srv5073712:84 , srv510656043:84 , srv516836438:84 , srv518800209:84 , srv531894003:84 , srv574828187:84 , srv59373949:84 , srv594172404:84 , srv597213546:84 , srv627898414:84 , srv642216064:84 , srv657366342:84 , srv668822112:84 , srv687390077:84 , srv722341543:84 , srv731157677:84 , srv756561144:84 , srv777669648:84 , srv778314199:84 , srv797986030:84 , srv799577111:84 , srv80899507:84 , srv810160977:84 , srv870100367:84 , srv872528196:84 , srv886441296:84 , srv897900090:84 , srv926025388:84 , srv965382926:84 , srv991619654:84 , srv580333690:684 } [srvr=100 rgns=9000 avg=90.0 max=90 min=90]
2023-02-20 04:54:07,413 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-02-20 04:54:07,421 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv657366342=81, srv1627549954=28, srv991619654=99, srv2079792599=47, srv642216064=80, srv1380661261=16, srv1053016140=5, srv1447608378=17, srv245547134=51, srv270840347=54, srv756561144=86, srv1654146394=30, srv810160977=92, srv1037103432=3, srv1633385715=29, srv1307298572=12, srv1578554824=26, srv1604095839=27, srv580333690=75, srv1191816648=9, srv368414753=58, srv778314199=88, srv150380283=21, srv1870478132=35, srv1932860592=39, srv1460717755=18, srv1942973879=40, srv965382926=98, srv2131774782=49, srv1375437145=15, srv1136775719=7, srv5073712=69, srv439125012=64, srv153277784=22, srv2057987976=46, srv102339600=2, srv777669648=87, srv1093822897=6, srv627898414=79, srv59373949=76, srv516836438=71, srv1267052388=11, srv1789616070=33, srv799577111=90, srv323056541=57, srv897900090=96, srv1872482050=36, srv45210208=65, srv1216621493=10, srv870100367=93, srv1468321466=19, srv188309014=37, srv378056701=60, srv926025388=97, srv250638167=52, srv531894003=73, srv1834103401=34, srv298840446=55, srv80899507=91, srv594172404=77, srv116682383=8, srv1693068960=31, srv2047608210=45, srv1021636496=1, srv1571315951=25, srv872528196=94, srv1570679747=24, srv2040297559=44, srv393952785=62, srv2112723071=48, srv597213546=78, srv1927222974=38, srv1944101832=41, srv687390077=83, srv722341543=84, srv380078989=61, srv1001028641=0, srv481102254=67, srv668822112=82, srv797986030=89, srv149043850=20, srv574828187=74, srv1757911292=32, srv315662129=56, srv27037668=53, srv1045064231=4, srv518800209=72, srv2033231839=43, srv731157677=85, srv886441296=95, srv136057180=14, srv375492728=59, srv1570661133=23, srv2137113824=50, srv510656043=70, srv462942746=66, srv2009891601=42, srv419698151=63, srv1331596021=13, srv482484591=68} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-02-20 04:54:07,500 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-02-20 04:54:07,500 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-02-20 04:54:07,500 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-02-20 04:54:07,500 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-02-20 04:54:07,501 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-02-20 04:54:07,501 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-02-20 04:54:07,501 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-02-20 04:54:07,501 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-02-20 04:54:07,501 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-02-20 04:54:07,501 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-02-20 04:54:07,501 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-02-20 04:54:07,501 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-02-20 04:54:07,501 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-02-20 04:54:07,502 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-02-20 04:54:07,502 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-02-20 04:54:07,502 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-02-20 04:54:07,502 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-02-20 04:54:07,502 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-02-20 04:54:07,502 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-02-20 04:54:07,502 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-02-20 04:54:07,502 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-02-20 04:54:07,502 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-02-20 04:54:07,502 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-02-20 04:54:07,503 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-02-20 04:54:07,503 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-02-20 04:54:07,503 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-02-20 04:54:07,503 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-02-20 04:54:07,503 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-02-20 04:54:07,503 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-02-20 04:54:07,503 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-02-20 04:54:07,503 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-02-20 04:54:07,503 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-02-20 04:54:07,503 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-02-20 04:54:07,504 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-02-20 04:54:07,504 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-02-20 04:54:07,504 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-02-20 04:54:07,504 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-02-20 04:54:07,504 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-02-20 04:54:07,504 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-02-20 04:54:07,504 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-02-20 04:54:07,505 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-02-20 04:54:07,505 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-02-20 04:54:07,505 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-02-20 04:54:07,505 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-02-20 04:54:07,505 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-02-20 04:54:07,505 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-02-20 04:54:07,505 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-02-20 04:54:07,505 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-02-20 04:54:07,505 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-02-20 04:54:07,505 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-02-20 04:54:07,506 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-02-20 04:54:07,506 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-02-20 04:54:07,506 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-02-20 04:54:07,506 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-02-20 04:54:07,506 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-02-20 04:54:07,506 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-02-20 04:54:07,506 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-02-20 04:54:07,506 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-02-20 04:54:07,506 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-02-20 04:54:07,507 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-02-20 04:54:07,507 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-02-20 04:54:07,507 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-02-20 04:54:07,507 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-02-20 04:54:07,507 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-02-20 04:54:07,507 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-02-20 04:54:07,507 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-02-20 04:54:07,508 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-02-20 04:54:07,508 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-02-20 04:54:07,508 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-02-20 04:54:07,508 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-02-20 04:54:07,508 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-02-20 04:54:07,508 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-02-20 04:54:07,508 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-02-20 04:54:07,508 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-02-20 04:54:07,508 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-02-20 04:54:07,509 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-02-20 04:54:07,509 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-02-20 04:54:07,509 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-02-20 04:54:07,509 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-02-20 04:54:07,509 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-02-20 04:54:07,509 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-02-20 04:54:07,509 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-02-20 04:54:07,510 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-02-20 04:54:07,510 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-02-20 04:54:07,510 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-02-20 04:54:07,510 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-02-20 04:54:07,510 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-02-20 04:54:07,510 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-02-20 04:54:07,510 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-02-20 04:54:07,511 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-02-20 04:54:07,511 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-02-20 04:54:07,511 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-02-20 04:54:07,511 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-02-20 04:54:07,511 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-02-20 04:54:07,511 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-02-20 04:54:07,511 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-02-20 04:54:07,511 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-02-20 04:54:07,511 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-02-20 04:54:07,512 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-02-20 04:54:07,512 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-02-20 04:54:07,512 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-02-20 04:54:07,753 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.06666666666666667, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-02-20 04:54:07,753 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-02-20 04:54:07,753 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.9909252140407105, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.06666666666666667, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-02-20 04:54:08,433 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 894 ms to try 5000 different iterations.  Found a solution that moves 4744 regions; Going from a computed imbalance of 0.9909252140407105 to a new imbalance of 0.17374195129470227. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.041827262524107775, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.057001388133608194, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.5271111111111111, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.041827262524107775, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.16833333333333333, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.24108333333333334, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-02-20 04:54:08,455 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv102339600:82 , srv188309014:82 , srv597213546:82 , srv1331596021:83 , srv5073712:83 , srv1136775719:84 , srv1375437145:84 , srv1380661261:84 , srv1460717755:84 , srv149043850:84 , srv1578554824:84 , srv1834103401:84 , srv1870478132:84 , srv1927222974:84 , srv2009891601:84 , srv2057987976:84 , srv250638167:84 , srv380078989:84 , srv462942746:84 , srv510656043:84 , srv59373949:84 , srv1093822897:85 , srv1216621493:85 , srv150380283:85 , srv1627549954:85 , srv1654146394:85 , srv1944101832:85 , srv2040297559:85 , srv2079792599:85 , srv2131774782:85 , srv323056541:85 , srv368414753:85 , srv378056701:85 , srv393952785:85 , srv481102254:85 , srv574828187:85 , srv642216064:85 , srv657366342:85 , srv731157677:85 , srv778314199:85 , srv797986030:85 , srv991619654:85 , srv1001028641:86 , srv1053016140:86 , srv1571315951:86 , srv1693068960:86 , srv2112723071:86 , srv2137113824:86 , srv518800209:86 , srv531894003:86 , srv627898414:86 , srv777669648:86 , srv799577111:86 , srv80899507:86 , srv926025388:86 , srv1037103432:87 , srv1045064231:87 , srv116682383:87 , srv153277784:87 , srv1570679747:87 , srv1604095839:87 , srv1757911292:87 , srv1789616070:87 , srv1872482050:87 , srv2033231839:87 , srv270840347:87 , srv298840446:87 , srv439125012:87 , srv482484591:87 , srv516836438:87 , srv722341543:87 , srv886441296:87 , srv897900090:87 , srv1191816648:88 , srv1447608378:88 , srv1570661133:88 , srv1932860592:88 , srv1942973879:88 , srv2047608210:88 , srv245547134:88 , srv27037668:88 , srv419698151:88 , srv594172404:88 , srv668822112:88 , srv756561144:88 , srv810160977:88 , srv870100367:88 , srv872528196:88 , srv1021636496:89 , srv1267052388:89 , srv1307298572:89 , srv1633385715:89 , srv315662129:89 , srv45210208:89 , srv965382926:89 , srv136057180:90 , srv687390077:90 , srv1468321466:91 , srv375492728:99 , srv580333690:462 }
2023-02-20 04:54:08,459 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-02-20 04:54:08,460 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv657366342=81, srv1627549954=28, srv991619654=99, srv2079792599=47, srv642216064=80, srv1380661261=16, srv1053016140=5, srv1447608378=17, srv245547134=51, srv270840347=54, srv756561144=86, srv1654146394=30, srv810160977=92, srv1037103432=3, srv1633385715=29, srv1307298572=12, srv1578554824=26, srv1604095839=27, srv580333690=75, srv1191816648=9, srv368414753=58, srv778314199=88, srv150380283=21, srv1870478132=35, srv1932860592=39, srv1460717755=18, srv1942973879=40, srv965382926=98, srv2131774782=49, srv1375437145=15, srv1136775719=7, srv5073712=69, srv439125012=64, srv153277784=22, srv2057987976=46, srv102339600=2, srv777669648=87, srv1093822897=6, srv627898414=79, srv59373949=76, srv516836438=71, srv1267052388=11, srv1789616070=33, srv799577111=90, srv323056541=57, srv897900090=96, srv1872482050=36, srv45210208=65, srv1216621493=10, srv870100367=93, srv1468321466=19, srv188309014=37, srv378056701=60, srv926025388=97, srv250638167=52, srv531894003=73, srv1834103401=34, srv298840446=55, srv80899507=91, srv594172404=77, srv116682383=8, srv1693068960=31, srv2047608210=45, srv1021636496=1, srv1571315951=25, srv872528196=94, srv1570679747=24, srv2040297559=44, srv393952785=62, srv2112723071=48, srv597213546=78, srv1927222974=38, srv1944101832=41, srv687390077=83, srv722341543=84, srv380078989=61, srv1001028641=0, srv481102254=67, srv668822112=82, srv797986030=89, srv149043850=20, srv574828187=74, srv1757911292=32, srv315662129=56, srv27037668=53, srv1045064231=4, srv518800209=72, srv2033231839=43, srv731157677=85, srv886441296=95, srv136057180=14, srv375492728=59, srv1570661133=23, srv2137113824=50, srv510656043=70, srv462942746=66, srv2009891601=42, srv419698151=63, srv1331596021=13, srv482484591=68} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-02-20 04:54:08,475 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-02-20 04:54:08,476 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-02-20 04:54:08,476 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-02-20 04:54:08,476 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-02-20 04:54:08,476 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-02-20 04:54:08,476 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-02-20 04:54:08,476 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-02-20 04:54:08,476 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-02-20 04:54:08,477 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-02-20 04:54:08,477 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-02-20 04:54:08,477 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-02-20 04:54:08,477 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-02-20 04:54:08,477 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-02-20 04:54:08,477 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-02-20 04:54:08,477 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-02-20 04:54:08,477 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-02-20 04:54:08,478 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-02-20 04:54:08,478 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-02-20 04:54:08,478 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-02-20 04:54:08,478 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-02-20 04:54:08,478 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-02-20 04:54:08,478 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-02-20 04:54:08,478 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-02-20 04:54:08,478 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-02-20 04:54:08,478 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-02-20 04:54:08,479 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-02-20 04:54:08,479 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-02-20 04:54:08,479 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-02-20 04:54:08,479 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-02-20 04:54:08,479 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-02-20 04:54:08,479 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-02-20 04:54:08,479 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-02-20 04:54:08,479 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-02-20 04:54:08,479 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-02-20 04:54:08,479 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-02-20 04:54:08,479 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-02-20 04:54:08,479 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-02-20 04:54:08,480 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-02-20 04:54:08,480 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-02-20 04:54:08,480 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-02-20 04:54:08,480 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-02-20 04:54:08,480 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-02-20 04:54:08,480 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-02-20 04:54:08,480 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-02-20 04:54:08,480 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-02-20 04:54:08,480 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-02-20 04:54:08,480 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-02-20 04:54:08,480 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-02-20 04:54:08,480 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-02-20 04:54:08,480 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-02-20 04:54:08,481 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-02-20 04:54:08,481 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-02-20 04:54:08,481 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-02-20 04:54:08,481 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-02-20 04:54:08,481 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-02-20 04:54:08,481 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-02-20 04:54:08,481 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-02-20 04:54:08,481 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-02-20 04:54:08,481 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-02-20 04:54:08,481 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-02-20 04:54:08,481 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-02-20 04:54:08,482 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-02-20 04:54:08,482 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-02-20 04:54:08,482 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-02-20 04:54:08,482 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-02-20 04:54:08,482 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-02-20 04:54:08,482 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-02-20 04:54:08,482 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-02-20 04:54:08,482 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-02-20 04:54:08,482 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-02-20 04:54:08,482 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-02-20 04:54:08,482 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-02-20 04:54:08,482 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-02-20 04:54:08,482 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-02-20 04:54:08,482 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-02-20 04:54:08,483 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-02-20 04:54:08,483 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-02-20 04:54:08,483 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-02-20 04:54:08,483 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-02-20 04:54:08,483 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-02-20 04:54:08,483 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-02-20 04:54:08,483 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-02-20 04:54:08,483 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-02-20 04:54:08,483 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-02-20 04:54:08,483 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-02-20 04:54:08,483 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-02-20 04:54:08,483 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-02-20 04:54:08,483 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-02-20 04:54:08,484 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-02-20 04:54:08,484 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-02-20 04:54:08,484 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-02-20 04:54:08,484 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-02-20 04:54:08,484 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-02-20 04:54:08,484 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-02-20 04:54:08,484 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-02-20 04:54:08,484 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-02-20 04:54:08,484 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-02-20 04:54:08,484 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-02-20 04:54:08,485 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-02-20 04:54:08,485 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-02-20 04:54:08,485 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-02-20 04:54:08,672 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.041827262524107775, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.057001388133608194, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.041827262524107775, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.16833333333333333, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.24108333333333334, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-02-20 04:54:08,672 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-02-20 04:54:08,673 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.17370873309671547, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.041827262524107775, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.057001388133608194, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.041827262524107775, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.16833333333333333, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.24108333333333334, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-02-20 04:54:09,003 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 504 ms to try 5000 different iterations.  Found a solution that moves 2626 regions; Going from a computed imbalance of 0.17370873309671547 to a new imbalance of 0.01441470348501919. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.02206340555244458); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.02959130518094815, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.2917777777777778, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.02206340555244458); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.011333333333333334); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.043916666666666666, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-02-20 04:54:09,015 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv375492728:74 , srv1307298572:81 , srv1468321466:81 , srv1570661133:81 , srv687390077:81 , srv756561144:81 , srv1267052388:82 , srv136057180:82 , srv1932860592:82 , srv531894003:82 , srv1037103432:83 , srv1571315951:83 , srv1633385715:83 , srv1789616070:83 , srv1942973879:83 , srv872528196:83 , srv1021636496:84 , srv1191816648:84 , srv153277784:84 , srv1604095839:84 , srv1693068960:84 , srv2047608210:84 , srv245547134:84 , srv27037668:84 , srv315662129:84 , srv627898414:84 , srv722341543:84 , srv810160977:84 , srv886441296:84 , srv1045064231:85 , srv116682383:85 , srv1216621493:85 , srv1570679747:85 , srv1757911292:85 , srv1872482050:85 , srv2033231839:85 , srv2057987976:85 , srv2137113824:85 , srv419698151:85 , srv594172404:85 , srv668822112:85 , srv777669648:85 , srv80899507:85 , srv926025388:85 , srv965382926:85 , srv1375437145:86 , srv1447608378:86 , srv150380283:86 , srv1578554824:86 , srv2079792599:86 , srv270840347:86 , srv298840446:86 , srv323056541:86 , srv481102254:86 , srv516836438:86 , srv642216064:86 , srv657366342:86 , srv799577111:86 , srv1380661261:87 , srv1460717755:87 , srv1654146394:87 , srv1944101832:87 , srv2040297559:87 , srv2131774782:87 , srv378056701:87 , srv393952785:87 , srv45210208:87 , srv482484591:87 , srv731157677:87 , srv797986030:87 , srv1001028641:88 , srv1053016140:88 , srv1093822897:88 , srv1136775719:88 , srv149043850:88 , srv1627549954:88 , srv1927222974:88 , srv2009891601:88 , srv2112723071:88 , srv250638167:88 , srv368414753:88 , srv380078989:88 , srv439125012:88 , srv510656043:88 , srv518800209:88 , srv870100367:88 , srv991619654:88 , srv1834103401:89 , srv1870478132:89 , srv5073712:89 , srv574828187:89 , srv778314199:89 , srv897900090:89 , srv1331596021:90 , srv59373949:90 , srv597213546:90 , srv102339600:91 , srv188309014:91 , srv462942746:91 , srv580333690:508 }
2023-02-20 04:54:09,021 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-02-20 04:54:09,022 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv657366342=81, srv1627549954=28, srv991619654=99, srv2079792599=47, srv642216064=80, srv1380661261=16, srv1053016140=5, srv1447608378=17, srv245547134=51, srv270840347=54, srv756561144=86, srv1654146394=30, srv810160977=92, srv1037103432=3, srv1633385715=29, srv1307298572=12, srv1578554824=26, srv1604095839=27, srv580333690=75, srv1191816648=9, srv368414753=58, srv778314199=88, srv150380283=21, srv1870478132=35, srv1932860592=39, srv1460717755=18, srv1942973879=40, srv965382926=98, srv2131774782=49, srv1375437145=15, srv1136775719=7, srv5073712=69, srv439125012=64, srv153277784=22, srv2057987976=46, srv102339600=2, srv777669648=87, srv1093822897=6, srv627898414=79, srv59373949=76, srv516836438=71, srv1267052388=11, srv1789616070=33, srv799577111=90, srv323056541=57, srv897900090=96, srv1872482050=36, srv45210208=65, srv1216621493=10, srv870100367=93, srv1468321466=19, srv188309014=37, srv378056701=60, srv926025388=97, srv250638167=52, srv531894003=73, srv1834103401=34, srv298840446=55, srv80899507=91, srv594172404=77, srv116682383=8, srv1693068960=31, srv2047608210=45, srv1021636496=1, srv1571315951=25, srv872528196=94, srv1570679747=24, srv2040297559=44, srv393952785=62, srv2112723071=48, srv597213546=78, srv1927222974=38, srv1944101832=41, srv687390077=83, srv722341543=84, srv380078989=61, srv1001028641=0, srv481102254=67, srv668822112=82, srv797986030=89, srv149043850=20, srv574828187=74, srv1757911292=32, srv315662129=56, srv27037668=53, srv1045064231=4, srv518800209=72, srv2033231839=43, srv731157677=85, srv886441296=95, srv136057180=14, srv375492728=59, srv1570661133=23, srv2137113824=50, srv510656043=70, srv462942746=66, srv2009891601=42, srv419698151=63, srv1331596021=13, srv482484591=68} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-02-20 04:54:09,051 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-02-20 04:54:09,051 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-02-20 04:54:09,051 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-02-20 04:54:09,051 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-02-20 04:54:09,051 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-02-20 04:54:09,051 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-02-20 04:54:09,052 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-02-20 04:54:09,052 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-02-20 04:54:09,052 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-02-20 04:54:09,052 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-02-20 04:54:09,052 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-02-20 04:54:09,052 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-02-20 04:54:09,052 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-02-20 04:54:09,052 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-02-20 04:54:09,053 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-02-20 04:54:09,053 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-02-20 04:54:09,053 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-02-20 04:54:09,053 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-02-20 04:54:09,053 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-02-20 04:54:09,053 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-02-20 04:54:09,053 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-02-20 04:54:09,053 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-02-20 04:54:09,053 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-02-20 04:54:09,053 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-02-20 04:54:09,054 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-02-20 04:54:09,054 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-02-20 04:54:09,054 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-02-20 04:54:09,054 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-02-20 04:54:09,054 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-02-20 04:54:09,054 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-02-20 04:54:09,054 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-02-20 04:54:09,054 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-02-20 04:54:09,055 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-02-20 04:54:09,055 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-02-20 04:54:09,055 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-02-20 04:54:09,055 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-02-20 04:54:09,055 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-02-20 04:54:09,055 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-02-20 04:54:09,055 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-02-20 04:54:09,055 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-02-20 04:54:09,055 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-02-20 04:54:09,056 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-02-20 04:54:09,056 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-02-20 04:54:09,056 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-02-20 04:54:09,056 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-02-20 04:54:09,056 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-02-20 04:54:09,056 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-02-20 04:54:09,056 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-02-20 04:54:09,056 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-02-20 04:54:09,056 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-02-20 04:54:09,056 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-02-20 04:54:09,057 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-02-20 04:54:09,057 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-02-20 04:54:09,057 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-02-20 04:54:09,057 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-02-20 04:54:09,057 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-02-20 04:54:09,057 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-02-20 04:54:09,057 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-02-20 04:54:09,057 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-02-20 04:54:09,058 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-02-20 04:54:09,058 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-02-20 04:54:09,058 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-02-20 04:54:09,058 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-02-20 04:54:09,058 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-02-20 04:54:09,058 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-02-20 04:54:09,058 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-02-20 04:54:09,058 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-02-20 04:54:09,058 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-02-20 04:54:09,058 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-02-20 04:54:09,059 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-02-20 04:54:09,059 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-02-20 04:54:09,059 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-02-20 04:54:09,059 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-02-20 04:54:09,059 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-02-20 04:54:09,059 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-02-20 04:54:09,059 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-02-20 04:54:09,059 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-02-20 04:54:09,059 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-02-20 04:54:09,060 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-02-20 04:54:09,060 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-02-20 04:54:09,060 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-02-20 04:54:09,060 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-02-20 04:54:09,060 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-02-20 04:54:09,060 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-02-20 04:54:09,060 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-02-20 04:54:09,060 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-02-20 04:54:09,060 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-02-20 04:54:09,061 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-02-20 04:54:09,061 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-02-20 04:54:09,061 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-02-20 04:54:09,061 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-02-20 04:54:09,061 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-02-20 04:54:09,061 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-02-20 04:54:09,061 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-02-20 04:54:09,061 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-02-20 04:54:09,061 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-02-20 04:54:09,062 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-02-20 04:54:09,062 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-02-20 04:54:09,062 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-02-20 04:54:09,062 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-02-20 04:54:09,062 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-02-20 04:54:09,217 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.02206340555244458); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.02959130518094815, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.02206340555244458); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.011333333333333334); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.043916666666666666, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-02-20 04:54:09,217 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-02-20 04:54:09,217 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.014396315840012172, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.02206340555244458); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.02959130518094815, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.02206340555244458); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.011333333333333334); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.043916666666666666, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-02-20 04:54:09,475 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 391 ms to try 5000 different iterations.  Found a solution that moves 975 regions; Going from a computed imbalance of 0.014396315840012172 to a new imbalance of 4.984510678083321E-4. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.004313445397637924); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.006267511942419625); MoveCostFunction : (multiplier=7.0, imbalance=0.10833333333333334, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.004313445397637924); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.6666666666666666E-4); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.00325); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-02-20 04:54:09,477 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv870100367:81 , srv897900090:81 , srv45210208:82 , srv1001028641:83 , srv439125012:83 , srv778314199:83 , srv1053016140:84 , srv1447608378:84 , srv1627549954:84 , srv1870478132:84 , srv2112723071:84 , srv315662129:84 , srv375492728:84 , srv378056701:84 , srv462942746:84 , srv482484591:84 , srv516836438:84 , srv518800209:84 , srv574828187:84 , srv59373949:84 , srv594172404:84 , srv965382926:84 , srv1021636496:85 , srv1093822897:85 , srv1136775719:85 , srv1191816648:85 , srv1331596021:85 , srv1468321466:85 , srv149043850:85 , srv1570679747:85 , srv1654146394:85 , srv1757911292:85 , srv1834103401:85 , srv188309014:85 , srv1944101832:85 , srv2009891601:85 , srv2033231839:85 , srv2131774782:85 , srv250638167:85 , srv27037668:85 , srv270840347:85 , srv298840446:85 , srv368414753:85 , srv419698151:85 , srv668822112:85 , srv991619654:85 , srv102339600:86 , srv1045064231:86 , srv116682383:86 , srv136057180:86 , srv1380661261:86 , srv150380283:86 , srv153277784:86 , srv1633385715:86 , srv1872482050:86 , srv1942973879:86 , srv2040297559:86 , srv2047608210:86 , srv245547134:86 , srv380078989:86 , srv393952785:86 , srv481102254:86 , srv5073712:86 , srv510656043:86 , srv597213546:86 , srv642216064:86 , srv657366342:86 , srv731157677:86 , srv797986030:86 , srv799577111:86 , srv80899507:86 , srv810160977:86 , srv886441296:86 , srv926025388:86 , srv1037103432:87 , srv1267052388:87 , srv1460717755:87 , srv1578554824:87 , srv1604095839:87 , srv1693068960:87 , srv1789616070:87 , srv1927222974:87 , srv1932860592:87 , srv2079792599:87 , srv2137113824:87 , srv323056541:87 , srv687390077:87 , srv722341543:87 , srv777669648:87 , srv1216621493:88 , srv1307298572:88 , srv1375437145:88 , srv2057987976:88 , srv627898414:88 , srv872528196:88 , srv1570661133:89 , srv1571315951:89 , srv531894003:89 , srv756561144:89 , srv580333690:526 }
2023-02-20 04:54:09,481 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-02-20 04:54:09,482 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv657366342=81, srv1627549954=28, srv991619654=99, srv2079792599=47, srv642216064=80, srv1380661261=16, srv1053016140=5, srv1447608378=17, srv245547134=51, srv270840347=54, srv756561144=86, srv1654146394=30, srv810160977=92, srv1037103432=3, srv1633385715=29, srv1307298572=12, srv1578554824=26, srv1604095839=27, srv580333690=75, srv1191816648=9, srv368414753=58, srv778314199=88, srv150380283=21, srv1870478132=35, srv1932860592=39, srv1460717755=18, srv1942973879=40, srv965382926=98, srv2131774782=49, srv1375437145=15, srv1136775719=7, srv5073712=69, srv439125012=64, srv153277784=22, srv2057987976=46, srv102339600=2, srv777669648=87, srv1093822897=6, srv627898414=79, srv59373949=76, srv516836438=71, srv1267052388=11, srv1789616070=33, srv799577111=90, srv323056541=57, srv897900090=96, srv1872482050=36, srv45210208=65, srv1216621493=10, srv870100367=93, srv1468321466=19, srv188309014=37, srv378056701=60, srv926025388=97, srv250638167=52, srv531894003=73, srv1834103401=34, srv298840446=55, srv80899507=91, srv594172404=77, srv116682383=8, srv1693068960=31, srv2047608210=45, srv1021636496=1, srv1571315951=25, srv872528196=94, srv1570679747=24, srv2040297559=44, srv393952785=62, srv2112723071=48, srv597213546=78, srv1927222974=38, srv1944101832=41, srv687390077=83, srv722341543=84, srv380078989=61, srv1001028641=0, srv481102254=67, srv668822112=82, srv797986030=89, srv149043850=20, srv574828187=74, srv1757911292=32, srv315662129=56, srv27037668=53, srv1045064231=4, srv518800209=72, srv2033231839=43, srv731157677=85, srv886441296=95, srv136057180=14, srv375492728=59, srv1570661133=23, srv2137113824=50, srv510656043=70, srv462942746=66, srv2009891601=42, srv419698151=63, srv1331596021=13, srv482484591=68} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-02-20 04:54:09,493 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-02-20 04:54:09,493 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-02-20 04:54:09,493 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-02-20 04:54:09,493 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-02-20 04:54:09,493 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-02-20 04:54:09,493 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-02-20 04:54:09,493 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-02-20 04:54:09,493 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-02-20 04:54:09,493 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-02-20 04:54:09,493 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-02-20 04:54:09,493 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-02-20 04:54:09,493 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-02-20 04:54:09,494 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-02-20 04:54:09,494 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-02-20 04:54:09,494 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-02-20 04:54:09,494 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-02-20 04:54:09,494 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-02-20 04:54:09,494 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-02-20 04:54:09,494 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-02-20 04:54:09,494 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-02-20 04:54:09,494 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-02-20 04:54:09,494 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-02-20 04:54:09,494 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-02-20 04:54:09,494 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-02-20 04:54:09,494 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-02-20 04:54:09,494 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-02-20 04:54:09,494 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-02-20 04:54:09,494 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-02-20 04:54:09,495 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-02-20 04:54:09,495 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-02-20 04:54:09,495 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-02-20 04:54:09,495 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-02-20 04:54:09,495 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-02-20 04:54:09,495 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-02-20 04:54:09,495 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-02-20 04:54:09,495 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-02-20 04:54:09,495 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-02-20 04:54:09,495 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-02-20 04:54:09,496 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-02-20 04:54:09,496 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-02-20 04:54:09,496 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-02-20 04:54:09,496 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-02-20 04:54:09,496 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-02-20 04:54:09,496 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-02-20 04:54:09,496 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-02-20 04:54:09,496 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-02-20 04:54:09,496 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-02-20 04:54:09,496 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-02-20 04:54:09,497 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-02-20 04:54:09,497 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-02-20 04:54:09,497 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-02-20 04:54:09,497 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-02-20 04:54:09,497 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-02-20 04:54:09,497 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-02-20 04:54:09,497 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-02-20 04:54:09,497 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-02-20 04:54:09,497 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-02-20 04:54:09,497 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-02-20 04:54:09,498 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-02-20 04:54:09,498 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-02-20 04:54:09,498 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-02-20 04:54:09,498 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-02-20 04:54:09,498 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-02-20 04:54:09,498 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-02-20 04:54:09,498 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-02-20 04:54:09,498 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-02-20 04:54:09,499 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-02-20 04:54:09,499 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-02-20 04:54:09,499 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-02-20 04:54:09,499 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-02-20 04:54:09,499 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-02-20 04:54:09,499 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-02-20 04:54:09,499 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-02-20 04:54:09,499 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-02-20 04:54:09,499 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-02-20 04:54:09,500 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-02-20 04:54:09,500 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-02-20 04:54:09,500 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-02-20 04:54:09,500 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-02-20 04:54:09,500 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-02-20 04:54:09,500 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-02-20 04:54:09,500 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-02-20 04:54:09,500 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-02-20 04:54:09,500 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-02-20 04:54:09,500 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-02-20 04:54:09,500 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-02-20 04:54:09,501 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-02-20 04:54:09,501 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-02-20 04:54:09,501 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-02-20 04:54:09,501 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-02-20 04:54:09,501 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-02-20 04:54:09,501 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-02-20 04:54:09,501 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-02-20 04:54:09,501 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-02-20 04:54:09,501 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-02-20 04:54:09,502 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-02-20 04:54:09,502 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-02-20 04:54:09,502 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-02-20 04:54:09,502 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-02-20 04:54:09,502 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-02-20 04:54:09,502 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-02-20 04:54:09,625 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.004313445397637924); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.006267511942419625); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.004313445397637924); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.6666666666666666E-4); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.00325); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-02-20 04:54:09,625 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-02-20 04:54:09,626 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=4.91623971889885E-4, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.004313445397637924); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.006267511942419625); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.004313445397637924); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.6666666666666666E-4); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.00325); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-02-20 04:54:09,965 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 450 ms to try 5000 different iterations.  Found a solution that moves 208 regions; Going from a computed imbalance of 4.91623971889885E-4 to a new imbalance of 2.3844927013466746E-5. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=5.470732932414788E-4); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.002721655269759087); MoveCostFunction : (multiplier=7.0, imbalance=0.02311111111111111); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=5.470732932414788E-4); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=8.333333333333333E-5); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-02-20 04:54:09,966 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv102339600:83 , srv136057180:83 , srv1375437145:83 , srv1460717755:83 , srv1570661133:83 , srv1927222974:83 , srv462942746:83 , srv777669648:83 , srv991619654:83 , srv1045064231:84 , srv1053016140:84 , srv1093822897:84 , srv116682383:84 , srv1216621493:84 , srv1267052388:84 , srv1307298572:84 , srv1331596021:84 , srv1447608378:84 , srv1571315951:84 , srv1604095839:84 , srv1633385715:84 , srv1834103401:84 , srv1872482050:84 , srv188309014:84 , srv1932860592:84 , srv1944101832:84 , srv2033231839:84 , srv2040297559:84 , srv2112723071:84 , srv2137113824:84 , srv245547134:84 , srv270840347:84 , srv298840446:84 , srv323056541:84 , srv368414753:84 , srv380078989:84 , srv419698151:84 , srv439125012:84 , srv481102254:84 , srv482484591:84 , srv5073712:84 , srv510656043:84 , srv516836438:84 , srv518800209:84 , srv59373949:84 , srv597213546:84 , srv627898414:84 , srv668822112:84 , srv687390077:84 , srv731157677:84 , srv797986030:84 , srv799577111:84 , srv80899507:84 , srv810160977:84 , srv872528196:84 , srv965382926:84 , srv1001028641:85 , srv1021636496:85 , srv1037103432:85 , srv1136775719:85 , srv1191816648:85 , srv1380661261:85 , srv1468321466:85 , srv149043850:85 , srv150380283:85 , srv153277784:85 , srv1570679747:85 , srv1578554824:85 , srv1627549954:85 , srv1693068960:85 , srv1757911292:85 , srv1789616070:85 , srv1870478132:85 , srv1942973879:85 , srv2047608210:85 , srv2079792599:85 , srv2131774782:85 , srv250638167:85 , srv27037668:85 , srv315662129:85 , srv375492728:85 , srv393952785:85 , srv45210208:85 , srv531894003:85 , srv574828187:85 , srv594172404:85 , srv642216064:85 , srv657366342:85 , srv722341543:85 , srv756561144:85 , srv778314199:85 , srv870100367:85 , srv886441296:85 , srv897900090:85 , srv926025388:85 , srv1654146394:86 , srv2009891601:86 , srv2057987976:86 , srv378056701:86 , srv580333690:646 }
2023-02-20 04:54:09,970 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-02-20 04:54:09,970 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv657366342=81, srv1627549954=28, srv991619654=99, srv2079792599=47, srv642216064=80, srv1380661261=16, srv1053016140=5, srv1447608378=17, srv245547134=51, srv270840347=54, srv756561144=86, srv1654146394=30, srv810160977=92, srv1037103432=3, srv1633385715=29, srv1307298572=12, srv1578554824=26, srv1604095839=27, srv580333690=75, srv1191816648=9, srv368414753=58, srv778314199=88, srv150380283=21, srv1870478132=35, srv1932860592=39, srv1460717755=18, srv1942973879=40, srv965382926=98, srv2131774782=49, srv1375437145=15, srv1136775719=7, srv5073712=69, srv439125012=64, srv153277784=22, srv2057987976=46, srv102339600=2, srv777669648=87, srv1093822897=6, srv627898414=79, srv59373949=76, srv516836438=71, srv1267052388=11, srv1789616070=33, srv799577111=90, srv323056541=57, srv897900090=96, srv1872482050=36, srv45210208=65, srv1216621493=10, srv870100367=93, srv1468321466=19, srv188309014=37, srv378056701=60, srv926025388=97, srv250638167=52, srv531894003=73, srv1834103401=34, srv298840446=55, srv80899507=91, srv594172404=77, srv116682383=8, srv1693068960=31, srv2047608210=45, srv1021636496=1, srv1571315951=25, srv872528196=94, srv1570679747=24, srv2040297559=44, srv393952785=62, srv2112723071=48, srv597213546=78, srv1927222974=38, srv1944101832=41, srv687390077=83, srv722341543=84, srv380078989=61, srv1001028641=0, srv481102254=67, srv668822112=82, srv797986030=89, srv149043850=20, srv574828187=74, srv1757911292=32, srv315662129=56, srv27037668=53, srv1045064231=4, srv518800209=72, srv2033231839=43, srv731157677=85, srv886441296=95, srv136057180=14, srv375492728=59, srv1570661133=23, srv2137113824=50, srv510656043=70, srv462942746=66, srv2009891601=42, srv419698151=63, srv1331596021=13, srv482484591=68} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-02-20 04:54:09,980 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-02-20 04:54:09,981 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-02-20 04:54:09,981 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-02-20 04:54:09,981 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-02-20 04:54:09,981 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-02-20 04:54:09,981 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-02-20 04:54:09,981 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-02-20 04:54:09,981 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-02-20 04:54:09,981 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-02-20 04:54:09,981 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-02-20 04:54:09,981 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-02-20 04:54:09,981 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-02-20 04:54:09,981 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-02-20 04:54:09,981 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-02-20 04:54:09,981 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-02-20 04:54:09,981 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-02-20 04:54:09,981 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-02-20 04:54:09,981 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-02-20 04:54:09,981 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-02-20 04:54:09,981 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-02-20 04:54:09,981 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-02-20 04:54:09,982 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-02-20 04:54:09,982 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-02-20 04:54:09,982 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-02-20 04:54:09,982 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-02-20 04:54:09,982 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-02-20 04:54:09,982 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-02-20 04:54:09,982 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-02-20 04:54:09,982 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-02-20 04:54:09,982 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-02-20 04:54:09,982 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-02-20 04:54:09,982 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-02-20 04:54:09,982 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-02-20 04:54:09,982 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-02-20 04:54:09,982 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-02-20 04:54:09,982 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-02-20 04:54:09,982 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-02-20 04:54:09,982 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-02-20 04:54:09,982 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-02-20 04:54:09,982 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-02-20 04:54:09,982 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-02-20 04:54:09,982 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-02-20 04:54:09,983 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-02-20 04:54:09,983 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-02-20 04:54:09,983 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-02-20 04:54:09,983 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-02-20 04:54:09,983 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-02-20 04:54:09,983 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-02-20 04:54:09,983 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-02-20 04:54:09,983 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-02-20 04:54:09,983 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-02-20 04:54:09,983 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-02-20 04:54:09,983 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-02-20 04:54:09,983 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-02-20 04:54:09,983 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-02-20 04:54:09,983 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-02-20 04:54:09,983 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-02-20 04:54:09,983 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-02-20 04:54:09,983 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-02-20 04:54:09,983 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-02-20 04:54:09,983 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-02-20 04:54:09,983 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-02-20 04:54:09,983 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-02-20 04:54:09,984 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-02-20 04:54:09,984 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-02-20 04:54:09,984 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-02-20 04:54:09,984 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-02-20 04:54:09,984 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-02-20 04:54:09,984 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-02-20 04:54:09,984 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-02-20 04:54:09,984 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-02-20 04:54:09,984 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-02-20 04:54:09,984 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-02-20 04:54:09,984 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-02-20 04:54:09,984 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-02-20 04:54:09,984 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-02-20 04:54:09,984 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-02-20 04:54:09,984 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-02-20 04:54:09,985 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-02-20 04:54:09,985 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-02-20 04:54:09,985 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-02-20 04:54:09,985 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-02-20 04:54:09,985 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-02-20 04:54:09,985 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-02-20 04:54:09,985 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-02-20 04:54:09,985 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-02-20 04:54:09,985 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-02-20 04:54:09,985 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-02-20 04:54:09,985 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-02-20 04:54:09,985 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-02-20 04:54:09,985 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-02-20 04:54:09,985 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-02-20 04:54:09,985 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-02-20 04:54:09,985 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-02-20 04:54:09,985 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-02-20 04:54:09,985 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-02-20 04:54:09,985 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-02-20 04:54:09,985 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-02-20 04:54:09,985 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-02-20 04:54:09,985 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-02-20 04:54:09,986 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-02-20 04:54:10,092 INFO  [Time-limited test] balancer.StochasticLoadBalancer(381): Cluster wide - skipping load balancing because weighted average imbalance=2.238847988419806E-5 <= threshold(0.025). If you want more aggressive balancing, either lower hbase.master.balancer.stochastic.minCostNeedBalance from 0.025 or increase the relative multiplier(s) of the specific cost function(s). functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=5.470732932414788E-4); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.002721655269759087); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=5.470732932414788E-4); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=8.333333333333333E-5); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-02-20 04:54:10,093 INFO  [Time-limited test] balancer.BalancerTestBase(570): Mock Final balance: { srv102339600:83 , srv136057180:83 , srv1375437145:83 , srv1460717755:83 , srv1570661133:83 , srv1927222974:83 , srv462942746:83 , srv777669648:83 , srv991619654:83 , srv1045064231:84 , srv1053016140:84 , srv1093822897:84 , srv116682383:84 , srv1216621493:84 , srv1267052388:84 , srv1307298572:84 , srv1331596021:84 , srv1447608378:84 , srv1571315951:84 , srv1604095839:84 , srv1633385715:84 , srv1834103401:84 , srv1872482050:84 , srv188309014:84 , srv1932860592:84 , srv1944101832:84 , srv2033231839:84 , srv2040297559:84 , srv2112723071:84 , srv2137113824:84 , srv245547134:84 , srv270840347:84 , srv298840446:84 , srv323056541:84 , srv368414753:84 , srv380078989:84 , srv419698151:84 , srv439125012:84 , srv481102254:84 , srv482484591:84 , srv5073712:84 , srv510656043:84 , srv516836438:84 , srv518800209:84 , srv59373949:84 , srv597213546:84 , srv627898414:84 , srv668822112:84 , srv687390077:84 , srv731157677:84 , srv797986030:84 , srv799577111:84 , srv80899507:84 , srv810160977:84 , srv872528196:84 , srv965382926:84 , srv1001028641:85 , srv1021636496:85 , srv1037103432:85 , srv1136775719:85 , srv1191816648:85 , srv1380661261:85 , srv1468321466:85 , srv149043850:85 , srv150380283:85 , srv153277784:85 , srv1570679747:85 , srv1578554824:85 , srv1627549954:85 , srv1693068960:85 , srv1757911292:85 , srv1789616070:85 , srv1870478132:85 , srv1942973879:85 , srv2047608210:85 , srv2079792599:85 , srv2131774782:85 , srv250638167:85 , srv27037668:85 , srv315662129:85 , srv375492728:85 , srv393952785:85 , srv45210208:85 , srv531894003:85 , srv574828187:85 , srv594172404:85 , srv642216064:85 , srv657366342:85 , srv722341543:85 , srv756561144:85 , srv778314199:85 , srv870100367:85 , srv886441296:85 , srv897900090:85 , srv926025388:85 , srv1654146394:86 , srv2009891601:86 , srv2057987976:86 , srv378056701:86 , srv580333690:646 }
2023-02-20 04:54:10,121 INFO  [Time-limited test] hbase.ResourceChecker(175): after: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnLargeClusterWithRacks Thread=10 (was 10), OpenFileDescriptor=260 (was 260), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=280 (was 280), ProcessCount=170 (was 170), AvailableMemoryMB=10084 (was 10594)
2023-02-20 04:54:10,128 INFO  [Time-limited test] hbase.ResourceChecker(147): before: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnMidClusterWithRacks Thread=10, OpenFileDescriptor=260, MaxFileDescriptor=60000, SystemLoadAverage=280, ProcessCount=170, AvailableMemoryMB=10084
2023-02-20 04:54:10,129 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2023-02-20 04:54:10,129 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=5000, runMaxSteps=true, stepsPerRegion=800, maxRunningTime=120000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 111077.0 etc.
2023-02-20 04:54:10,139 INFO  [Time-limited test] balancer.BalancerTestBase(547): Mock Cluster : { srv1012038460:84 , srv1069237651:84 , srv1186407806:84 , srv1189624130:84 , srv1226690801:84 , srv1233576998:84 , srv130622681:84 , srv131627735:84 , srv13421470:84 , srv1457857264:84 , srv1482891382:84 , srv1672465558:84 , srv1894770829:84 , srv1930327262:84 , srv312781450:84 , srv386744518:84 , srv447719663:84 , srv476140048:84 , srv509933137:84 , srv583945163:84 , srv608480577:84 , srv732754833:84 , srv733659908:84 , srv770689438:84 , srv80942248:84 , srv874327634:84 , srv920704640:84 , srv924260450:84 , srv934657041:84 , srv2089999317:264 } [srvr=30 rgns=2700 avg=90.0 max=90 min=90]
2023-02-20 04:54:10,140 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-02-20 04:54:10,140 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv2089999317=14, srv476140048=18, srv583945163=20, srv920704640=27, srv1226690801=4, srv1457857264=9, srv509933137=19, srv13421470=8, srv447719663=17, srv1069237651=1, srv1012038460=0, srv924260450=28, srv386744518=16, srv934657041=29, srv1894770829=12, srv874327634=26, srv1189624130=3, srv1233576998=5, srv312781450=15, srv732754833=22, srv1930327262=13, srv1482891382=10, srv130622681=6, srv1186407806=2, srv770689438=24, srv80942248=25, srv733659908=23, srv131627735=7, srv1672465558=11, srv608480577=21} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-02-20 04:54:10,150 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-02-20 04:54:10,150 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-02-20 04:54:10,150 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-02-20 04:54:10,150 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-02-20 04:54:10,150 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-02-20 04:54:10,150 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-02-20 04:54:10,150 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-02-20 04:54:10,150 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-02-20 04:54:10,150 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-02-20 04:54:10,150 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-02-20 04:54:10,150 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-02-20 04:54:10,150 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-02-20 04:54:10,151 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-02-20 04:54:10,151 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-02-20 04:54:10,151 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-02-20 04:54:10,151 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-02-20 04:54:10,151 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-02-20 04:54:10,151 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-02-20 04:54:10,151 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-02-20 04:54:10,151 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-02-20 04:54:10,151 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-02-20 04:54:10,151 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-02-20 04:54:10,151 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-02-20 04:54:10,151 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-02-20 04:54:10,151 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-02-20 04:54:10,151 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-02-20 04:54:10,152 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-02-20 04:54:10,152 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-02-20 04:54:10,152 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-02-20 04:54:10,152 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-02-20 04:54:10,152 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=10, number of hosts=30, number of racks=4
2023-02-20 04:54:10,168 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=1.08152424299658, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-02-20 04:54:10,169 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.991244992349195, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=1.08152424299658, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=64800000
2023-02-20 04:56:10,155 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 120001 ms to try 6785626 different iterations.  Found a solution that moves 1845 regions; Going from a computed imbalance of 0.991244992349195 to a new imbalance of 4.306322040866546E-5. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); MoveCostFunction : (multiplier=7.0, imbalance=0.6833333333333333, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-02-20 04:56:10,162 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1012038460:90 , srv1069237651:90 , srv1186407806:90 , srv1189624130:90 , srv1226690801:90 , srv1233576998:90 , srv130622681:90 , srv131627735:90 , srv13421470:90 , srv1457857264:90 , srv1482891382:90 , srv1672465558:90 , srv1894770829:90 , srv1930327262:90 , srv2089999317:90 , srv312781450:90 , srv386744518:90 , srv447719663:90 , srv476140048:90 , srv509933137:90 , srv583945163:90 , srv608480577:90 , srv732754833:90 , srv733659908:90 , srv770689438:90 , srv80942248:90 , srv874327634:90 , srv920704640:90 , srv924260450:90 , srv934657041:90 }
2023-02-20 04:56:10,164 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-02-20 04:56:10,164 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv2089999317=14, srv476140048=18, srv583945163=20, srv920704640=27, srv1226690801=4, srv1457857264=9, srv509933137=19, srv13421470=8, srv447719663=17, srv1069237651=1, srv1012038460=0, srv924260450=28, srv386744518=16, srv934657041=29, srv1894770829=12, srv874327634=26, srv1189624130=3, srv1233576998=5, srv312781450=15, srv732754833=22, srv1930327262=13, srv1482891382=10, srv130622681=6, srv1186407806=2, srv770689438=24, srv80942248=25, srv733659908=23, srv131627735=7, srv1672465558=11, srv608480577=21} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-02-20 04:56:10,169 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-02-20 04:56:10,170 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-02-20 04:56:10,170 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-02-20 04:56:10,170 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-02-20 04:56:10,170 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-02-20 04:56:10,170 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-02-20 04:56:10,170 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-02-20 04:56:10,170 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-02-20 04:56:10,170 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-02-20 04:56:10,170 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-02-20 04:56:10,170 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-02-20 04:56:10,170 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-02-20 04:56:10,171 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-02-20 04:56:10,171 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-02-20 04:56:10,171 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-02-20 04:56:10,171 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-02-20 04:56:10,171 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-02-20 04:56:10,171 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-02-20 04:56:10,171 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-02-20 04:56:10,171 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-02-20 04:56:10,171 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-02-20 04:56:10,171 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-02-20 04:56:10,171 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-02-20 04:56:10,171 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-02-20 04:56:10,171 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-02-20 04:56:10,171 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-02-20 04:56:10,172 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-02-20 04:56:10,172 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-02-20 04:56:10,172 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-02-20 04:56:10,172 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-02-20 04:56:10,172 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=10, number of hosts=30, number of racks=4
2023-02-20 04:56:10,186 INFO  [Time-limited test] balancer.StochasticLoadBalancer(381): Cluster wide - skipping load balancing because weighted average imbalance=0.0 <= threshold(0.025). If you want more aggressive balancing, either lower hbase.master.balancer.stochastic.minCostNeedBalance from 0.025 or increase the relative multiplier(s) of the specific cost function(s). functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-02-20 04:56:10,186 INFO  [Time-limited test] balancer.BalancerTestBase(570): Mock Final balance: { srv1012038460:90 , srv1069237651:90 , srv1186407806:90 , srv1189624130:90 , srv1226690801:90 , srv1233576998:90 , srv130622681:90 , srv131627735:90 , srv13421470:90 , srv1457857264:90 , srv1482891382:90 , srv1672465558:90 , srv1894770829:90 , srv1930327262:90 , srv2089999317:90 , srv312781450:90 , srv386744518:90 , srv447719663:90 , srv476140048:90 , srv509933137:90 , srv583945163:90 , srv608480577:90 , srv732754833:90 , srv733659908:90 , srv770689438:90 , srv80942248:90 , srv874327634:90 , srv920704640:90 , srv924260450:90 , srv934657041:90 }
2023-02-20 04:56:10,199 INFO  [Time-limited test] hbase.ResourceChecker(175): after: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnMidClusterWithRacks Thread=9 (was 10), OpenFileDescriptor=260 (was 260), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=166 (was 280), ProcessCount=170 (was 170), AvailableMemoryMB=9835 (was 10084)