2023-03-08 18:54:21,621 INFO  [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks timeout: 13 mins
2023-03-08 18:54:21,960 WARN  [Time-limited test] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties
2023-03-08 18:54:22,074 INFO  [Time-limited test] metrics.MetricRegistriesLoader(60): Loaded MetricRegistries class org.apache.hadoop.hbase.metrics.impl.MetricRegistriesImpl
2023-03-08 18:54:22,135 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2023-03-08 18:54:22,144 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc.
2023-03-08 18:54:22,159 INFO  [Time-limited test] hbase.ResourceChecker(147): before: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnLargeClusterWithRacks Thread=10, OpenFileDescriptor=260, MaxFileDescriptor=60000, SystemLoadAverage=206, ProcessCount=187, AvailableMemoryMB=7703
2023-03-08 18:54:22,162 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2023-03-08 18:54:22,162 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=5000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=10000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc.
2023-03-08 18:54:22,280 INFO  [Time-limited test] balancer.BalancerTestBase(547): Mock Cluster : { srv1007407279:84 , srv1014661193:84 , srv1037544781:84 , srv1040462571:84 , srv1056023673:84 , srv1065369400:84 , srv107567229:84 , srv109004384:84 , srv1092419797:84 , srv1095164123:84 , srv1106824903:84 , srv1129696365:84 , srv1134543776:84 , srv1202005114:84 , srv1205389957:84 , srv12084302:84 , srv1241959747:84 , srv1279656550:84 , srv1283773752:84 , srv1332600471:84 , srv1342904679:84 , srv137654105:84 , srv1388379380:84 , srv1396310902:84 , srv1409332149:84 , srv1421999466:84 , srv1520759294:84 , srv1522375971:84 , srv1528186827:84 , srv1623387740:84 , srv1625136620:84 , srv1635834282:84 , srv1654110397:84 , srv1669112362:84 , srv1675105519:84 , srv169751986:84 , srv1718801242:84 , srv172794567:84 , srv1743140823:84 , srv1780845347:84 , srv1833010310:84 , srv1834833995:84 , srv1855885671:84 , srv1864997882:84 , srv1870066087:84 , srv1911861014:84 , srv1911878715:84 , srv1965744544:84 , srv1971190269:84 , srv199484973:84 , srv2013365029:84 , srv2016607277:84 , srv2019596685:84 , srv2031535687:84 , srv2048936783:84 , srv2051089193:84 , srv2056315213:84 , srv210209077:84 , srv2142857178:84 , srv32473288:84 , srv325127799:84 , srv351795585:84 , srv364868077:84 , srv371099509:84 , srv380495303:84 , srv397418091:84 , srv420060159:84 , srv422467136:84 , srv429474002:84 , srv43270634:84 , srv462695315:84 , srv488333751:84 , srv512314907:84 , srv544978338:84 , srv546986981:84 , srv604374347:84 , srv620301866:84 , srv621641360:84 , srv633368722:84 , srv633946970:84 , srv644412358:84 , srv646757958:84 , srv683786204:84 , srv718245114:84 , srv736872752:84 , srv740508776:84 , srv756903494:84 , srv764443970:84 , srv772889156:84 , srv781780299:84 , srv796958043:84 , srv797318137:84 , srv811281164:84 , srv838397142:84 , srv878564808:84 , srv94867476:84 , srv968247023:84 , srv983710623:84 , srv987670763:84 , srv1525368191:684 } [srvr=100 rgns=9000 avg=90.0 max=90 min=90]
2023-03-08 18:54:22,288 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-03-08 18:54:22,296 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv983710623=98, srv12084302=15, srv1834833995=42, srv1279656550=17, srv32473288=60, srv1283773752=18, srv633946970=80, srv1342904679=20, srv2051089193=56, srv646757958=82, srv633368722=79, srv736872752=85, srv621641360=78, srv620301866=77, srv199484973=50, srv2142857178=59, srv364868077=63, srv1202005114=13, srv772889156=89, srv796958043=91, srv811281164=93, srv1525368191=28, srv1396310902=23, srv1520759294=26, srv1040462571=3, srv1095164123=9, srv1855885671=43, srv878564808=95, srv1870066087=45, srv1965744544=48, srv2048936783=55, srv210209077=58, srv462695315=71, srv968247023=97, srv1675105519=35, srv2019596685=53, srv1014661193=1, srv1037544781=2, srv1635834282=32, srv1421999466=25, srv1625136620=31, srv1833010310=41, srv1864997882=44, srv1718801242=37, srv1092419797=8, srv2013365029=51, srv397418091=66, srv2031535687=54, srv1911861014=46, srv1056023673=4, srv488333751=72, srv987670763=99, srv2016607277=52, srv1654110397=33, srv1388379380=22, srv169751986=36, srv797318137=92, srv1065369400=5, srv371099509=64, srv172794567=38, srv740508776=86, srv2056315213=57, srv1106824903=10, srv512314907=73, srv109004384=7, srv1205389957=14, srv107567229=6, srv1241959747=16, srv644412358=81, srv1669112362=34, srv756903494=87, srv422467136=68, srv764443970=88, srv380495303=65, srv420060159=67, srv1409332149=24, srv1522375971=27, srv94867476=96, srv544978338=74, srv1971190269=49, srv351795585=62, srv781780299=90, srv546986981=75, srv1134543776=12, srv1332600471=19, srv1743140823=39, srv604374347=76, srv429474002=69, srv1780845347=40, srv43270634=70, srv1911878715=47, srv137654105=21, srv683786204=83, srv1528186827=29, srv1623387740=30, srv838397142=94, srv1129696365=11, srv1007407279=0, srv718245114=84, srv325127799=61} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-03-08 18:54:22,393 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-03-08 18:54:22,394 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-03-08 18:54:22,394 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-03-08 18:54:22,394 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-03-08 18:54:22,394 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-03-08 18:54:22,394 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-03-08 18:54:22,394 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-03-08 18:54:22,394 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-03-08 18:54:22,394 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-03-08 18:54:22,394 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-03-08 18:54:22,394 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-03-08 18:54:22,395 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-03-08 18:54:22,395 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-03-08 18:54:22,395 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-03-08 18:54:22,395 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-03-08 18:54:22,395 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-03-08 18:54:22,395 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-03-08 18:54:22,395 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-03-08 18:54:22,395 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-03-08 18:54:22,395 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-03-08 18:54:22,395 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-03-08 18:54:22,396 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-03-08 18:54:22,396 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-03-08 18:54:22,396 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-03-08 18:54:22,396 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-03-08 18:54:22,396 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-03-08 18:54:22,396 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-03-08 18:54:22,396 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-03-08 18:54:22,396 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-03-08 18:54:22,396 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-03-08 18:54:22,396 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-03-08 18:54:22,396 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-03-08 18:54:22,397 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-03-08 18:54:22,397 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-03-08 18:54:22,397 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-03-08 18:54:22,397 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-03-08 18:54:22,397 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-03-08 18:54:22,397 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-03-08 18:54:22,397 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-03-08 18:54:22,397 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-03-08 18:54:22,397 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-03-08 18:54:22,397 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-03-08 18:54:22,398 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-03-08 18:54:22,398 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-03-08 18:54:22,398 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-03-08 18:54:22,398 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-03-08 18:54:22,398 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-03-08 18:54:22,398 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-03-08 18:54:22,398 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-03-08 18:54:22,398 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-03-08 18:54:22,398 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-03-08 18:54:22,398 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-03-08 18:54:22,399 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-03-08 18:54:22,399 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-03-08 18:54:22,399 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-03-08 18:54:22,399 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-03-08 18:54:22,399 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-03-08 18:54:22,399 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-03-08 18:54:22,399 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-03-08 18:54:22,399 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-03-08 18:54:22,399 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-03-08 18:54:22,399 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-03-08 18:54:22,399 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-03-08 18:54:22,400 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-03-08 18:54:22,400 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-03-08 18:54:22,400 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-03-08 18:54:22,400 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-03-08 18:54:22,400 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-03-08 18:54:22,400 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-03-08 18:54:22,400 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-03-08 18:54:22,400 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-03-08 18:54:22,400 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-03-08 18:54:22,400 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-03-08 18:54:22,401 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-03-08 18:54:22,401 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-03-08 18:54:22,401 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-03-08 18:54:22,401 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-03-08 18:54:22,401 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-03-08 18:54:22,401 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-03-08 18:54:22,401 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-03-08 18:54:22,401 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-03-08 18:54:22,401 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-03-08 18:54:22,401 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-03-08 18:54:22,401 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-03-08 18:54:22,402 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-03-08 18:54:22,402 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-03-08 18:54:22,402 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-03-08 18:54:22,402 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-03-08 18:54:22,402 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-03-08 18:54:22,402 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-03-08 18:54:22,402 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-03-08 18:54:22,402 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-03-08 18:54:22,402 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-03-08 18:54:22,402 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-03-08 18:54:22,402 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-03-08 18:54:22,403 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-03-08 18:54:22,403 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-03-08 18:54:22,403 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-03-08 18:54:22,403 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-03-08 18:54:22,403 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-03-08 18:54:22,403 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-03-08 18:54:22,581 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.06666666666666667, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-03-08 18:54:22,581 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-03-08 18:54:22,582 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.9909252140407105, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.06666666666666667, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-03-08 18:54:22,852 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 424 ms to try 5000 different iterations.  Found a solution that moves 4681 regions; Going from a computed imbalance of 0.9909252140407105 to a new imbalance of 0.18173973218009967. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.037046800060027, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.055620164451417195, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.5201111111111111, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.037046800060027, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.177, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.24358333333333335, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-03-08 18:54:22,875 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1654110397:81 , srv1675105519:81 , srv544978338:81 , srv380495303:82 , srv488333751:82 , srv1870066087:83 , srv210209077:83 , srv1092419797:84 , srv1205389957:84 , srv1241959747:84 , srv137654105:84 , srv1388379380:84 , srv1396310902:84 , srv1528186827:84 , srv1743140823:84 , srv1864997882:84 , srv2019596685:84 , srv397418091:84 , srv740508776:84 , srv878564808:84 , srv94867476:84 , srv1014661193:85 , srv1040462571:85 , srv1409332149:85 , srv1421999466:85 , srv172794567:85 , srv371099509:85 , srv604374347:85 , srv633946970:85 , srv983710623:85 , srv1625136620:86 , srv1669112362:86 , srv1834833995:86 , srv1911861014:86 , srv1911878715:86 , srv2031535687:86 , srv2048936783:86 , srv2142857178:86 , srv351795585:86 , srv420060159:86 , srv422467136:86 , srv429474002:86 , srv462695315:86 , srv512314907:86 , srv546986981:86 , srv633368722:86 , srv646757958:86 , srv781780299:86 , srv968247023:86 , srv1007407279:87 , srv1037544781:87 , srv1056023673:87 , srv1106824903:87 , srv1279656550:87 , srv1332600471:87 , srv1342904679:87 , srv1520759294:87 , srv1522375971:87 , srv1623387740:87 , srv1833010310:87 , srv1855885671:87 , srv1971190269:87 , srv2056315213:87 , srv364868077:87 , srv43270634:87 , srv683786204:87 , srv736872752:87 , srv772889156:87 , srv838397142:87 , srv987670763:87 , srv107567229:88 , srv1283773752:88 , srv169751986:88 , srv199484973:88 , srv2016607277:88 , srv325127799:88 , srv620301866:88 , srv644412358:88 , srv796958043:88 , srv1065369400:89 , srv109004384:89 , srv1202005114:89 , srv1718801242:89 , srv1965744544:89 , srv2013365029:89 , srv621641360:89 , srv1129696365:90 , srv1134543776:90 , srv2051089193:90 , srv32473288:90 , srv756903494:90 , srv797318137:90 , srv12084302:92 , srv1780845347:92 , srv718245114:92 , srv764443970:92 , srv1095164123:93 , srv1635834282:93 , srv811281164:97 , srv1525368191:419 }
2023-03-08 18:54:22,879 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-03-08 18:54:22,880 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv983710623=98, srv12084302=15, srv1834833995=42, srv1279656550=17, srv32473288=60, srv1283773752=18, srv633946970=80, srv1342904679=20, srv2051089193=56, srv646757958=82, srv633368722=79, srv736872752=85, srv621641360=78, srv620301866=77, srv199484973=50, srv2142857178=59, srv364868077=63, srv1202005114=13, srv772889156=89, srv796958043=91, srv811281164=93, srv1525368191=28, srv1396310902=23, srv1520759294=26, srv1040462571=3, srv1095164123=9, srv1855885671=43, srv878564808=95, srv1870066087=45, srv1965744544=48, srv2048936783=55, srv210209077=58, srv462695315=71, srv968247023=97, srv1675105519=35, srv2019596685=53, srv1014661193=1, srv1037544781=2, srv1635834282=32, srv1421999466=25, srv1625136620=31, srv1833010310=41, srv1864997882=44, srv1718801242=37, srv1092419797=8, srv2013365029=51, srv397418091=66, srv2031535687=54, srv1911861014=46, srv1056023673=4, srv488333751=72, srv987670763=99, srv2016607277=52, srv1654110397=33, srv1388379380=22, srv169751986=36, srv797318137=92, srv1065369400=5, srv371099509=64, srv172794567=38, srv740508776=86, srv2056315213=57, srv1106824903=10, srv512314907=73, srv109004384=7, srv1205389957=14, srv107567229=6, srv1241959747=16, srv644412358=81, srv1669112362=34, srv756903494=87, srv422467136=68, srv764443970=88, srv380495303=65, srv420060159=67, srv1409332149=24, srv1522375971=27, srv94867476=96, srv544978338=74, srv1971190269=49, srv351795585=62, srv781780299=90, srv546986981=75, srv1134543776=12, srv1332600471=19, srv1743140823=39, srv604374347=76, srv429474002=69, srv1780845347=40, srv43270634=70, srv1911878715=47, srv137654105=21, srv683786204=83, srv1528186827=29, srv1623387740=30, srv838397142=94, srv1129696365=11, srv1007407279=0, srv718245114=84, srv325127799=61} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-03-08 18:54:22,901 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-03-08 18:54:22,901 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-03-08 18:54:22,901 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-03-08 18:54:22,901 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-03-08 18:54:22,901 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-03-08 18:54:22,901 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-03-08 18:54:22,901 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-03-08 18:54:22,901 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-03-08 18:54:22,901 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-03-08 18:54:22,901 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-03-08 18:54:22,902 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-03-08 18:54:22,902 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-03-08 18:54:22,902 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-03-08 18:54:22,902 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-03-08 18:54:22,902 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-03-08 18:54:22,902 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-03-08 18:54:22,902 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-03-08 18:54:22,902 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-03-08 18:54:22,902 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-03-08 18:54:22,902 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-03-08 18:54:22,902 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-03-08 18:54:22,902 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-03-08 18:54:22,902 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-03-08 18:54:22,903 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-03-08 18:54:22,903 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-03-08 18:54:22,903 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-03-08 18:54:22,903 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-03-08 18:54:22,903 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-03-08 18:54:22,903 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-03-08 18:54:22,903 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-03-08 18:54:22,903 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-03-08 18:54:22,903 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-03-08 18:54:22,903 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-03-08 18:54:22,903 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-03-08 18:54:22,903 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-03-08 18:54:22,903 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-03-08 18:54:22,903 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-03-08 18:54:22,904 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-03-08 18:54:22,904 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-03-08 18:54:22,904 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-03-08 18:54:22,904 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-03-08 18:54:22,904 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-03-08 18:54:22,904 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-03-08 18:54:22,904 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-03-08 18:54:22,904 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-03-08 18:54:22,904 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-03-08 18:54:22,904 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-03-08 18:54:22,904 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-03-08 18:54:22,904 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-03-08 18:54:22,904 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-03-08 18:54:22,904 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-03-08 18:54:22,905 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-03-08 18:54:22,905 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-03-08 18:54:22,905 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-03-08 18:54:22,905 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-03-08 18:54:22,905 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-03-08 18:54:22,905 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-03-08 18:54:22,905 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-03-08 18:54:22,905 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-03-08 18:54:22,905 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-03-08 18:54:22,905 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-03-08 18:54:22,905 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-03-08 18:54:22,905 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-03-08 18:54:22,905 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-03-08 18:54:22,905 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-03-08 18:54:22,906 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-03-08 18:54:22,906 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-03-08 18:54:22,906 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-03-08 18:54:22,906 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-03-08 18:54:22,906 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-03-08 18:54:22,906 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-03-08 18:54:22,906 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-03-08 18:54:22,906 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-03-08 18:54:22,906 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-03-08 18:54:22,906 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-03-08 18:54:22,906 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-03-08 18:54:22,906 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-03-08 18:54:22,906 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-03-08 18:54:22,907 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-03-08 18:54:22,907 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-03-08 18:54:22,907 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-03-08 18:54:22,907 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-03-08 18:54:22,907 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-03-08 18:54:22,907 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-03-08 18:54:22,907 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-03-08 18:54:22,907 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-03-08 18:54:22,907 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-03-08 18:54:22,907 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-03-08 18:54:22,907 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-03-08 18:54:22,907 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-03-08 18:54:22,907 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-03-08 18:54:22,907 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-03-08 18:54:22,907 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-03-08 18:54:22,908 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-03-08 18:54:22,908 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-03-08 18:54:22,908 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-03-08 18:54:22,908 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-03-08 18:54:22,908 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-03-08 18:54:22,908 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-03-08 18:54:22,908 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-03-08 18:54:22,908 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-03-08 18:54:23,026 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.037046800060027, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.055620164451417195, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.037046800060027, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.177, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.24358333333333335, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-03-08 18:54:23,026 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-03-08 18:54:23,026 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.18170695511754148, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.037046800060027, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.055620164451417195, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.037046800060027, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.177, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.24358333333333335, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-03-08 18:54:23,297 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 366 ms to try 5000 different iterations.  Found a solution that moves 2680 regions; Going from a computed imbalance of 0.18170695511754148 to a new imbalance of 0.015163332304302531. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.01848953961558828); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.03130889511912304, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.29777777777777775, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.01848953961558828); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.012166666666666666); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.044, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-03-08 18:54:23,309 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv811281164:76 , srv1635834282:79 , srv718245114:79 , srv1780845347:80 , srv1095164123:81 , srv2051089193:81 , srv2056315213:81 , srv1065369400:82 , srv1134543776:82 , srv12084302:82 , srv1522375971:82 , srv1965744544:82 , srv32473288:82 , srv620301866:82 , srv756903494:82 , srv169751986:83 , srv1718801242:83 , srv1855885671:83 , srv621641360:83 , srv764443970:83 , srv796958043:83 , srv1007407279:84 , srv107567229:84 , srv1129696365:84 , srv1279656550:84 , srv1283773752:84 , srv1342904679:84 , srv1911878715:84 , srv2013365029:84 , srv2031535687:84 , srv2048936783:84 , srv797318137:84 , srv1202005114:85 , srv1625136620:85 , srv1833010310:85 , srv1911861014:85 , srv2016607277:85 , srv364868077:85 , srv420060159:85 , srv512314907:85 , srv644412358:85 , srv838397142:85 , srv1037544781:86 , srv1056023673:86 , srv109004384:86 , srv1092419797:86 , srv1205389957:86 , srv137654105:86 , srv1409332149:86 , srv1421999466:86 , srv1623387740:86 , srv1669112362:86 , srv1864997882:86 , srv1971190269:86 , srv325127799:86 , srv43270634:86 , srv633946970:86 , srv683786204:86 , srv736872752:86 , srv878564808:86 , srv987670763:86 , srv1241959747:87 , srv1396310902:87 , srv1520759294:87 , srv199484973:87 , srv371099509:87 , srv422467136:87 , srv633368722:87 , srv740508776:87 , srv772889156:87 , srv781780299:87 , srv1014661193:88 , srv1106824903:88 , srv1332600471:88 , srv1528186827:88 , srv172794567:88 , srv1834833995:88 , srv2019596685:88 , srv2142857178:88 , srv351795585:88 , srv429474002:88 , srv604374347:88 , srv646757958:88 , srv94867476:88 , srv968247023:88 , srv983710623:88 , srv1743140823:89 , srv210209077:89 , srv397418091:89 , srv462695315:89 , srv488333751:89 , srv1040462571:90 , srv1388379380:90 , srv544978338:90 , srv546986981:90 , srv1654110397:91 , srv1870066087:91 , srv380495303:92 , srv1675105519:93 , srv1525368191:519 }
2023-03-08 18:54:23,314 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-03-08 18:54:23,315 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv983710623=98, srv12084302=15, srv1834833995=42, srv1279656550=17, srv32473288=60, srv1283773752=18, srv633946970=80, srv1342904679=20, srv2051089193=56, srv646757958=82, srv633368722=79, srv736872752=85, srv621641360=78, srv620301866=77, srv199484973=50, srv2142857178=59, srv364868077=63, srv1202005114=13, srv772889156=89, srv796958043=91, srv811281164=93, srv1525368191=28, srv1396310902=23, srv1520759294=26, srv1040462571=3, srv1095164123=9, srv1855885671=43, srv878564808=95, srv1870066087=45, srv1965744544=48, srv2048936783=55, srv210209077=58, srv462695315=71, srv968247023=97, srv1675105519=35, srv2019596685=53, srv1014661193=1, srv1037544781=2, srv1635834282=32, srv1421999466=25, srv1625136620=31, srv1833010310=41, srv1864997882=44, srv1718801242=37, srv1092419797=8, srv2013365029=51, srv397418091=66, srv2031535687=54, srv1911861014=46, srv1056023673=4, srv488333751=72, srv987670763=99, srv2016607277=52, srv1654110397=33, srv1388379380=22, srv169751986=36, srv797318137=92, srv1065369400=5, srv371099509=64, srv172794567=38, srv740508776=86, srv2056315213=57, srv1106824903=10, srv512314907=73, srv109004384=7, srv1205389957=14, srv107567229=6, srv1241959747=16, srv644412358=81, srv1669112362=34, srv756903494=87, srv422467136=68, srv764443970=88, srv380495303=65, srv420060159=67, srv1409332149=24, srv1522375971=27, srv94867476=96, srv544978338=74, srv1971190269=49, srv351795585=62, srv781780299=90, srv546986981=75, srv1134543776=12, srv1332600471=19, srv1743140823=39, srv604374347=76, srv429474002=69, srv1780845347=40, srv43270634=70, srv1911878715=47, srv137654105=21, srv683786204=83, srv1528186827=29, srv1623387740=30, srv838397142=94, srv1129696365=11, srv1007407279=0, srv718245114=84, srv325127799=61} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-03-08 18:54:23,333 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-03-08 18:54:23,333 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-03-08 18:54:23,334 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-03-08 18:54:23,334 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-03-08 18:54:23,334 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-03-08 18:54:23,334 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-03-08 18:54:23,334 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-03-08 18:54:23,334 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-03-08 18:54:23,334 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-03-08 18:54:23,334 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-03-08 18:54:23,334 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-03-08 18:54:23,334 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-03-08 18:54:23,335 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-03-08 18:54:23,335 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-03-08 18:54:23,335 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-03-08 18:54:23,335 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-03-08 18:54:23,335 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-03-08 18:54:23,335 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-03-08 18:54:23,335 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-03-08 18:54:23,335 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-03-08 18:54:23,335 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-03-08 18:54:23,335 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-03-08 18:54:23,335 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-03-08 18:54:23,335 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-03-08 18:54:23,335 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-03-08 18:54:23,335 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-03-08 18:54:23,336 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-03-08 18:54:23,336 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-03-08 18:54:23,336 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-03-08 18:54:23,336 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-03-08 18:54:23,336 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-03-08 18:54:23,336 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-03-08 18:54:23,336 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-03-08 18:54:23,336 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-03-08 18:54:23,336 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-03-08 18:54:23,336 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-03-08 18:54:23,336 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-03-08 18:54:23,336 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-03-08 18:54:23,336 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-03-08 18:54:23,336 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-03-08 18:54:23,337 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-03-08 18:54:23,337 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-03-08 18:54:23,337 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-03-08 18:54:23,337 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-03-08 18:54:23,337 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-03-08 18:54:23,337 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-03-08 18:54:23,337 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-03-08 18:54:23,337 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-03-08 18:54:23,337 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-03-08 18:54:23,337 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-03-08 18:54:23,337 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-03-08 18:54:23,337 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-03-08 18:54:23,337 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-03-08 18:54:23,337 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-03-08 18:54:23,338 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-03-08 18:54:23,338 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-03-08 18:54:23,338 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-03-08 18:54:23,338 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-03-08 18:54:23,338 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-03-08 18:54:23,338 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-03-08 18:54:23,338 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-03-08 18:54:23,338 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-03-08 18:54:23,338 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-03-08 18:54:23,338 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-03-08 18:54:23,338 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-03-08 18:54:23,338 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-03-08 18:54:23,338 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-03-08 18:54:23,338 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-03-08 18:54:23,338 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-03-08 18:54:23,338 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-03-08 18:54:23,339 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-03-08 18:54:23,339 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-03-08 18:54:23,339 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-03-08 18:54:23,339 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-03-08 18:54:23,339 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-03-08 18:54:23,339 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-03-08 18:54:23,339 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-03-08 18:54:23,339 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-03-08 18:54:23,339 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-03-08 18:54:23,339 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-03-08 18:54:23,339 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-03-08 18:54:23,339 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-03-08 18:54:23,339 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-03-08 18:54:23,339 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-03-08 18:54:23,339 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-03-08 18:54:23,340 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-03-08 18:54:23,340 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-03-08 18:54:23,340 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-03-08 18:54:23,340 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-03-08 18:54:23,340 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-03-08 18:54:23,340 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-03-08 18:54:23,340 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-03-08 18:54:23,340 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-03-08 18:54:23,340 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-03-08 18:54:23,340 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-03-08 18:54:23,340 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-03-08 18:54:23,340 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-03-08 18:54:23,340 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-03-08 18:54:23,340 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-03-08 18:54:23,340 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-03-08 18:54:23,340 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-03-08 18:54:23,457 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.01848953961558828); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.03130889511912304, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.01848953961558828); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.012166666666666666); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.044, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-03-08 18:54:23,457 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-03-08 18:54:23,457 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.015144566543213877, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.01848953961558828); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.03130889511912304, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.01848953961558828); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.012166666666666666); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.044, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-03-08 18:54:23,755 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 392 ms to try 5000 different iterations.  Found a solution that moves 1041 regions; Going from a computed imbalance of 0.015144566543213877 to a new imbalance of 8.628573698523182E-4. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.004658161240544447); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.006750316948122676); MoveCostFunction : (multiplier=7.0, imbalance=0.11566666666666667, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.004658161240544447); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=5.0E-4); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.003916666666666666); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-03-08 18:54:23,758 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1040462571:82 , srv1332600471:82 , srv1106824903:83 , srv1129696365:83 , srv12084302:83 , srv1388379380:83 , srv1675105519:83 , srv1834833995:83 , srv1870066087:83 , srv199484973:83 , srv2142857178:83 , srv429474002:83 , srv462695315:83 , srv546986981:83 , srv646757958:83 , srv764443970:83 , srv772889156:83 , srv797318137:83 , srv1014661193:84 , srv109004384:84 , srv1095164123:84 , srv1202005114:84 , srv2016607277:84 , srv325127799:84 , srv380495303:84 , srv422467136:84 , srv683786204:84 , srv736872752:84 , srv781780299:84 , srv811281164:84 , srv968247023:84 , srv987670763:84 , srv1037544781:85 , srv1056023673:85 , srv107567229:85 , srv1134543776:85 , srv1283773752:85 , srv1520759294:85 , srv1623387740:85 , srv172794567:85 , srv1743140823:85 , srv1780845347:85 , srv1833010310:85 , srv2013365029:85 , srv32473288:85 , srv351795585:85 , srv364868077:85 , srv397418091:85 , srv604374347:85 , srv633368722:85 , srv94867476:85 , srv1007407279:86 , srv1065369400:86 , srv1241959747:86 , srv1342904679:86 , srv1396310902:86 , srv1421999466:86 , srv1528186827:86 , srv1635834282:86 , srv1654110397:86 , srv1669112362:86 , srv169751986:86 , srv1718801242:86 , srv1911861014:86 , srv1965744544:86 , srv1971190269:86 , srv2019596685:86 , srv2051089193:86 , srv210209077:86 , srv371099509:86 , srv420060159:86 , srv43270634:86 , srv488333751:86 , srv512314907:86 , srv621641360:86 , srv633946970:86 , srv644412358:86 , srv756903494:86 , srv796958043:86 , srv838397142:86 , srv983710623:86 , srv1205389957:87 , srv1279656550:87 , srv1409332149:87 , srv1625136620:87 , srv1911878715:87 , srv2031535687:87 , srv2048936783:87 , srv544978338:87 , srv718245114:87 , srv740508776:87 , srv878564808:87 , srv1092419797:88 , srv137654105:88 , srv1855885671:88 , srv1864997882:88 , srv620301866:88 , srv2056315213:89 , srv1522375971:90 , srv1525368191:561 }
2023-03-08 18:54:23,764 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-03-08 18:54:23,765 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv983710623=98, srv12084302=15, srv1834833995=42, srv1279656550=17, srv32473288=60, srv1283773752=18, srv633946970=80, srv1342904679=20, srv2051089193=56, srv646757958=82, srv633368722=79, srv736872752=85, srv621641360=78, srv620301866=77, srv199484973=50, srv2142857178=59, srv364868077=63, srv1202005114=13, srv772889156=89, srv796958043=91, srv811281164=93, srv1525368191=28, srv1396310902=23, srv1520759294=26, srv1040462571=3, srv1095164123=9, srv1855885671=43, srv878564808=95, srv1870066087=45, srv1965744544=48, srv2048936783=55, srv210209077=58, srv462695315=71, srv968247023=97, srv1675105519=35, srv2019596685=53, srv1014661193=1, srv1037544781=2, srv1635834282=32, srv1421999466=25, srv1625136620=31, srv1833010310=41, srv1864997882=44, srv1718801242=37, srv1092419797=8, srv2013365029=51, srv397418091=66, srv2031535687=54, srv1911861014=46, srv1056023673=4, srv488333751=72, srv987670763=99, srv2016607277=52, srv1654110397=33, srv1388379380=22, srv169751986=36, srv797318137=92, srv1065369400=5, srv371099509=64, srv172794567=38, srv740508776=86, srv2056315213=57, srv1106824903=10, srv512314907=73, srv109004384=7, srv1205389957=14, srv107567229=6, srv1241959747=16, srv644412358=81, srv1669112362=34, srv756903494=87, srv422467136=68, srv764443970=88, srv380495303=65, srv420060159=67, srv1409332149=24, srv1522375971=27, srv94867476=96, srv544978338=74, srv1971190269=49, srv351795585=62, srv781780299=90, srv546986981=75, srv1134543776=12, srv1332600471=19, srv1743140823=39, srv604374347=76, srv429474002=69, srv1780845347=40, srv43270634=70, srv1911878715=47, srv137654105=21, srv683786204=83, srv1528186827=29, srv1623387740=30, srv838397142=94, srv1129696365=11, srv1007407279=0, srv718245114=84, srv325127799=61} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-03-08 18:54:23,781 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-03-08 18:54:23,782 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-03-08 18:54:23,782 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-03-08 18:54:23,782 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-03-08 18:54:23,782 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-03-08 18:54:23,782 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-03-08 18:54:23,782 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-03-08 18:54:23,782 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-03-08 18:54:23,782 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-03-08 18:54:23,782 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-03-08 18:54:23,782 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-03-08 18:54:23,783 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-03-08 18:54:23,783 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-03-08 18:54:23,783 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-03-08 18:54:23,783 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-03-08 18:54:23,783 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-03-08 18:54:23,783 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-03-08 18:54:23,783 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-03-08 18:54:23,783 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-03-08 18:54:23,783 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-03-08 18:54:23,783 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-03-08 18:54:23,783 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-03-08 18:54:23,783 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-03-08 18:54:23,784 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-03-08 18:54:23,784 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-03-08 18:54:23,784 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-03-08 18:54:23,784 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-03-08 18:54:23,784 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-03-08 18:54:23,784 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-03-08 18:54:23,784 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-03-08 18:54:23,784 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-03-08 18:54:23,784 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-03-08 18:54:23,784 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-03-08 18:54:23,784 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-03-08 18:54:23,784 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-03-08 18:54:23,785 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-03-08 18:54:23,785 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-03-08 18:54:23,785 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-03-08 18:54:23,785 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-03-08 18:54:23,785 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-03-08 18:54:23,785 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-03-08 18:54:23,785 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-03-08 18:54:23,785 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-03-08 18:54:23,785 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-03-08 18:54:23,785 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-03-08 18:54:23,785 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-03-08 18:54:23,785 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-03-08 18:54:23,786 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-03-08 18:54:23,786 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-03-08 18:54:23,786 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-03-08 18:54:23,786 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-03-08 18:54:23,786 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-03-08 18:54:23,786 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-03-08 18:54:23,786 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-03-08 18:54:23,786 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-03-08 18:54:23,786 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-03-08 18:54:23,786 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-03-08 18:54:23,786 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-03-08 18:54:23,787 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-03-08 18:54:23,787 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-03-08 18:54:23,787 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-03-08 18:54:23,787 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-03-08 18:54:23,787 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-03-08 18:54:23,787 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-03-08 18:54:23,787 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-03-08 18:54:23,787 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-03-08 18:54:23,787 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-03-08 18:54:23,787 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-03-08 18:54:23,787 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-03-08 18:54:23,787 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-03-08 18:54:23,788 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-03-08 18:54:23,788 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-03-08 18:54:23,788 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-03-08 18:54:23,788 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-03-08 18:54:23,788 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-03-08 18:54:23,788 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-03-08 18:54:23,788 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-03-08 18:54:23,788 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-03-08 18:54:23,788 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-03-08 18:54:23,788 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-03-08 18:54:23,788 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-03-08 18:54:23,788 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-03-08 18:54:23,788 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-03-08 18:54:23,789 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-03-08 18:54:23,789 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-03-08 18:54:23,789 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-03-08 18:54:23,789 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-03-08 18:54:23,789 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-03-08 18:54:23,789 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-03-08 18:54:23,789 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-03-08 18:54:23,789 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-03-08 18:54:23,789 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-03-08 18:54:23,789 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-03-08 18:54:23,789 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-03-08 18:54:23,789 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-03-08 18:54:23,790 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-03-08 18:54:23,790 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-03-08 18:54:23,790 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-03-08 18:54:23,790 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-03-08 18:54:23,790 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-03-08 18:54:23,790 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-03-08 18:54:23,901 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.004658161240544447); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.006750316948122676); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.004658161240544447); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=5.0E-4); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.003916666666666666); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-03-08 18:54:23,901 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-03-08 18:54:23,902 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=8.555681320563148E-4, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.004658161240544447); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.006750316948122676); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.004658161240544447); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=5.0E-4); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.003916666666666666); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-03-08 18:54:24,262 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 455 ms to try 5000 different iterations.  Found a solution that moves 241 regions; Going from a computed imbalance of 8.555681320563148E-4 to a new imbalance of 1.9320952809341837E-5. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=4.4668347344853864E-4); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0017727200782610348); MoveCostFunction : (multiplier=7.0, imbalance=0.02677777777777778, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=4.4668347344853864E-4); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=8.333333333333333E-5); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-03-08 18:54:24,263 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv109004384:83 , srv1409332149:83 , srv1520759294:83 , srv1669112362:83 , srv1743140823:83 , srv1971190269:83 , srv351795585:83 , srv546986981:83 , srv983710623:83 , srv1037544781:84 , srv1056023673:84 , srv107567229:84 , srv1092419797:84 , srv1095164123:84 , srv1106824903:84 , srv1202005114:84 , srv1279656550:84 , srv137654105:84 , srv1522375971:84 , srv1528186827:84 , srv1623387740:84 , srv1625136620:84 , srv1635834282:84 , srv1654110397:84 , srv172794567:84 , srv1834833995:84 , srv1855885671:84 , srv1864997882:84 , srv199484973:84 , srv2016607277:84 , srv2019596685:84 , srv2051089193:84 , srv210209077:84 , srv325127799:84 , srv371099509:84 , srv380495303:84 , srv397418091:84 , srv422467136:84 , srv43270634:84 , srv462695315:84 , srv544978338:84 , srv604374347:84 , srv620301866:84 , srv621641360:84 , srv633368722:84 , srv644412358:84 , srv718245114:84 , srv740508776:84 , srv756903494:84 , srv764443970:84 , srv838397142:84 , srv968247023:84 , srv1007407279:85 , srv1014661193:85 , srv1040462571:85 , srv1065369400:85 , srv1129696365:85 , srv1134543776:85 , srv1205389957:85 , srv12084302:85 , srv1241959747:85 , srv1283773752:85 , srv1332600471:85 , srv1342904679:85 , srv1388379380:85 , srv1396310902:85 , srv1421999466:85 , srv1675105519:85 , srv169751986:85 , srv1718801242:85 , srv1780845347:85 , srv1833010310:85 , srv1870066087:85 , srv1911861014:85 , srv1911878715:85 , srv1965744544:85 , srv2013365029:85 , srv2031535687:85 , srv2048936783:85 , srv2056315213:85 , srv2142857178:85 , srv32473288:85 , srv364868077:85 , srv420060159:85 , srv429474002:85 , srv488333751:85 , srv512314907:85 , srv633946970:85 , srv646757958:85 , srv781780299:85 , srv796958043:85 , srv797318137:85 , srv811281164:85 , srv878564808:85 , srv94867476:85 , srv987670763:85 , srv683786204:86 , srv736872752:86 , srv772889156:86 , srv1525368191:643 }
2023-03-08 18:54:24,268 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-03-08 18:54:24,269 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv983710623=98, srv12084302=15, srv1834833995=42, srv1279656550=17, srv32473288=60, srv1283773752=18, srv633946970=80, srv1342904679=20, srv2051089193=56, srv646757958=82, srv633368722=79, srv736872752=85, srv621641360=78, srv620301866=77, srv199484973=50, srv2142857178=59, srv364868077=63, srv1202005114=13, srv772889156=89, srv796958043=91, srv811281164=93, srv1525368191=28, srv1396310902=23, srv1520759294=26, srv1040462571=3, srv1095164123=9, srv1855885671=43, srv878564808=95, srv1870066087=45, srv1965744544=48, srv2048936783=55, srv210209077=58, srv462695315=71, srv968247023=97, srv1675105519=35, srv2019596685=53, srv1014661193=1, srv1037544781=2, srv1635834282=32, srv1421999466=25, srv1625136620=31, srv1833010310=41, srv1864997882=44, srv1718801242=37, srv1092419797=8, srv2013365029=51, srv397418091=66, srv2031535687=54, srv1911861014=46, srv1056023673=4, srv488333751=72, srv987670763=99, srv2016607277=52, srv1654110397=33, srv1388379380=22, srv169751986=36, srv797318137=92, srv1065369400=5, srv371099509=64, srv172794567=38, srv740508776=86, srv2056315213=57, srv1106824903=10, srv512314907=73, srv109004384=7, srv1205389957=14, srv107567229=6, srv1241959747=16, srv644412358=81, srv1669112362=34, srv756903494=87, srv422467136=68, srv764443970=88, srv380495303=65, srv420060159=67, srv1409332149=24, srv1522375971=27, srv94867476=96, srv544978338=74, srv1971190269=49, srv351795585=62, srv781780299=90, srv546986981=75, srv1134543776=12, srv1332600471=19, srv1743140823=39, srv604374347=76, srv429474002=69, srv1780845347=40, srv43270634=70, srv1911878715=47, srv137654105=21, srv683786204=83, srv1528186827=29, srv1623387740=30, srv838397142=94, srv1129696365=11, srv1007407279=0, srv718245114=84, srv325127799=61} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-03-08 18:54:24,281 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-03-08 18:54:24,281 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-03-08 18:54:24,281 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-03-08 18:54:24,281 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-03-08 18:54:24,281 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-03-08 18:54:24,281 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-03-08 18:54:24,281 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-03-08 18:54:24,281 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-03-08 18:54:24,281 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-03-08 18:54:24,281 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-03-08 18:54:24,282 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-03-08 18:54:24,282 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-03-08 18:54:24,282 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-03-08 18:54:24,282 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-03-08 18:54:24,282 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-03-08 18:54:24,282 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-03-08 18:54:24,282 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-03-08 18:54:24,282 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-03-08 18:54:24,282 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-03-08 18:54:24,282 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-03-08 18:54:24,282 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-03-08 18:54:24,282 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-03-08 18:54:24,282 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-03-08 18:54:24,282 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-03-08 18:54:24,282 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-03-08 18:54:24,282 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-03-08 18:54:24,282 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-03-08 18:54:24,282 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-03-08 18:54:24,283 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-03-08 18:54:24,283 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-03-08 18:54:24,283 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-03-08 18:54:24,283 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-03-08 18:54:24,283 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-03-08 18:54:24,283 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-03-08 18:54:24,283 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-03-08 18:54:24,283 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-03-08 18:54:24,283 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-03-08 18:54:24,283 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-03-08 18:54:24,283 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-03-08 18:54:24,283 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-03-08 18:54:24,283 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-03-08 18:54:24,283 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-03-08 18:54:24,283 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-03-08 18:54:24,284 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-03-08 18:54:24,284 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-03-08 18:54:24,284 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-03-08 18:54:24,284 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-03-08 18:54:24,284 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-03-08 18:54:24,284 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-03-08 18:54:24,284 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-03-08 18:54:24,284 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-03-08 18:54:24,284 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-03-08 18:54:24,284 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-03-08 18:54:24,284 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-03-08 18:54:24,284 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-03-08 18:54:24,284 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-03-08 18:54:24,284 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-03-08 18:54:24,284 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-03-08 18:54:24,285 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-03-08 18:54:24,285 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-03-08 18:54:24,285 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-03-08 18:54:24,285 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-03-08 18:54:24,285 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-03-08 18:54:24,285 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-03-08 18:54:24,285 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-03-08 18:54:24,285 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-03-08 18:54:24,285 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-03-08 18:54:24,285 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-03-08 18:54:24,285 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-03-08 18:54:24,285 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-03-08 18:54:24,285 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-03-08 18:54:24,285 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-03-08 18:54:24,286 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-03-08 18:54:24,286 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-03-08 18:54:24,286 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-03-08 18:54:24,286 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-03-08 18:54:24,286 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-03-08 18:54:24,286 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-03-08 18:54:24,286 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-03-08 18:54:24,286 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-03-08 18:54:24,286 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-03-08 18:54:24,286 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-03-08 18:54:24,286 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-03-08 18:54:24,286 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-03-08 18:54:24,286 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-03-08 18:54:24,286 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-03-08 18:54:24,286 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-03-08 18:54:24,286 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-03-08 18:54:24,286 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-03-08 18:54:24,286 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-03-08 18:54:24,286 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-03-08 18:54:24,287 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-03-08 18:54:24,287 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-03-08 18:54:24,287 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-03-08 18:54:24,287 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-03-08 18:54:24,287 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-03-08 18:54:24,287 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-03-08 18:54:24,287 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-03-08 18:54:24,287 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-03-08 18:54:24,287 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-03-08 18:54:24,287 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-03-08 18:54:24,398 INFO  [Time-limited test] balancer.StochasticLoadBalancer(381): Cluster wide - skipping load balancing because weighted average imbalance=1.7633434741294947E-5 <= threshold(0.025). If you want more aggressive balancing, either lower hbase.master.balancer.stochastic.minCostNeedBalance from 0.025 or increase the relative multiplier(s) of the specific cost function(s). functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=4.4668347344853864E-4); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0017727200782610348); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=4.4668347344853864E-4); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=8.333333333333333E-5); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-03-08 18:54:24,398 INFO  [Time-limited test] balancer.BalancerTestBase(570): Mock Final balance: { srv109004384:83 , srv1409332149:83 , srv1520759294:83 , srv1669112362:83 , srv1743140823:83 , srv1971190269:83 , srv351795585:83 , srv546986981:83 , srv983710623:83 , srv1037544781:84 , srv1056023673:84 , srv107567229:84 , srv1092419797:84 , srv1095164123:84 , srv1106824903:84 , srv1202005114:84 , srv1279656550:84 , srv137654105:84 , srv1522375971:84 , srv1528186827:84 , srv1623387740:84 , srv1625136620:84 , srv1635834282:84 , srv1654110397:84 , srv172794567:84 , srv1834833995:84 , srv1855885671:84 , srv1864997882:84 , srv199484973:84 , srv2016607277:84 , srv2019596685:84 , srv2051089193:84 , srv210209077:84 , srv325127799:84 , srv371099509:84 , srv380495303:84 , srv397418091:84 , srv422467136:84 , srv43270634:84 , srv462695315:84 , srv544978338:84 , srv604374347:84 , srv620301866:84 , srv621641360:84 , srv633368722:84 , srv644412358:84 , srv718245114:84 , srv740508776:84 , srv756903494:84 , srv764443970:84 , srv838397142:84 , srv968247023:84 , srv1007407279:85 , srv1014661193:85 , srv1040462571:85 , srv1065369400:85 , srv1129696365:85 , srv1134543776:85 , srv1205389957:85 , srv12084302:85 , srv1241959747:85 , srv1283773752:85 , srv1332600471:85 , srv1342904679:85 , srv1388379380:85 , srv1396310902:85 , srv1421999466:85 , srv1675105519:85 , srv169751986:85 , srv1718801242:85 , srv1780845347:85 , srv1833010310:85 , srv1870066087:85 , srv1911861014:85 , srv1911878715:85 , srv1965744544:85 , srv2013365029:85 , srv2031535687:85 , srv2048936783:85 , srv2056315213:85 , srv2142857178:85 , srv32473288:85 , srv364868077:85 , srv420060159:85 , srv429474002:85 , srv488333751:85 , srv512314907:85 , srv633946970:85 , srv646757958:85 , srv781780299:85 , srv796958043:85 , srv797318137:85 , srv811281164:85 , srv878564808:85 , srv94867476:85 , srv987670763:85 , srv683786204:86 , srv736872752:86 , srv772889156:86 , srv1525368191:643 }
2023-03-08 18:54:24,429 INFO  [Time-limited test] hbase.ResourceChecker(175): after: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnLargeClusterWithRacks Thread=10 (was 10), OpenFileDescriptor=260 (was 260), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=206 (was 206), ProcessCount=187 (was 187), AvailableMemoryMB=7209 (was 7703)
2023-03-08 18:54:24,439 INFO  [Time-limited test] hbase.ResourceChecker(147): before: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnMidClusterWithRacks Thread=10, OpenFileDescriptor=260, MaxFileDescriptor=60000, SystemLoadAverage=206, ProcessCount=187, AvailableMemoryMB=7208
2023-03-08 18:54:24,439 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2023-03-08 18:54:24,440 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=5000, runMaxSteps=true, stepsPerRegion=800, maxRunningTime=120000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 111077.0 etc.
2023-03-08 18:54:24,451 INFO  [Time-limited test] balancer.BalancerTestBase(547): Mock Cluster : { srv1054583857:84 , srv1077923503:84 , srv1107908108:84 , srv1229968557:84 , srv1326987882:84 , srv1329644585:84 , srv1428848788:84 , srv1495123163:84 , srv1508084678:84 , srv1680917447:84 , srv1760299855:84 , srv1858991299:84 , srv1900053970:84 , srv1920554581:84 , srv2038064084:84 , srv266144807:84 , srv31461353:84 , srv331697097:84 , srv344926919:84 , srv372469178:84 , srv38444326:84 , srv429003454:84 , srv474338482:84 , srv551532482:84 , srv637379268:84 , srv641305941:84 , srv688354974:84 , srv77740793:84 , srv90859515:84 , srv511673730:264 } [srvr=30 rgns=2700 avg=90.0 max=90 min=90]
2023-03-08 18:54:24,454 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-03-08 18:54:24,454 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1858991299=11, srv1760299855=10, srv331697097=17, srv1326987882=4, srv1508084678=8, srv1077923503=1, srv1107908108=2, srv1680917447=9, srv90859515=29, srv2038064084=14, srv511673730=23, srv1054583857=0, srv641305941=26, srv1900053970=12, srv344926919=18, srv31461353=16, srv551532482=24, srv1495123163=7, srv474338482=22, srv637379268=25, srv429003454=21, srv1428848788=6, srv1920554581=13, srv688354974=27, srv77740793=28, srv266144807=15, srv1329644585=5, srv1229968557=3, srv372469178=19, srv38444326=20} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-03-08 18:54:24,466 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-03-08 18:54:24,466 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-03-08 18:54:24,466 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-03-08 18:54:24,466 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-03-08 18:54:24,466 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-03-08 18:54:24,466 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-03-08 18:54:24,466 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-03-08 18:54:24,466 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-03-08 18:54:24,466 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-03-08 18:54:24,466 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-03-08 18:54:24,467 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-03-08 18:54:24,467 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-03-08 18:54:24,467 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-03-08 18:54:24,467 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-03-08 18:54:24,467 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-03-08 18:54:24,467 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-03-08 18:54:24,467 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-03-08 18:54:24,467 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-03-08 18:54:24,467 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-03-08 18:54:24,467 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-03-08 18:54:24,467 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-03-08 18:54:24,467 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-03-08 18:54:24,467 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-03-08 18:54:24,467 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-03-08 18:54:24,468 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-03-08 18:54:24,468 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-03-08 18:54:24,468 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-03-08 18:54:24,468 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-03-08 18:54:24,468 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-03-08 18:54:24,468 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-03-08 18:54:24,468 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=10, number of hosts=30, number of racks=4
2023-03-08 18:54:24,488 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=1.1988892334416754, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-03-08 18:54:24,489 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.9912819736744521, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=1.1988892334416754, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=64800000
2023-03-08 18:56:24,472 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 120001 ms to try 6436703 different iterations.  Found a solution that moves 1868 regions; Going from a computed imbalance of 0.9912819736744521 to a new imbalance of 4.360005188259462E-5. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); MoveCostFunction : (multiplier=7.0, imbalance=0.6918518518518518, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-03-08 18:56:24,479 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1054583857:90 , srv1077923503:90 , srv1107908108:90 , srv1229968557:90 , srv1326987882:90 , srv1329644585:90 , srv1428848788:90 , srv1495123163:90 , srv1508084678:90 , srv1680917447:90 , srv1760299855:90 , srv1858991299:90 , srv1900053970:90 , srv1920554581:90 , srv2038064084:90 , srv266144807:90 , srv31461353:90 , srv331697097:90 , srv344926919:90 , srv372469178:90 , srv38444326:90 , srv429003454:90 , srv474338482:90 , srv511673730:90 , srv551532482:90 , srv637379268:90 , srv641305941:90 , srv688354974:90 , srv77740793:90 , srv90859515:90 }
2023-03-08 18:56:24,481 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-03-08 18:56:24,482 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1858991299=11, srv1760299855=10, srv331697097=17, srv1326987882=4, srv1508084678=8, srv1077923503=1, srv1107908108=2, srv1680917447=9, srv90859515=29, srv2038064084=14, srv511673730=23, srv1054583857=0, srv641305941=26, srv1900053970=12, srv344926919=18, srv31461353=16, srv551532482=24, srv1495123163=7, srv474338482=22, srv637379268=25, srv429003454=21, srv1428848788=6, srv1920554581=13, srv688354974=27, srv77740793=28, srv266144807=15, srv1329644585=5, srv1229968557=3, srv372469178=19, srv38444326=20} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-03-08 18:56:24,487 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-03-08 18:56:24,487 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-03-08 18:56:24,487 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-03-08 18:56:24,487 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-03-08 18:56:24,487 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-03-08 18:56:24,487 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-03-08 18:56:24,487 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-03-08 18:56:24,487 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-03-08 18:56:24,487 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-03-08 18:56:24,487 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-03-08 18:56:24,487 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-03-08 18:56:24,488 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-03-08 18:56:24,488 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-03-08 18:56:24,488 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-03-08 18:56:24,488 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-03-08 18:56:24,488 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-03-08 18:56:24,488 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-03-08 18:56:24,488 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-03-08 18:56:24,488 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-03-08 18:56:24,488 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-03-08 18:56:24,488 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-03-08 18:56:24,488 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-03-08 18:56:24,488 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-03-08 18:56:24,488 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-03-08 18:56:24,488 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-03-08 18:56:24,488 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-03-08 18:56:24,488 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-03-08 18:56:24,488 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-03-08 18:56:24,488 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-03-08 18:56:24,488 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-03-08 18:56:24,488 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=10, number of hosts=30, number of racks=4
2023-03-08 18:56:24,500 INFO  [Time-limited test] balancer.StochasticLoadBalancer(381): Cluster wide - skipping load balancing because weighted average imbalance=0.0 <= threshold(0.025). If you want more aggressive balancing, either lower hbase.master.balancer.stochastic.minCostNeedBalance from 0.025 or increase the relative multiplier(s) of the specific cost function(s). functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-03-08 18:56:24,501 INFO  [Time-limited test] balancer.BalancerTestBase(570): Mock Final balance: { srv1054583857:90 , srv1077923503:90 , srv1107908108:90 , srv1229968557:90 , srv1326987882:90 , srv1329644585:90 , srv1428848788:90 , srv1495123163:90 , srv1508084678:90 , srv1680917447:90 , srv1760299855:90 , srv1858991299:90 , srv1900053970:90 , srv1920554581:90 , srv2038064084:90 , srv266144807:90 , srv31461353:90 , srv331697097:90 , srv344926919:90 , srv372469178:90 , srv38444326:90 , srv429003454:90 , srv474338482:90 , srv511673730:90 , srv551532482:90 , srv637379268:90 , srv641305941:90 , srv688354974:90 , srv77740793:90 , srv90859515:90 }
2023-03-08 18:56:24,517 INFO  [Time-limited test] hbase.ResourceChecker(175): after: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnMidClusterWithRacks Thread=9 (was 10), OpenFileDescriptor=260 (was 260), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=188 (was 206), ProcessCount=170 (was 187), AvailableMemoryMB=6874 (was 7208)