2023-03-14 10:54:11,652 INFO  [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks timeout: 13 mins
2023-03-14 10:54:11,964 WARN  [Time-limited test] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties
2023-03-14 10:54:12,065 INFO  [Time-limited test] metrics.MetricRegistriesLoader(60): Loaded MetricRegistries class org.apache.hadoop.hbase.metrics.impl.MetricRegistriesImpl
2023-03-14 10:54:12,124 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2023-03-14 10:54:12,131 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc.
2023-03-14 10:54:12,143 INFO  [Time-limited test] hbase.ResourceChecker(147): before: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnLargeClusterWithRacks Thread=10, OpenFileDescriptor=260, MaxFileDescriptor=60000, SystemLoadAverage=270, ProcessCount=169, AvailableMemoryMB=3414
2023-03-14 10:54:12,145 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2023-03-14 10:54:12,146 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=5000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=10000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc.
2023-03-14 10:54:12,279 INFO  [Time-limited test] balancer.BalancerTestBase(547): Mock Cluster : { srv1068160345:84 , srv1073945288:84 , srv1075658825:84 , srv1095411700:84 , srv1099524764:84 , srv1106340404:84 , srv1111807846:84 , srv1119254566:84 , srv1137104869:84 , srv1137201339:84 , srv1171275851:84 , srv1179722:84 , srv1265340631:84 , srv1279185194:84 , srv1284930075:84 , srv1298305094:84 , srv1337894365:84 , srv1378746372:84 , srv1406280477:84 , srv1472824181:84 , srv1479017688:84 , srv155219462:84 , srv1565557451:84 , srv1589615595:84 , srv1614228885:84 , srv1628850051:84 , srv1639538198:84 , srv1680370936:84 , srv1685756055:84 , srv1706660461:84 , srv174645388:84 , srv1755834642:84 , srv1782621234:84 , srv179721298:84 , srv1820319437:84 , srv1843739102:84 , srv1921448627:84 , srv1923326296:84 , srv1952868670:84 , srv1986689046:84 , srv1993625371:84 , srv201312554:84 , srv2024745184:84 , srv2041280712:84 , srv2060786675:84 , srv2067747449:84 , srv2068575734:84 , srv2082543648:84 , srv2098124122:84 , srv2100945855:84 , srv2106471997:84 , srv2108682675:84 , srv2122328884:84 , srv2127549006:84 , srv21369969:84 , srv2145413706:84 , srv223529112:84 , srv225916046:84 , srv241455882:84 , srv243916860:84 , srv246568577:84 , srv311099705:84 , srv319411246:84 , srv333278005:84 , srv339511883:84 , srv406750484:84 , srv421308939:84 , srv442584438:84 , srv467672367:84 , srv474679264:84 , srv502645765:84 , srv510885747:84 , srv543265997:84 , srv544496211:84 , srv578743681:84 , srv596264966:84 , srv633688529:84 , srv634164773:84 , srv63497679:84 , srv637064145:84 , srv663812171:84 , srv699962931:84 , srv747965936:84 , srv761979308:84 , srv784505595:84 , srv793586178:84 , srv798022548:84 , srv800168473:84 , srv881654515:84 , srv889818969:84 , srv893314162:84 , srv917959497:84 , srv928771770:84 , srv966291281:84 , srv970029027:84 , srv97907542:84 , srv983178121:84 , srv993905237:84 , srv995731989:84 , srv222385357:684 } [srvr=100 rgns=9000 avg=90.0 max=90 min=90]
2023-03-14 10:54:12,290 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-03-14 10:54:12,298 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1993625371=40, srv222385357=56, srv596264966=76, srv889818969=90, srv995731989=99, srv881654515=89, srv510885747=72, srv578743681=75, srv800168473=88, srv421308939=67, srv1298305094=15, srv2082543648=47, srv311099705=62, srv1755834642=31, srv2068575734=46, srv1279185194=13, srv201312554=41, srv2024745184=42, srv1472824181=19, srv2106471997=50, srv2122328884=52, srv179721298=33, srv634164773=78, srv2041280712=43, srv1706660461=29, srv663812171=81, srv928771770=93, srv1075658825=2, srv1843739102=35, srv893314162=91, srv1820319437=34, srv544496211=74, srv2145413706=55, srv983178121=97, srv225916046=58, srv699962931=82, srv793586178=86, srv1265340631=12, srv333278005=64, srv761979308=84, srv1952868670=38, srv246568577=61, srv339511883=65, srv798022548=87, srv637064145=80, srv1119254566=7, srv467672367=69, srv1589615595=23, srv1565557451=22, srv1106340404=5, srv406750484=66, srv1179722=11, srv1337894365=16, srv1095411700=3, srv1782621234=32, srv1378746372=17, srv1111807846=6, srv155219462=21, srv97907542=96, srv1406280477=18, srv1680370936=27, srv784505595=85, srv1614228885=24, srv1073945288=1, srv1137104869=8, srv1171275851=10, srv442584438=68, srv21369969=54, srv2067747449=45, srv319411246=63, srv63497679=79, srv993905237=98, srv1986689046=39, srv1284930075=14, srv633688529=77, srv747965936=83, srv474679264=70, srv917959497=92, srv502645765=71, srv543265997=73, srv174645388=30, srv1921448627=36, srv1068160345=0, srv970029027=95, srv2108682675=51, srv2127549006=53, srv966291281=94, srv241455882=59, srv1639538198=26, srv1099524764=4, srv2100945855=49, srv243916860=60, srv1137201339=9, srv2060786675=44, srv1479017688=20, srv1628850051=25, srv223529112=57, srv2098124122=48, srv1685756055=28, srv1923326296=37} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-03-14 10:54:12,384 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-03-14 10:54:12,384 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-03-14 10:54:12,384 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-03-14 10:54:12,384 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-03-14 10:54:12,384 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-03-14 10:54:12,385 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-03-14 10:54:12,385 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-03-14 10:54:12,385 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-03-14 10:54:12,385 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-03-14 10:54:12,385 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-03-14 10:54:12,385 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-03-14 10:54:12,385 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-03-14 10:54:12,385 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-03-14 10:54:12,385 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-03-14 10:54:12,385 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-03-14 10:54:12,385 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-03-14 10:54:12,386 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-03-14 10:54:12,386 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-03-14 10:54:12,386 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-03-14 10:54:12,386 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-03-14 10:54:12,386 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-03-14 10:54:12,386 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-03-14 10:54:12,386 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-03-14 10:54:12,386 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-03-14 10:54:12,386 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-03-14 10:54:12,386 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-03-14 10:54:12,386 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-03-14 10:54:12,387 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-03-14 10:54:12,387 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-03-14 10:54:12,387 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-03-14 10:54:12,387 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-03-14 10:54:12,387 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-03-14 10:54:12,387 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-03-14 10:54:12,387 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-03-14 10:54:12,387 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-03-14 10:54:12,387 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-03-14 10:54:12,387 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-03-14 10:54:12,388 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-03-14 10:54:12,388 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-03-14 10:54:12,388 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-03-14 10:54:12,388 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-03-14 10:54:12,388 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-03-14 10:54:12,388 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-03-14 10:54:12,388 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-03-14 10:54:12,388 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-03-14 10:54:12,388 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-03-14 10:54:12,388 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-03-14 10:54:12,388 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-03-14 10:54:12,388 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-03-14 10:54:12,389 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-03-14 10:54:12,389 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-03-14 10:54:12,389 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-03-14 10:54:12,389 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-03-14 10:54:12,389 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-03-14 10:54:12,389 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-03-14 10:54:12,389 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-03-14 10:54:12,389 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-03-14 10:54:12,389 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-03-14 10:54:12,389 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-03-14 10:54:12,389 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-03-14 10:54:12,390 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-03-14 10:54:12,390 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-03-14 10:54:12,390 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-03-14 10:54:12,390 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-03-14 10:54:12,390 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-03-14 10:54:12,390 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-03-14 10:54:12,390 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-03-14 10:54:12,390 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-03-14 10:54:12,390 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-03-14 10:54:12,390 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-03-14 10:54:12,390 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-03-14 10:54:12,390 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-03-14 10:54:12,391 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-03-14 10:54:12,391 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-03-14 10:54:12,391 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-03-14 10:54:12,391 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-03-14 10:54:12,391 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-03-14 10:54:12,391 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-03-14 10:54:12,391 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-03-14 10:54:12,391 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-03-14 10:54:12,391 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-03-14 10:54:12,391 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-03-14 10:54:12,391 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-03-14 10:54:12,392 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-03-14 10:54:12,392 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-03-14 10:54:12,392 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-03-14 10:54:12,392 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-03-14 10:54:12,392 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-03-14 10:54:12,392 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-03-14 10:54:12,392 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-03-14 10:54:12,392 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-03-14 10:54:12,392 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-03-14 10:54:12,392 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-03-14 10:54:12,392 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-03-14 10:54:12,392 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-03-14 10:54:12,393 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-03-14 10:54:12,393 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-03-14 10:54:12,393 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-03-14 10:54:12,393 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-03-14 10:54:12,393 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-03-14 10:54:12,393 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-03-14 10:54:12,601 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.06666666666666667, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-03-14 10:54:12,601 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-03-14 10:54:12,601 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.9909252140407105, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.06666666666666667, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-03-14 10:54:13,280 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 857 ms to try 5000 different iterations.  Found a solution that moves 4695 regions; Going from a computed imbalance of 0.9909252140407105 to a new imbalance of 0.17783250800670383. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.04110094817811132, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.05492163583737059, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.5216666666666666, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.04110094817811132, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.17266666666666666, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.24333333333333335, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-03-14 10:54:13,302 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1111807846:81 , srv995731989:81 , srv1095411700:82 , srv1639538198:82 , srv2106471997:82 , srv421308939:82 , srv1378746372:83 , srv1406280477:83 , srv155219462:83 , srv1565557451:83 , srv1628850051:83 , srv1680370936:83 , srv2100945855:83 , srv21369969:83 , srv311099705:83 , srv406750484:83 , srv633688529:83 , srv747965936:83 , srv928771770:83 , srv1099524764:84 , srv1820319437:84 , srv1986689046:84 , srv2024745184:84 , srv2067747449:84 , srv2068575734:84 , srv2127549006:84 , srv474679264:84 , srv784505595:84 , srv800168473:84 , srv993905237:84 , srv1265340631:85 , srv1337894365:85 , srv1782621234:85 , srv2041280712:85 , srv2060786675:85 , srv2082543648:85 , srv2098124122:85 , srv241455882:85 , srv246568577:85 , srv510885747:85 , srv889818969:85 , srv983178121:85 , srv1068160345:86 , srv1075658825:86 , srv1119254566:86 , srv1137104869:86 , srv1171275851:86 , srv1179722:86 , srv1279185194:86 , srv1298305094:86 , srv1614228885:86 , srv179721298:86 , srv1952868670:86 , srv339511883:86 , srv543265997:86 , srv970029027:86 , srv1755834642:87 , srv225916046:87 , srv319411246:87 , srv333278005:87 , srv544496211:87 , srv634164773:87 , srv761979308:87 , srv798022548:87 , srv881654515:87 , srv966291281:87 , srv1106340404:88 , srv1472824181:88 , srv1479017688:88 , srv1589615595:88 , srv174645388:88 , srv1923326296:88 , srv201312554:88 , srv2108682675:88 , srv223529112:88 , srv243916860:88 , srv596264966:88 , srv637064145:88 , srv699962931:88 , srv793586178:88 , srv1073945288:89 , srv1284930075:89 , srv1843739102:89 , srv1993625371:89 , srv442584438:89 , srv63497679:89 , srv1137201339:90 , srv1685756055:90 , srv1921448627:90 , srv2122328884:90 , srv502645765:90 , srv578743681:90 , srv1706660461:91 , srv467672367:91 , srv663812171:91 , srv2145413706:92 , srv893314162:94 , srv97907542:95 , srv917959497:98 , srv222385357:455 }
2023-03-14 10:54:13,306 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-03-14 10:54:13,307 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1993625371=40, srv222385357=56, srv596264966=76, srv889818969=90, srv995731989=99, srv881654515=89, srv510885747=72, srv578743681=75, srv800168473=88, srv421308939=67, srv1298305094=15, srv2082543648=47, srv311099705=62, srv1755834642=31, srv2068575734=46, srv1279185194=13, srv201312554=41, srv2024745184=42, srv1472824181=19, srv2106471997=50, srv2122328884=52, srv179721298=33, srv634164773=78, srv2041280712=43, srv1706660461=29, srv663812171=81, srv928771770=93, srv1075658825=2, srv1843739102=35, srv893314162=91, srv1820319437=34, srv544496211=74, srv2145413706=55, srv983178121=97, srv225916046=58, srv699962931=82, srv793586178=86, srv1265340631=12, srv333278005=64, srv761979308=84, srv1952868670=38, srv246568577=61, srv339511883=65, srv798022548=87, srv637064145=80, srv1119254566=7, srv467672367=69, srv1589615595=23, srv1565557451=22, srv1106340404=5, srv406750484=66, srv1179722=11, srv1337894365=16, srv1095411700=3, srv1782621234=32, srv1378746372=17, srv1111807846=6, srv155219462=21, srv97907542=96, srv1406280477=18, srv1680370936=27, srv784505595=85, srv1614228885=24, srv1073945288=1, srv1137104869=8, srv1171275851=10, srv442584438=68, srv21369969=54, srv2067747449=45, srv319411246=63, srv63497679=79, srv993905237=98, srv1986689046=39, srv1284930075=14, srv633688529=77, srv747965936=83, srv474679264=70, srv917959497=92, srv502645765=71, srv543265997=73, srv174645388=30, srv1921448627=36, srv1068160345=0, srv970029027=95, srv2108682675=51, srv2127549006=53, srv966291281=94, srv241455882=59, srv1639538198=26, srv1099524764=4, srv2100945855=49, srv243916860=60, srv1137201339=9, srv2060786675=44, srv1479017688=20, srv1628850051=25, srv223529112=57, srv2098124122=48, srv1685756055=28, srv1923326296=37} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-03-14 10:54:13,326 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-03-14 10:54:13,326 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-03-14 10:54:13,326 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-03-14 10:54:13,326 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-03-14 10:54:13,326 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-03-14 10:54:13,326 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-03-14 10:54:13,326 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-03-14 10:54:13,326 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-03-14 10:54:13,326 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-03-14 10:54:13,327 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-03-14 10:54:13,327 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-03-14 10:54:13,327 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-03-14 10:54:13,327 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-03-14 10:54:13,327 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-03-14 10:54:13,327 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-03-14 10:54:13,327 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-03-14 10:54:13,327 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-03-14 10:54:13,327 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-03-14 10:54:13,327 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-03-14 10:54:13,328 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-03-14 10:54:13,328 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-03-14 10:54:13,328 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-03-14 10:54:13,328 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-03-14 10:54:13,328 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-03-14 10:54:13,328 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-03-14 10:54:13,328 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-03-14 10:54:13,328 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-03-14 10:54:13,328 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-03-14 10:54:13,328 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-03-14 10:54:13,329 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-03-14 10:54:13,329 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-03-14 10:54:13,329 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-03-14 10:54:13,329 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-03-14 10:54:13,329 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-03-14 10:54:13,329 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-03-14 10:54:13,329 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-03-14 10:54:13,329 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-03-14 10:54:13,329 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-03-14 10:54:13,329 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-03-14 10:54:13,329 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-03-14 10:54:13,329 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-03-14 10:54:13,329 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-03-14 10:54:13,330 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-03-14 10:54:13,330 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-03-14 10:54:13,330 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-03-14 10:54:13,330 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-03-14 10:54:13,330 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-03-14 10:54:13,330 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-03-14 10:54:13,330 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-03-14 10:54:13,330 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-03-14 10:54:13,330 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-03-14 10:54:13,330 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-03-14 10:54:13,330 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-03-14 10:54:13,330 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-03-14 10:54:13,330 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-03-14 10:54:13,330 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-03-14 10:54:13,331 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-03-14 10:54:13,331 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-03-14 10:54:13,331 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-03-14 10:54:13,331 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-03-14 10:54:13,331 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-03-14 10:54:13,331 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-03-14 10:54:13,331 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-03-14 10:54:13,331 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-03-14 10:54:13,331 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-03-14 10:54:13,331 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-03-14 10:54:13,331 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-03-14 10:54:13,331 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-03-14 10:54:13,332 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-03-14 10:54:13,332 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-03-14 10:54:13,332 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-03-14 10:54:13,332 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-03-14 10:54:13,332 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-03-14 10:54:13,332 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-03-14 10:54:13,332 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-03-14 10:54:13,332 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-03-14 10:54:13,332 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-03-14 10:54:13,332 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-03-14 10:54:13,332 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-03-14 10:54:13,332 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-03-14 10:54:13,332 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-03-14 10:54:13,333 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-03-14 10:54:13,333 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-03-14 10:54:13,333 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-03-14 10:54:13,333 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-03-14 10:54:13,333 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-03-14 10:54:13,333 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-03-14 10:54:13,333 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-03-14 10:54:13,333 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-03-14 10:54:13,333 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-03-14 10:54:13,333 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-03-14 10:54:13,333 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-03-14 10:54:13,333 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-03-14 10:54:13,333 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-03-14 10:54:13,333 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-03-14 10:54:13,334 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-03-14 10:54:13,334 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-03-14 10:54:13,334 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-03-14 10:54:13,334 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-03-14 10:54:13,334 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-03-14 10:54:13,334 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-03-14 10:54:13,500 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.04110094817811132, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.05492163583737059, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.04110094817811132, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.17266666666666666, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.24333333333333335, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-03-14 10:54:13,500 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-03-14 10:54:13,500 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.17779963291405038, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.04110094817811132, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.05492163583737059, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.04110094817811132, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.17266666666666666, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.24333333333333335, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-03-14 10:54:13,842 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 489 ms to try 5000 different iterations.  Found a solution that moves 2700 regions; Going from a computed imbalance of 0.17779963291405038 to a new imbalance of 0.01676118606649021. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.020252182391840467); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.031028027589130272, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.3, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.020252182391840467); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.013583333333333333); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0475, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-03-14 10:54:13,854 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv917959497:74 , srv97907542:77 , srv1706660461:80 , srv2145413706:80 , srv893314162:80 , srv502645765:81 , srv663812171:81 , srv1284930075:82 , srv1685756055:82 , srv2122328884:82 , srv1106340404:83 , srv1589615595:83 , srv1843739102:83 , srv1921448627:83 , srv2108682675:83 , srv442584438:83 , srv467672367:83 , srv578743681:83 , srv699962931:83 , srv1073945288:84 , srv1119254566:84 , srv1137104869:84 , srv1279185194:84 , srv1479017688:84 , srv174645388:84 , srv1923326296:84 , srv1993625371:84 , srv201312554:84 , srv243916860:84 , srv634164773:84 , srv637064145:84 , srv798022548:84 , srv1068160345:85 , srv1137201339:85 , srv1337894365:85 , srv1755834642:85 , srv1782621234:85 , srv1952868670:85 , srv223529112:85 , srv319411246:85 , srv596264966:85 , srv63497679:85 , srv793586178:85 , srv966291281:85 , srv1075658825:86 , srv1179722:86 , srv2041280712:86 , srv2068575734:86 , srv225916046:86 , srv241455882:86 , srv333278005:86 , srv544496211:86 , srv800168473:86 , srv1171275851:87 , srv1472824181:87 , srv155219462:87 , srv1614228885:87 , srv179721298:87 , srv2127549006:87 , srv406750484:87 , srv510885747:87 , srv881654515:87 , srv889818969:87 , srv970029027:87 , srv993905237:87 , srv1099524764:88 , srv1298305094:88 , srv1406280477:88 , srv1565557451:88 , srv1820319437:88 , srv2024745184:88 , srv2067747449:88 , srv2082543648:88 , srv2098124122:88 , srv2100945855:88 , srv246568577:88 , srv311099705:88 , srv339511883:88 , srv633688529:88 , srv761979308:88 , srv784505595:88 , srv983178121:88 , srv1680370936:89 , srv1986689046:89 , srv2060786675:89 , srv21369969:89 , srv474679264:89 , srv543265997:89 , srv747965936:89 , srv928771770:89 , srv1111807846:90 , srv1265340631:90 , srv1378746372:90 , srv1628850051:90 , srv1639538198:90 , srv421308939:90 , srv1095411700:92 , srv995731989:92 , srv2106471997:93 , srv222385357:499 }
2023-03-14 10:54:13,858 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-03-14 10:54:13,859 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1993625371=40, srv222385357=56, srv596264966=76, srv889818969=90, srv995731989=99, srv881654515=89, srv510885747=72, srv578743681=75, srv800168473=88, srv421308939=67, srv1298305094=15, srv2082543648=47, srv311099705=62, srv1755834642=31, srv2068575734=46, srv1279185194=13, srv201312554=41, srv2024745184=42, srv1472824181=19, srv2106471997=50, srv2122328884=52, srv179721298=33, srv634164773=78, srv2041280712=43, srv1706660461=29, srv663812171=81, srv928771770=93, srv1075658825=2, srv1843739102=35, srv893314162=91, srv1820319437=34, srv544496211=74, srv2145413706=55, srv983178121=97, srv225916046=58, srv699962931=82, srv793586178=86, srv1265340631=12, srv333278005=64, srv761979308=84, srv1952868670=38, srv246568577=61, srv339511883=65, srv798022548=87, srv637064145=80, srv1119254566=7, srv467672367=69, srv1589615595=23, srv1565557451=22, srv1106340404=5, srv406750484=66, srv1179722=11, srv1337894365=16, srv1095411700=3, srv1782621234=32, srv1378746372=17, srv1111807846=6, srv155219462=21, srv97907542=96, srv1406280477=18, srv1680370936=27, srv784505595=85, srv1614228885=24, srv1073945288=1, srv1137104869=8, srv1171275851=10, srv442584438=68, srv21369969=54, srv2067747449=45, srv319411246=63, srv63497679=79, srv993905237=98, srv1986689046=39, srv1284930075=14, srv633688529=77, srv747965936=83, srv474679264=70, srv917959497=92, srv502645765=71, srv543265997=73, srv174645388=30, srv1921448627=36, srv1068160345=0, srv970029027=95, srv2108682675=51, srv2127549006=53, srv966291281=94, srv241455882=59, srv1639538198=26, srv1099524764=4, srv2100945855=49, srv243916860=60, srv1137201339=9, srv2060786675=44, srv1479017688=20, srv1628850051=25, srv223529112=57, srv2098124122=48, srv1685756055=28, srv1923326296=37} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-03-14 10:54:13,873 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-03-14 10:54:13,873 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-03-14 10:54:13,873 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-03-14 10:54:13,873 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-03-14 10:54:13,873 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-03-14 10:54:13,873 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-03-14 10:54:13,873 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-03-14 10:54:13,873 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-03-14 10:54:13,873 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-03-14 10:54:13,874 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-03-14 10:54:13,874 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-03-14 10:54:13,874 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-03-14 10:54:13,874 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-03-14 10:54:13,874 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-03-14 10:54:13,874 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-03-14 10:54:13,874 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-03-14 10:54:13,874 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-03-14 10:54:13,874 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-03-14 10:54:13,874 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-03-14 10:54:13,874 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-03-14 10:54:13,874 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-03-14 10:54:13,875 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-03-14 10:54:13,875 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-03-14 10:54:13,875 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-03-14 10:54:13,875 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-03-14 10:54:13,875 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-03-14 10:54:13,875 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-03-14 10:54:13,875 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-03-14 10:54:13,875 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-03-14 10:54:13,875 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-03-14 10:54:13,875 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-03-14 10:54:13,875 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-03-14 10:54:13,876 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-03-14 10:54:13,876 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-03-14 10:54:13,876 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-03-14 10:54:13,876 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-03-14 10:54:13,876 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-03-14 10:54:13,876 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-03-14 10:54:13,876 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-03-14 10:54:13,876 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-03-14 10:54:13,876 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-03-14 10:54:13,876 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-03-14 10:54:13,876 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-03-14 10:54:13,877 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-03-14 10:54:13,877 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-03-14 10:54:13,877 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-03-14 10:54:13,877 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-03-14 10:54:13,877 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-03-14 10:54:13,877 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-03-14 10:54:13,877 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-03-14 10:54:13,877 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-03-14 10:54:13,877 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-03-14 10:54:13,877 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-03-14 10:54:13,877 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-03-14 10:54:13,877 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-03-14 10:54:13,877 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-03-14 10:54:13,877 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-03-14 10:54:13,877 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-03-14 10:54:13,878 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-03-14 10:54:13,878 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-03-14 10:54:13,878 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-03-14 10:54:13,878 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-03-14 10:54:13,878 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-03-14 10:54:13,878 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-03-14 10:54:13,878 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-03-14 10:54:13,878 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-03-14 10:54:13,878 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-03-14 10:54:13,878 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-03-14 10:54:13,878 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-03-14 10:54:13,878 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-03-14 10:54:13,878 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-03-14 10:54:13,878 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-03-14 10:54:13,878 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-03-14 10:54:13,878 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-03-14 10:54:13,879 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-03-14 10:54:13,879 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-03-14 10:54:13,879 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-03-14 10:54:13,879 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-03-14 10:54:13,879 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-03-14 10:54:13,879 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-03-14 10:54:13,879 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-03-14 10:54:13,879 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-03-14 10:54:13,879 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-03-14 10:54:13,879 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-03-14 10:54:13,879 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-03-14 10:54:13,879 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-03-14 10:54:13,879 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-03-14 10:54:13,879 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-03-14 10:54:13,879 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-03-14 10:54:13,879 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-03-14 10:54:13,879 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-03-14 10:54:13,880 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-03-14 10:54:13,880 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-03-14 10:54:13,880 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-03-14 10:54:13,880 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-03-14 10:54:13,880 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-03-14 10:54:13,880 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-03-14 10:54:13,880 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-03-14 10:54:13,880 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-03-14 10:54:13,880 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-03-14 10:54:13,880 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-03-14 10:54:14,018 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.020252182391840467); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.031028027589130272, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.020252182391840467); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.013583333333333333); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0475, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-03-14 10:54:14,018 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-03-14 10:54:14,018 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.016742280262408357, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.020252182391840467); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.031028027589130272, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.020252182391840467); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.013583333333333333); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0475, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-03-14 10:54:14,290 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 400 ms to try 5000 different iterations.  Found a solution that moves 1007 regions; Going from a computed imbalance of 0.016742280262408357 to a new imbalance of 7.160591422320478E-4. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.005892159691374372); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.007871014035869962); MoveCostFunction : (multiplier=7.0, imbalance=0.11188888888888888, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.005892159691374372); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=4.166666666666667E-4); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.003); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-03-14 10:54:14,293 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1137201339:82 , srv1472824181:82 , srv2060786675:82 , srv761979308:82 , srv1095411700:83 , srv1265340631:83 , srv2106471997:83 , srv333278005:83 , srv339511883:83 , srv543265997:83 , srv793586178:83 , srv893314162:83 , srv1171275851:84 , srv1298305094:84 , srv1378746372:84 , srv1614228885:84 , srv1628850051:84 , srv1921448627:84 , srv1993625371:84 , srv2024745184:84 , srv2082543648:84 , srv2098124122:84 , srv467672367:84 , srv474679264:84 , srv578743681:84 , srv881654515:84 , srv970029027:84 , srv1073945288:85 , srv1179722:85 , srv1479017688:85 , srv1639538198:85 , srv1680370936:85 , srv1755834642:85 , srv179721298:85 , srv1843739102:85 , srv1923326296:85 , srv1986689046:85 , srv2122328884:85 , srv223529112:85 , srv225916046:85 , srv243916860:85 , srv246568577:85 , srv319411246:85 , srv421308939:85 , srv442584438:85 , srv510885747:85 , srv544496211:85 , srv596264966:85 , srv63497679:85 , srv637064145:85 , srv663812171:85 , srv889818969:85 , srv917959497:85 , srv966291281:85 , srv97907542:85 , srv983178121:85 , srv995731989:85 , srv1075658825:86 , srv1099524764:86 , srv1111807846:86 , srv1565557451:86 , srv1685756055:86 , srv1820319437:86 , srv1952868670:86 , srv201312554:86 , srv2041280712:86 , srv2108682675:86 , srv21369969:86 , srv2145413706:86 , srv241455882:86 , srv311099705:86 , srv634164773:86 , srv747965936:86 , srv784505595:86 , srv798022548:86 , srv928771770:86 , srv993905237:86 , srv1068160345:87 , srv1106340404:87 , srv1119254566:87 , srv1137104869:87 , srv1284930075:87 , srv1337894365:87 , srv155219462:87 , srv1589615595:87 , srv1706660461:87 , srv174645388:87 , srv1782621234:87 , srv2067747449:87 , srv2100945855:87 , srv406750484:87 , srv800168473:87 , srv1279185194:88 , srv2068575734:88 , srv2127549006:88 , srv502645765:88 , srv633688529:88 , srv699962931:88 , srv1406280477:89 , srv222385357:556 }
2023-03-14 10:54:14,296 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-03-14 10:54:14,297 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1993625371=40, srv222385357=56, srv596264966=76, srv889818969=90, srv995731989=99, srv881654515=89, srv510885747=72, srv578743681=75, srv800168473=88, srv421308939=67, srv1298305094=15, srv2082543648=47, srv311099705=62, srv1755834642=31, srv2068575734=46, srv1279185194=13, srv201312554=41, srv2024745184=42, srv1472824181=19, srv2106471997=50, srv2122328884=52, srv179721298=33, srv634164773=78, srv2041280712=43, srv1706660461=29, srv663812171=81, srv928771770=93, srv1075658825=2, srv1843739102=35, srv893314162=91, srv1820319437=34, srv544496211=74, srv2145413706=55, srv983178121=97, srv225916046=58, srv699962931=82, srv793586178=86, srv1265340631=12, srv333278005=64, srv761979308=84, srv1952868670=38, srv246568577=61, srv339511883=65, srv798022548=87, srv637064145=80, srv1119254566=7, srv467672367=69, srv1589615595=23, srv1565557451=22, srv1106340404=5, srv406750484=66, srv1179722=11, srv1337894365=16, srv1095411700=3, srv1782621234=32, srv1378746372=17, srv1111807846=6, srv155219462=21, srv97907542=96, srv1406280477=18, srv1680370936=27, srv784505595=85, srv1614228885=24, srv1073945288=1, srv1137104869=8, srv1171275851=10, srv442584438=68, srv21369969=54, srv2067747449=45, srv319411246=63, srv63497679=79, srv993905237=98, srv1986689046=39, srv1284930075=14, srv633688529=77, srv747965936=83, srv474679264=70, srv917959497=92, srv502645765=71, srv543265997=73, srv174645388=30, srv1921448627=36, srv1068160345=0, srv970029027=95, srv2108682675=51, srv2127549006=53, srv966291281=94, srv241455882=59, srv1639538198=26, srv1099524764=4, srv2100945855=49, srv243916860=60, srv1137201339=9, srv2060786675=44, srv1479017688=20, srv1628850051=25, srv223529112=57, srv2098124122=48, srv1685756055=28, srv1923326296=37} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-03-14 10:54:14,316 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-03-14 10:54:14,316 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-03-14 10:54:14,316 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-03-14 10:54:14,316 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-03-14 10:54:14,316 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-03-14 10:54:14,316 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-03-14 10:54:14,316 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-03-14 10:54:14,316 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-03-14 10:54:14,316 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-03-14 10:54:14,316 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-03-14 10:54:14,316 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-03-14 10:54:14,316 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-03-14 10:54:14,316 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-03-14 10:54:14,317 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-03-14 10:54:14,317 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-03-14 10:54:14,317 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-03-14 10:54:14,317 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-03-14 10:54:14,317 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-03-14 10:54:14,317 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-03-14 10:54:14,317 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-03-14 10:54:14,317 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-03-14 10:54:14,317 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-03-14 10:54:14,317 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-03-14 10:54:14,317 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-03-14 10:54:14,317 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-03-14 10:54:14,317 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-03-14 10:54:14,317 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-03-14 10:54:14,317 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-03-14 10:54:14,318 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-03-14 10:54:14,318 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-03-14 10:54:14,318 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-03-14 10:54:14,318 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-03-14 10:54:14,318 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-03-14 10:54:14,318 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-03-14 10:54:14,318 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-03-14 10:54:14,318 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-03-14 10:54:14,318 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-03-14 10:54:14,318 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-03-14 10:54:14,318 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-03-14 10:54:14,318 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-03-14 10:54:14,318 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-03-14 10:54:14,318 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-03-14 10:54:14,318 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-03-14 10:54:14,318 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-03-14 10:54:14,319 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-03-14 10:54:14,319 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-03-14 10:54:14,319 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-03-14 10:54:14,319 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-03-14 10:54:14,319 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-03-14 10:54:14,319 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-03-14 10:54:14,319 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-03-14 10:54:14,319 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-03-14 10:54:14,319 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-03-14 10:54:14,319 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-03-14 10:54:14,319 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-03-14 10:54:14,319 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-03-14 10:54:14,319 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-03-14 10:54:14,319 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-03-14 10:54:14,319 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-03-14 10:54:14,320 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-03-14 10:54:14,320 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-03-14 10:54:14,320 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-03-14 10:54:14,320 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-03-14 10:54:14,320 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-03-14 10:54:14,320 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-03-14 10:54:14,320 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-03-14 10:54:14,320 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-03-14 10:54:14,320 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-03-14 10:54:14,320 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-03-14 10:54:14,320 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-03-14 10:54:14,320 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-03-14 10:54:14,321 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-03-14 10:54:14,321 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-03-14 10:54:14,321 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-03-14 10:54:14,321 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-03-14 10:54:14,321 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-03-14 10:54:14,321 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-03-14 10:54:14,321 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-03-14 10:54:14,321 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-03-14 10:54:14,321 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-03-14 10:54:14,321 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-03-14 10:54:14,321 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-03-14 10:54:14,321 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-03-14 10:54:14,322 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-03-14 10:54:14,322 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-03-14 10:54:14,322 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-03-14 10:54:14,322 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-03-14 10:54:14,322 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-03-14 10:54:14,322 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-03-14 10:54:14,322 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-03-14 10:54:14,322 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-03-14 10:54:14,322 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-03-14 10:54:14,322 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-03-14 10:54:14,322 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-03-14 10:54:14,322 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-03-14 10:54:14,322 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-03-14 10:54:14,322 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-03-14 10:54:14,322 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-03-14 10:54:14,322 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-03-14 10:54:14,322 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-03-14 10:54:14,323 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-03-14 10:54:14,452 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.005892159691374372); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.007871014035869962); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.005892159691374372); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=4.166666666666667E-4); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.003); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-03-14 10:54:14,453 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-03-14 10:54:14,453 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=7.090079775244825E-4, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.005892159691374372); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.007871014035869962); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.005892159691374372); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=4.166666666666667E-4); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.003); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-03-14 10:54:14,732 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 396 ms to try 5000 different iterations.  Found a solution that moves 211 regions; Going from a computed imbalance of 7.090079775244825E-4 to a new imbalance of 1.2951401907057385E-5. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=3.5313429231318235E-4); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0021711298242630987); MoveCostFunction : (multiplier=7.0, imbalance=0.023444444444444445); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=3.5313429231318235E-4); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-03-14 10:54:14,733 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1406280477:82 , srv2067747449:83 , srv2127549006:83 , srv502645765:83 , srv633688529:83 , srv63497679:83 , srv699962931:83 , srv1068160345:84 , srv1073945288:84 , srv1075658825:84 , srv1099524764:84 , srv1106340404:84 , srv1137104869:84 , srv1265340631:84 , srv1279185194:84 , srv1284930075:84 , srv1298305094:84 , srv1479017688:84 , srv1589615595:84 , srv1685756055:84 , srv1706660461:84 , srv174645388:84 , srv179721298:84 , srv1820319437:84 , srv1921448627:84 , srv201312554:84 , srv2068575734:84 , srv2098124122:84 , srv2100945855:84 , srv2106471997:84 , srv21369969:84 , srv2145413706:84 , srv225916046:84 , srv246568577:84 , srv467672367:84 , srv543265997:84 , srv544496211:84 , srv596264966:84 , srv747965936:84 , srv784505595:84 , srv881654515:84 , srv889818969:84 , srv928771770:84 , srv983178121:84 , srv995731989:84 , srv1095411700:85 , srv1111807846:85 , srv1119254566:85 , srv1137201339:85 , srv1171275851:85 , srv1179722:85 , srv1337894365:85 , srv1378746372:85 , srv1472824181:85 , srv155219462:85 , srv1565557451:85 , srv1614228885:85 , srv1628850051:85 , srv1639538198:85 , srv1680370936:85 , srv1755834642:85 , srv1782621234:85 , srv1843739102:85 , srv1923326296:85 , srv1952868670:85 , srv1986689046:85 , srv1993625371:85 , srv2041280712:85 , srv2082543648:85 , srv2108682675:85 , srv2122328884:85 , srv223529112:85 , srv241455882:85 , srv243916860:85 , srv311099705:85 , srv319411246:85 , srv339511883:85 , srv406750484:85 , srv442584438:85 , srv474679264:85 , srv510885747:85 , srv634164773:85 , srv637064145:85 , srv663812171:85 , srv761979308:85 , srv798022548:85 , srv800168473:85 , srv893314162:85 , srv917959497:85 , srv966291281:85 , srv970029027:85 , srv97907542:85 , srv993905237:85 , srv2024745184:86 , srv2060786675:86 , srv333278005:86 , srv421308939:86 , srv578743681:86 , srv793586178:86 , srv222385357:632 }
2023-03-14 10:54:14,736 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-03-14 10:54:14,737 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1993625371=40, srv222385357=56, srv596264966=76, srv889818969=90, srv995731989=99, srv881654515=89, srv510885747=72, srv578743681=75, srv800168473=88, srv421308939=67, srv1298305094=15, srv2082543648=47, srv311099705=62, srv1755834642=31, srv2068575734=46, srv1279185194=13, srv201312554=41, srv2024745184=42, srv1472824181=19, srv2106471997=50, srv2122328884=52, srv179721298=33, srv634164773=78, srv2041280712=43, srv1706660461=29, srv663812171=81, srv928771770=93, srv1075658825=2, srv1843739102=35, srv893314162=91, srv1820319437=34, srv544496211=74, srv2145413706=55, srv983178121=97, srv225916046=58, srv699962931=82, srv793586178=86, srv1265340631=12, srv333278005=64, srv761979308=84, srv1952868670=38, srv246568577=61, srv339511883=65, srv798022548=87, srv637064145=80, srv1119254566=7, srv467672367=69, srv1589615595=23, srv1565557451=22, srv1106340404=5, srv406750484=66, srv1179722=11, srv1337894365=16, srv1095411700=3, srv1782621234=32, srv1378746372=17, srv1111807846=6, srv155219462=21, srv97907542=96, srv1406280477=18, srv1680370936=27, srv784505595=85, srv1614228885=24, srv1073945288=1, srv1137104869=8, srv1171275851=10, srv442584438=68, srv21369969=54, srv2067747449=45, srv319411246=63, srv63497679=79, srv993905237=98, srv1986689046=39, srv1284930075=14, srv633688529=77, srv747965936=83, srv474679264=70, srv917959497=92, srv502645765=71, srv543265997=73, srv174645388=30, srv1921448627=36, srv1068160345=0, srv970029027=95, srv2108682675=51, srv2127549006=53, srv966291281=94, srv241455882=59, srv1639538198=26, srv1099524764=4, srv2100945855=49, srv243916860=60, srv1137201339=9, srv2060786675=44, srv1479017688=20, srv1628850051=25, srv223529112=57, srv2098124122=48, srv1685756055=28, srv1923326296=37} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-03-14 10:54:14,748 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-03-14 10:54:14,748 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-03-14 10:54:14,748 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-03-14 10:54:14,748 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-03-14 10:54:14,748 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-03-14 10:54:14,748 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-03-14 10:54:14,748 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-03-14 10:54:14,748 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-03-14 10:54:14,748 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-03-14 10:54:14,748 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-03-14 10:54:14,748 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-03-14 10:54:14,748 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-03-14 10:54:14,749 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-03-14 10:54:14,749 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-03-14 10:54:14,749 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-03-14 10:54:14,749 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-03-14 10:54:14,749 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-03-14 10:54:14,749 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-03-14 10:54:14,749 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-03-14 10:54:14,749 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-03-14 10:54:14,749 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-03-14 10:54:14,749 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-03-14 10:54:14,749 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-03-14 10:54:14,749 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-03-14 10:54:14,749 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-03-14 10:54:14,749 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-03-14 10:54:14,749 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-03-14 10:54:14,749 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-03-14 10:54:14,749 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-03-14 10:54:14,749 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-03-14 10:54:14,749 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-03-14 10:54:14,749 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-03-14 10:54:14,750 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-03-14 10:54:14,750 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-03-14 10:54:14,750 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-03-14 10:54:14,750 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-03-14 10:54:14,750 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-03-14 10:54:14,750 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-03-14 10:54:14,750 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-03-14 10:54:14,750 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-03-14 10:54:14,750 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-03-14 10:54:14,750 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-03-14 10:54:14,750 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-03-14 10:54:14,750 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-03-14 10:54:14,750 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-03-14 10:54:14,750 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-03-14 10:54:14,750 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-03-14 10:54:14,750 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-03-14 10:54:14,750 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-03-14 10:54:14,750 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-03-14 10:54:14,750 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-03-14 10:54:14,751 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-03-14 10:54:14,751 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-03-14 10:54:14,751 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-03-14 10:54:14,751 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-03-14 10:54:14,751 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-03-14 10:54:14,751 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-03-14 10:54:14,751 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-03-14 10:54:14,751 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-03-14 10:54:14,751 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-03-14 10:54:14,751 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-03-14 10:54:14,751 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-03-14 10:54:14,752 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-03-14 10:54:14,752 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-03-14 10:54:14,752 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-03-14 10:54:14,752 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-03-14 10:54:14,752 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-03-14 10:54:14,752 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-03-14 10:54:14,752 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-03-14 10:54:14,752 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-03-14 10:54:14,753 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-03-14 10:54:14,753 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-03-14 10:54:14,753 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-03-14 10:54:14,753 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-03-14 10:54:14,753 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-03-14 10:54:14,753 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-03-14 10:54:14,753 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-03-14 10:54:14,753 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-03-14 10:54:14,753 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-03-14 10:54:14,754 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-03-14 10:54:14,754 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-03-14 10:54:14,754 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-03-14 10:54:14,754 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-03-14 10:54:14,754 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-03-14 10:54:14,754 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-03-14 10:54:14,754 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-03-14 10:54:14,754 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-03-14 10:54:14,754 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-03-14 10:54:14,754 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-03-14 10:54:14,754 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-03-14 10:54:14,755 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-03-14 10:54:14,755 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-03-14 10:54:14,755 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-03-14 10:54:14,755 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-03-14 10:54:14,755 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-03-14 10:54:14,755 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-03-14 10:54:14,755 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-03-14 10:54:14,755 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-03-14 10:54:14,755 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-03-14 10:54:14,755 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-03-14 10:54:14,755 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-03-14 10:54:14,861 INFO  [Time-limited test] balancer.StochasticLoadBalancer(381): Cluster wide - skipping load balancing because weighted average imbalance=1.1473948328808863E-5 <= threshold(0.025). If you want more aggressive balancing, either lower hbase.master.balancer.stochastic.minCostNeedBalance from 0.025 or increase the relative multiplier(s) of the specific cost function(s). functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=3.5313429231318235E-4); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0021711298242630987); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=3.5313429231318235E-4); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-03-14 10:54:14,861 INFO  [Time-limited test] balancer.BalancerTestBase(570): Mock Final balance: { srv1406280477:82 , srv2067747449:83 , srv2127549006:83 , srv502645765:83 , srv633688529:83 , srv63497679:83 , srv699962931:83 , srv1068160345:84 , srv1073945288:84 , srv1075658825:84 , srv1099524764:84 , srv1106340404:84 , srv1137104869:84 , srv1265340631:84 , srv1279185194:84 , srv1284930075:84 , srv1298305094:84 , srv1479017688:84 , srv1589615595:84 , srv1685756055:84 , srv1706660461:84 , srv174645388:84 , srv179721298:84 , srv1820319437:84 , srv1921448627:84 , srv201312554:84 , srv2068575734:84 , srv2098124122:84 , srv2100945855:84 , srv2106471997:84 , srv21369969:84 , srv2145413706:84 , srv225916046:84 , srv246568577:84 , srv467672367:84 , srv543265997:84 , srv544496211:84 , srv596264966:84 , srv747965936:84 , srv784505595:84 , srv881654515:84 , srv889818969:84 , srv928771770:84 , srv983178121:84 , srv995731989:84 , srv1095411700:85 , srv1111807846:85 , srv1119254566:85 , srv1137201339:85 , srv1171275851:85 , srv1179722:85 , srv1337894365:85 , srv1378746372:85 , srv1472824181:85 , srv155219462:85 , srv1565557451:85 , srv1614228885:85 , srv1628850051:85 , srv1639538198:85 , srv1680370936:85 , srv1755834642:85 , srv1782621234:85 , srv1843739102:85 , srv1923326296:85 , srv1952868670:85 , srv1986689046:85 , srv1993625371:85 , srv2041280712:85 , srv2082543648:85 , srv2108682675:85 , srv2122328884:85 , srv223529112:85 , srv241455882:85 , srv243916860:85 , srv311099705:85 , srv319411246:85 , srv339511883:85 , srv406750484:85 , srv442584438:85 , srv474679264:85 , srv510885747:85 , srv634164773:85 , srv637064145:85 , srv663812171:85 , srv761979308:85 , srv798022548:85 , srv800168473:85 , srv893314162:85 , srv917959497:85 , srv966291281:85 , srv970029027:85 , srv97907542:85 , srv993905237:85 , srv2024745184:86 , srv2060786675:86 , srv333278005:86 , srv421308939:86 , srv578743681:86 , srv793586178:86 , srv222385357:632 }
2023-03-14 10:54:14,885 INFO  [Time-limited test] hbase.ResourceChecker(175): after: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnLargeClusterWithRacks Thread=10 (was 10), OpenFileDescriptor=260 (was 260), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=288 (was 270) - SystemLoadAverage LEAK? -, ProcessCount=169 (was 169), AvailableMemoryMB=2920 (was 3414)
2023-03-14 10:54:14,892 INFO  [Time-limited test] hbase.ResourceChecker(147): before: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnMidClusterWithRacks Thread=10, OpenFileDescriptor=260, MaxFileDescriptor=60000, SystemLoadAverage=288, ProcessCount=169, AvailableMemoryMB=2920
2023-03-14 10:54:14,893 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2023-03-14 10:54:14,893 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=5000, runMaxSteps=true, stepsPerRegion=800, maxRunningTime=120000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 111077.0 etc.
2023-03-14 10:54:14,903 INFO  [Time-limited test] balancer.BalancerTestBase(547): Mock Cluster : { srv1060988806:84 , srv1071782498:84 , srv117522748:84 , srv1216197253:84 , srv1231994030:84 , srv1234527626:84 , srv1261569150:84 , srv1297526094:84 , srv1316055511:84 , srv1379644459:84 , srv1389695832:84 , srv1393703664:84 , srv1427452370:84 , srv1427506879:84 , srv1439468500:84 , srv1586811897:84 , srv158888448:84 , srv1592460484:84 , srv1728439201:84 , srv1892220224:84 , srv1954605125:84 , srv218785723:84 , srv317210288:84 , srv577607098:84 , srv607526966:84 , srv641267485:84 , srv77385140:84 , srv832396865:84 , srv886016344:84 , srv93405405:264 } [srvr=30 rgns=2700 avg=90.0 max=90 min=90]
2023-03-14 10:54:14,905 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-03-14 10:54:14,905 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1234527626=5, srv1261569150=6, srv93405405=29, srv1393703664=11, srv1071782498=1, srv1216197253=3, srv1379644459=9, srv317210288=22, srv1586811897=15, srv1231994030=4, srv577607098=23, srv1060988806=0, srv117522748=2, srv1892220224=19, srv1297526094=7, srv641267485=25, srv77385140=26, srv1728439201=18, srv218785723=21, srv886016344=28, srv1954605125=20, srv1389695832=10, srv1427506879=13, srv832396865=27, srv1316055511=8, srv607526966=24, srv158888448=16, srv1592460484=17, srv1439468500=14, srv1427452370=12} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-03-14 10:54:14,915 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-03-14 10:54:14,915 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-03-14 10:54:14,915 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-03-14 10:54:14,915 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-03-14 10:54:14,915 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-03-14 10:54:14,915 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-03-14 10:54:14,915 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-03-14 10:54:14,915 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-03-14 10:54:14,915 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-03-14 10:54:14,915 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-03-14 10:54:14,915 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-03-14 10:54:14,915 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-03-14 10:54:14,915 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-03-14 10:54:14,915 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-03-14 10:54:14,915 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-03-14 10:54:14,916 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-03-14 10:54:14,916 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-03-14 10:54:14,916 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-03-14 10:54:14,916 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-03-14 10:54:14,916 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-03-14 10:54:14,916 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-03-14 10:54:14,916 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-03-14 10:54:14,916 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-03-14 10:54:14,916 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-03-14 10:54:14,916 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-03-14 10:54:14,916 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-03-14 10:54:14,916 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-03-14 10:54:14,917 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-03-14 10:54:14,917 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-03-14 10:54:14,917 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-03-14 10:54:14,917 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=10, number of hosts=30, number of racks=4
2023-03-14 10:54:14,933 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=1.1427191746498182, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-03-14 10:54:14,934 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.9912642746723391, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=1.1427191746498182, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=64800000
2023-03-14 10:56:14,920 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 120001 ms to try 6700456 different iterations.  Found a solution that moves 1858 regions; Going from a computed imbalance of 0.9912642746723391 to a new imbalance of 4.336664689392977E-5. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); MoveCostFunction : (multiplier=7.0, imbalance=0.6881481481481482, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-03-14 10:56:14,927 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1060988806:90 , srv1071782498:90 , srv117522748:90 , srv1216197253:90 , srv1231994030:90 , srv1234527626:90 , srv1261569150:90 , srv1297526094:90 , srv1316055511:90 , srv1379644459:90 , srv1389695832:90 , srv1393703664:90 , srv1427452370:90 , srv1427506879:90 , srv1439468500:90 , srv1586811897:90 , srv158888448:90 , srv1592460484:90 , srv1728439201:90 , srv1892220224:90 , srv1954605125:90 , srv218785723:90 , srv317210288:90 , srv577607098:90 , srv607526966:90 , srv641267485:90 , srv77385140:90 , srv832396865:90 , srv886016344:90 , srv93405405:90 }
2023-03-14 10:56:14,928 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-03-14 10:56:14,929 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1234527626=5, srv1261569150=6, srv93405405=29, srv1393703664=11, srv1071782498=1, srv1216197253=3, srv1379644459=9, srv317210288=22, srv1586811897=15, srv1231994030=4, srv577607098=23, srv1060988806=0, srv117522748=2, srv1892220224=19, srv1297526094=7, srv641267485=25, srv77385140=26, srv1728439201=18, srv218785723=21, srv886016344=28, srv1954605125=20, srv1389695832=10, srv1427506879=13, srv832396865=27, srv1316055511=8, srv607526966=24, srv158888448=16, srv1592460484=17, srv1439468500=14, srv1427452370=12} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-03-14 10:56:14,932 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-03-14 10:56:14,932 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-03-14 10:56:14,932 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-03-14 10:56:14,932 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-03-14 10:56:14,932 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-03-14 10:56:14,932 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-03-14 10:56:14,932 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-03-14 10:56:14,932 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-03-14 10:56:14,932 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-03-14 10:56:14,932 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-03-14 10:56:14,932 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-03-14 10:56:14,932 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-03-14 10:56:14,932 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-03-14 10:56:14,933 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-03-14 10:56:14,933 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-03-14 10:56:14,933 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-03-14 10:56:14,933 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-03-14 10:56:14,933 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-03-14 10:56:14,933 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-03-14 10:56:14,933 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-03-14 10:56:14,933 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-03-14 10:56:14,933 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-03-14 10:56:14,933 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-03-14 10:56:14,933 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-03-14 10:56:14,933 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-03-14 10:56:14,933 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-03-14 10:56:14,933 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-03-14 10:56:14,933 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-03-14 10:56:14,933 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-03-14 10:56:14,933 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-03-14 10:56:14,933 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=10, number of hosts=30, number of racks=4
2023-03-14 10:56:14,945 INFO  [Time-limited test] balancer.StochasticLoadBalancer(381): Cluster wide - skipping load balancing because weighted average imbalance=0.0 <= threshold(0.025). If you want more aggressive balancing, either lower hbase.master.balancer.stochastic.minCostNeedBalance from 0.025 or increase the relative multiplier(s) of the specific cost function(s). functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-03-14 10:56:14,945 INFO  [Time-limited test] balancer.BalancerTestBase(570): Mock Final balance: { srv1060988806:90 , srv1071782498:90 , srv117522748:90 , srv1216197253:90 , srv1231994030:90 , srv1234527626:90 , srv1261569150:90 , srv1297526094:90 , srv1316055511:90 , srv1379644459:90 , srv1389695832:90 , srv1393703664:90 , srv1427452370:90 , srv1427506879:90 , srv1439468500:90 , srv1586811897:90 , srv158888448:90 , srv1592460484:90 , srv1728439201:90 , srv1892220224:90 , srv1954605125:90 , srv218785723:90 , srv317210288:90 , srv577607098:90 , srv607526966:90 , srv641267485:90 , srv77385140:90 , srv832396865:90 , srv886016344:90 , srv93405405:90 }
2023-03-14 10:56:14,959 INFO  [Time-limited test] hbase.ResourceChecker(175): after: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnMidClusterWithRacks Thread=9 (was 10), OpenFileDescriptor=260 (was 260), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=152 (was 288), ProcessCount=169 (was 169), AvailableMemoryMB=2660 (was 2920)