2023-03-24 01:56:00,740 INFO  [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks timeout: 13 mins
2023-03-24 01:56:01,149 WARN  [Time-limited test] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties
2023-03-24 01:56:01,280 INFO  [Time-limited test] metrics.MetricRegistriesLoader(60): Loaded MetricRegistries class org.apache.hadoop.hbase.metrics.impl.MetricRegistriesImpl
2023-03-24 01:56:01,352 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2023-03-24 01:56:01,359 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc.
2023-03-24 01:56:01,373 INFO  [Time-limited test] hbase.ResourceChecker(147): before: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnLargeClusterWithRacks Thread=10, OpenFileDescriptor=260, MaxFileDescriptor=60000, SystemLoadAverage=347, ProcessCount=171, AvailableMemoryMB=6271
2023-03-24 01:56:01,376 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2023-03-24 01:56:01,376 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=5000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=10000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc.
2023-03-24 01:56:01,542 INFO  [Time-limited test] balancer.BalancerTestBase(547): Mock Cluster : { srv1002364565:84 , srv100449195:84 , srv1011532166:84 , srv1027809560:84 , srv1057041089:84 , srv1077145439:84 , srv1117248154:84 , srv113495022:84 , srv1139808780:84 , srv1166369819:84 , srv1180796989:84 , srv11846504:84 , srv1205671301:84 , srv1289409491:84 , srv1330941275:84 , srv1336629549:84 , srv1404090430:84 , srv1415558921:84 , srv1458017895:84 , srv1470389337:84 , srv1484314526:84 , srv1491881437:84 , srv1496679405:84 , srv1519178771:84 , srv1521927418:84 , srv1530436236:84 , srv1564262781:84 , srv1589300162:84 , srv1595310618:84 , srv1634032826:84 , srv1673349371:84 , srv1700242522:84 , srv1700390242:84 , srv1811626719:84 , srv1849827555:84 , srv1902335275:84 , srv1909899463:84 , srv1939039208:84 , srv1952178989:84 , srv1955946910:84 , srv1970174502:84 , srv2006389749:84 , srv201640073:84 , srv2019773664:84 , srv2023038965:84 , srv2027239993:84 , srv2030604300:84 , srv2046444446:84 , srv2082984587:84 , srv2104984034:84 , srv234717137:84 , srv235022803:84 , srv245283602:84 , srv266671136:84 , srv27618143:84 , srv287499454:84 , srv290487896:84 , srv297735545:84 , srv317572534:84 , srv342959852:84 , srv349378500:84 , srv395355019:84 , srv40409004:84 , srv408641643:84 , srv413369364:84 , srv418939823:84 , srv4473083:84 , srv486177393:84 , srv490536927:84 , srv497830396:84 , srv516726578:84 , srv518361821:84 , srv526275256:84 , srv543555669:84 , srv57651786:84 , srv624310447:84 , srv647139112:84 , srv675612271:84 , srv687478532:84 , srv702776400:84 , srv739577125:84 , srv744393005:84 , srv773779916:84 , srv774309829:84 , srv784345119:84 , srv798864131:84 , srv799370367:84 , srv799683856:84 , srv823119237:84 , srv824931523:84 , srv83369648:84 , srv8527993:84 , srv881301264:84 , srv914732411:84 , srv930887373:84 , srv939447502:84 , srv962423977:84 , srv96999314:84 , srv985710124:84 , srv94921290:684 } [srvr=100 rgns=9000 avg=90.0 max=90 min=90]
2023-03-24 01:56:01,556 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-03-24 01:56:01,568 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv96999314=98, srv1330941275=14, srv824931523=89, srv245283602=52, srv317572534=58, srv1496679405=22, srv1700390242=32, srv8527993=91, srv1589300162=27, srv647139112=76, srv40409004=62, srv799370367=86, srv1484314526=20, srv1970174502=40, srv290487896=56, srv799683856=87, srv1952178989=38, srv342959852=59, srv1166369819=9, srv1002364565=0, srv1939039208=37, srv1180796989=10, srv2019773664=43, srv675612271=77, srv1404090430=16, srv486177393=67, srv823119237=88, srv1289409491=13, srv349378500=60, srv773779916=82, srv1470389337=19, srv1530436236=25, srv408641643=63, srv287499454=55, srv1336629549=15, srv113495022=7, srv881301264=92, srv100449195=1, srv395355019=61, srv939447502=95, srv1811626719=33, srv1521927418=24, srv2046444446=47, srv1205671301=12, srv1519178771=23, srv234717137=50, srv985710124=99, srv687478532=78, srv1491881437=21, srv526275256=72, srv1955946910=39, srv2006389749=41, srv413369364=64, srv297735545=57, srv1415558921=17, srv1673349371=30, srv1011532166=2, srv4473083=66, srv543555669=73, srv914732411=93, srv1564262781=26, srv1139808780=8, srv702776400=79, srv94921290=96, srv739577125=80, srv1027809560=3, srv1700242522=31, srv266671136=53, srv1902335275=35, srv27618143=54, srv1077145439=5, srv516726578=70, srv1909899463=36, srv2104984034=49, srv418939823=65, srv518361821=71, srv11846504=11, srv1595310618=28, srv624310447=75, srv2023038965=44, srv83369648=90, srv1634032826=29, srv57651786=74, srv1849827555=34, srv201640073=42, srv2027239993=45, srv798864131=85, srv490536927=68, srv774309829=83, srv744393005=81, srv497830396=69, srv962423977=97, srv1057041089=4, srv235022803=51, srv2030604300=46, srv1117248154=6, srv2082984587=48, srv784345119=84, srv930887373=94, srv1458017895=18} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-03-24 01:56:01,692 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-03-24 01:56:01,692 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-03-24 01:56:01,692 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-03-24 01:56:01,692 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-03-24 01:56:01,693 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-03-24 01:56:01,693 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-03-24 01:56:01,693 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-03-24 01:56:01,693 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-03-24 01:56:01,693 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-03-24 01:56:01,693 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-03-24 01:56:01,694 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-03-24 01:56:01,694 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-03-24 01:56:01,694 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-03-24 01:56:01,694 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-03-24 01:56:01,694 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-03-24 01:56:01,694 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-03-24 01:56:01,695 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-03-24 01:56:01,695 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-03-24 01:56:01,695 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-03-24 01:56:01,695 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-03-24 01:56:01,695 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-03-24 01:56:01,695 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-03-24 01:56:01,695 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-03-24 01:56:01,695 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-03-24 01:56:01,695 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-03-24 01:56:01,696 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-03-24 01:56:01,696 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-03-24 01:56:01,696 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-03-24 01:56:01,696 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-03-24 01:56:01,696 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-03-24 01:56:01,696 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-03-24 01:56:01,696 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-03-24 01:56:01,696 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-03-24 01:56:01,697 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-03-24 01:56:01,697 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-03-24 01:56:01,697 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-03-24 01:56:01,697 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-03-24 01:56:01,697 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-03-24 01:56:01,697 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-03-24 01:56:01,698 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-03-24 01:56:01,698 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-03-24 01:56:01,698 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-03-24 01:56:01,698 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-03-24 01:56:01,698 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-03-24 01:56:01,698 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-03-24 01:56:01,699 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-03-24 01:56:01,699 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-03-24 01:56:01,699 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-03-24 01:56:01,699 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-03-24 01:56:01,699 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-03-24 01:56:01,699 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-03-24 01:56:01,700 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-03-24 01:56:01,700 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-03-24 01:56:01,700 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-03-24 01:56:01,700 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-03-24 01:56:01,700 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-03-24 01:56:01,700 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-03-24 01:56:01,701 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-03-24 01:56:01,701 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-03-24 01:56:01,701 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-03-24 01:56:01,701 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-03-24 01:56:01,701 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-03-24 01:56:01,701 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-03-24 01:56:01,701 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-03-24 01:56:01,701 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-03-24 01:56:01,702 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-03-24 01:56:01,702 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-03-24 01:56:01,702 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-03-24 01:56:01,702 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-03-24 01:56:01,702 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-03-24 01:56:01,702 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-03-24 01:56:01,702 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-03-24 01:56:01,703 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-03-24 01:56:01,704 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-03-24 01:56:01,704 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-03-24 01:56:01,704 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-03-24 01:56:01,704 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-03-24 01:56:01,704 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-03-24 01:56:01,705 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-03-24 01:56:01,705 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-03-24 01:56:01,705 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-03-24 01:56:01,705 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-03-24 01:56:01,705 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-03-24 01:56:01,705 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-03-24 01:56:01,705 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-03-24 01:56:01,706 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-03-24 01:56:01,706 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-03-24 01:56:01,706 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-03-24 01:56:01,706 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-03-24 01:56:01,706 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-03-24 01:56:01,706 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-03-24 01:56:01,706 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-03-24 01:56:01,707 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-03-24 01:56:01,707 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-03-24 01:56:01,707 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-03-24 01:56:01,707 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-03-24 01:56:01,707 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-03-24 01:56:01,707 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-03-24 01:56:01,707 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-03-24 01:56:01,708 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-03-24 01:56:01,708 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-03-24 01:56:02,003 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.06666666666666667, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-03-24 01:56:02,003 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-03-24 01:56:02,004 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.9909252140407105, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.06666666666666667, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-03-24 01:56:02,387 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 648 ms to try 5000 different iterations.  Found a solution that moves 4658 regions; Going from a computed imbalance of 0.9909252140407105 to a new imbalance of 0.1823848297259089. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.03890539973377658, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06031157410331208, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.5175555555555555, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.03890539973377658, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.17833333333333334, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.23708333333333334, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-03-24 01:56:02,405 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv2027239993:82 , srv744393005:82 , srv1027809560:83 , srv1470389337:83 , srv1849827555:83 , srv739577125:83 , srv798864131:83 , srv930887373:83 , srv1595310618:84 , srv2104984034:84 , srv297735545:84 , srv317572534:84 , srv799370367:84 , srv824931523:84 , srv96999314:84 , srv1077145439:85 , srv113495022:85 , srv1458017895:85 , srv1519178771:85 , srv1673349371:85 , srv1700390242:85 , srv1952178989:85 , srv235022803:85 , srv266671136:85 , srv40409004:85 , srv413369364:85 , srv418939823:85 , srv57651786:85 , srv687478532:85 , srv799683856:85 , srv83369648:85 , srv8527993:85 , srv962423977:85 , srv1415558921:86 , srv1530436236:86 , srv1564262781:86 , srv1589300162:86 , srv1811626719:86 , srv234717137:86 , srv245283602:86 , srv287499454:86 , srv349378500:86 , srv408641643:86 , srv4473083:86 , srv486177393:86 , srv490536927:86 , srv497830396:86 , srv516726578:86 , srv647139112:86 , srv702776400:86 , srv774309829:86 , srv823119237:86 , srv1139808780:87 , srv1180796989:87 , srv11846504:87 , srv1205671301:87 , srv1330941275:87 , srv1336629549:87 , srv1634032826:87 , srv1700242522:87 , srv1939039208:87 , srv1955946910:87 , srv201640073:87 , srv2019773664:87 , srv2030604300:87 , srv2046444446:87 , srv2082984587:87 , srv395355019:87 , srv526275256:87 , srv914732411:87 , srv939447502:87 , srv100449195:88 , srv1289409491:88 , srv1484314526:88 , srv2006389749:88 , srv290487896:88 , srv342959852:88 , srv518361821:88 , srv543555669:88 , srv624310447:88 , srv675612271:88 , srv773779916:88 , srv881301264:88 , srv1166369819:89 , srv1909899463:89 , srv1970174502:89 , srv2023038965:89 , srv27618143:89 , srv985710124:89 , srv1057041089:90 , srv1117248154:90 , srv1491881437:90 , srv784345119:90 , srv1002364565:91 , srv1011532166:91 , srv1404090430:91 , srv1496679405:91 , srv1521927418:91 , srv1902335275:92 , srv94921290:436 }
2023-03-24 01:56:02,411 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-03-24 01:56:02,412 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv96999314=98, srv1330941275=14, srv824931523=89, srv245283602=52, srv317572534=58, srv1496679405=22, srv1700390242=32, srv8527993=91, srv1589300162=27, srv647139112=76, srv40409004=62, srv799370367=86, srv1484314526=20, srv1970174502=40, srv290487896=56, srv799683856=87, srv1952178989=38, srv342959852=59, srv1166369819=9, srv1002364565=0, srv1939039208=37, srv1180796989=10, srv2019773664=43, srv675612271=77, srv1404090430=16, srv486177393=67, srv823119237=88, srv1289409491=13, srv349378500=60, srv773779916=82, srv1470389337=19, srv1530436236=25, srv408641643=63, srv287499454=55, srv1336629549=15, srv113495022=7, srv881301264=92, srv100449195=1, srv395355019=61, srv939447502=95, srv1811626719=33, srv1521927418=24, srv2046444446=47, srv1205671301=12, srv1519178771=23, srv234717137=50, srv985710124=99, srv687478532=78, srv1491881437=21, srv526275256=72, srv1955946910=39, srv2006389749=41, srv413369364=64, srv297735545=57, srv1415558921=17, srv1673349371=30, srv1011532166=2, srv4473083=66, srv543555669=73, srv914732411=93, srv1564262781=26, srv1139808780=8, srv702776400=79, srv94921290=96, srv739577125=80, srv1027809560=3, srv1700242522=31, srv266671136=53, srv1902335275=35, srv27618143=54, srv1077145439=5, srv516726578=70, srv1909899463=36, srv2104984034=49, srv418939823=65, srv518361821=71, srv11846504=11, srv1595310618=28, srv624310447=75, srv2023038965=44, srv83369648=90, srv1634032826=29, srv57651786=74, srv1849827555=34, srv201640073=42, srv2027239993=45, srv798864131=85, srv490536927=68, srv774309829=83, srv744393005=81, srv497830396=69, srv962423977=97, srv1057041089=4, srv235022803=51, srv2030604300=46, srv1117248154=6, srv2082984587=48, srv784345119=84, srv930887373=94, srv1458017895=18} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-03-24 01:56:02,441 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-03-24 01:56:02,441 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-03-24 01:56:02,441 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-03-24 01:56:02,442 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-03-24 01:56:02,442 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-03-24 01:56:02,442 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-03-24 01:56:02,442 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-03-24 01:56:02,442 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-03-24 01:56:02,442 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-03-24 01:56:02,442 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-03-24 01:56:02,442 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-03-24 01:56:02,443 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-03-24 01:56:02,443 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-03-24 01:56:02,443 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-03-24 01:56:02,443 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-03-24 01:56:02,443 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-03-24 01:56:02,443 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-03-24 01:56:02,443 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-03-24 01:56:02,443 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-03-24 01:56:02,443 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-03-24 01:56:02,444 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-03-24 01:56:02,444 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-03-24 01:56:02,444 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-03-24 01:56:02,444 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-03-24 01:56:02,444 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-03-24 01:56:02,444 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-03-24 01:56:02,444 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-03-24 01:56:02,444 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-03-24 01:56:02,445 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-03-24 01:56:02,445 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-03-24 01:56:02,445 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-03-24 01:56:02,445 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-03-24 01:56:02,445 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-03-24 01:56:02,445 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-03-24 01:56:02,445 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-03-24 01:56:02,445 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-03-24 01:56:02,446 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-03-24 01:56:02,446 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-03-24 01:56:02,446 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-03-24 01:56:02,446 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-03-24 01:56:02,446 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-03-24 01:56:02,446 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-03-24 01:56:02,446 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-03-24 01:56:02,446 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-03-24 01:56:02,446 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-03-24 01:56:02,447 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-03-24 01:56:02,447 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-03-24 01:56:02,447 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-03-24 01:56:02,447 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-03-24 01:56:02,447 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-03-24 01:56:02,447 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-03-24 01:56:02,447 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-03-24 01:56:02,447 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-03-24 01:56:02,447 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-03-24 01:56:02,448 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-03-24 01:56:02,448 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-03-24 01:56:02,448 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-03-24 01:56:02,448 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-03-24 01:56:02,448 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-03-24 01:56:02,448 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-03-24 01:56:02,448 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-03-24 01:56:02,448 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-03-24 01:56:02,449 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-03-24 01:56:02,449 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-03-24 01:56:02,449 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-03-24 01:56:02,449 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-03-24 01:56:02,449 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-03-24 01:56:02,449 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-03-24 01:56:02,449 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-03-24 01:56:02,449 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-03-24 01:56:02,449 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-03-24 01:56:02,449 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-03-24 01:56:02,450 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-03-24 01:56:02,450 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-03-24 01:56:02,450 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-03-24 01:56:02,450 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-03-24 01:56:02,450 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-03-24 01:56:02,450 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-03-24 01:56:02,450 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-03-24 01:56:02,450 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-03-24 01:56:02,450 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-03-24 01:56:02,451 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-03-24 01:56:02,451 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-03-24 01:56:02,451 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-03-24 01:56:02,451 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-03-24 01:56:02,451 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-03-24 01:56:02,451 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-03-24 01:56:02,451 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-03-24 01:56:02,451 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-03-24 01:56:02,451 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-03-24 01:56:02,452 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-03-24 01:56:02,452 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-03-24 01:56:02,452 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-03-24 01:56:02,452 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-03-24 01:56:02,452 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-03-24 01:56:02,452 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-03-24 01:56:02,452 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-03-24 01:56:02,452 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-03-24 01:56:02,452 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-03-24 01:56:02,453 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-03-24 01:56:02,453 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-03-24 01:56:02,628 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.03890539973377658, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06031157410331208, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.03890539973377658, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.17833333333333334, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.23708333333333334, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-03-24 01:56:02,628 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-03-24 01:56:02,629 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.1823522137127929, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.03890539973377658, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06031157410331208, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.03890539973377658, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.17833333333333334, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.23708333333333334, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-03-24 01:56:03,002 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 522 ms to try 5000 different iterations.  Found a solution that moves 2577 regions; Going from a computed imbalance of 0.1823522137127929 to a new imbalance of 0.014686654300423256. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.022968392971542954); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.04078081897667738, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.28633333333333333, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.022968392971542954); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.011583333333333333); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.043833333333333335, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-03-24 01:56:03,014 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1521927418:79 , srv1117248154:80 , srv1902335275:80 , srv1166369819:81 , srv1404090430:81 , srv2023038965:81 , srv784345119:81 , srv1057041089:82 , srv985710124:82 , srv1002364565:83 , srv1011532166:83 , srv1484314526:83 , srv1491881437:83 , srv1909899463:83 , srv1955946910:83 , srv2030604300:83 , srv2046444446:83 , srv342959852:83 , srv518361821:83 , srv543555669:83 , srv100449195:84 , srv11846504:84 , srv1205671301:84 , srv1289409491:84 , srv1336629549:84 , srv1415558921:84 , srv1530436236:84 , srv1564262781:84 , srv1939039208:84 , srv1970174502:84 , srv201640073:84 , srv57651786:84 , srv624310447:84 , srv702776400:84 , srv773779916:84 , srv881301264:84 , srv1077145439:85 , srv1139808780:85 , srv1180796989:85 , srv1634032826:85 , srv1700242522:85 , srv1700390242:85 , srv1811626719:85 , srv2006389749:85 , srv2082984587:85 , srv245283602:85 , srv27618143:85 , srv290487896:85 , srv349378500:85 , srv395355019:85 , srv408641643:85 , srv490536927:85 , srv497830396:85 , srv516726578:85 , srv914732411:85 , srv1330941275:86 , srv1458017895:86 , srv1673349371:86 , srv486177393:86 , srv526275256:86 , srv798864131:86 , srv824931523:86 , srv8527993:86 , srv962423977:86 , srv1027809560:87 , srv113495022:87 , srv1589300162:87 , srv1952178989:87 , srv2104984034:87 , srv235022803:87 , srv287499454:87 , srv40409004:87 , srv647139112:87 , srv675612271:87 , srv774309829:87 , srv799370367:87 , srv823119237:87 , srv83369648:87 , srv939447502:87 , srv1496679405:88 , srv1595310618:88 , srv2019773664:88 , srv266671136:88 , srv418939823:88 , srv687478532:88 , srv739577125:88 , srv744393005:88 , srv930887373:88 , srv1519178771:89 , srv234717137:89 , srv317572534:89 , srv413369364:89 , srv799683856:89 , srv96999314:89 , srv1849827555:90 , srv1470389337:91 , srv2027239993:91 , srv297735545:91 , srv4473083:91 , srv94921290:542 }
2023-03-24 01:56:03,020 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-03-24 01:56:03,021 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv96999314=98, srv1330941275=14, srv824931523=89, srv245283602=52, srv317572534=58, srv1496679405=22, srv1700390242=32, srv8527993=91, srv1589300162=27, srv647139112=76, srv40409004=62, srv799370367=86, srv1484314526=20, srv1970174502=40, srv290487896=56, srv799683856=87, srv1952178989=38, srv342959852=59, srv1166369819=9, srv1002364565=0, srv1939039208=37, srv1180796989=10, srv2019773664=43, srv675612271=77, srv1404090430=16, srv486177393=67, srv823119237=88, srv1289409491=13, srv349378500=60, srv773779916=82, srv1470389337=19, srv1530436236=25, srv408641643=63, srv287499454=55, srv1336629549=15, srv113495022=7, srv881301264=92, srv100449195=1, srv395355019=61, srv939447502=95, srv1811626719=33, srv1521927418=24, srv2046444446=47, srv1205671301=12, srv1519178771=23, srv234717137=50, srv985710124=99, srv687478532=78, srv1491881437=21, srv526275256=72, srv1955946910=39, srv2006389749=41, srv413369364=64, srv297735545=57, srv1415558921=17, srv1673349371=30, srv1011532166=2, srv4473083=66, srv543555669=73, srv914732411=93, srv1564262781=26, srv1139808780=8, srv702776400=79, srv94921290=96, srv739577125=80, srv1027809560=3, srv1700242522=31, srv266671136=53, srv1902335275=35, srv27618143=54, srv1077145439=5, srv516726578=70, srv1909899463=36, srv2104984034=49, srv418939823=65, srv518361821=71, srv11846504=11, srv1595310618=28, srv624310447=75, srv2023038965=44, srv83369648=90, srv1634032826=29, srv57651786=74, srv1849827555=34, srv201640073=42, srv2027239993=45, srv798864131=85, srv490536927=68, srv774309829=83, srv744393005=81, srv497830396=69, srv962423977=97, srv1057041089=4, srv235022803=51, srv2030604300=46, srv1117248154=6, srv2082984587=48, srv784345119=84, srv930887373=94, srv1458017895=18} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-03-24 01:56:03,039 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-03-24 01:56:03,039 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-03-24 01:56:03,039 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-03-24 01:56:03,039 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-03-24 01:56:03,039 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-03-24 01:56:03,040 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-03-24 01:56:03,040 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-03-24 01:56:03,040 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-03-24 01:56:03,040 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-03-24 01:56:03,040 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-03-24 01:56:03,040 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-03-24 01:56:03,040 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-03-24 01:56:03,040 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-03-24 01:56:03,040 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-03-24 01:56:03,041 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-03-24 01:56:03,041 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-03-24 01:56:03,041 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-03-24 01:56:03,041 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-03-24 01:56:03,041 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-03-24 01:56:03,041 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-03-24 01:56:03,041 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-03-24 01:56:03,041 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-03-24 01:56:03,041 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-03-24 01:56:03,042 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-03-24 01:56:03,042 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-03-24 01:56:03,042 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-03-24 01:56:03,042 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-03-24 01:56:03,042 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-03-24 01:56:03,042 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-03-24 01:56:03,042 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-03-24 01:56:03,042 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-03-24 01:56:03,042 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-03-24 01:56:03,042 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-03-24 01:56:03,043 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-03-24 01:56:03,043 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-03-24 01:56:03,043 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-03-24 01:56:03,043 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-03-24 01:56:03,043 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-03-24 01:56:03,043 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-03-24 01:56:03,043 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-03-24 01:56:03,043 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-03-24 01:56:03,043 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-03-24 01:56:03,044 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-03-24 01:56:03,044 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-03-24 01:56:03,044 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-03-24 01:56:03,044 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-03-24 01:56:03,044 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-03-24 01:56:03,044 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-03-24 01:56:03,044 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-03-24 01:56:03,044 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-03-24 01:56:03,044 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-03-24 01:56:03,045 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-03-24 01:56:03,045 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-03-24 01:56:03,045 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-03-24 01:56:03,045 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-03-24 01:56:03,045 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-03-24 01:56:03,045 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-03-24 01:56:03,045 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-03-24 01:56:03,045 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-03-24 01:56:03,045 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-03-24 01:56:03,046 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-03-24 01:56:03,046 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-03-24 01:56:03,046 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-03-24 01:56:03,046 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-03-24 01:56:03,046 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-03-24 01:56:03,046 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-03-24 01:56:03,046 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-03-24 01:56:03,046 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-03-24 01:56:03,046 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-03-24 01:56:03,046 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-03-24 01:56:03,047 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-03-24 01:56:03,047 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-03-24 01:56:03,047 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-03-24 01:56:03,047 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-03-24 01:56:03,047 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-03-24 01:56:03,047 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-03-24 01:56:03,047 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-03-24 01:56:03,047 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-03-24 01:56:03,047 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-03-24 01:56:03,047 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-03-24 01:56:03,047 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-03-24 01:56:03,047 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-03-24 01:56:03,047 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-03-24 01:56:03,047 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-03-24 01:56:03,048 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-03-24 01:56:03,048 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-03-24 01:56:03,048 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-03-24 01:56:03,048 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-03-24 01:56:03,048 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-03-24 01:56:03,048 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-03-24 01:56:03,048 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-03-24 01:56:03,048 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-03-24 01:56:03,048 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-03-24 01:56:03,048 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-03-24 01:56:03,048 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-03-24 01:56:03,048 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-03-24 01:56:03,048 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-03-24 01:56:03,048 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-03-24 01:56:03,048 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-03-24 01:56:03,048 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-03-24 01:56:03,049 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-03-24 01:56:03,227 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.022968392971542954); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.04078081897667738, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.022968392971542954); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.011583333333333333); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.043833333333333335, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-03-24 01:56:03,228 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-03-24 01:56:03,228 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.014668609760749577, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.022968392971542954); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.04078081897667738, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.022968392971542954); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.011583333333333333); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.043833333333333335, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-03-24 01:56:03,581 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 516 ms to try 5000 different iterations.  Found a solution that moves 1000 regions; Going from a computed imbalance of 0.014668609760749577 to a new imbalance of 0.0010286045604662487. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.007670414998073679); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.012079051255657978); MoveCostFunction : (multiplier=7.0, imbalance=0.1111111111111111, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.007670414998073679); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=5.0E-4); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.005333333333333333); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-03-24 01:56:03,585 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1496679405:78 , srv4473083:80 , srv2019773664:81 , srv675612271:82 , srv1011532166:83 , srv1470389337:83 , srv234717137:83 , srv297735545:83 , srv799683856:83 , srv1289409491:84 , srv1491881437:84 , srv1519178771:84 , srv1589300162:84 , srv1849827555:84 , srv1970174502:84 , srv266671136:84 , srv27618143:84 , srv290487896:84 , srv317572534:84 , srv413369364:84 , srv418939823:84 , srv526275256:84 , srv647139112:84 , srv687478532:84 , srv939447502:84 , srv96999314:84 , srv1002364565:85 , srv113495022:85 , srv1139808780:85 , srv1180796989:85 , srv1205671301:85 , srv1330941275:85 , srv1336629549:85 , srv1595310618:85 , srv1634032826:85 , srv1902335275:85 , srv1909899463:85 , srv2006389749:85 , srv2027239993:85 , srv2082984587:85 , srv235022803:85 , srv287499454:85 , srv408641643:85 , srv486177393:85 , srv624310447:85 , srv773779916:85 , srv774309829:85 , srv823119237:85 , srv881301264:85 , srv914732411:85 , srv962423977:85 , srv100449195:86 , srv1057041089:86 , srv1166369819:86 , srv11846504:86 , srv1404090430:86 , srv1458017895:86 , srv1484314526:86 , srv1673349371:86 , srv1700242522:86 , srv1811626719:86 , srv1939039208:86 , srv1952178989:86 , srv201640073:86 , srv245283602:86 , srv395355019:86 , srv40409004:86 , srv490536927:86 , srv543555669:86 , srv739577125:86 , srv744393005:86 , srv83369648:86 , srv8527993:86 , srv930887373:86 , srv1027809560:87 , srv1077145439:87 , srv1415558921:87 , srv1521927418:87 , srv1530436236:87 , srv1564262781:87 , srv1700390242:87 , srv2030604300:87 , srv2046444446:87 , srv349378500:87 , srv497830396:87 , srv516726578:87 , srv702776400:87 , srv784345119:87 , srv799370367:87 , srv824931523:87 , srv1117248154:88 , srv1955946910:88 , srv2023038965:88 , srv2104984034:88 , srv342959852:88 , srv518361821:88 , srv57651786:88 , srv985710124:88 , srv798864131:89 , srv94921290:548 }
2023-03-24 01:56:03,592 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-03-24 01:56:03,595 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv96999314=98, srv1330941275=14, srv824931523=89, srv245283602=52, srv317572534=58, srv1496679405=22, srv1700390242=32, srv8527993=91, srv1589300162=27, srv647139112=76, srv40409004=62, srv799370367=86, srv1484314526=20, srv1970174502=40, srv290487896=56, srv799683856=87, srv1952178989=38, srv342959852=59, srv1166369819=9, srv1002364565=0, srv1939039208=37, srv1180796989=10, srv2019773664=43, srv675612271=77, srv1404090430=16, srv486177393=67, srv823119237=88, srv1289409491=13, srv349378500=60, srv773779916=82, srv1470389337=19, srv1530436236=25, srv408641643=63, srv287499454=55, srv1336629549=15, srv113495022=7, srv881301264=92, srv100449195=1, srv395355019=61, srv939447502=95, srv1811626719=33, srv1521927418=24, srv2046444446=47, srv1205671301=12, srv1519178771=23, srv234717137=50, srv985710124=99, srv687478532=78, srv1491881437=21, srv526275256=72, srv1955946910=39, srv2006389749=41, srv413369364=64, srv297735545=57, srv1415558921=17, srv1673349371=30, srv1011532166=2, srv4473083=66, srv543555669=73, srv914732411=93, srv1564262781=26, srv1139808780=8, srv702776400=79, srv94921290=96, srv739577125=80, srv1027809560=3, srv1700242522=31, srv266671136=53, srv1902335275=35, srv27618143=54, srv1077145439=5, srv516726578=70, srv1909899463=36, srv2104984034=49, srv418939823=65, srv518361821=71, srv11846504=11, srv1595310618=28, srv624310447=75, srv2023038965=44, srv83369648=90, srv1634032826=29, srv57651786=74, srv1849827555=34, srv201640073=42, srv2027239993=45, srv798864131=85, srv490536927=68, srv774309829=83, srv744393005=81, srv497830396=69, srv962423977=97, srv1057041089=4, srv235022803=51, srv2030604300=46, srv1117248154=6, srv2082984587=48, srv784345119=84, srv930887373=94, srv1458017895=18} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-03-24 01:56:03,635 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-03-24 01:56:03,635 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-03-24 01:56:03,635 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-03-24 01:56:03,635 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-03-24 01:56:03,635 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-03-24 01:56:03,635 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-03-24 01:56:03,635 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-03-24 01:56:03,636 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-03-24 01:56:03,636 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-03-24 01:56:03,636 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-03-24 01:56:03,636 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-03-24 01:56:03,636 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-03-24 01:56:03,636 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-03-24 01:56:03,636 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-03-24 01:56:03,636 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-03-24 01:56:03,636 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-03-24 01:56:03,636 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-03-24 01:56:03,637 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-03-24 01:56:03,637 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-03-24 01:56:03,637 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-03-24 01:56:03,637 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-03-24 01:56:03,637 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-03-24 01:56:03,637 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-03-24 01:56:03,638 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-03-24 01:56:03,638 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-03-24 01:56:03,639 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-03-24 01:56:03,639 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-03-24 01:56:03,639 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-03-24 01:56:03,639 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-03-24 01:56:03,639 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-03-24 01:56:03,639 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-03-24 01:56:03,640 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-03-24 01:56:03,640 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-03-24 01:56:03,640 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-03-24 01:56:03,640 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-03-24 01:56:03,640 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-03-24 01:56:03,640 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-03-24 01:56:03,640 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-03-24 01:56:03,640 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-03-24 01:56:03,641 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-03-24 01:56:03,641 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-03-24 01:56:03,641 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-03-24 01:56:03,641 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-03-24 01:56:03,641 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-03-24 01:56:03,641 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-03-24 01:56:03,641 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-03-24 01:56:03,641 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-03-24 01:56:03,641 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-03-24 01:56:03,641 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-03-24 01:56:03,642 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-03-24 01:56:03,642 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-03-24 01:56:03,642 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-03-24 01:56:03,642 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-03-24 01:56:03,642 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-03-24 01:56:03,642 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-03-24 01:56:03,642 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-03-24 01:56:03,642 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-03-24 01:56:03,642 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-03-24 01:56:03,643 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-03-24 01:56:03,643 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-03-24 01:56:03,643 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-03-24 01:56:03,643 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-03-24 01:56:03,643 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-03-24 01:56:03,643 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-03-24 01:56:03,643 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-03-24 01:56:03,643 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-03-24 01:56:03,643 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-03-24 01:56:03,643 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-03-24 01:56:03,644 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-03-24 01:56:03,644 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-03-24 01:56:03,644 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-03-24 01:56:03,644 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-03-24 01:56:03,644 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-03-24 01:56:03,644 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-03-24 01:56:03,644 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-03-24 01:56:03,644 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-03-24 01:56:03,644 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-03-24 01:56:03,644 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-03-24 01:56:03,645 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-03-24 01:56:03,645 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-03-24 01:56:03,645 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-03-24 01:56:03,645 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-03-24 01:56:03,645 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-03-24 01:56:03,645 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-03-24 01:56:03,645 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-03-24 01:56:03,645 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-03-24 01:56:03,645 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-03-24 01:56:03,645 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-03-24 01:56:03,645 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-03-24 01:56:03,646 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-03-24 01:56:03,646 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-03-24 01:56:03,646 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-03-24 01:56:03,646 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-03-24 01:56:03,646 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-03-24 01:56:03,646 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-03-24 01:56:03,646 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-03-24 01:56:03,646 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-03-24 01:56:03,646 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-03-24 01:56:03,646 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-03-24 01:56:03,647 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-03-24 01:56:03,647 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-03-24 01:56:03,802 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.007670414998073679); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.012079051255657978); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.007670414998073679); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=5.0E-4); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.005333333333333333); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-03-24 01:56:03,803 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-03-24 01:56:03,803 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.0010216024108063032, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.007670414998073679); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.012079051255657978); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.007670414998073679); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=5.0E-4); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.005333333333333333); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-03-24 01:56:04,176 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 505 ms to try 5000 different iterations.  Found a solution that moves 302 regions; Going from a computed imbalance of 0.0010216024108063032 to a new imbalance of 2.8985529476275183E-5. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=3.868392354571063E-4); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0022222222222222222); MoveCostFunction : (multiplier=7.0, imbalance=0.033555555555555554, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=3.868392354571063E-4); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.6666666666666666E-4); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-03-24 01:56:04,177 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1002364565:83 , srv1952178989:83 , srv2104984034:83 , srv413369364:83 , srv518361821:83 , srv985710124:83 , srv100449195:84 , srv1057041089:84 , srv1117248154:84 , srv1330941275:84 , srv1404090430:84 , srv1484314526:84 , srv1519178771:84 , srv1700242522:84 , srv1700390242:84 , srv1955946910:84 , srv2006389749:84 , srv2023038965:84 , srv2027239993:84 , srv2082984587:84 , srv234717137:84 , srv287499454:84 , srv297735545:84 , srv342959852:84 , srv349378500:84 , srv395355019:84 , srv40409004:84 , srv497830396:84 , srv773779916:84 , srv774309829:84 , srv784345119:84 , srv798864131:84 , srv799370367:84 , srv823119237:84 , srv83369648:84 , srv939447502:84 , srv1011532166:85 , srv1027809560:85 , srv1077145439:85 , srv113495022:85 , srv1139808780:85 , srv1180796989:85 , srv11846504:85 , srv1415558921:85 , srv1470389337:85 , srv1491881437:85 , srv1496679405:85 , srv1521927418:85 , srv1530436236:85 , srv1564262781:85 , srv1589300162:85 , srv1595310618:85 , srv1634032826:85 , srv1673349371:85 , srv1811626719:85 , srv1902335275:85 , srv1909899463:85 , srv1939039208:85 , srv1970174502:85 , srv201640073:85 , srv2030604300:85 , srv2046444446:85 , srv235022803:85 , srv245283602:85 , srv266671136:85 , srv27618143:85 , srv290487896:85 , srv317572534:85 , srv418939823:85 , srv4473083:85 , srv486177393:85 , srv490536927:85 , srv516726578:85 , srv526275256:85 , srv543555669:85 , srv57651786:85 , srv624310447:85 , srv647139112:85 , srv675612271:85 , srv702776400:85 , srv739577125:85 , srv799683856:85 , srv824931523:85 , srv8527993:85 , srv881301264:85 , srv914732411:85 , srv930887373:85 , srv96999314:85 , srv1166369819:86 , srv1205671301:86 , srv1289409491:86 , srv1336629549:86 , srv1458017895:86 , srv1849827555:86 , srv2019773664:86 , srv408641643:86 , srv687478532:86 , srv744393005:86 , srv962423977:86 , srv94921290:616 }
2023-03-24 01:56:04,183 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-03-24 01:56:04,184 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv96999314=98, srv1330941275=14, srv824931523=89, srv245283602=52, srv317572534=58, srv1496679405=22, srv1700390242=32, srv8527993=91, srv1589300162=27, srv647139112=76, srv40409004=62, srv799370367=86, srv1484314526=20, srv1970174502=40, srv290487896=56, srv799683856=87, srv1952178989=38, srv342959852=59, srv1166369819=9, srv1002364565=0, srv1939039208=37, srv1180796989=10, srv2019773664=43, srv675612271=77, srv1404090430=16, srv486177393=67, srv823119237=88, srv1289409491=13, srv349378500=60, srv773779916=82, srv1470389337=19, srv1530436236=25, srv408641643=63, srv287499454=55, srv1336629549=15, srv113495022=7, srv881301264=92, srv100449195=1, srv395355019=61, srv939447502=95, srv1811626719=33, srv1521927418=24, srv2046444446=47, srv1205671301=12, srv1519178771=23, srv234717137=50, srv985710124=99, srv687478532=78, srv1491881437=21, srv526275256=72, srv1955946910=39, srv2006389749=41, srv413369364=64, srv297735545=57, srv1415558921=17, srv1673349371=30, srv1011532166=2, srv4473083=66, srv543555669=73, srv914732411=93, srv1564262781=26, srv1139808780=8, srv702776400=79, srv94921290=96, srv739577125=80, srv1027809560=3, srv1700242522=31, srv266671136=53, srv1902335275=35, srv27618143=54, srv1077145439=5, srv516726578=70, srv1909899463=36, srv2104984034=49, srv418939823=65, srv518361821=71, srv11846504=11, srv1595310618=28, srv624310447=75, srv2023038965=44, srv83369648=90, srv1634032826=29, srv57651786=74, srv1849827555=34, srv201640073=42, srv2027239993=45, srv798864131=85, srv490536927=68, srv774309829=83, srv744393005=81, srv497830396=69, srv962423977=97, srv1057041089=4, srv235022803=51, srv2030604300=46, srv1117248154=6, srv2082984587=48, srv784345119=84, srv930887373=94, srv1458017895=18} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-03-24 01:56:04,202 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-03-24 01:56:04,202 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-03-24 01:56:04,202 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-03-24 01:56:04,202 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-03-24 01:56:04,202 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-03-24 01:56:04,202 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-03-24 01:56:04,202 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-03-24 01:56:04,202 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-03-24 01:56:04,203 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-03-24 01:56:04,203 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-03-24 01:56:04,203 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-03-24 01:56:04,203 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-03-24 01:56:04,203 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-03-24 01:56:04,203 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-03-24 01:56:04,203 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-03-24 01:56:04,203 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-03-24 01:56:04,203 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-03-24 01:56:04,203 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-03-24 01:56:04,203 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-03-24 01:56:04,203 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-03-24 01:56:04,204 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-03-24 01:56:04,204 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-03-24 01:56:04,204 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-03-24 01:56:04,204 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-03-24 01:56:04,204 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-03-24 01:56:04,204 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-03-24 01:56:04,204 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-03-24 01:56:04,204 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-03-24 01:56:04,204 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-03-24 01:56:04,204 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-03-24 01:56:04,204 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-03-24 01:56:04,205 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-03-24 01:56:04,205 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-03-24 01:56:04,205 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-03-24 01:56:04,205 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-03-24 01:56:04,205 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-03-24 01:56:04,205 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-03-24 01:56:04,205 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-03-24 01:56:04,205 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-03-24 01:56:04,205 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-03-24 01:56:04,205 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-03-24 01:56:04,205 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-03-24 01:56:04,205 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-03-24 01:56:04,206 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-03-24 01:56:04,206 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-03-24 01:56:04,206 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-03-24 01:56:04,206 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-03-24 01:56:04,206 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-03-24 01:56:04,206 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-03-24 01:56:04,206 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-03-24 01:56:04,206 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-03-24 01:56:04,206 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-03-24 01:56:04,206 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-03-24 01:56:04,206 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-03-24 01:56:04,207 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-03-24 01:56:04,207 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-03-24 01:56:04,207 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-03-24 01:56:04,207 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-03-24 01:56:04,207 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-03-24 01:56:04,207 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-03-24 01:56:04,207 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-03-24 01:56:04,207 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-03-24 01:56:04,207 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-03-24 01:56:04,207 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-03-24 01:56:04,207 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-03-24 01:56:04,207 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-03-24 01:56:04,208 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-03-24 01:56:04,208 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-03-24 01:56:04,208 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-03-24 01:56:04,208 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-03-24 01:56:04,208 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-03-24 01:56:04,208 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-03-24 01:56:04,208 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-03-24 01:56:04,209 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-03-24 01:56:04,209 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-03-24 01:56:04,209 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-03-24 01:56:04,209 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-03-24 01:56:04,209 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-03-24 01:56:04,209 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-03-24 01:56:04,209 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-03-24 01:56:04,209 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-03-24 01:56:04,209 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-03-24 01:56:04,209 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-03-24 01:56:04,209 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-03-24 01:56:04,210 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-03-24 01:56:04,210 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-03-24 01:56:04,210 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-03-24 01:56:04,210 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-03-24 01:56:04,210 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-03-24 01:56:04,210 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-03-24 01:56:04,210 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-03-24 01:56:04,210 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-03-24 01:56:04,210 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-03-24 01:56:04,210 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-03-24 01:56:04,210 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-03-24 01:56:04,210 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-03-24 01:56:04,211 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-03-24 01:56:04,211 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-03-24 01:56:04,211 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-03-24 01:56:04,211 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-03-24 01:56:04,211 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-03-24 01:56:04,359 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=3.868392354571063E-4); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0022222222222222222); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=3.868392354571063E-4); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.6666666666666666E-4); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-03-24 01:56:04,359 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-03-24 01:56:04,361 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=2.687088027897161E-5, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=3.868392354571063E-4); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0022222222222222222); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=3.868392354571063E-4); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.6666666666666666E-4); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-03-24 01:56:04,719 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 494 ms to try 5000 different iterations.  Found a solution that moves 23 regions; Going from a computed imbalance of 2.687088027897161E-5 to a new imbalance of 7.850471242529529E-6. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0017082358106351274); MoveCostFunction : (multiplier=7.0, imbalance=0.0025555555555555557); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-03-24 01:56:04,719 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1458017895:83 , srv1849827555:83 , srv27618143:83 , srv342959852:83 , srv516726578:83 , srv687478532:83 , srv1002364565:84 , srv100449195:84 , srv1011532166:84 , srv1027809560:84 , srv1057041089:84 , srv1077145439:84 , srv1117248154:84 , srv113495022:84 , srv1139808780:84 , srv1166369819:84 , srv1180796989:84 , srv11846504:84 , srv1205671301:84 , srv1289409491:84 , srv1330941275:84 , srv1336629549:84 , srv1404090430:84 , srv1415558921:84 , srv1470389337:84 , srv1491881437:84 , srv1496679405:84 , srv1519178771:84 , srv1521927418:84 , srv1530436236:84 , srv1564262781:84 , srv1589300162:84 , srv1595310618:84 , srv1634032826:84 , srv1673349371:84 , srv1700242522:84 , srv1811626719:84 , srv1902335275:84 , srv1909899463:84 , srv1939039208:84 , srv1955946910:84 , srv1970174502:84 , srv2006389749:84 , srv201640073:84 , srv2019773664:84 , srv2023038965:84 , srv2027239993:84 , srv2030604300:84 , srv2046444446:84 , srv2104984034:84 , srv234717137:84 , srv235022803:84 , srv245283602:84 , srv266671136:84 , srv287499454:84 , srv290487896:84 , srv297735545:84 , srv317572534:84 , srv349378500:84 , srv395355019:84 , srv40409004:84 , srv408641643:84 , srv418939823:84 , srv4473083:84 , srv486177393:84 , srv490536927:84 , srv497830396:84 , srv518361821:84 , srv526275256:84 , srv543555669:84 , srv57651786:84 , srv624310447:84 , srv647139112:84 , srv675612271:84 , srv702776400:84 , srv739577125:84 , srv744393005:84 , srv774309829:84 , srv784345119:84 , srv798864131:84 , srv799370367:84 , srv799683856:84 , srv823119237:84 , srv824931523:84 , srv83369648:84 , srv8527993:84 , srv881301264:84 , srv914732411:84 , srv930887373:84 , srv939447502:84 , srv962423977:84 , srv96999314:84 , srv985710124:84 , srv1484314526:85 , srv1700390242:85 , srv1952178989:85 , srv2082984587:85 , srv413369364:85 , srv773779916:85 , srv94921290:684 }
2023-03-24 01:56:04,725 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-03-24 01:56:04,725 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv96999314=98, srv1330941275=14, srv824931523=89, srv245283602=52, srv317572534=58, srv1496679405=22, srv1700390242=32, srv8527993=91, srv1589300162=27, srv647139112=76, srv40409004=62, srv799370367=86, srv1484314526=20, srv1970174502=40, srv290487896=56, srv799683856=87, srv1952178989=38, srv342959852=59, srv1166369819=9, srv1002364565=0, srv1939039208=37, srv1180796989=10, srv2019773664=43, srv675612271=77, srv1404090430=16, srv486177393=67, srv823119237=88, srv1289409491=13, srv349378500=60, srv773779916=82, srv1470389337=19, srv1530436236=25, srv408641643=63, srv287499454=55, srv1336629549=15, srv113495022=7, srv881301264=92, srv100449195=1, srv395355019=61, srv939447502=95, srv1811626719=33, srv1521927418=24, srv2046444446=47, srv1205671301=12, srv1519178771=23, srv234717137=50, srv985710124=99, srv687478532=78, srv1491881437=21, srv526275256=72, srv1955946910=39, srv2006389749=41, srv413369364=64, srv297735545=57, srv1415558921=17, srv1673349371=30, srv1011532166=2, srv4473083=66, srv543555669=73, srv914732411=93, srv1564262781=26, srv1139808780=8, srv702776400=79, srv94921290=96, srv739577125=80, srv1027809560=3, srv1700242522=31, srv266671136=53, srv1902335275=35, srv27618143=54, srv1077145439=5, srv516726578=70, srv1909899463=36, srv2104984034=49, srv418939823=65, srv518361821=71, srv11846504=11, srv1595310618=28, srv624310447=75, srv2023038965=44, srv83369648=90, srv1634032826=29, srv57651786=74, srv1849827555=34, srv201640073=42, srv2027239993=45, srv798864131=85, srv490536927=68, srv774309829=83, srv744393005=81, srv497830396=69, srv962423977=97, srv1057041089=4, srv235022803=51, srv2030604300=46, srv1117248154=6, srv2082984587=48, srv784345119=84, srv930887373=94, srv1458017895=18} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-03-24 01:56:04,740 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-03-24 01:56:04,740 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-03-24 01:56:04,740 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-03-24 01:56:04,740 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-03-24 01:56:04,740 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-03-24 01:56:04,741 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-03-24 01:56:04,741 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-03-24 01:56:04,741 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-03-24 01:56:04,741 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-03-24 01:56:04,741 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-03-24 01:56:04,741 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-03-24 01:56:04,741 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-03-24 01:56:04,741 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-03-24 01:56:04,741 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-03-24 01:56:04,741 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-03-24 01:56:04,741 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-03-24 01:56:04,741 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-03-24 01:56:04,741 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-03-24 01:56:04,742 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-03-24 01:56:04,742 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-03-24 01:56:04,742 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-03-24 01:56:04,742 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-03-24 01:56:04,742 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-03-24 01:56:04,742 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-03-24 01:56:04,742 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-03-24 01:56:04,742 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-03-24 01:56:04,742 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-03-24 01:56:04,742 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-03-24 01:56:04,742 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-03-24 01:56:04,742 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-03-24 01:56:04,743 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-03-24 01:56:04,743 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-03-24 01:56:04,743 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-03-24 01:56:04,743 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-03-24 01:56:04,743 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-03-24 01:56:04,743 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-03-24 01:56:04,743 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-03-24 01:56:04,743 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-03-24 01:56:04,743 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-03-24 01:56:04,743 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-03-24 01:56:04,743 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-03-24 01:56:04,743 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-03-24 01:56:04,743 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-03-24 01:56:04,743 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-03-24 01:56:04,743 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-03-24 01:56:04,743 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-03-24 01:56:04,743 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-03-24 01:56:04,743 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-03-24 01:56:04,743 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-03-24 01:56:04,743 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-03-24 01:56:04,744 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-03-24 01:56:04,744 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-03-24 01:56:04,744 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-03-24 01:56:04,744 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-03-24 01:56:04,744 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-03-24 01:56:04,744 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-03-24 01:56:04,744 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-03-24 01:56:04,744 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-03-24 01:56:04,744 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-03-24 01:56:04,744 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-03-24 01:56:04,744 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-03-24 01:56:04,744 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-03-24 01:56:04,744 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-03-24 01:56:04,744 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-03-24 01:56:04,744 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-03-24 01:56:04,744 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-03-24 01:56:04,744 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-03-24 01:56:04,744 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-03-24 01:56:04,745 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-03-24 01:56:04,745 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-03-24 01:56:04,745 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-03-24 01:56:04,745 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-03-24 01:56:04,745 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-03-24 01:56:04,745 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-03-24 01:56:04,745 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-03-24 01:56:04,745 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-03-24 01:56:04,745 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-03-24 01:56:04,745 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-03-24 01:56:04,745 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-03-24 01:56:04,745 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-03-24 01:56:04,746 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-03-24 01:56:04,746 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-03-24 01:56:04,746 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-03-24 01:56:04,746 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-03-24 01:56:04,746 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-03-24 01:56:04,746 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-03-24 01:56:04,746 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-03-24 01:56:04,746 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-03-24 01:56:04,746 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-03-24 01:56:04,746 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-03-24 01:56:04,746 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-03-24 01:56:04,746 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-03-24 01:56:04,746 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-03-24 01:56:04,747 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-03-24 01:56:04,747 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-03-24 01:56:04,747 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-03-24 01:56:04,747 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-03-24 01:56:04,747 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-03-24 01:56:04,747 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-03-24 01:56:04,747 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-03-24 01:56:04,747 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-03-24 01:56:04,887 INFO  [Time-limited test] balancer.StochasticLoadBalancer(381): Cluster wide - skipping load balancing because weighted average imbalance=7.689421800350782E-6 <= threshold(0.025). If you want more aggressive balancing, either lower hbase.master.balancer.stochastic.minCostNeedBalance from 0.025 or increase the relative multiplier(s) of the specific cost function(s). functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0017082358106351274); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-03-24 01:56:04,888 INFO  [Time-limited test] balancer.BalancerTestBase(570): Mock Final balance: { srv1458017895:83 , srv1849827555:83 , srv27618143:83 , srv342959852:83 , srv516726578:83 , srv687478532:83 , srv1002364565:84 , srv100449195:84 , srv1011532166:84 , srv1027809560:84 , srv1057041089:84 , srv1077145439:84 , srv1117248154:84 , srv113495022:84 , srv1139808780:84 , srv1166369819:84 , srv1180796989:84 , srv11846504:84 , srv1205671301:84 , srv1289409491:84 , srv1330941275:84 , srv1336629549:84 , srv1404090430:84 , srv1415558921:84 , srv1470389337:84 , srv1491881437:84 , srv1496679405:84 , srv1519178771:84 , srv1521927418:84 , srv1530436236:84 , srv1564262781:84 , srv1589300162:84 , srv1595310618:84 , srv1634032826:84 , srv1673349371:84 , srv1700242522:84 , srv1811626719:84 , srv1902335275:84 , srv1909899463:84 , srv1939039208:84 , srv1955946910:84 , srv1970174502:84 , srv2006389749:84 , srv201640073:84 , srv2019773664:84 , srv2023038965:84 , srv2027239993:84 , srv2030604300:84 , srv2046444446:84 , srv2104984034:84 , srv234717137:84 , srv235022803:84 , srv245283602:84 , srv266671136:84 , srv287499454:84 , srv290487896:84 , srv297735545:84 , srv317572534:84 , srv349378500:84 , srv395355019:84 , srv40409004:84 , srv408641643:84 , srv418939823:84 , srv4473083:84 , srv486177393:84 , srv490536927:84 , srv497830396:84 , srv518361821:84 , srv526275256:84 , srv543555669:84 , srv57651786:84 , srv624310447:84 , srv647139112:84 , srv675612271:84 , srv702776400:84 , srv739577125:84 , srv744393005:84 , srv774309829:84 , srv784345119:84 , srv798864131:84 , srv799370367:84 , srv799683856:84 , srv823119237:84 , srv824931523:84 , srv83369648:84 , srv8527993:84 , srv881301264:84 , srv914732411:84 , srv930887373:84 , srv939447502:84 , srv962423977:84 , srv96999314:84 , srv985710124:84 , srv1484314526:85 , srv1700390242:85 , srv1952178989:85 , srv2082984587:85 , srv413369364:85 , srv773779916:85 , srv94921290:684 }
2023-03-24 01:56:04,929 INFO  [Time-limited test] hbase.ResourceChecker(175): after: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnLargeClusterWithRacks Thread=10 (was 10), OpenFileDescriptor=260 (was 260), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=367 (was 347) - SystemLoadAverage LEAK? -, ProcessCount=170 (was 171), AvailableMemoryMB=5788 (was 6271)
2023-03-24 01:56:04,944 INFO  [Time-limited test] hbase.ResourceChecker(147): before: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnMidClusterWithRacks Thread=10, OpenFileDescriptor=260, MaxFileDescriptor=60000, SystemLoadAverage=367, ProcessCount=170, AvailableMemoryMB=5787
2023-03-24 01:56:04,945 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2023-03-24 01:56:04,945 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=5000, runMaxSteps=true, stepsPerRegion=800, maxRunningTime=120000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 111077.0 etc.
2023-03-24 01:56:04,962 INFO  [Time-limited test] balancer.BalancerTestBase(547): Mock Cluster : { srv1132616508:84 , srv1164292612:84 , srv1192977393:84 , srv1393650287:84 , srv1440358780:84 , srv1484526038:84 , srv162399126:84 , srv1841245633:84 , srv1896929381:84 , srv1916544418:84 , srv2075205237:84 , srv2092814726:84 , srv21499717:84 , srv252055018:84 , srv318382267:84 , srv333265552:84 , srv348313255:84 , srv602200329:84 , srv645080689:84 , srv679425865:84 , srv679567978:84 , srv733759709:84 , srv769706821:84 , srv834176067:84 , srv848344898:84 , srv894195308:84 , srv906400268:84 , srv925073745:84 , srv957179788:84 , srv1329732275:264 } [srvr=30 rgns=2700 avg=90.0 max=90 min=90]
2023-03-24 01:56:04,964 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-03-24 01:56:04,965 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv333265552=16, srv602200329=18, srv645080689=19, srv679425865=20, srv1393650287=4, srv733759709=22, srv1329732275=3, srv162399126=7, srv1192977393=2, srv2092814726=12, srv906400268=27, srv957179788=29, srv1164292612=1, srv1896929381=9, srv1841245633=8, srv252055018=14, srv318382267=15, srv1440358780=5, srv848344898=25, srv679567978=21, srv769706821=23, srv348313255=17, srv1484526038=6, srv1132616508=0, srv834176067=24, srv1916544418=10, srv925073745=28, srv2075205237=11, srv894195308=26, srv21499717=13} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-03-24 01:56:04,977 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-03-24 01:56:04,977 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-03-24 01:56:04,977 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-03-24 01:56:04,977 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-03-24 01:56:04,977 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-03-24 01:56:04,977 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-03-24 01:56:04,977 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-03-24 01:56:04,978 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-03-24 01:56:04,978 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-03-24 01:56:04,978 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-03-24 01:56:04,978 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-03-24 01:56:04,978 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-03-24 01:56:04,978 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-03-24 01:56:04,978 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-03-24 01:56:04,978 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-03-24 01:56:04,978 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-03-24 01:56:04,978 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-03-24 01:56:04,978 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-03-24 01:56:04,978 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-03-24 01:56:04,979 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-03-24 01:56:04,979 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-03-24 01:56:04,979 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-03-24 01:56:04,979 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-03-24 01:56:04,979 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-03-24 01:56:04,979 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-03-24 01:56:04,979 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-03-24 01:56:04,979 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-03-24 01:56:04,979 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-03-24 01:56:04,979 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-03-24 01:56:04,979 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-03-24 01:56:04,979 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=10, number of hosts=30, number of racks=4
2023-03-24 01:56:05,004 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=1.044702961980882, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-03-24 01:56:05,004 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.9912333900837796, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=1.044702961980882, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=64800000
2023-03-24 01:58:04,985 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 120002 ms to try 6021232 different iterations.  Found a solution that moves 1860 regions; Going from a computed imbalance of 0.9912333900837796 to a new imbalance of 4.341332789166274E-5. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); MoveCostFunction : (multiplier=7.0, imbalance=0.6888888888888889, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-03-24 01:58:04,992 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1132616508:90 , srv1164292612:90 , srv1192977393:90 , srv1329732275:90 , srv1393650287:90 , srv1440358780:90 , srv1484526038:90 , srv162399126:90 , srv1841245633:90 , srv1896929381:90 , srv1916544418:90 , srv2075205237:90 , srv2092814726:90 , srv21499717:90 , srv252055018:90 , srv318382267:90 , srv333265552:90 , srv348313255:90 , srv602200329:90 , srv645080689:90 , srv679425865:90 , srv679567978:90 , srv733759709:90 , srv769706821:90 , srv834176067:90 , srv848344898:90 , srv894195308:90 , srv906400268:90 , srv925073745:90 , srv957179788:90 }
2023-03-24 01:58:04,993 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-03-24 01:58:04,994 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv333265552=16, srv602200329=18, srv645080689=19, srv679425865=20, srv1393650287=4, srv733759709=22, srv1329732275=3, srv162399126=7, srv1192977393=2, srv2092814726=12, srv906400268=27, srv957179788=29, srv1164292612=1, srv1896929381=9, srv1841245633=8, srv252055018=14, srv318382267=15, srv1440358780=5, srv848344898=25, srv679567978=21, srv769706821=23, srv348313255=17, srv1484526038=6, srv1132616508=0, srv834176067=24, srv1916544418=10, srv925073745=28, srv2075205237=11, srv894195308=26, srv21499717=13} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-03-24 01:58:04,997 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-03-24 01:58:04,997 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-03-24 01:58:04,997 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-03-24 01:58:04,997 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-03-24 01:58:04,997 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-03-24 01:58:04,997 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-03-24 01:58:04,997 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-03-24 01:58:04,997 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-03-24 01:58:04,998 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-03-24 01:58:04,998 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-03-24 01:58:04,998 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-03-24 01:58:04,998 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-03-24 01:58:04,998 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-03-24 01:58:04,998 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-03-24 01:58:04,998 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-03-24 01:58:04,998 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-03-24 01:58:04,998 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-03-24 01:58:04,998 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-03-24 01:58:04,998 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-03-24 01:58:04,998 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-03-24 01:58:04,998 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-03-24 01:58:04,998 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-03-24 01:58:04,998 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-03-24 01:58:04,998 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-03-24 01:58:04,998 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-03-24 01:58:04,998 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-03-24 01:58:04,998 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-03-24 01:58:04,998 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-03-24 01:58:04,998 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-03-24 01:58:04,998 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-03-24 01:58:04,998 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=10, number of hosts=30, number of racks=4
2023-03-24 01:58:05,011 INFO  [Time-limited test] balancer.StochasticLoadBalancer(381): Cluster wide - skipping load balancing because weighted average imbalance=0.0 <= threshold(0.025). If you want more aggressive balancing, either lower hbase.master.balancer.stochastic.minCostNeedBalance from 0.025 or increase the relative multiplier(s) of the specific cost function(s). functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-03-24 01:58:05,011 INFO  [Time-limited test] balancer.BalancerTestBase(570): Mock Final balance: { srv1132616508:90 , srv1164292612:90 , srv1192977393:90 , srv1329732275:90 , srv1393650287:90 , srv1440358780:90 , srv1484526038:90 , srv162399126:90 , srv1841245633:90 , srv1896929381:90 , srv1916544418:90 , srv2075205237:90 , srv2092814726:90 , srv21499717:90 , srv252055018:90 , srv318382267:90 , srv333265552:90 , srv348313255:90 , srv602200329:90 , srv645080689:90 , srv679425865:90 , srv679567978:90 , srv733759709:90 , srv769706821:90 , srv834176067:90 , srv848344898:90 , srv894195308:90 , srv906400268:90 , srv925073745:90 , srv957179788:90 }
2023-03-24 01:58:05,025 INFO  [Time-limited test] hbase.ResourceChecker(175): after: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnMidClusterWithRacks Thread=9 (was 10), OpenFileDescriptor=260 (was 260), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=242 (was 367), ProcessCount=168 (was 170), AvailableMemoryMB=5829 (was 5787) - AvailableMemoryMB LEAK? -