2023-07-17 19:53:10,987 INFO  [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks timeout: 13 mins
2023-07-17 19:53:11,304 WARN  [Time-limited test] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties
2023-07-17 19:53:11,417 INFO  [Time-limited test] metrics.MetricRegistriesLoader(60): Loaded MetricRegistries class org.apache.hadoop.hbase.metrics.impl.MetricRegistriesImpl
2023-07-17 19:53:11,489 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2023-07-17 19:53:11,497 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc.
2023-07-17 19:53:11,511 INFO  [Time-limited test] hbase.ResourceChecker(147): before: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnLargeClusterWithRacks Thread=12, OpenFileDescriptor=263, MaxFileDescriptor=60000, SystemLoadAverage=331, ProcessCount=176, AvailableMemoryMB=7713
2023-07-17 19:53:11,513 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2023-07-17 19:53:11,513 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=5000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=10000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc.
2023-07-17 19:53:11,679 INFO  [Time-limited test] balancer.BalancerTestBase(547): Mock Cluster : { srv1028996635:84 , srv1039382901:84 , srv1050849199:84 , srv1073290947:84 , srv1073867202:84 , srv1097707492:84 , srv1107884406:84 , srv1112671384:84 , srv1118137009:84 , srv113700010:84 , srv1138559794:84 , srv1139516692:84 , srv1152026520:84 , srv116547124:84 , srv1167375096:84 , srv1189028788:84 , srv1215992887:84 , srv1229628365:84 , srv1287119650:84 , srv1311571917:84 , srv1314786936:84 , srv1326092562:84 , srv1329718459:84 , srv1345564194:84 , srv1364845212:84 , srv1372899355:84 , srv1381382154:84 , srv1447026648:84 , srv1471529207:84 , srv1513989548:84 , srv1547982993:84 , srv1548817504:84 , srv1564620399:84 , srv1566254381:84 , srv1573378238:84 , srv1581684151:84 , srv1591668706:84 , srv1613292698:84 , srv1629761724:84 , srv1728162394:84 , srv1734996151:84 , srv1784412489:84 , srv1801656727:84 , srv1802999613:84 , srv181694712:84 , srv1835746672:84 , srv1856091802:84 , srv1865326680:84 , srv1893925679:84 , srv1906555896:84 , srv1923917312:84 , srv193626532:84 , srv2006827987:84 , srv2021079710:84 , srv2053692254:84 , srv2056222472:84 , srv207575686:84 , srv2092664190:84 , srv2094163402:84 , srv2096722940:84 , srv2107169348:84 , srv211748873:84 , srv2144626990:84 , srv222832433:84 , srv248736708:84 , srv265567014:84 , srv26662636:84 , srv269495384:84 , srv29255474:84 , srv319747968:84 , srv379583296:84 , srv384490138:84 , srv395929740:84 , srv411717834:84 , srv428022428:84 , srv494474020:84 , srv571233396:84 , srv574719891:84 , srv59239813:84 , srv64148291:84 , srv653398634:84 , srv664765696:84 , srv696356412:84 , srv701722027:84 , srv715329442:84 , srv734952848:84 , srv737614434:84 , srv74006714:84 , srv764711785:84 , srv7753392:84 , srv78226040:84 , srv791233261:84 , srv79722733:84 , srv799922186:84 , srv829151767:84 , srv853482955:84 , srv904580282:84 , srv90583640:84 , srv981542424:84 , srv1264175256:684 } [srvr=100 rgns=9000 avg=90.0 max=90 min=90]
2023-07-17 19:53:11,693 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-07-17 19:53:11,701 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv2092664190=58, srv1865326680=48, srv981542424=99, srv1189028788=15, srv1381382154=27, srv113700010=9, srv1167375096=14, srv1229628365=17, srv2021079710=54, srv26662636=67, srv664765696=82, srv715329442=85, srv269495384=68, srv1329718459=23, srv653398634=81, srv411717834=74, srv1039382901=1, srv2107169348=61, srv181694712=45, srv853482955=96, srv1513989548=30, srv2094163402=59, srv734952848=86, srv379583296=71, srv1028996635=0, srv1112671384=7, srv79722733=93, srv1613292698=38, srv1107884406=6, srv1893925679=49, srv1073290947=3, srv193626532=52, srv1139516692=11, srv1287119650=19, srv384490138=72, srv1564620399=33, srv1923917312=51, srv1073867202=4, srv1138559794=10, srv1581684151=36, srv1345564194=24, srv1906555896=50, srv1050849199=2, srv1215992887=16, srv1591668706=37, srv1097707492=5, srv1264175256=18, srv1573378238=35, srv1801656727=43, srv74006714=88, srv1118137009=8, srv1835746672=46, srv319747968=70, srv1856091802=47, srv696356412=83, srv701722027=84, srv1152026520=12, srv904580282=97, srv116547124=13, srv428022428=75, srv1372899355=26, srv1566254381=34, srv2006827987=53, srv2144626990=63, srv494474020=76, srv1547982993=31, srv1629761724=39, srv1326092562=22, srv1471529207=29, srv1311571917=20, srv1784412489=42, srv1548817504=32, srv211748873=62, srv1447026648=28, srv64148291=80, srv222832433=64, srv248736708=65, srv764711785=89, srv59239813=79, srv2096722940=60, srv1364845212=25, srv1728162394=40, srv737614434=87, srv2056222472=56, srv2053692254=55, srv7753392=90, srv571233396=77, srv799922186=94, srv1802999613=44, srv395929740=73, srv829151767=95, srv78226040=91, srv1734996151=41, srv29255474=69, srv791233261=92, srv90583640=98, srv1314786936=21, srv574719891=78, srv265567014=66, srv207575686=57} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-07-17 19:53:11,800 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-07-17 19:53:11,800 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-07-17 19:53:11,800 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-07-17 19:53:11,800 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-07-17 19:53:11,800 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-07-17 19:53:11,800 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-07-17 19:53:11,800 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-07-17 19:53:11,800 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-07-17 19:53:11,801 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-07-17 19:53:11,801 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-07-17 19:53:11,801 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-07-17 19:53:11,801 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-07-17 19:53:11,801 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-07-17 19:53:11,801 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-07-17 19:53:11,801 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-07-17 19:53:11,801 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-07-17 19:53:11,801 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-07-17 19:53:11,801 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-07-17 19:53:11,801 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-07-17 19:53:11,802 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-07-17 19:53:11,802 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-07-17 19:53:11,802 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-07-17 19:53:11,802 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-07-17 19:53:11,802 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-07-17 19:53:11,802 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-07-17 19:53:11,802 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-07-17 19:53:11,802 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-07-17 19:53:11,802 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-07-17 19:53:11,802 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-07-17 19:53:11,802 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-07-17 19:53:11,803 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-07-17 19:53:11,803 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-07-17 19:53:11,803 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-07-17 19:53:11,803 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-07-17 19:53:11,803 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-07-17 19:53:11,803 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-07-17 19:53:11,803 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-07-17 19:53:11,804 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-07-17 19:53:11,804 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-07-17 19:53:11,804 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-07-17 19:53:11,804 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-07-17 19:53:11,804 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-07-17 19:53:11,804 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-07-17 19:53:11,804 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-07-17 19:53:11,804 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-07-17 19:53:11,805 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-07-17 19:53:11,805 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-07-17 19:53:11,805 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-07-17 19:53:11,805 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-07-17 19:53:11,805 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-07-17 19:53:11,805 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-07-17 19:53:11,805 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-07-17 19:53:11,806 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-07-17 19:53:11,806 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-07-17 19:53:11,806 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-07-17 19:53:11,806 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-07-17 19:53:11,806 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-07-17 19:53:11,806 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-07-17 19:53:11,806 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-07-17 19:53:11,807 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-07-17 19:53:11,807 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-07-17 19:53:11,807 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-07-17 19:53:11,807 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-07-17 19:53:11,807 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-07-17 19:53:11,807 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-07-17 19:53:11,807 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-07-17 19:53:11,807 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-07-17 19:53:11,807 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-07-17 19:53:11,807 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-07-17 19:53:11,808 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-07-17 19:53:11,808 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-07-17 19:53:11,808 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-07-17 19:53:11,808 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-07-17 19:53:11,808 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-07-17 19:53:11,808 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-07-17 19:53:11,808 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-07-17 19:53:11,808 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-07-17 19:53:11,808 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-07-17 19:53:11,809 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-07-17 19:53:11,809 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-07-17 19:53:11,809 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-07-17 19:53:11,809 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-07-17 19:53:11,809 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-07-17 19:53:11,809 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-07-17 19:53:11,809 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-07-17 19:53:11,809 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-07-17 19:53:11,810 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-07-17 19:53:11,810 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-07-17 19:53:11,810 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-07-17 19:53:11,810 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-07-17 19:53:11,810 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-07-17 19:53:11,810 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-07-17 19:53:11,810 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-07-17 19:53:11,811 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-07-17 19:53:11,811 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-07-17 19:53:11,811 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-07-17 19:53:11,811 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-07-17 19:53:11,812 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-07-17 19:53:11,812 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-07-17 19:53:11,812 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-07-17 19:53:11,812 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-07-17 19:53:12,032 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.06666666666666667, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-07-17 19:53:12,032 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-07-17 19:53:12,032 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.9909252140407105, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.06666666666666667, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-07-17 19:53:12,367 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 533 ms to try 5000 different iterations.  Found a solution that moves 4646 regions; Going from a computed imbalance of 0.9909252140407105 to a new imbalance of 0.1835541080682675. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.04100891231352395, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.059506009844652444, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.5162222222222222, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.04100891231352395, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.17925, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.24083333333333334, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-07-17 19:53:12,387 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1923917312:81 , srv737614434:81 , srv1314786936:82 , srv1548817504:82 , srv181694712:82 , srv2056222472:82 , srv395929740:82 , srv571233396:82 , srv653398634:82 , srv981542424:82 , srv1547982993:83 , srv1564620399:83 , srv193626532:83 , srv2006827987:83 , srv384490138:83 , srv411717834:83 , srv696356412:83 , srv791233261:83 , srv1073290947:84 , srv1073867202:84 , srv1118137009:84 , srv1229628365:84 , srv248736708:84 , srv574719891:84 , srv715329442:84 , srv764711785:84 , srv799922186:84 , srv90583640:84 , srv1097707492:85 , srv1139516692:85 , srv116547124:85 , srv1364845212:85 , srv1591668706:85 , srv1802999613:85 , srv2094163402:85 , srv29255474:85 , srv59239813:85 , srv701722027:85 , srv74006714:85 , srv7753392:85 , srv853482955:85 , srv1112671384:86 , srv1152026520:86 , srv1326092562:86 , srv1329718459:86 , srv1381382154:86 , srv1728162394:86 , srv2053692254:86 , srv207575686:86 , srv2092664190:86 , srv428022428:86 , srv64148291:86 , srv664765696:86 , srv904580282:86 , srv1028996635:87 , srv1287119650:87 , srv1471529207:87 , srv1513989548:87 , srv1573378238:87 , srv1613292698:87 , srv1784412489:87 , srv1835746672:87 , srv1856091802:87 , srv1865326680:87 , srv1893925679:87 , srv2096722940:87 , srv211748873:87 , srv2144626990:87 , srv222832433:87 , srv265567014:87 , srv494474020:87 , srv829151767:87 , srv1107884406:88 , srv113700010:88 , srv1189028788:88 , srv1215992887:88 , srv1311571917:88 , srv1566254381:88 , srv1734996151:88 , srv1906555896:88 , srv1050849199:89 , srv1345564194:89 , srv1447026648:89 , srv1581684151:89 , srv2107169348:89 , srv379583296:89 , srv734952848:89 , srv78226040:89 , srv1039382901:90 , srv1167375096:90 , srv1372899355:90 , srv26662636:90 , srv79722733:90 , srv269495384:91 , srv1801656727:93 , srv2021079710:93 , srv319747968:95 , srv1629761724:96 , srv1138559794:101 , srv1264175256:454 }
2023-07-17 19:53:12,392 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-07-17 19:53:12,393 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv2092664190=58, srv1865326680=48, srv981542424=99, srv1189028788=15, srv1381382154=27, srv113700010=9, srv1167375096=14, srv1229628365=17, srv2021079710=54, srv26662636=67, srv664765696=82, srv715329442=85, srv269495384=68, srv1329718459=23, srv653398634=81, srv411717834=74, srv1039382901=1, srv2107169348=61, srv181694712=45, srv853482955=96, srv1513989548=30, srv2094163402=59, srv734952848=86, srv379583296=71, srv1028996635=0, srv1112671384=7, srv79722733=93, srv1613292698=38, srv1107884406=6, srv1893925679=49, srv1073290947=3, srv193626532=52, srv1139516692=11, srv1287119650=19, srv384490138=72, srv1564620399=33, srv1923917312=51, srv1073867202=4, srv1138559794=10, srv1581684151=36, srv1345564194=24, srv1906555896=50, srv1050849199=2, srv1215992887=16, srv1591668706=37, srv1097707492=5, srv1264175256=18, srv1573378238=35, srv1801656727=43, srv74006714=88, srv1118137009=8, srv1835746672=46, srv319747968=70, srv1856091802=47, srv696356412=83, srv701722027=84, srv1152026520=12, srv904580282=97, srv116547124=13, srv428022428=75, srv1372899355=26, srv1566254381=34, srv2006827987=53, srv2144626990=63, srv494474020=76, srv1547982993=31, srv1629761724=39, srv1326092562=22, srv1471529207=29, srv1311571917=20, srv1784412489=42, srv1548817504=32, srv211748873=62, srv1447026648=28, srv64148291=80, srv222832433=64, srv248736708=65, srv764711785=89, srv59239813=79, srv2096722940=60, srv1364845212=25, srv1728162394=40, srv737614434=87, srv2056222472=56, srv2053692254=55, srv7753392=90, srv571233396=77, srv799922186=94, srv1802999613=44, srv395929740=73, srv829151767=95, srv78226040=91, srv1734996151=41, srv29255474=69, srv791233261=92, srv90583640=98, srv1314786936=21, srv574719891=78, srv265567014=66, srv207575686=57} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-07-17 19:53:12,417 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-07-17 19:53:12,417 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-07-17 19:53:12,417 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-07-17 19:53:12,417 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-07-17 19:53:12,417 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-07-17 19:53:12,418 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-07-17 19:53:12,418 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-07-17 19:53:12,418 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-07-17 19:53:12,418 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-07-17 19:53:12,418 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-07-17 19:53:12,418 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-07-17 19:53:12,418 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-07-17 19:53:12,418 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-07-17 19:53:12,418 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-07-17 19:53:12,418 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-07-17 19:53:12,418 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-07-17 19:53:12,418 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-07-17 19:53:12,418 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-07-17 19:53:12,419 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-07-17 19:53:12,419 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-07-17 19:53:12,419 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-07-17 19:53:12,419 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-07-17 19:53:12,419 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-07-17 19:53:12,419 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-07-17 19:53:12,419 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-07-17 19:53:12,419 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-07-17 19:53:12,419 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-07-17 19:53:12,419 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-07-17 19:53:12,419 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-07-17 19:53:12,419 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-07-17 19:53:12,419 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-07-17 19:53:12,419 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-07-17 19:53:12,420 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-07-17 19:53:12,420 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-07-17 19:53:12,420 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-07-17 19:53:12,420 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-07-17 19:53:12,420 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-07-17 19:53:12,420 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-07-17 19:53:12,420 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-07-17 19:53:12,420 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-07-17 19:53:12,420 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-07-17 19:53:12,420 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-07-17 19:53:12,420 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-07-17 19:53:12,420 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-07-17 19:53:12,420 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-07-17 19:53:12,420 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-07-17 19:53:12,421 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-07-17 19:53:12,421 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-07-17 19:53:12,421 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-07-17 19:53:12,421 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-07-17 19:53:12,421 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-07-17 19:53:12,421 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-07-17 19:53:12,421 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-07-17 19:53:12,421 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-07-17 19:53:12,421 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-07-17 19:53:12,421 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-07-17 19:53:12,421 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-07-17 19:53:12,421 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-07-17 19:53:12,421 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-07-17 19:53:12,421 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-07-17 19:53:12,422 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-07-17 19:53:12,422 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-07-17 19:53:12,422 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-07-17 19:53:12,422 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-07-17 19:53:12,422 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-07-17 19:53:12,422 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-07-17 19:53:12,422 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-07-17 19:53:12,422 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-07-17 19:53:12,422 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-07-17 19:53:12,422 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-07-17 19:53:12,422 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-07-17 19:53:12,422 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-07-17 19:53:12,422 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-07-17 19:53:12,423 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-07-17 19:53:12,423 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-07-17 19:53:12,423 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-07-17 19:53:12,423 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-07-17 19:53:12,423 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-07-17 19:53:12,423 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-07-17 19:53:12,423 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-07-17 19:53:12,423 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-07-17 19:53:12,423 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-07-17 19:53:12,423 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-07-17 19:53:12,423 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-07-17 19:53:12,423 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-07-17 19:53:12,423 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-07-17 19:53:12,424 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-07-17 19:53:12,424 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-07-17 19:53:12,424 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-07-17 19:53:12,424 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-07-17 19:53:12,424 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-07-17 19:53:12,424 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-07-17 19:53:12,424 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-07-17 19:53:12,424 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-07-17 19:53:12,424 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-07-17 19:53:12,425 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-07-17 19:53:12,425 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-07-17 19:53:12,425 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-07-17 19:53:12,425 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-07-17 19:53:12,425 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-07-17 19:53:12,425 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-07-17 19:53:12,640 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.04100891231352395, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.059506009844652444, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.04100891231352395, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.17925, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.24083333333333334, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-07-17 19:53:12,641 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-07-17 19:53:12,641 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.1835215760809474, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.04100891231352395, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.059506009844652444, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.04100891231352395, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.17925, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.24083333333333334, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-07-17 19:53:13,088 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 628 ms to try 5000 different iterations.  Found a solution that moves 2670 regions; Going from a computed imbalance of 0.1835215760809474 to a new imbalance of 0.015616100722396506. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.021496569646037737); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.03702457702867971, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.2966666666666667, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.021496569646037737); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.012333333333333333); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.04691666666666667, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-07-17 19:53:13,107 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1138559794:71 , srv1629761724:75 , srv1801656727:78 , srv319747968:79 , srv2021079710:80 , srv1167375096:81 , srv1345564194:81 , srv1372899355:81 , srv269495384:81 , srv1050849199:82 , srv1566254381:82 , srv26662636:82 , srv1189028788:83 , srv1447026648:83 , srv1581684151:83 , srv1613292698:83 , srv2107169348:83 , srv379583296:83 , srv64148291:83 , srv734952848:83 , srv829151767:83 , srv1835746672:84 , srv1865326680:84 , srv1906555896:84 , srv78226040:84 , srv79722733:84 , srv1107884406:85 , srv113700010:85 , srv1152026520:85 , srv1215992887:85 , srv1471529207:85 , srv1513989548:85 , srv1573378238:85 , srv1734996151:85 , srv1893925679:85 , srv2092664190:85 , srv211748873:85 , srv428022428:85 , srv74006714:85 , srv7753392:85 , srv1028996635:86 , srv1039382901:86 , srv1112671384:86 , srv116547124:86 , srv1287119650:86 , srv1311571917:86 , srv1364845212:86 , srv181694712:86 , srv1856091802:86 , srv2094163402:86 , srv2096722940:86 , srv2144626990:86 , srv29255474:86 , srv494474020:86 , srv59239813:86 , srv664765696:86 , srv1329718459:87 , srv2006827987:87 , srv2053692254:87 , srv207575686:87 , srv222832433:87 , srv265567014:87 , srv701722027:87 , srv715329442:87 , srv764711785:87 , srv853482955:87 , srv904580282:87 , srv90583640:87 , srv1139516692:88 , srv1229628365:88 , srv1314786936:88 , srv1326092562:88 , srv1564620399:88 , srv1591668706:88 , srv1802999613:88 , srv193626532:88 , srv248736708:88 , srv384490138:88 , srv395929740:88 , srv574719891:88 , srv1073867202:89 , srv1097707492:89 , srv1118137009:89 , srv1381382154:89 , srv1547982993:89 , srv1548817504:89 , srv1784412489:89 , srv653398634:89 , srv696356412:89 , srv791233261:89 , srv799922186:89 , srv981542424:89 , srv1073290947:90 , srv1728162394:90 , srv2056222472:90 , srv571233396:90 , srv737614434:91 , srv1923917312:92 , srv411717834:92 , srv1264175256:511 }
2023-07-17 19:53:13,114 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-07-17 19:53:13,115 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv2092664190=58, srv1865326680=48, srv981542424=99, srv1189028788=15, srv1381382154=27, srv113700010=9, srv1167375096=14, srv1229628365=17, srv2021079710=54, srv26662636=67, srv664765696=82, srv715329442=85, srv269495384=68, srv1329718459=23, srv653398634=81, srv411717834=74, srv1039382901=1, srv2107169348=61, srv181694712=45, srv853482955=96, srv1513989548=30, srv2094163402=59, srv734952848=86, srv379583296=71, srv1028996635=0, srv1112671384=7, srv79722733=93, srv1613292698=38, srv1107884406=6, srv1893925679=49, srv1073290947=3, srv193626532=52, srv1139516692=11, srv1287119650=19, srv384490138=72, srv1564620399=33, srv1923917312=51, srv1073867202=4, srv1138559794=10, srv1581684151=36, srv1345564194=24, srv1906555896=50, srv1050849199=2, srv1215992887=16, srv1591668706=37, srv1097707492=5, srv1264175256=18, srv1573378238=35, srv1801656727=43, srv74006714=88, srv1118137009=8, srv1835746672=46, srv319747968=70, srv1856091802=47, srv696356412=83, srv701722027=84, srv1152026520=12, srv904580282=97, srv116547124=13, srv428022428=75, srv1372899355=26, srv1566254381=34, srv2006827987=53, srv2144626990=63, srv494474020=76, srv1547982993=31, srv1629761724=39, srv1326092562=22, srv1471529207=29, srv1311571917=20, srv1784412489=42, srv1548817504=32, srv211748873=62, srv1447026648=28, srv64148291=80, srv222832433=64, srv248736708=65, srv764711785=89, srv59239813=79, srv2096722940=60, srv1364845212=25, srv1728162394=40, srv737614434=87, srv2056222472=56, srv2053692254=55, srv7753392=90, srv571233396=77, srv799922186=94, srv1802999613=44, srv395929740=73, srv829151767=95, srv78226040=91, srv1734996151=41, srv29255474=69, srv791233261=92, srv90583640=98, srv1314786936=21, srv574719891=78, srv265567014=66, srv207575686=57} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-07-17 19:53:13,137 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-07-17 19:53:13,138 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-07-17 19:53:13,138 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-07-17 19:53:13,138 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-07-17 19:53:13,138 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-07-17 19:53:13,138 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-07-17 19:53:13,138 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-07-17 19:53:13,138 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-07-17 19:53:13,138 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-07-17 19:53:13,138 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-07-17 19:53:13,138 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-07-17 19:53:13,138 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-07-17 19:53:13,139 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-07-17 19:53:13,139 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-07-17 19:53:13,139 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-07-17 19:53:13,139 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-07-17 19:53:13,139 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-07-17 19:53:13,139 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-07-17 19:53:13,139 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-07-17 19:53:13,139 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-07-17 19:53:13,139 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-07-17 19:53:13,139 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-07-17 19:53:13,139 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-07-17 19:53:13,140 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-07-17 19:53:13,140 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-07-17 19:53:13,140 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-07-17 19:53:13,140 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-07-17 19:53:13,140 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-07-17 19:53:13,140 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-07-17 19:53:13,140 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-07-17 19:53:13,140 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-07-17 19:53:13,140 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-07-17 19:53:13,141 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-07-17 19:53:13,141 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-07-17 19:53:13,141 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-07-17 19:53:13,141 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-07-17 19:53:13,141 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-07-17 19:53:13,141 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-07-17 19:53:13,141 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-07-17 19:53:13,141 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-07-17 19:53:13,141 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-07-17 19:53:13,141 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-07-17 19:53:13,141 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-07-17 19:53:13,142 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-07-17 19:53:13,142 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-07-17 19:53:13,142 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-07-17 19:53:13,142 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-07-17 19:53:13,142 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-07-17 19:53:13,142 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-07-17 19:53:13,142 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-07-17 19:53:13,142 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-07-17 19:53:13,142 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-07-17 19:53:13,142 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-07-17 19:53:13,143 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-07-17 19:53:13,143 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-07-17 19:53:13,143 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-07-17 19:53:13,143 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-07-17 19:53:13,143 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-07-17 19:53:13,143 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-07-17 19:53:13,143 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-07-17 19:53:13,143 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-07-17 19:53:13,143 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-07-17 19:53:13,143 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-07-17 19:53:13,144 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-07-17 19:53:13,144 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-07-17 19:53:13,144 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-07-17 19:53:13,144 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-07-17 19:53:13,144 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-07-17 19:53:13,144 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-07-17 19:53:13,144 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-07-17 19:53:13,144 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-07-17 19:53:13,144 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-07-17 19:53:13,144 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-07-17 19:53:13,144 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-07-17 19:53:13,145 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-07-17 19:53:13,145 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-07-17 19:53:13,145 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-07-17 19:53:13,145 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-07-17 19:53:13,145 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-07-17 19:53:13,145 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-07-17 19:53:13,145 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-07-17 19:53:13,145 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-07-17 19:53:13,145 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-07-17 19:53:13,145 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-07-17 19:53:13,146 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-07-17 19:53:13,146 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-07-17 19:53:13,146 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-07-17 19:53:13,146 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-07-17 19:53:13,146 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-07-17 19:53:13,146 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-07-17 19:53:13,146 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-07-17 19:53:13,146 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-07-17 19:53:13,146 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-07-17 19:53:13,146 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-07-17 19:53:13,147 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-07-17 19:53:13,147 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-07-17 19:53:13,147 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-07-17 19:53:13,147 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-07-17 19:53:13,147 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-07-17 19:53:13,147 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-07-17 19:53:13,147 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-07-17 19:53:13,325 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.021496569646037737); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.03702457702867971, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.021496569646037737); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.012333333333333333); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.04691666666666667, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-07-17 19:53:13,326 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-07-17 19:53:13,326 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.015597404982804451, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.021496569646037737); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.03702457702867971, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.021496569646037737); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.012333333333333333); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.04691666666666667, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-07-17 19:53:13,623 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 454 ms to try 5000 different iterations.  Found a solution that moves 1002 regions; Going from a computed imbalance of 0.015597404982804451 to a new imbalance of 4.717825914340015E-4. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.008706031639392198); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.013934269296612848); MoveCostFunction : (multiplier=7.0, imbalance=0.11133333333333334, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.008706031639392198); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=8.333333333333333E-5); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0031666666666666666); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-07-17 19:53:13,625 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1039382901:81 , srv1784412489:82 , srv319747968:82 , srv79722733:82 , srv1028996635:83 , srv1073290947:83 , srv1287119650:83 , srv1311571917:83 , srv1326092562:83 , srv1329718459:83 , srv1728162394:83 , srv2144626990:83 , srv265567014:83 , srv1097707492:84 , srv1107884406:84 , srv1112671384:84 , srv113700010:84 , srv1138559794:84 , srv1471529207:84 , srv1547982993:84 , srv1591668706:84 , srv1734996151:84 , srv1906555896:84 , srv1923917312:84 , srv2053692254:84 , srv2096722940:84 , srv248736708:84 , srv411717834:84 , srv494474020:84 , srv571233396:84 , srv791233261:84 , srv799922186:84 , srv904580282:84 , srv1050849199:85 , srv1073867202:85 , srv1139516692:85 , srv1372899355:85 , srv1381382154:85 , srv1447026648:85 , srv1513989548:85 , srv1581684151:85 , srv1893925679:85 , srv2021079710:85 , srv2056222472:85 , srv207575686:85 , srv2094163402:85 , srv222832433:85 , srv26662636:85 , srv269495384:85 , srv29255474:85 , srv379583296:85 , srv428022428:85 , srv574719891:85 , srv653398634:85 , srv696356412:85 , srv701722027:85 , srv737614434:85 , srv78226040:85 , srv1118137009:86 , srv116547124:86 , srv1167375096:86 , srv1215992887:86 , srv1229628365:86 , srv1314786936:86 , srv1364845212:86 , srv1564620399:86 , srv1573378238:86 , srv1629761724:86 , srv1802999613:86 , srv1835746672:86 , srv1856091802:86 , srv2006827987:86 , srv2107169348:86 , srv211748873:86 , srv395929740:86 , srv715329442:86 , srv734952848:86 , srv764711785:86 , srv7753392:86 , srv1152026520:87 , srv1189028788:87 , srv1548817504:87 , srv1566254381:87 , srv1613292698:87 , srv1801656727:87 , srv1865326680:87 , srv193626532:87 , srv2092664190:87 , srv384490138:87 , srv59239813:87 , srv664765696:87 , srv74006714:87 , srv853482955:87 , srv90583640:87 , srv981542424:87 , srv1345564194:88 , srv64148291:88 , srv829151767:88 , srv181694712:89 , srv1264175256:570 }
2023-07-17 19:53:13,629 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-07-17 19:53:13,630 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv2092664190=58, srv1865326680=48, srv981542424=99, srv1189028788=15, srv1381382154=27, srv113700010=9, srv1167375096=14, srv1229628365=17, srv2021079710=54, srv26662636=67, srv664765696=82, srv715329442=85, srv269495384=68, srv1329718459=23, srv653398634=81, srv411717834=74, srv1039382901=1, srv2107169348=61, srv181694712=45, srv853482955=96, srv1513989548=30, srv2094163402=59, srv734952848=86, srv379583296=71, srv1028996635=0, srv1112671384=7, srv79722733=93, srv1613292698=38, srv1107884406=6, srv1893925679=49, srv1073290947=3, srv193626532=52, srv1139516692=11, srv1287119650=19, srv384490138=72, srv1564620399=33, srv1923917312=51, srv1073867202=4, srv1138559794=10, srv1581684151=36, srv1345564194=24, srv1906555896=50, srv1050849199=2, srv1215992887=16, srv1591668706=37, srv1097707492=5, srv1264175256=18, srv1573378238=35, srv1801656727=43, srv74006714=88, srv1118137009=8, srv1835746672=46, srv319747968=70, srv1856091802=47, srv696356412=83, srv701722027=84, srv1152026520=12, srv904580282=97, srv116547124=13, srv428022428=75, srv1372899355=26, srv1566254381=34, srv2006827987=53, srv2144626990=63, srv494474020=76, srv1547982993=31, srv1629761724=39, srv1326092562=22, srv1471529207=29, srv1311571917=20, srv1784412489=42, srv1548817504=32, srv211748873=62, srv1447026648=28, srv64148291=80, srv222832433=64, srv248736708=65, srv764711785=89, srv59239813=79, srv2096722940=60, srv1364845212=25, srv1728162394=40, srv737614434=87, srv2056222472=56, srv2053692254=55, srv7753392=90, srv571233396=77, srv799922186=94, srv1802999613=44, srv395929740=73, srv829151767=95, srv78226040=91, srv1734996151=41, srv29255474=69, srv791233261=92, srv90583640=98, srv1314786936=21, srv574719891=78, srv265567014=66, srv207575686=57} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-07-17 19:53:13,650 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-07-17 19:53:13,650 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-07-17 19:53:13,650 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-07-17 19:53:13,650 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-07-17 19:53:13,650 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-07-17 19:53:13,651 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-07-17 19:53:13,651 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-07-17 19:53:13,651 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-07-17 19:53:13,651 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-07-17 19:53:13,651 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-07-17 19:53:13,651 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-07-17 19:53:13,651 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-07-17 19:53:13,651 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-07-17 19:53:13,651 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-07-17 19:53:13,651 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-07-17 19:53:13,651 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-07-17 19:53:13,651 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-07-17 19:53:13,651 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-07-17 19:53:13,651 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-07-17 19:53:13,651 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-07-17 19:53:13,652 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-07-17 19:53:13,652 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-07-17 19:53:13,652 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-07-17 19:53:13,652 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-07-17 19:53:13,652 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-07-17 19:53:13,652 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-07-17 19:53:13,652 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-07-17 19:53:13,652 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-07-17 19:53:13,652 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-07-17 19:53:13,653 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-07-17 19:53:13,653 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-07-17 19:53:13,653 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-07-17 19:53:13,653 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-07-17 19:53:13,653 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-07-17 19:53:13,653 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-07-17 19:53:13,653 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-07-17 19:53:13,653 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-07-17 19:53:13,653 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-07-17 19:53:13,654 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-07-17 19:53:13,654 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-07-17 19:53:13,654 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-07-17 19:53:13,654 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-07-17 19:53:13,654 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-07-17 19:53:13,654 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-07-17 19:53:13,654 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-07-17 19:53:13,654 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-07-17 19:53:13,654 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-07-17 19:53:13,655 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-07-17 19:53:13,655 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-07-17 19:53:13,655 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-07-17 19:53:13,655 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-07-17 19:53:13,655 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-07-17 19:53:13,655 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-07-17 19:53:13,655 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-07-17 19:53:13,655 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-07-17 19:53:13,655 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-07-17 19:53:13,656 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-07-17 19:53:13,656 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-07-17 19:53:13,656 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-07-17 19:53:13,656 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-07-17 19:53:13,656 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-07-17 19:53:13,656 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-07-17 19:53:13,656 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-07-17 19:53:13,656 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-07-17 19:53:13,656 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-07-17 19:53:13,657 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-07-17 19:53:13,657 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-07-17 19:53:13,657 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-07-17 19:53:13,657 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-07-17 19:53:13,657 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-07-17 19:53:13,657 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-07-17 19:53:13,657 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-07-17 19:53:13,657 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-07-17 19:53:13,657 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-07-17 19:53:13,658 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-07-17 19:53:13,658 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-07-17 19:53:13,658 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-07-17 19:53:13,658 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-07-17 19:53:13,658 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-07-17 19:53:13,658 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-07-17 19:53:13,658 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-07-17 19:53:13,658 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-07-17 19:53:13,658 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-07-17 19:53:13,658 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-07-17 19:53:13,659 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-07-17 19:53:13,659 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-07-17 19:53:13,659 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-07-17 19:53:13,659 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-07-17 19:53:13,659 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-07-17 19:53:13,659 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-07-17 19:53:13,659 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-07-17 19:53:13,659 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-07-17 19:53:13,659 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-07-17 19:53:13,660 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-07-17 19:53:13,660 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-07-17 19:53:13,660 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-07-17 19:53:13,660 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-07-17 19:53:13,660 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-07-17 19:53:13,660 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-07-17 19:53:13,660 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-07-17 19:53:13,660 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-07-17 19:53:13,817 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.008706031639392198); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.013934269296612848); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.008706031639392198); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=8.333333333333333E-5); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0031666666666666666); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-07-17 19:53:13,817 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-07-17 19:53:13,817 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=4.6476643747473594E-4, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.008706031639392198); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.013934269296612848); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.008706031639392198); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=8.333333333333333E-5); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0031666666666666666); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-07-17 19:53:14,203 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 523 ms to try 5000 different iterations.  Found a solution that moves 253 regions; Going from a computed imbalance of 4.6476643747473594E-4 to a new imbalance of 1.9486057553759098E-5. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=5.23782800878924E-4); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0017082358106351274); MoveCostFunction : (multiplier=7.0, imbalance=0.02811111111111111, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=5.23782800878924E-4); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=8.333333333333333E-5); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-07-17 19:53:14,204 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1215992887:83 , srv1381382154:83 , srv1728162394:83 , srv1802999613:83 , srv1856091802:83 , srv211748873:83 , srv222832433:83 , srv411717834:83 , srv664765696:83 , srv853482955:83 , srv1097707492:84 , srv1107884406:84 , srv1118137009:84 , srv1139516692:84 , srv1189028788:84 , srv1229628365:84 , srv1345564194:84 , srv1548817504:84 , srv1573378238:84 , srv1784412489:84 , srv1801656727:84 , srv1865326680:84 , srv193626532:84 , srv2021079710:84 , srv207575686:84 , srv2092664190:84 , srv2107169348:84 , srv384490138:84 , srv59239813:84 , srv734952848:84 , srv78226040:84 , srv829151767:84 , srv981542424:84 , srv1028996635:85 , srv1039382901:85 , srv1050849199:85 , srv1073290947:85 , srv1073867202:85 , srv1112671384:85 , srv1152026520:85 , srv116547124:85 , srv1167375096:85 , srv1311571917:85 , srv1326092562:85 , srv1364845212:85 , srv1447026648:85 , srv1471529207:85 , srv1513989548:85 , srv1564620399:85 , srv1566254381:85 , srv1581684151:85 , srv1591668706:85 , srv1613292698:85 , srv1629761724:85 , srv1734996151:85 , srv181694712:85 , srv1835746672:85 , srv1893925679:85 , srv1906555896:85 , srv1923917312:85 , srv2006827987:85 , srv2056222472:85 , srv2096722940:85 , srv248736708:85 , srv265567014:85 , srv26662636:85 , srv269495384:85 , srv379583296:85 , srv395929740:85 , srv571233396:85 , srv574719891:85 , srv64148291:85 , srv701722027:85 , srv715329442:85 , srv737614434:85 , srv74006714:85 , srv764711785:85 , srv799922186:85 , srv904580282:85 , srv90583640:85 , srv113700010:86 , srv1138559794:86 , srv1287119650:86 , srv1314786936:86 , srv1329718459:86 , srv1372899355:86 , srv1547982993:86 , srv2053692254:86 , srv2144626990:86 , srv29255474:86 , srv319747968:86 , srv428022428:86 , srv494474020:86 , srv653398634:86 , srv696356412:86 , srv7753392:86 , srv791233261:86 , srv79722733:86 , srv2094163402:87 , srv1264175256:608 }
2023-07-17 19:53:14,210 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-07-17 19:53:14,211 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv2092664190=58, srv1865326680=48, srv981542424=99, srv1189028788=15, srv1381382154=27, srv113700010=9, srv1167375096=14, srv1229628365=17, srv2021079710=54, srv26662636=67, srv664765696=82, srv715329442=85, srv269495384=68, srv1329718459=23, srv653398634=81, srv411717834=74, srv1039382901=1, srv2107169348=61, srv181694712=45, srv853482955=96, srv1513989548=30, srv2094163402=59, srv734952848=86, srv379583296=71, srv1028996635=0, srv1112671384=7, srv79722733=93, srv1613292698=38, srv1107884406=6, srv1893925679=49, srv1073290947=3, srv193626532=52, srv1139516692=11, srv1287119650=19, srv384490138=72, srv1564620399=33, srv1923917312=51, srv1073867202=4, srv1138559794=10, srv1581684151=36, srv1345564194=24, srv1906555896=50, srv1050849199=2, srv1215992887=16, srv1591668706=37, srv1097707492=5, srv1264175256=18, srv1573378238=35, srv1801656727=43, srv74006714=88, srv1118137009=8, srv1835746672=46, srv319747968=70, srv1856091802=47, srv696356412=83, srv701722027=84, srv1152026520=12, srv904580282=97, srv116547124=13, srv428022428=75, srv1372899355=26, srv1566254381=34, srv2006827987=53, srv2144626990=63, srv494474020=76, srv1547982993=31, srv1629761724=39, srv1326092562=22, srv1471529207=29, srv1311571917=20, srv1784412489=42, srv1548817504=32, srv211748873=62, srv1447026648=28, srv64148291=80, srv222832433=64, srv248736708=65, srv764711785=89, srv59239813=79, srv2096722940=60, srv1364845212=25, srv1728162394=40, srv737614434=87, srv2056222472=56, srv2053692254=55, srv7753392=90, srv571233396=77, srv799922186=94, srv1802999613=44, srv395929740=73, srv829151767=95, srv78226040=91, srv1734996151=41, srv29255474=69, srv791233261=92, srv90583640=98, srv1314786936=21, srv574719891=78, srv265567014=66, srv207575686=57} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-07-17 19:53:14,229 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-07-17 19:53:14,229 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-07-17 19:53:14,229 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-07-17 19:53:14,229 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-07-17 19:53:14,229 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-07-17 19:53:14,229 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-07-17 19:53:14,229 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-07-17 19:53:14,229 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-07-17 19:53:14,229 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-07-17 19:53:14,230 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-07-17 19:53:14,230 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-07-17 19:53:14,230 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-07-17 19:53:14,230 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-07-17 19:53:14,230 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-07-17 19:53:14,230 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-07-17 19:53:14,230 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-07-17 19:53:14,230 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-07-17 19:53:14,230 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-07-17 19:53:14,230 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-07-17 19:53:14,230 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-07-17 19:53:14,230 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-07-17 19:53:14,231 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-07-17 19:53:14,231 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-07-17 19:53:14,231 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-07-17 19:53:14,231 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-07-17 19:53:14,231 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-07-17 19:53:14,231 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-07-17 19:53:14,231 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-07-17 19:53:14,231 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-07-17 19:53:14,231 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-07-17 19:53:14,231 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-07-17 19:53:14,231 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-07-17 19:53:14,231 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-07-17 19:53:14,232 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-07-17 19:53:14,232 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-07-17 19:53:14,232 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-07-17 19:53:14,232 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-07-17 19:53:14,232 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-07-17 19:53:14,232 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-07-17 19:53:14,232 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-07-17 19:53:14,232 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-07-17 19:53:14,232 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-07-17 19:53:14,232 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-07-17 19:53:14,232 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-07-17 19:53:14,232 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-07-17 19:53:14,233 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-07-17 19:53:14,233 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-07-17 19:53:14,233 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-07-17 19:53:14,233 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-07-17 19:53:14,233 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-07-17 19:53:14,233 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-07-17 19:53:14,233 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-07-17 19:53:14,233 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-07-17 19:53:14,233 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-07-17 19:53:14,233 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-07-17 19:53:14,233 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-07-17 19:53:14,234 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-07-17 19:53:14,234 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-07-17 19:53:14,234 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-07-17 19:53:14,234 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-07-17 19:53:14,234 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-07-17 19:53:14,234 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-07-17 19:53:14,234 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-07-17 19:53:14,234 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-07-17 19:53:14,234 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-07-17 19:53:14,234 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-07-17 19:53:14,235 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-07-17 19:53:14,235 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-07-17 19:53:14,235 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-07-17 19:53:14,235 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-07-17 19:53:14,235 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-07-17 19:53:14,235 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-07-17 19:53:14,235 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-07-17 19:53:14,236 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-07-17 19:53:14,236 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-07-17 19:53:14,236 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-07-17 19:53:14,236 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-07-17 19:53:14,236 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-07-17 19:53:14,236 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-07-17 19:53:14,236 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-07-17 19:53:14,236 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-07-17 19:53:14,236 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-07-17 19:53:14,236 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-07-17 19:53:14,237 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-07-17 19:53:14,237 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-07-17 19:53:14,237 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-07-17 19:53:14,237 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-07-17 19:53:14,237 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-07-17 19:53:14,237 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-07-17 19:53:14,237 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-07-17 19:53:14,237 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-07-17 19:53:14,237 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-07-17 19:53:14,237 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-07-17 19:53:14,237 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-07-17 19:53:14,237 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-07-17 19:53:14,237 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-07-17 19:53:14,238 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-07-17 19:53:14,238 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-07-17 19:53:14,238 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-07-17 19:53:14,238 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-07-17 19:53:14,238 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-07-17 19:53:14,398 INFO  [Time-limited test] balancer.StochasticLoadBalancer(381): Cluster wide - skipping load balancing because weighted average imbalance=1.7714513689792858E-5 <= threshold(0.025). If you want more aggressive balancing, either lower hbase.master.balancer.stochastic.minCostNeedBalance from 0.025 or increase the relative multiplier(s) of the specific cost function(s). functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=5.23782800878924E-4); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0017082358106351274); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=5.23782800878924E-4); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=8.333333333333333E-5); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-07-17 19:53:14,398 INFO  [Time-limited test] balancer.BalancerTestBase(570): Mock Final balance: { srv1215992887:83 , srv1381382154:83 , srv1728162394:83 , srv1802999613:83 , srv1856091802:83 , srv211748873:83 , srv222832433:83 , srv411717834:83 , srv664765696:83 , srv853482955:83 , srv1097707492:84 , srv1107884406:84 , srv1118137009:84 , srv1139516692:84 , srv1189028788:84 , srv1229628365:84 , srv1345564194:84 , srv1548817504:84 , srv1573378238:84 , srv1784412489:84 , srv1801656727:84 , srv1865326680:84 , srv193626532:84 , srv2021079710:84 , srv207575686:84 , srv2092664190:84 , srv2107169348:84 , srv384490138:84 , srv59239813:84 , srv734952848:84 , srv78226040:84 , srv829151767:84 , srv981542424:84 , srv1028996635:85 , srv1039382901:85 , srv1050849199:85 , srv1073290947:85 , srv1073867202:85 , srv1112671384:85 , srv1152026520:85 , srv116547124:85 , srv1167375096:85 , srv1311571917:85 , srv1326092562:85 , srv1364845212:85 , srv1447026648:85 , srv1471529207:85 , srv1513989548:85 , srv1564620399:85 , srv1566254381:85 , srv1581684151:85 , srv1591668706:85 , srv1613292698:85 , srv1629761724:85 , srv1734996151:85 , srv181694712:85 , srv1835746672:85 , srv1893925679:85 , srv1906555896:85 , srv1923917312:85 , srv2006827987:85 , srv2056222472:85 , srv2096722940:85 , srv248736708:85 , srv265567014:85 , srv26662636:85 , srv269495384:85 , srv379583296:85 , srv395929740:85 , srv571233396:85 , srv574719891:85 , srv64148291:85 , srv701722027:85 , srv715329442:85 , srv737614434:85 , srv74006714:85 , srv764711785:85 , srv799922186:85 , srv904580282:85 , srv90583640:85 , srv113700010:86 , srv1138559794:86 , srv1287119650:86 , srv1314786936:86 , srv1329718459:86 , srv1372899355:86 , srv1547982993:86 , srv2053692254:86 , srv2144626990:86 , srv29255474:86 , srv319747968:86 , srv428022428:86 , srv494474020:86 , srv653398634:86 , srv696356412:86 , srv7753392:86 , srv791233261:86 , srv79722733:86 , srv2094163402:87 , srv1264175256:608 }
2023-07-17 19:53:14,442 INFO  [Time-limited test] hbase.ResourceChecker(175): after: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnLargeClusterWithRacks Thread=12 (was 12), OpenFileDescriptor=263 (was 263), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=331 (was 331), ProcessCount=175 (was 176), AvailableMemoryMB=7119 (was 7713)
2023-07-17 19:53:14,454 INFO  [Time-limited test] hbase.ResourceChecker(147): before: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnMidClusterWithRacks Thread=12, OpenFileDescriptor=263, MaxFileDescriptor=60000, SystemLoadAverage=331, ProcessCount=175, AvailableMemoryMB=7118
2023-07-17 19:53:14,454 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2023-07-17 19:53:14,455 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=5000, runMaxSteps=true, stepsPerRegion=800, maxRunningTime=120000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 111077.0 etc.
2023-07-17 19:53:14,467 INFO  [Time-limited test] balancer.BalancerTestBase(547): Mock Cluster : { srv1066688976:84 , srv1149258058:84 , srv1167640546:84 , srv1174067602:84 , srv1199819995:84 , srv120574507:84 , srv1266319500:84 , srv1271458912:84 , srv1347555891:84 , srv1540628896:84 , srv1831364753:84 , srv1894395244:84 , srv1917536305:84 , srv1987188503:84 , srv1991386648:84 , srv20231214:84 , srv272691904:84 , srv37528288:84 , srv441854092:84 , srv458853396:84 , srv482841530:84 , srv500600423:84 , srv585131851:84 , srv645348311:84 , srv711188086:84 , srv733134671:84 , srv75679008:84 , srv822971636:84 , srv956750480:84 , srv745903919:264 } [srvr=30 rgns=2700 avg=90.0 max=90 min=90]
2023-07-17 19:53:14,469 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-07-17 19:53:14,470 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1167640546=2, srv458853396=19, srv822971636=28, srv120574507=5, srv1347555891=8, srv645348311=23, srv733134671=25, srv1066688976=0, srv1271458912=7, srv585131851=22, srv1149258058=1, srv956750480=29, srv745903919=26, srv1199819995=4, srv1266319500=6, srv20231214=15, srv37528288=17, srv441854092=18, srv1831364753=10, srv1894395244=11, srv272691904=16, srv1174067602=3, srv1917536305=12, srv500600423=21, srv1540628896=9, srv482841530=20, srv1987188503=13, srv1991386648=14, srv711188086=24, srv75679008=27} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-07-17 19:53:14,483 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-07-17 19:53:14,483 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-07-17 19:53:14,483 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-07-17 19:53:14,483 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-07-17 19:53:14,483 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-07-17 19:53:14,483 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-07-17 19:53:14,483 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-07-17 19:53:14,484 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-07-17 19:53:14,484 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-07-17 19:53:14,484 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-07-17 19:53:14,484 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-07-17 19:53:14,484 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-07-17 19:53:14,484 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-07-17 19:53:14,484 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-07-17 19:53:14,484 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-07-17 19:53:14,484 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-07-17 19:53:14,484 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-07-17 19:53:14,484 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-07-17 19:53:14,484 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-07-17 19:53:14,484 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-07-17 19:53:14,485 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-07-17 19:53:14,485 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-07-17 19:53:14,485 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-07-17 19:53:14,485 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-07-17 19:53:14,485 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-07-17 19:53:14,485 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-07-17 19:53:14,485 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-07-17 19:53:14,485 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-07-17 19:53:14,485 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-07-17 19:53:14,485 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-07-17 19:53:14,485 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=10, number of hosts=30, number of racks=4
2023-07-17 19:53:14,514 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=1.0415491948272626, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-07-17 19:53:14,515 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.9912323963420475, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=1.0415491948272626, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=64800000
2023-07-17 19:55:14,489 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 120001 ms to try 6101638 different iterations.  Found a solution that moves 1844 regions; Going from a computed imbalance of 0.9912323963420475 to a new imbalance of 4.303987990979898E-5. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); MoveCostFunction : (multiplier=7.0, imbalance=0.682962962962963, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-07-17 19:55:14,497 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1066688976:90 , srv1149258058:90 , srv1167640546:90 , srv1174067602:90 , srv1199819995:90 , srv120574507:90 , srv1266319500:90 , srv1271458912:90 , srv1347555891:90 , srv1540628896:90 , srv1831364753:90 , srv1894395244:90 , srv1917536305:90 , srv1987188503:90 , srv1991386648:90 , srv20231214:90 , srv272691904:90 , srv37528288:90 , srv441854092:90 , srv458853396:90 , srv482841530:90 , srv500600423:90 , srv585131851:90 , srv645348311:90 , srv711188086:90 , srv733134671:90 , srv745903919:90 , srv75679008:90 , srv822971636:90 , srv956750480:90 }
2023-07-17 19:55:14,498 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-07-17 19:55:14,499 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1167640546=2, srv458853396=19, srv822971636=28, srv120574507=5, srv1347555891=8, srv645348311=23, srv733134671=25, srv1066688976=0, srv1271458912=7, srv585131851=22, srv1149258058=1, srv956750480=29, srv745903919=26, srv1199819995=4, srv1266319500=6, srv20231214=15, srv37528288=17, srv441854092=18, srv1831364753=10, srv1894395244=11, srv272691904=16, srv1174067602=3, srv1917536305=12, srv500600423=21, srv1540628896=9, srv482841530=20, srv1987188503=13, srv1991386648=14, srv711188086=24, srv75679008=27} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-07-17 19:55:14,502 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-07-17 19:55:14,502 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-07-17 19:55:14,502 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-07-17 19:55:14,502 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-07-17 19:55:14,502 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-07-17 19:55:14,502 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-07-17 19:55:14,502 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-07-17 19:55:14,502 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-07-17 19:55:14,502 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-07-17 19:55:14,503 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-07-17 19:55:14,503 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-07-17 19:55:14,503 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-07-17 19:55:14,503 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-07-17 19:55:14,503 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-07-17 19:55:14,503 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-07-17 19:55:14,503 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-07-17 19:55:14,503 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-07-17 19:55:14,503 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-07-17 19:55:14,503 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-07-17 19:55:14,503 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-07-17 19:55:14,503 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-07-17 19:55:14,503 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-07-17 19:55:14,503 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-07-17 19:55:14,503 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-07-17 19:55:14,503 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-07-17 19:55:14,503 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-07-17 19:55:14,503 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-07-17 19:55:14,503 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-07-17 19:55:14,503 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-07-17 19:55:14,503 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-07-17 19:55:14,503 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=10, number of hosts=30, number of racks=4
2023-07-17 19:55:14,520 INFO  [Time-limited test] balancer.StochasticLoadBalancer(381): Cluster wide - skipping load balancing because weighted average imbalance=0.0 <= threshold(0.025). If you want more aggressive balancing, either lower hbase.master.balancer.stochastic.minCostNeedBalance from 0.025 or increase the relative multiplier(s) of the specific cost function(s). functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-07-17 19:55:14,521 INFO  [Time-limited test] balancer.BalancerTestBase(570): Mock Final balance: { srv1066688976:90 , srv1149258058:90 , srv1167640546:90 , srv1174067602:90 , srv1199819995:90 , srv120574507:90 , srv1266319500:90 , srv1271458912:90 , srv1347555891:90 , srv1540628896:90 , srv1831364753:90 , srv1894395244:90 , srv1917536305:90 , srv1987188503:90 , srv1991386648:90 , srv20231214:90 , srv272691904:90 , srv37528288:90 , srv441854092:90 , srv458853396:90 , srv482841530:90 , srv500600423:90 , srv585131851:90 , srv645348311:90 , srv711188086:90 , srv733134671:90 , srv745903919:90 , srv75679008:90 , srv822971636:90 , srv956750480:90 }
2023-07-17 19:55:14,536 INFO  [Time-limited test] hbase.ResourceChecker(175): after: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnMidClusterWithRacks Thread=11 (was 12), OpenFileDescriptor=263 (was 263), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=276 (was 331), ProcessCount=178 (was 175) - ProcessCount LEAK? -, AvailableMemoryMB=6518 (was 7118)