2023-11-19 20:55:15,986 INFO  [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks timeout: 13 mins
2023-11-19 20:55:16,308 WARN  [Time-limited test] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties
2023-11-19 20:55:16,416 INFO  [Time-limited test] metrics.MetricRegistriesLoader(60): Loaded MetricRegistries class org.apache.hadoop.hbase.metrics.impl.MetricRegistriesImpl
2023-11-19 20:55:16,485 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2023-11-19 20:55:16,491 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc.
2023-11-19 20:55:16,504 INFO  [Time-limited test] hbase.ResourceChecker(147): before: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnLargeClusterWithRacks Thread=12, OpenFileDescriptor=290, MaxFileDescriptor=60000, SystemLoadAverage=169, ProcessCount=171, AvailableMemoryMB=15877
2023-11-19 20:55:16,506 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2023-11-19 20:55:16,506 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=5000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=10000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc.
2023-11-19 20:55:16,629 INFO  [Time-limited test] balancer.BalancerTestBase(547): Mock Cluster : { srv1014269360:84 , srv1014457974:84 , srv1026244550:84 , srv1038341179:84 , srv1042589845:84 , srv1043864732:84 , srv1048628820:84 , srv1068518494:84 , srv1090185692:84 , srv1090776876:84 , srv1125316637:84 , srv1128961294:84 , srv1160015113:84 , srv1169970756:84 , srv1173615922:84 , srv1206889402:84 , srv1248129079:84 , srv1264686832:84 , srv1299042313:84 , srv1306998776:84 , srv133088458:84 , srv141688160:84 , srv1424170343:84 , srv1430298643:84 , srv1450982376:84 , srv1463464788:84 , srv1468254846:84 , srv1480541763:84 , srv1481120841:84 , srv1487374020:84 , srv1498825591:84 , srv1522950596:84 , srv1557485336:84 , srv1564407910:84 , srv1610629514:84 , srv1617210700:84 , srv164747962:84 , srv1657155839:84 , srv1678729341:84 , srv1705092826:84 , srv1709232642:84 , srv1711694794:84 , srv1725835053:84 , srv1744742559:84 , srv1747621579:84 , srv1752952365:84 , srv1763374917:84 , srv1774443464:84 , srv1782608140:84 , srv178515478:84 , srv1791403832:84 , srv1822850721:84 , srv184144260:84 , srv1855356760:84 , srv1859467121:84 , srv1952009890:84 , srv1993748091:84 , srv2003178475:84 , srv2024567786:84 , srv2059258090:84 , srv2090417423:84 , srv2119790984:84 , srv2129985931:84 , srv216660168:84 , srv223012371:84 , srv225125976:84 , srv28655146:84 , srv326211133:84 , srv375860390:84 , srv417323881:84 , srv442176669:84 , srv449415424:84 , srv502624409:84 , srv514321383:84 , srv544735764:84 , srv561924173:84 , srv567221150:84 , srv619257273:84 , srv625409656:84 , srv62799334:84 , srv638019628:84 , srv682924381:84 , srv695594460:84 , srv697698804:84 , srv70150071:84 , srv710004268:84 , srv747008600:84 , srv76035594:84 , srv764804492:84 , srv778087003:84 , srv779677297:84 , srv780307064:84 , srv786856738:84 , srv809109395:84 , srv825403455:84 , srv836522141:84 , srv867321306:84 , srv928160550:84 , srv964350364:84 , srv1142036913:684 } [srvr=100 rgns=9000 avg=90.0 max=90 min=90]
2023-11-19 20:55:16,636 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-11-19 20:55:16,642 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1487374020=30, srv2119790984=62, srv1859467121=55, srv178515478=50, srv1090185692=8, srv625409656=79, srv1610629514=35, srv561924173=76, srv1068518494=7, srv1725835053=43, srv1744742559=44, srv417323881=70, srv1752952365=46, srv1557485336=33, srv375860390=69, srv1993748091=57, srv514321383=74, srv62799334=80, srv442176669=71, srv1463464788=26, srv1705092826=40, srv1774443464=48, srv1855356760=54, srv70150071=85, srv780307064=92, srv2059258090=60, srv764804492=89, srv928160550=98, srv1711694794=42, srv1043864732=5, srv1747621579=45, srv1160015113=13, srv502624409=73, srv1306998776=20, srv184144260=53, srv2090417423=61, srv1522950596=32, srv133088458=21, srv1822850721=52, srv1169970756=14, srv1430298643=24, srv326211133=68, srv1952009890=56, srv1014269360=0, srv2003178475=58, srv28655146=67, srv76035594=88, srv1206889402=16, srv695594460=83, srv836522141=96, srv1657155839=38, srv164747962=37, srv216660168=64, srv1763374917=47, srv1128961294=11, srv1617210700=36, srv1782608140=49, srv1299042313=19, srv786856738=93, srv1014457974=1, srv2129985931=63, srv1264686832=18, srv223012371=65, srv1026244550=2, srv1090776876=9, srv619257273=78, srv710004268=86, srv1791403832=51, srv1450982376=25, srv1481120841=29, srv1038341179=3, srv682924381=82, srv1048628820=6, srv638019628=81, srv141688160=22, srv544735764=75, srv225125976=66, srv1678729341=39, srv964350364=99, srv1042589845=4, srv1564407910=34, srv567221150=77, srv1498825591=31, srv1424170343=23, srv1248129079=17, srv1125316637=10, srv779677297=91, srv778087003=90, srv867321306=97, srv2024567786=59, srv1173615922=15, srv1468254846=27, srv449415424=72, srv697698804=84, srv747008600=87, srv809109395=94, srv1709232642=41, srv1142036913=12, srv825403455=95, srv1480541763=28} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-11-19 20:55:16,710 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-11-19 20:55:16,710 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-11-19 20:55:16,711 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-11-19 20:55:16,711 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-11-19 20:55:16,711 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-11-19 20:55:16,711 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-11-19 20:55:16,711 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-11-19 20:55:16,711 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-11-19 20:55:16,711 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-11-19 20:55:16,711 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-11-19 20:55:16,711 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-11-19 20:55:16,711 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-11-19 20:55:16,712 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-11-19 20:55:16,712 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-11-19 20:55:16,712 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-11-19 20:55:16,712 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-11-19 20:55:16,712 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-11-19 20:55:16,712 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-11-19 20:55:16,712 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-11-19 20:55:16,712 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-11-19 20:55:16,712 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-11-19 20:55:16,712 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-11-19 20:55:16,712 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-11-19 20:55:16,713 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-11-19 20:55:16,713 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-11-19 20:55:16,713 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-11-19 20:55:16,713 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-11-19 20:55:16,713 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-11-19 20:55:16,713 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-11-19 20:55:16,713 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-11-19 20:55:16,713 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-11-19 20:55:16,713 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-11-19 20:55:16,713 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-11-19 20:55:16,713 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-11-19 20:55:16,714 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-11-19 20:55:16,714 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-11-19 20:55:16,714 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-11-19 20:55:16,714 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-11-19 20:55:16,714 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-11-19 20:55:16,714 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-11-19 20:55:16,714 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-11-19 20:55:16,714 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-11-19 20:55:16,714 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-11-19 20:55:16,714 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-11-19 20:55:16,715 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-11-19 20:55:16,715 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-11-19 20:55:16,715 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-11-19 20:55:16,715 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-11-19 20:55:16,715 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-11-19 20:55:16,715 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-11-19 20:55:16,715 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-11-19 20:55:16,715 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-11-19 20:55:16,715 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-11-19 20:55:16,715 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-11-19 20:55:16,715 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-11-19 20:55:16,715 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-11-19 20:55:16,716 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-11-19 20:55:16,716 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-11-19 20:55:16,716 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-11-19 20:55:16,716 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-11-19 20:55:16,716 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-11-19 20:55:16,716 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-11-19 20:55:16,716 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-11-19 20:55:16,716 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-11-19 20:55:16,716 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-11-19 20:55:16,716 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-11-19 20:55:16,716 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-11-19 20:55:16,717 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-11-19 20:55:16,717 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-11-19 20:55:16,717 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-11-19 20:55:16,717 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-11-19 20:55:16,717 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-11-19 20:55:16,717 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-11-19 20:55:16,717 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-11-19 20:55:16,717 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-11-19 20:55:16,717 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-11-19 20:55:16,717 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-11-19 20:55:16,717 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-11-19 20:55:16,718 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-11-19 20:55:16,718 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-11-19 20:55:16,718 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-11-19 20:55:16,718 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-11-19 20:55:16,718 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-11-19 20:55:16,718 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-11-19 20:55:16,718 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-11-19 20:55:16,718 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-11-19 20:55:16,718 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-11-19 20:55:16,718 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-11-19 20:55:16,718 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-11-19 20:55:16,718 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-11-19 20:55:16,719 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-11-19 20:55:16,719 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-11-19 20:55:16,719 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-11-19 20:55:16,719 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-11-19 20:55:16,719 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-11-19 20:55:16,719 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-11-19 20:55:16,719 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-11-19 20:55:16,719 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-11-19 20:55:16,719 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-11-19 20:55:16,719 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-11-19 20:55:16,719 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-11-19 20:55:16,873 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.06666666666666667, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-11-19 20:55:16,874 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-11-19 20:55:16,874 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.9909252140407105, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.06666666666666667, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-11-19 20:55:17,211 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 468 ms to try 5000 different iterations.  Found a solution that moves 4736 regions; Going from a computed imbalance of 0.9909252140407105 to a new imbalance of 0.17412903571070937. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.039728471093014035, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.050251890762960605, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.5262222222222223, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.039728471093014035, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.16933333333333334, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.23583333333333334, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-11-19 20:55:17,220 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv809109395:80 , srv1043864732:82 , srv1068518494:82 , srv1160015113:82 , srv326211133:82 , srv1564407910:83 , srv164747962:83 , srv1752952365:83 , srv70150071:83 , srv1038341179:84 , srv1090776876:84 , srv1173615922:84 , srv1264686832:84 , srv1424170343:84 , srv1617210700:84 , srv1657155839:84 , srv1744742559:84 , srv1791403832:84 , srv2024567786:84 , srv225125976:84 , srv442176669:84 , srv502624409:84 , srv825403455:84 , srv1026244550:85 , srv1128961294:85 , srv133088458:85 , srv1487374020:85 , srv1522950596:85 , srv1557485336:85 , srv1747621579:85 , srv184144260:85 , srv1855356760:85 , srv1993748091:85 , srv2090417423:85 , srv375860390:85 , srv544735764:85 , srv567221150:85 , srv682924381:85 , srv747008600:85 , srv764804492:85 , srv779677297:85 , srv1306998776:86 , srv141688160:86 , srv1468254846:86 , srv1678729341:86 , srv1711694794:86 , srv1725835053:86 , srv1782608140:86 , srv178515478:86 , srv1859467121:86 , srv2119790984:86 , srv2129985931:86 , srv216660168:86 , srv417323881:86 , srv786856738:86 , srv1014457974:87 , srv1090185692:87 , srv1125316637:87 , srv1169970756:87 , srv1206889402:87 , srv1248129079:87 , srv1430298643:87 , srv1450982376:87 , srv1481120841:87 , srv1498825591:87 , srv1763374917:87 , srv625409656:87 , srv638019628:87 , srv836522141:87 , srv867321306:87 , srv1042589845:88 , srv1610629514:88 , srv1705092826:88 , srv223012371:88 , srv449415424:88 , srv695594460:88 , srv710004268:88 , srv1014269360:89 , srv1463464788:89 , srv1822850721:89 , srv1952009890:89 , srv561924173:89 , srv62799334:89 , srv778087003:89 , srv780307064:89 , srv928160550:89 , srv964350364:89 , srv1048628820:90 , srv1709232642:90 , srv514321383:90 , srv619257273:90 , srv697698804:90 , srv1299042313:91 , srv1480541763:91 , srv2003178475:91 , srv1774443464:92 , srv76035594:92 , srv2059258090:93 , srv28655146:96 , srv1142036913:443 }
2023-11-19 20:55:17,224 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-11-19 20:55:17,225 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1487374020=30, srv2119790984=62, srv1859467121=55, srv178515478=50, srv1090185692=8, srv625409656=79, srv1610629514=35, srv561924173=76, srv1068518494=7, srv1725835053=43, srv1744742559=44, srv417323881=70, srv1752952365=46, srv1557485336=33, srv375860390=69, srv1993748091=57, srv514321383=74, srv62799334=80, srv442176669=71, srv1463464788=26, srv1705092826=40, srv1774443464=48, srv1855356760=54, srv70150071=85, srv780307064=92, srv2059258090=60, srv764804492=89, srv928160550=98, srv1711694794=42, srv1043864732=5, srv1747621579=45, srv1160015113=13, srv502624409=73, srv1306998776=20, srv184144260=53, srv2090417423=61, srv1522950596=32, srv133088458=21, srv1822850721=52, srv1169970756=14, srv1430298643=24, srv326211133=68, srv1952009890=56, srv1014269360=0, srv2003178475=58, srv28655146=67, srv76035594=88, srv1206889402=16, srv695594460=83, srv836522141=96, srv1657155839=38, srv164747962=37, srv216660168=64, srv1763374917=47, srv1128961294=11, srv1617210700=36, srv1782608140=49, srv1299042313=19, srv786856738=93, srv1014457974=1, srv2129985931=63, srv1264686832=18, srv223012371=65, srv1026244550=2, srv1090776876=9, srv619257273=78, srv710004268=86, srv1791403832=51, srv1450982376=25, srv1481120841=29, srv1038341179=3, srv682924381=82, srv1048628820=6, srv638019628=81, srv141688160=22, srv544735764=75, srv225125976=66, srv1678729341=39, srv964350364=99, srv1042589845=4, srv1564407910=34, srv567221150=77, srv1498825591=31, srv1424170343=23, srv1248129079=17, srv1125316637=10, srv779677297=91, srv778087003=90, srv867321306=97, srv2024567786=59, srv1173615922=15, srv1468254846=27, srv449415424=72, srv697698804=84, srv747008600=87, srv809109395=94, srv1709232642=41, srv1142036913=12, srv825403455=95, srv1480541763=28} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-11-19 20:55:17,238 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-11-19 20:55:17,238 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-11-19 20:55:17,238 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-11-19 20:55:17,238 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-11-19 20:55:17,238 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-11-19 20:55:17,238 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-11-19 20:55:17,238 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-11-19 20:55:17,238 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-11-19 20:55:17,239 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-11-19 20:55:17,239 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-11-19 20:55:17,239 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-11-19 20:55:17,239 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-11-19 20:55:17,239 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-11-19 20:55:17,239 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-11-19 20:55:17,239 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-11-19 20:55:17,239 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-11-19 20:55:17,239 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-11-19 20:55:17,239 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-11-19 20:55:17,239 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-11-19 20:55:17,240 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-11-19 20:55:17,240 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-11-19 20:55:17,240 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-11-19 20:55:17,240 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-11-19 20:55:17,240 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-11-19 20:55:17,240 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-11-19 20:55:17,240 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-11-19 20:55:17,240 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-11-19 20:55:17,240 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-11-19 20:55:17,241 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-11-19 20:55:17,241 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-11-19 20:55:17,241 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-11-19 20:55:17,241 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-11-19 20:55:17,241 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-11-19 20:55:17,241 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-11-19 20:55:17,241 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-11-19 20:55:17,241 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-11-19 20:55:17,241 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-11-19 20:55:17,241 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-11-19 20:55:17,241 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-11-19 20:55:17,241 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-11-19 20:55:17,242 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-11-19 20:55:17,242 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-11-19 20:55:17,242 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-11-19 20:55:17,242 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-11-19 20:55:17,242 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-11-19 20:55:17,242 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-11-19 20:55:17,242 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-11-19 20:55:17,242 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-11-19 20:55:17,242 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-11-19 20:55:17,242 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-11-19 20:55:17,242 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-11-19 20:55:17,242 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-11-19 20:55:17,242 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-11-19 20:55:17,242 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-11-19 20:55:17,243 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-11-19 20:55:17,243 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-11-19 20:55:17,243 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-11-19 20:55:17,243 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-11-19 20:55:17,243 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-11-19 20:55:17,243 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-11-19 20:55:17,243 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-11-19 20:55:17,243 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-11-19 20:55:17,243 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-11-19 20:55:17,243 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-11-19 20:55:17,243 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-11-19 20:55:17,243 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-11-19 20:55:17,243 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-11-19 20:55:17,243 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-11-19 20:55:17,244 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-11-19 20:55:17,244 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-11-19 20:55:17,244 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-11-19 20:55:17,244 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-11-19 20:55:17,244 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-11-19 20:55:17,244 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-11-19 20:55:17,244 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-11-19 20:55:17,244 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-11-19 20:55:17,244 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-11-19 20:55:17,244 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-11-19 20:55:17,244 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-11-19 20:55:17,244 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-11-19 20:55:17,244 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-11-19 20:55:17,244 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-11-19 20:55:17,245 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-11-19 20:55:17,245 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-11-19 20:55:17,245 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-11-19 20:55:17,245 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-11-19 20:55:17,245 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-11-19 20:55:17,245 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-11-19 20:55:17,245 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-11-19 20:55:17,245 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-11-19 20:55:17,245 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-11-19 20:55:17,245 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-11-19 20:55:17,245 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-11-19 20:55:17,245 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-11-19 20:55:17,245 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-11-19 20:55:17,245 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-11-19 20:55:17,245 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-11-19 20:55:17,246 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-11-19 20:55:17,246 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-11-19 20:55:17,246 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-11-19 20:55:17,246 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-11-19 20:55:17,360 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.039728471093014035, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.050251890762960605, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.039728471093014035, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.16933333333333334, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.23583333333333334, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-11-19 20:55:17,360 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-11-19 20:55:17,360 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.17409587352991987, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.039728471093014035, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.050251890762960605, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.039728471093014035, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.16933333333333334, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.23583333333333334, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-11-19 20:55:17,637 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 377 ms to try 5000 different iterations.  Found a solution that moves 2644 regions; Going from a computed imbalance of 0.17409587352991987 to a new imbalance of 0.014596930405445975. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.023853169338522); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.03313069721033799, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.2937777777777778, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.023853169338522); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.011583333333333333); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.043166666666666666, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-11-19 20:55:17,651 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1480541763:79 , srv28655146:79 , srv1014269360:80 , srv1299042313:80 , srv2059258090:80 , srv514321383:80 , srv76035594:80 , srv1463464788:81 , srv1774443464:81 , srv1952009890:81 , srv2003178475:81 , srv619257273:81 , srv695594460:81 , srv1610629514:82 , srv1169970756:83 , srv1481120841:83 , srv1705092826:83 , srv1709232642:83 , srv1822850721:83 , srv697698804:83 , srv710004268:83 , srv778087003:83 , srv964350364:83 , srv1042589845:84 , srv1048628820:84 , srv1090185692:84 , srv1125316637:84 , srv1248129079:84 , srv133088458:84 , srv1430298643:84 , srv1468254846:84 , srv2129985931:84 , srv216660168:84 , srv223012371:84 , srv449415424:84 , srv561924173:84 , srv638019628:84 , srv867321306:84 , srv928160550:84 , srv1014457974:85 , srv1026244550:85 , srv1128961294:85 , srv1264686832:85 , srv1306998776:85 , srv1763374917:85 , srv1782608140:85 , srv1859467121:85 , srv2090417423:85 , srv625409656:85 , srv780307064:85 , srv836522141:85 , srv1206889402:86 , srv141688160:86 , srv1450982376:86 , srv1487374020:86 , srv178515478:86 , srv1791403832:86 , srv184144260:86 , srv1855356760:86 , srv2119790984:86 , srv375860390:86 , srv62799334:86 , srv682924381:86 , srv786856738:86 , srv1090776876:87 , srv1498825591:87 , srv1557485336:87 , srv1617210700:87 , srv164747962:87 , srv1678729341:87 , srv1725835053:87 , srv417323881:87 , srv502624409:87 , srv544735764:87 , srv747008600:87 , srv1173615922:88 , srv1424170343:88 , srv1744742559:88 , srv1747621579:88 , srv1993748091:88 , srv2024567786:88 , srv567221150:88 , srv779677297:88 , srv1160015113:89 , srv1522950596:89 , srv1564407910:89 , srv1657155839:89 , srv225125976:89 , srv70150071:89 , srv764804492:89 , srv1068518494:90 , srv1711694794:90 , srv326211133:90 , srv442176669:90 , srv825403455:90 , srv1752952365:91 , srv1043864732:92 , srv809109395:92 , srv1038341179:93 , srv1142036913:543 }
2023-11-19 20:55:17,655 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-11-19 20:55:17,656 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1487374020=30, srv2119790984=62, srv1859467121=55, srv178515478=50, srv1090185692=8, srv625409656=79, srv1610629514=35, srv561924173=76, srv1068518494=7, srv1725835053=43, srv1744742559=44, srv417323881=70, srv1752952365=46, srv1557485336=33, srv375860390=69, srv1993748091=57, srv514321383=74, srv62799334=80, srv442176669=71, srv1463464788=26, srv1705092826=40, srv1774443464=48, srv1855356760=54, srv70150071=85, srv780307064=92, srv2059258090=60, srv764804492=89, srv928160550=98, srv1711694794=42, srv1043864732=5, srv1747621579=45, srv1160015113=13, srv502624409=73, srv1306998776=20, srv184144260=53, srv2090417423=61, srv1522950596=32, srv133088458=21, srv1822850721=52, srv1169970756=14, srv1430298643=24, srv326211133=68, srv1952009890=56, srv1014269360=0, srv2003178475=58, srv28655146=67, srv76035594=88, srv1206889402=16, srv695594460=83, srv836522141=96, srv1657155839=38, srv164747962=37, srv216660168=64, srv1763374917=47, srv1128961294=11, srv1617210700=36, srv1782608140=49, srv1299042313=19, srv786856738=93, srv1014457974=1, srv2129985931=63, srv1264686832=18, srv223012371=65, srv1026244550=2, srv1090776876=9, srv619257273=78, srv710004268=86, srv1791403832=51, srv1450982376=25, srv1481120841=29, srv1038341179=3, srv682924381=82, srv1048628820=6, srv638019628=81, srv141688160=22, srv544735764=75, srv225125976=66, srv1678729341=39, srv964350364=99, srv1042589845=4, srv1564407910=34, srv567221150=77, srv1498825591=31, srv1424170343=23, srv1248129079=17, srv1125316637=10, srv779677297=91, srv778087003=90, srv867321306=97, srv2024567786=59, srv1173615922=15, srv1468254846=27, srv449415424=72, srv697698804=84, srv747008600=87, srv809109395=94, srv1709232642=41, srv1142036913=12, srv825403455=95, srv1480541763=28} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-11-19 20:55:17,685 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-11-19 20:55:17,686 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-11-19 20:55:17,686 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-11-19 20:55:17,686 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-11-19 20:55:17,686 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-11-19 20:55:17,686 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-11-19 20:55:17,686 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-11-19 20:55:17,686 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-11-19 20:55:17,687 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-11-19 20:55:17,687 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-11-19 20:55:17,687 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-11-19 20:55:17,687 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-11-19 20:55:17,687 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-11-19 20:55:17,687 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-11-19 20:55:17,687 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-11-19 20:55:17,687 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-11-19 20:55:17,687 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-11-19 20:55:17,687 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-11-19 20:55:17,687 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-11-19 20:55:17,687 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-11-19 20:55:17,687 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-11-19 20:55:17,687 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-11-19 20:55:17,687 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-11-19 20:55:17,687 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-11-19 20:55:17,688 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-11-19 20:55:17,688 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-11-19 20:55:17,688 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-11-19 20:55:17,688 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-11-19 20:55:17,688 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-11-19 20:55:17,688 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-11-19 20:55:17,688 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-11-19 20:55:17,688 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-11-19 20:55:17,688 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-11-19 20:55:17,688 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-11-19 20:55:17,689 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-11-19 20:55:17,689 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-11-19 20:55:17,689 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-11-19 20:55:17,689 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-11-19 20:55:17,689 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-11-19 20:55:17,689 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-11-19 20:55:17,689 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-11-19 20:55:17,689 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-11-19 20:55:17,689 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-11-19 20:55:17,690 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-11-19 20:55:17,690 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-11-19 20:55:17,690 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-11-19 20:55:17,690 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-11-19 20:55:17,690 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-11-19 20:55:17,690 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-11-19 20:55:17,690 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-11-19 20:55:17,690 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-11-19 20:55:17,690 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-11-19 20:55:17,691 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-11-19 20:55:17,691 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-11-19 20:55:17,691 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-11-19 20:55:17,691 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-11-19 20:55:17,691 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-11-19 20:55:17,691 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-11-19 20:55:17,691 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-11-19 20:55:17,691 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-11-19 20:55:17,691 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-11-19 20:55:17,692 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-11-19 20:55:17,692 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-11-19 20:55:17,692 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-11-19 20:55:17,692 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-11-19 20:55:17,692 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-11-19 20:55:17,692 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-11-19 20:55:17,692 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-11-19 20:55:17,692 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-11-19 20:55:17,693 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-11-19 20:55:17,693 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-11-19 20:55:17,693 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-11-19 20:55:17,693 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-11-19 20:55:17,693 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-11-19 20:55:17,693 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-11-19 20:55:17,693 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-11-19 20:55:17,693 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-11-19 20:55:17,693 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-11-19 20:55:17,694 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-11-19 20:55:17,694 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-11-19 20:55:17,694 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-11-19 20:55:17,694 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-11-19 20:55:17,694 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-11-19 20:55:17,694 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-11-19 20:55:17,694 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-11-19 20:55:17,694 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-11-19 20:55:17,695 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-11-19 20:55:17,695 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-11-19 20:55:17,695 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-11-19 20:55:17,695 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-11-19 20:55:17,695 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-11-19 20:55:17,695 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-11-19 20:55:17,695 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-11-19 20:55:17,695 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-11-19 20:55:17,695 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-11-19 20:55:17,696 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-11-19 20:55:17,696 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-11-19 20:55:17,696 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-11-19 20:55:17,696 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-11-19 20:55:17,696 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-11-19 20:55:17,696 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-11-19 20:55:17,854 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.023853169338522); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.03313069721033799, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.023853169338522); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.011583333333333333); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.043166666666666666, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-11-19 20:55:17,854 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-11-19 20:55:17,854 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.014578416721745079, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.023853169338522); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.03313069721033799, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.023853169338522); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.011583333333333333); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.043166666666666666, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-11-19 20:55:18,074 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 355 ms to try 5000 different iterations.  Found a solution that moves 932 regions; Going from a computed imbalance of 0.014578416721745079 to a new imbalance of 5.123112436020952E-4. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.007778579403935822); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.009039134271190744); MoveCostFunction : (multiplier=7.0, imbalance=0.10355555555555555, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.007778579403935822); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=8.333333333333333E-5); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.003916666666666666); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-11-19 20:55:18,075 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1038341179:80 , srv1711694794:81 , srv62799334:82 , srv1206889402:83 , srv1498825591:83 , srv1752952365:83 , srv1774443464:83 , srv28655146:83 , srv1043864732:84 , srv1048628820:84 , srv1450982376:84 , srv1522950596:84 , srv1657155839:84 , srv1678729341:84 , srv1709232642:84 , srv1725835053:84 , srv1744742559:84 , srv1747621579:84 , srv1822850721:84 , srv2059258090:84 , srv225125976:84 , srv442176669:84 , srv561924173:84 , srv697698804:84 , srv764804492:84 , srv780307064:84 , srv825403455:84 , srv836522141:84 , srv1014457974:85 , srv1042589845:85 , srv1160015113:85 , srv141688160:85 , srv1424170343:85 , srv1557485336:85 , srv1564407910:85 , srv1763374917:85 , srv178515478:85 , srv1993748091:85 , srv2003178475:85 , srv223012371:85 , srv417323881:85 , srv449415424:85 , srv70150071:85 , srv76035594:85 , srv779677297:85 , srv786856738:85 , srv809109395:85 , srv867321306:85 , srv928160550:85 , srv964350364:85 , srv1068518494:86 , srv1125316637:86 , srv1173615922:86 , srv1306998776:86 , srv1487374020:86 , srv1617210700:86 , srv164747962:86 , srv1705092826:86 , srv1782608140:86 , srv184144260:86 , srv1855356760:86 , srv1859467121:86 , srv1952009890:86 , srv2024567786:86 , srv2119790984:86 , srv544735764:86 , srv567221150:86 , srv625409656:86 , srv682924381:86 , srv710004268:86 , srv747008600:86 , srv778087003:86 , srv1026244550:87 , srv1090185692:87 , srv1090776876:87 , srv1128961294:87 , srv1248129079:87 , srv1299042313:87 , srv1430298643:87 , srv1463464788:87 , srv1480541763:87 , srv2090417423:87 , srv216660168:87 , srv326211133:87 , srv375860390:87 , srv502624409:87 , srv514321383:87 , srv619257273:87 , srv638019628:87 , srv1014269360:88 , srv1169970756:88 , srv1264686832:88 , srv133088458:88 , srv1468254846:88 , srv1481120841:88 , srv1610629514:88 , srv1791403832:88 , srv2129985931:88 , srv695594460:88 , srv1142036913:541 }
2023-11-19 20:55:18,079 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-11-19 20:55:18,080 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1487374020=30, srv2119790984=62, srv1859467121=55, srv178515478=50, srv1090185692=8, srv625409656=79, srv1610629514=35, srv561924173=76, srv1068518494=7, srv1725835053=43, srv1744742559=44, srv417323881=70, srv1752952365=46, srv1557485336=33, srv375860390=69, srv1993748091=57, srv514321383=74, srv62799334=80, srv442176669=71, srv1463464788=26, srv1705092826=40, srv1774443464=48, srv1855356760=54, srv70150071=85, srv780307064=92, srv2059258090=60, srv764804492=89, srv928160550=98, srv1711694794=42, srv1043864732=5, srv1747621579=45, srv1160015113=13, srv502624409=73, srv1306998776=20, srv184144260=53, srv2090417423=61, srv1522950596=32, srv133088458=21, srv1822850721=52, srv1169970756=14, srv1430298643=24, srv326211133=68, srv1952009890=56, srv1014269360=0, srv2003178475=58, srv28655146=67, srv76035594=88, srv1206889402=16, srv695594460=83, srv836522141=96, srv1657155839=38, srv164747962=37, srv216660168=64, srv1763374917=47, srv1128961294=11, srv1617210700=36, srv1782608140=49, srv1299042313=19, srv786856738=93, srv1014457974=1, srv2129985931=63, srv1264686832=18, srv223012371=65, srv1026244550=2, srv1090776876=9, srv619257273=78, srv710004268=86, srv1791403832=51, srv1450982376=25, srv1481120841=29, srv1038341179=3, srv682924381=82, srv1048628820=6, srv638019628=81, srv141688160=22, srv544735764=75, srv225125976=66, srv1678729341=39, srv964350364=99, srv1042589845=4, srv1564407910=34, srv567221150=77, srv1498825591=31, srv1424170343=23, srv1248129079=17, srv1125316637=10, srv779677297=91, srv778087003=90, srv867321306=97, srv2024567786=59, srv1173615922=15, srv1468254846=27, srv449415424=72, srv697698804=84, srv747008600=87, srv809109395=94, srv1709232642=41, srv1142036913=12, srv825403455=95, srv1480541763=28} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-11-19 20:55:18,092 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-11-19 20:55:18,092 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-11-19 20:55:18,092 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-11-19 20:55:18,092 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-11-19 20:55:18,092 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-11-19 20:55:18,093 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-11-19 20:55:18,093 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-11-19 20:55:18,093 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-11-19 20:55:18,093 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-11-19 20:55:18,093 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-11-19 20:55:18,093 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-11-19 20:55:18,093 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-11-19 20:55:18,093 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-11-19 20:55:18,093 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-11-19 20:55:18,093 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-11-19 20:55:18,093 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-11-19 20:55:18,093 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-11-19 20:55:18,093 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-11-19 20:55:18,093 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-11-19 20:55:18,093 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-11-19 20:55:18,093 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-11-19 20:55:18,093 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-11-19 20:55:18,094 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-11-19 20:55:18,094 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-11-19 20:55:18,094 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-11-19 20:55:18,094 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-11-19 20:55:18,094 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-11-19 20:55:18,094 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-11-19 20:55:18,094 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-11-19 20:55:18,094 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-11-19 20:55:18,094 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-11-19 20:55:18,094 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-11-19 20:55:18,094 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-11-19 20:55:18,095 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-11-19 20:55:18,095 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-11-19 20:55:18,095 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-11-19 20:55:18,095 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-11-19 20:55:18,095 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-11-19 20:55:18,095 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-11-19 20:55:18,095 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-11-19 20:55:18,095 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-11-19 20:55:18,095 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-11-19 20:55:18,095 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-11-19 20:55:18,096 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-11-19 20:55:18,096 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-11-19 20:55:18,096 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-11-19 20:55:18,096 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-11-19 20:55:18,096 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-11-19 20:55:18,096 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-11-19 20:55:18,096 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-11-19 20:55:18,097 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-11-19 20:55:18,097 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-11-19 20:55:18,097 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-11-19 20:55:18,097 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-11-19 20:55:18,097 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-11-19 20:55:18,097 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-11-19 20:55:18,097 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-11-19 20:55:18,097 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-11-19 20:55:18,098 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-11-19 20:55:18,098 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-11-19 20:55:18,098 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-11-19 20:55:18,098 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-11-19 20:55:18,098 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-11-19 20:55:18,098 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-11-19 20:55:18,098 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-11-19 20:55:18,098 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-11-19 20:55:18,098 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-11-19 20:55:18,099 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-11-19 20:55:18,099 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-11-19 20:55:18,099 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-11-19 20:55:18,099 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-11-19 20:55:18,099 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-11-19 20:55:18,099 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-11-19 20:55:18,099 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-11-19 20:55:18,099 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-11-19 20:55:18,099 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-11-19 20:55:18,100 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-11-19 20:55:18,100 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-11-19 20:55:18,100 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-11-19 20:55:18,100 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-11-19 20:55:18,100 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-11-19 20:55:18,100 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-11-19 20:55:18,100 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-11-19 20:55:18,100 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-11-19 20:55:18,100 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-11-19 20:55:18,100 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-11-19 20:55:18,101 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-11-19 20:55:18,101 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-11-19 20:55:18,101 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-11-19 20:55:18,101 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-11-19 20:55:18,101 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-11-19 20:55:18,101 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-11-19 20:55:18,101 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-11-19 20:55:18,101 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-11-19 20:55:18,101 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-11-19 20:55:18,101 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-11-19 20:55:18,102 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-11-19 20:55:18,102 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-11-19 20:55:18,102 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-11-19 20:55:18,102 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-11-19 20:55:18,102 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-11-19 20:55:18,208 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.007778579403935822); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.009039134271190744); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.007778579403935822); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=8.333333333333333E-5); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.003916666666666666); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-11-19 20:55:18,208 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-11-19 20:55:18,209 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=5.057852401190258E-4, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.007778579403935822); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.009039134271190744); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.007778579403935822); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=8.333333333333333E-5); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.003916666666666666); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-11-19 20:55:18,544 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 430 ms to try 5000 different iterations.  Found a solution that moves 235 regions; Going from a computed imbalance of 5.057852401190258E-4 to a new imbalance of 1.8398768799507375E-5. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=3.868392354571063E-4); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0016412198797244363); MoveCostFunction : (multiplier=7.0, imbalance=0.026111111111111113, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=3.868392354571063E-4); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=8.333333333333333E-5); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-11-19 20:55:18,545 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1299042313:83 , srv1430298643:83 , srv326211133:83 , srv567221150:83 , srv1043864732:84 , srv1048628820:84 , srv1068518494:84 , srv1090185692:84 , srv1090776876:84 , srv1169970756:84 , srv1173615922:84 , srv1248129079:84 , srv1481120841:84 , srv1522950596:84 , srv1610629514:84 , srv1617210700:84 , srv1791403832:84 , srv1993748091:84 , srv2119790984:84 , srv2129985931:84 , srv28655146:84 , srv375860390:84 , srv417323881:84 , srv442176669:84 , srv502624409:84 , srv544735764:84 , srv619257273:84 , srv625409656:84 , srv638019628:84 , srv697698804:84 , srv747008600:84 , srv764804492:84 , srv778087003:84 , srv779677297:84 , srv780307064:84 , srv825403455:84 , srv1014269360:85 , srv1014457974:85 , srv1026244550:85 , srv1038341179:85 , srv1042589845:85 , srv1125316637:85 , srv1128961294:85 , srv1264686832:85 , srv1306998776:85 , srv133088458:85 , srv1424170343:85 , srv1450982376:85 , srv1468254846:85 , srv1480541763:85 , srv1487374020:85 , srv1498825591:85 , srv1557485336:85 , srv1564407910:85 , srv1657155839:85 , srv1678729341:85 , srv1705092826:85 , srv1709232642:85 , srv1711694794:85 , srv1725835053:85 , srv1747621579:85 , srv1752952365:85 , srv1763374917:85 , srv1782608140:85 , srv178515478:85 , srv1822850721:85 , srv184144260:85 , srv1855356760:85 , srv1859467121:85 , srv1952009890:85 , srv2003178475:85 , srv2024567786:85 , srv2059258090:85 , srv2090417423:85 , srv223012371:85 , srv225125976:85 , srv449415424:85 , srv514321383:85 , srv561924173:85 , srv62799334:85 , srv682924381:85 , srv695594460:85 , srv70150071:85 , srv710004268:85 , srv76035594:85 , srv786856738:85 , srv809109395:85 , srv928160550:85 , srv964350364:85 , srv1160015113:86 , srv1206889402:86 , srv141688160:86 , srv1463464788:86 , srv164747962:86 , srv1744742559:86 , srv1774443464:86 , srv216660168:86 , srv836522141:86 , srv867321306:86 , srv1142036913:615 }
2023-11-19 20:55:18,549 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-11-19 20:55:18,550 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1487374020=30, srv2119790984=62, srv1859467121=55, srv178515478=50, srv1090185692=8, srv625409656=79, srv1610629514=35, srv561924173=76, srv1068518494=7, srv1725835053=43, srv1744742559=44, srv417323881=70, srv1752952365=46, srv1557485336=33, srv375860390=69, srv1993748091=57, srv514321383=74, srv62799334=80, srv442176669=71, srv1463464788=26, srv1705092826=40, srv1774443464=48, srv1855356760=54, srv70150071=85, srv780307064=92, srv2059258090=60, srv764804492=89, srv928160550=98, srv1711694794=42, srv1043864732=5, srv1747621579=45, srv1160015113=13, srv502624409=73, srv1306998776=20, srv184144260=53, srv2090417423=61, srv1522950596=32, srv133088458=21, srv1822850721=52, srv1169970756=14, srv1430298643=24, srv326211133=68, srv1952009890=56, srv1014269360=0, srv2003178475=58, srv28655146=67, srv76035594=88, srv1206889402=16, srv695594460=83, srv836522141=96, srv1657155839=38, srv164747962=37, srv216660168=64, srv1763374917=47, srv1128961294=11, srv1617210700=36, srv1782608140=49, srv1299042313=19, srv786856738=93, srv1014457974=1, srv2129985931=63, srv1264686832=18, srv223012371=65, srv1026244550=2, srv1090776876=9, srv619257273=78, srv710004268=86, srv1791403832=51, srv1450982376=25, srv1481120841=29, srv1038341179=3, srv682924381=82, srv1048628820=6, srv638019628=81, srv141688160=22, srv544735764=75, srv225125976=66, srv1678729341=39, srv964350364=99, srv1042589845=4, srv1564407910=34, srv567221150=77, srv1498825591=31, srv1424170343=23, srv1248129079=17, srv1125316637=10, srv779677297=91, srv778087003=90, srv867321306=97, srv2024567786=59, srv1173615922=15, srv1468254846=27, srv449415424=72, srv697698804=84, srv747008600=87, srv809109395=94, srv1709232642=41, srv1142036913=12, srv825403455=95, srv1480541763=28} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-11-19 20:55:18,567 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-11-19 20:55:18,567 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-11-19 20:55:18,567 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-11-19 20:55:18,567 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-11-19 20:55:18,567 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-11-19 20:55:18,567 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-11-19 20:55:18,567 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-11-19 20:55:18,567 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-11-19 20:55:18,567 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-11-19 20:55:18,567 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-11-19 20:55:18,568 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-11-19 20:55:18,568 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-11-19 20:55:18,568 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-11-19 20:55:18,568 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-11-19 20:55:18,568 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-11-19 20:55:18,568 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-11-19 20:55:18,568 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-11-19 20:55:18,568 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-11-19 20:55:18,568 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-11-19 20:55:18,568 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-11-19 20:55:18,568 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-11-19 20:55:18,568 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-11-19 20:55:18,568 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-11-19 20:55:18,568 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-11-19 20:55:18,568 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-11-19 20:55:18,569 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-11-19 20:55:18,569 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-11-19 20:55:18,569 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-11-19 20:55:18,569 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-11-19 20:55:18,569 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-11-19 20:55:18,569 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-11-19 20:55:18,569 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-11-19 20:55:18,569 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-11-19 20:55:18,569 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-11-19 20:55:18,569 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-11-19 20:55:18,569 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-11-19 20:55:18,570 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-11-19 20:55:18,570 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-11-19 20:55:18,570 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-11-19 20:55:18,570 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-11-19 20:55:18,570 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-11-19 20:55:18,570 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-11-19 20:55:18,570 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-11-19 20:55:18,570 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-11-19 20:55:18,570 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-11-19 20:55:18,570 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-11-19 20:55:18,570 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-11-19 20:55:18,570 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-11-19 20:55:18,570 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-11-19 20:55:18,570 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-11-19 20:55:18,570 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-11-19 20:55:18,571 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-11-19 20:55:18,571 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-11-19 20:55:18,571 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-11-19 20:55:18,571 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-11-19 20:55:18,571 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-11-19 20:55:18,571 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-11-19 20:55:18,571 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-11-19 20:55:18,571 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-11-19 20:55:18,571 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-11-19 20:55:18,571 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-11-19 20:55:18,571 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-11-19 20:55:18,572 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-11-19 20:55:18,572 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-11-19 20:55:18,572 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-11-19 20:55:18,572 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-11-19 20:55:18,572 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-11-19 20:55:18,572 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-11-19 20:55:18,572 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-11-19 20:55:18,573 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-11-19 20:55:18,573 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-11-19 20:55:18,573 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-11-19 20:55:18,573 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-11-19 20:55:18,573 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-11-19 20:55:18,573 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-11-19 20:55:18,573 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-11-19 20:55:18,573 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-11-19 20:55:18,573 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-11-19 20:55:18,574 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-11-19 20:55:18,574 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-11-19 20:55:18,574 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-11-19 20:55:18,574 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-11-19 20:55:18,574 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-11-19 20:55:18,574 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-11-19 20:55:18,574 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-11-19 20:55:18,574 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-11-19 20:55:18,574 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-11-19 20:55:18,575 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-11-19 20:55:18,575 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-11-19 20:55:18,575 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-11-19 20:55:18,575 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-11-19 20:55:18,575 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-11-19 20:55:18,575 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-11-19 20:55:18,575 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-11-19 20:55:18,575 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-11-19 20:55:18,575 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-11-19 20:55:18,575 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-11-19 20:55:18,576 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-11-19 20:55:18,576 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-11-19 20:55:18,576 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-11-19 20:55:18,576 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-11-19 20:55:18,690 INFO  [Time-limited test] balancer.StochasticLoadBalancer(381): Cluster wide - skipping load balancing because weighted average imbalance=1.675326362942016E-5 <= threshold(0.025). If you want more aggressive balancing, either lower hbase.master.balancer.stochastic.minCostNeedBalance from 0.025 or increase the relative multiplier(s) of the specific cost function(s). functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=3.868392354571063E-4); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0016412198797244363); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=3.868392354571063E-4); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=8.333333333333333E-5); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-11-19 20:55:18,691 INFO  [Time-limited test] balancer.BalancerTestBase(570): Mock Final balance: { srv1299042313:83 , srv1430298643:83 , srv326211133:83 , srv567221150:83 , srv1043864732:84 , srv1048628820:84 , srv1068518494:84 , srv1090185692:84 , srv1090776876:84 , srv1169970756:84 , srv1173615922:84 , srv1248129079:84 , srv1481120841:84 , srv1522950596:84 , srv1610629514:84 , srv1617210700:84 , srv1791403832:84 , srv1993748091:84 , srv2119790984:84 , srv2129985931:84 , srv28655146:84 , srv375860390:84 , srv417323881:84 , srv442176669:84 , srv502624409:84 , srv544735764:84 , srv619257273:84 , srv625409656:84 , srv638019628:84 , srv697698804:84 , srv747008600:84 , srv764804492:84 , srv778087003:84 , srv779677297:84 , srv780307064:84 , srv825403455:84 , srv1014269360:85 , srv1014457974:85 , srv1026244550:85 , srv1038341179:85 , srv1042589845:85 , srv1125316637:85 , srv1128961294:85 , srv1264686832:85 , srv1306998776:85 , srv133088458:85 , srv1424170343:85 , srv1450982376:85 , srv1468254846:85 , srv1480541763:85 , srv1487374020:85 , srv1498825591:85 , srv1557485336:85 , srv1564407910:85 , srv1657155839:85 , srv1678729341:85 , srv1705092826:85 , srv1709232642:85 , srv1711694794:85 , srv1725835053:85 , srv1747621579:85 , srv1752952365:85 , srv1763374917:85 , srv1782608140:85 , srv178515478:85 , srv1822850721:85 , srv184144260:85 , srv1855356760:85 , srv1859467121:85 , srv1952009890:85 , srv2003178475:85 , srv2024567786:85 , srv2059258090:85 , srv2090417423:85 , srv223012371:85 , srv225125976:85 , srv449415424:85 , srv514321383:85 , srv561924173:85 , srv62799334:85 , srv682924381:85 , srv695594460:85 , srv70150071:85 , srv710004268:85 , srv76035594:85 , srv786856738:85 , srv809109395:85 , srv928160550:85 , srv964350364:85 , srv1160015113:86 , srv1206889402:86 , srv141688160:86 , srv1463464788:86 , srv164747962:86 , srv1744742559:86 , srv1774443464:86 , srv216660168:86 , srv836522141:86 , srv867321306:86 , srv1142036913:615 }
2023-11-19 20:55:18,718 INFO  [Time-limited test] hbase.ResourceChecker(175): after: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnLargeClusterWithRacks Thread=12 (was 12), OpenFileDescriptor=290 (was 290), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=169 (was 169), ProcessCount=171 (was 171), AvailableMemoryMB=15384 (was 15877)
2023-11-19 20:55:18,727 INFO  [Time-limited test] hbase.ResourceChecker(147): before: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnMidClusterWithRacks Thread=12, OpenFileDescriptor=290, MaxFileDescriptor=60000, SystemLoadAverage=169, ProcessCount=171, AvailableMemoryMB=15384
2023-11-19 20:55:18,728 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2023-11-19 20:55:18,728 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=5000, runMaxSteps=true, stepsPerRegion=800, maxRunningTime=120000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 111077.0 etc.
2023-11-19 20:55:18,738 INFO  [Time-limited test] balancer.BalancerTestBase(547): Mock Cluster : { srv1039453354:84 , srv1081213419:84 , srv1185856345:84 , srv1191082578:84 , srv1322951457:84 , srv1470625148:84 , srv1620150073:84 , srv1631170334:84 , srv1642392135:84 , srv1670538870:84 , srv1733314896:84 , srv1785219717:84 , srv1876926574:84 , srv1887020995:84 , srv1948811777:84 , srv1991231745:84 , srv290023011:84 , srv380748867:84 , srv382718101:84 , srv404477442:84 , srv541865720:84 , srv702801116:84 , srv803163057:84 , srv880759829:84 , srv906945242:84 , srv919038795:84 , srv931683116:84 , srv946412215:84 , srv97840237:84 , srv1517450378:264 } [srvr=30 rgns=2700 avg=90.0 max=90 min=90]
2023-11-19 20:55:18,739 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-11-19 20:55:18,739 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv404477442=20, srv1948811777=15, srv919038795=26, srv1185856345=2, srv1991231745=16, srv1191082578=3, srv1876926574=13, srv946412215=28, srv1631170334=8, srv1733314896=11, srv1517450378=6, srv880759829=24, srv290023011=17, srv1039453354=0, srv541865720=21, srv906945242=25, srv1081213419=1, srv1887020995=14, srv1670538870=10, srv382718101=19, srv1470625148=5, srv1785219717=12, srv380748867=18, srv97840237=29, srv1322951457=4, srv702801116=22, srv803163057=23, srv1642392135=9, srv1620150073=7, srv931683116=27} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-11-19 20:55:18,750 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-11-19 20:55:18,750 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-11-19 20:55:18,750 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-11-19 20:55:18,750 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-11-19 20:55:18,751 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-11-19 20:55:18,751 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-11-19 20:55:18,751 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-11-19 20:55:18,751 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-11-19 20:55:18,751 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-11-19 20:55:18,751 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-11-19 20:55:18,751 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-11-19 20:55:18,751 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-11-19 20:55:18,751 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-11-19 20:55:18,751 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-11-19 20:55:18,751 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-11-19 20:55:18,751 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-11-19 20:55:18,751 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-11-19 20:55:18,751 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-11-19 20:55:18,751 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-11-19 20:55:18,751 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-11-19 20:55:18,751 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-11-19 20:55:18,752 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-11-19 20:55:18,752 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-11-19 20:55:18,752 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-11-19 20:55:18,752 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-11-19 20:55:18,752 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-11-19 20:55:18,752 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-11-19 20:55:18,752 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-11-19 20:55:18,752 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-11-19 20:55:18,752 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-11-19 20:55:18,752 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=10, number of hosts=30, number of racks=4
2023-11-19 20:55:18,777 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=1.1029674862130652, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-11-19 20:55:18,777 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.9912517490451139, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=1.1029674862130652, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=64800000
2023-11-19 20:57:18,756 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 120001 ms to try 6119336 different iterations.  Found a solution that moves 1859 regions; Going from a computed imbalance of 0.9912517490451139 to a new imbalance of 4.338998739279625E-5. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); MoveCostFunction : (multiplier=7.0, imbalance=0.6885185185185185, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-11-19 20:57:18,763 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1039453354:90 , srv1081213419:90 , srv1185856345:90 , srv1191082578:90 , srv1322951457:90 , srv1470625148:90 , srv1517450378:90 , srv1620150073:90 , srv1631170334:90 , srv1642392135:90 , srv1670538870:90 , srv1733314896:90 , srv1785219717:90 , srv1876926574:90 , srv1887020995:90 , srv1948811777:90 , srv1991231745:90 , srv290023011:90 , srv380748867:90 , srv382718101:90 , srv404477442:90 , srv541865720:90 , srv702801116:90 , srv803163057:90 , srv880759829:90 , srv906945242:90 , srv919038795:90 , srv931683116:90 , srv946412215:90 , srv97840237:90 }
2023-11-19 20:57:18,764 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-11-19 20:57:18,765 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv404477442=20, srv1948811777=15, srv919038795=26, srv1185856345=2, srv1991231745=16, srv1191082578=3, srv1876926574=13, srv946412215=28, srv1631170334=8, srv1733314896=11, srv1517450378=6, srv880759829=24, srv290023011=17, srv1039453354=0, srv541865720=21, srv906945242=25, srv1081213419=1, srv1887020995=14, srv1670538870=10, srv382718101=19, srv1470625148=5, srv1785219717=12, srv380748867=18, srv97840237=29, srv1322951457=4, srv702801116=22, srv803163057=23, srv1642392135=9, srv1620150073=7, srv931683116=27} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-11-19 20:57:18,769 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-11-19 20:57:18,769 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-11-19 20:57:18,769 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-11-19 20:57:18,769 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-11-19 20:57:18,769 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-11-19 20:57:18,769 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-11-19 20:57:18,769 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-11-19 20:57:18,769 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-11-19 20:57:18,769 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-11-19 20:57:18,769 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-11-19 20:57:18,769 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-11-19 20:57:18,769 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-11-19 20:57:18,769 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-11-19 20:57:18,769 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-11-19 20:57:18,769 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-11-19 20:57:18,769 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-11-19 20:57:18,769 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-11-19 20:57:18,769 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-11-19 20:57:18,770 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-11-19 20:57:18,770 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-11-19 20:57:18,770 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-11-19 20:57:18,770 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-11-19 20:57:18,770 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-11-19 20:57:18,770 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-11-19 20:57:18,770 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-11-19 20:57:18,770 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-11-19 20:57:18,770 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-11-19 20:57:18,770 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-11-19 20:57:18,770 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-11-19 20:57:18,770 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-11-19 20:57:18,770 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=10, number of hosts=30, number of racks=4
2023-11-19 20:57:18,787 INFO  [Time-limited test] balancer.StochasticLoadBalancer(381): Cluster wide - skipping load balancing because weighted average imbalance=0.0 <= threshold(0.025). If you want more aggressive balancing, either lower hbase.master.balancer.stochastic.minCostNeedBalance from 0.025 or increase the relative multiplier(s) of the specific cost function(s). functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-11-19 20:57:18,787 INFO  [Time-limited test] balancer.BalancerTestBase(570): Mock Final balance: { srv1039453354:90 , srv1081213419:90 , srv1185856345:90 , srv1191082578:90 , srv1322951457:90 , srv1470625148:90 , srv1517450378:90 , srv1620150073:90 , srv1631170334:90 , srv1642392135:90 , srv1670538870:90 , srv1733314896:90 , srv1785219717:90 , srv1876926574:90 , srv1887020995:90 , srv1948811777:90 , srv1991231745:90 , srv290023011:90 , srv380748867:90 , srv382718101:90 , srv404477442:90 , srv541865720:90 , srv702801116:90 , srv803163057:90 , srv880759829:90 , srv906945242:90 , srv919038795:90 , srv931683116:90 , srv946412215:90 , srv97840237:90 }
2023-11-19 20:57:18,806 INFO  [Time-limited test] hbase.ResourceChecker(175): after: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnMidClusterWithRacks Thread=11 (was 12), OpenFileDescriptor=290 (was 290), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=210 (was 169) - SystemLoadAverage LEAK? -, ProcessCount=168 (was 171), AvailableMemoryMB=15319 (was 15384)