2023-11-30 20:53:14,013 INFO  [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks timeout: 13 mins
2023-11-30 20:53:14,379 WARN  [Time-limited test] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties
2023-11-30 20:53:14,511 INFO  [Time-limited test] metrics.MetricRegistriesLoader(60): Loaded MetricRegistries class org.apache.hadoop.hbase.metrics.impl.MetricRegistriesImpl
2023-11-30 20:53:14,591 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2023-11-30 20:53:14,600 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc.
2023-11-30 20:53:14,619 INFO  [Time-limited test] hbase.ResourceChecker(147): before: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnLargeClusterWithRacks Thread=12, OpenFileDescriptor=290, MaxFileDescriptor=60000, SystemLoadAverage=322, ProcessCount=174, AvailableMemoryMB=9004
2023-11-30 20:53:14,622 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2023-11-30 20:53:14,622 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=5000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=10000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc.
2023-11-30 20:53:14,758 INFO  [Time-limited test] balancer.BalancerTestBase(547): Mock Cluster : { srv1021664874:84 , srv1027155410:84 , srv1031461578:84 , srv1039158884:84 , srv106430938:84 , srv1074363205:84 , srv1095164675:84 , srv1110463955:84 , srv1129457209:84 , srv1151981047:84 , srv1153778642:84 , srv1168177395:84 , srv1186223354:84 , srv1314393639:84 , srv1327355751:84 , srv1374190481:84 , srv1377593120:84 , srv1385882545:84 , srv1424002412:84 , srv1486992925:84 , srv1497889833:84 , srv1548423991:84 , srv1587942172:84 , srv1595883937:84 , srv1630339712:84 , srv1643751281:84 , srv1648342174:84 , srv1734353752:84 , srv179028955:84 , srv1804422393:84 , srv1819746347:84 , srv184985513:84 , srv1852600554:84 , srv1867688825:84 , srv18865251:84 , srv1898712548:84 , srv1908272348:84 , srv1935799915:84 , srv1942459334:84 , srv1994354428:84 , srv2006312910:84 , srv2025555201:84 , srv2032599326:84 , srv2046608936:84 , srv2048513134:84 , srv2064385718:84 , srv2067293975:84 , srv2069783721:84 , srv2083064466:84 , srv2101298334:84 , srv2101341847:84 , srv211414903:84 , srv2119087444:84 , srv212489731:84 , srv2131609936:84 , srv2140169144:84 , srv221695312:84 , srv227766135:84 , srv249505951:84 , srv254440348:84 , srv256312257:84 , srv297908225:84 , srv344130064:84 , srv380725970:84 , srv398927745:84 , srv459294342:84 , srv487824988:84 , srv497339703:84 , srv50214710:84 , srv504209145:84 , srv51748521:84 , srv534588419:84 , srv58179894:84 , srv585314857:84 , srv588526745:84 , srv639190420:84 , srv644264850:84 , srv661344457:84 , srv674603991:84 , srv694867233:84 , srv745044805:84 , srv764501074:84 , srv77792940:84 , srv77931518:84 , srv803278379:84 , srv821768584:84 , srv886331236:84 , srv888707177:84 , srv89141746:84 , srv892176011:84 , srv903627490:84 , srv906845627:84 , srv911578749:84 , srv940446734:84 , srv944069738:84 , srv955649864:84 , srv973305970:84 , srv975726337:84 , srv997093616:84 , srv1888763098:684 } [srvr=100 rgns=9000 avg=90.0 max=90 min=90]
2023-11-30 20:53:14,771 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-11-30 20:53:14,780 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv674603991=79, srv1804422393=29, srv1908272348=37, srv1643751281=25, srv694867233=80, srv1497889833=20, srv2032599326=43, srv1888763098=35, srv1129457209=8, srv211414903=52, srv459294342=66, srv1548423991=21, srv50214710=69, srv89141746=89, srv2067293975=47, srv745044805=81, srv764501074=82, srv888707177=88, srv1385882545=17, srv179028955=28, srv212489731=54, srv1935799915=38, srv254440348=60, srv2048513134=45, srv249505951=59, srv2131609936=55, srv1095164675=6, srv2140169144=56, srv906845627=92, srv1031461578=2, srv1424002412=18, srv821768584=86, srv398927745=65, srv58179894=73, srv504209145=70, srv1153778642=10, srv497339703=68, srv77792940=83, srv940446734=94, srv344130064=63, srv1039158884=3, srv227766135=58, srv184985513=31, srv997093616=99, srv1486992925=19, srv1377593120=16, srv1327355751=14, srv297908225=62, srv1819746347=30, srv886331236=87, srv1074363205=5, srv1942459334=39, srv1587942172=22, srv2119087444=53, srv1852600554=32, srv903627490=91, srv639190420=76, srv51748521=71, srv944069738=95, srv1168177395=11, srv1186223354=12, srv1898712548=36, srv1374190481=15, srv2046608936=44, srv1314393639=13, srv2101341847=51, srv487824988=67, srv1027155410=1, srv1110463955=7, srv2069783721=48, srv380725970=64, srv588526745=75, srv1734353752=27, srv892176011=90, srv2101298334=50, srv585314857=74, srv955649864=96, srv77931518=84, srv18865251=34, srv803278379=85, srv975726337=98, srv106430938=4, srv1630339712=24, srv1867688825=33, srv911578749=93, srv644264850=77, srv2006312910=41, srv221695312=57, srv1151981047=9, srv2025555201=42, srv2083064466=49, srv256312257=61, srv1595883937=23, srv2064385718=46, srv661344457=78, srv973305970=97, srv1648342174=26, srv534588419=72, srv1994354428=40, srv1021664874=0} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-11-30 20:53:14,884 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-11-30 20:53:14,884 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-11-30 20:53:14,885 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-11-30 20:53:14,885 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-11-30 20:53:14,885 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-11-30 20:53:14,885 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-11-30 20:53:14,885 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-11-30 20:53:14,886 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-11-30 20:53:14,886 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-11-30 20:53:14,886 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-11-30 20:53:14,886 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-11-30 20:53:14,886 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-11-30 20:53:14,886 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-11-30 20:53:14,887 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-11-30 20:53:14,887 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-11-30 20:53:14,887 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-11-30 20:53:14,887 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-11-30 20:53:14,887 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-11-30 20:53:14,887 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-11-30 20:53:14,888 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-11-30 20:53:14,888 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-11-30 20:53:14,888 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-11-30 20:53:14,888 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-11-30 20:53:14,888 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-11-30 20:53:14,888 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-11-30 20:53:14,889 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-11-30 20:53:14,889 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-11-30 20:53:14,889 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-11-30 20:53:14,889 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-11-30 20:53:14,889 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-11-30 20:53:14,889 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-11-30 20:53:14,890 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-11-30 20:53:14,890 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-11-30 20:53:14,890 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-11-30 20:53:14,890 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-11-30 20:53:14,890 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-11-30 20:53:14,890 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-11-30 20:53:14,891 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-11-30 20:53:14,891 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-11-30 20:53:14,891 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-11-30 20:53:14,891 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-11-30 20:53:14,891 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-11-30 20:53:14,891 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-11-30 20:53:14,891 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-11-30 20:53:14,892 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-11-30 20:53:14,892 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-11-30 20:53:14,892 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-11-30 20:53:14,892 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-11-30 20:53:14,892 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-11-30 20:53:14,892 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-11-30 20:53:14,893 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-11-30 20:53:14,893 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-11-30 20:53:14,893 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-11-30 20:53:14,893 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-11-30 20:53:14,894 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-11-30 20:53:14,894 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-11-30 20:53:14,894 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-11-30 20:53:14,894 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-11-30 20:53:14,894 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-11-30 20:53:14,894 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-11-30 20:53:14,894 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-11-30 20:53:14,895 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-11-30 20:53:14,895 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-11-30 20:53:14,895 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-11-30 20:53:14,895 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-11-30 20:53:14,895 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-11-30 20:53:14,895 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-11-30 20:53:14,895 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-11-30 20:53:14,896 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-11-30 20:53:14,896 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-11-30 20:53:14,896 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-11-30 20:53:14,896 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-11-30 20:53:14,896 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-11-30 20:53:14,896 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-11-30 20:53:14,897 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-11-30 20:53:14,897 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-11-30 20:53:14,897 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-11-30 20:53:14,897 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-11-30 20:53:14,897 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-11-30 20:53:14,897 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-11-30 20:53:14,897 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-11-30 20:53:14,898 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-11-30 20:53:14,898 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-11-30 20:53:14,898 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-11-30 20:53:14,898 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-11-30 20:53:14,898 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-11-30 20:53:14,898 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-11-30 20:53:14,898 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-11-30 20:53:14,899 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-11-30 20:53:14,899 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-11-30 20:53:14,899 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-11-30 20:53:14,899 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-11-30 20:53:14,899 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-11-30 20:53:14,900 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-11-30 20:53:14,900 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-11-30 20:53:14,900 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-11-30 20:53:14,900 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-11-30 20:53:14,900 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-11-30 20:53:14,900 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-11-30 20:53:14,901 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-11-30 20:53:14,901 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-11-30 20:53:15,355 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.06666666666666667, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-11-30 20:53:15,355 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-11-30 20:53:15,356 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.9909252140407105, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.06666666666666667, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-11-30 20:53:15,804 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 867 ms to try 5000 different iterations.  Found a solution that moves 4694 regions; Going from a computed imbalance of 0.9909252140407105 to a new imbalance of 0.17703406797645724. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.04020151261036848, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06184227430434264, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.5215555555555556, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.04020151261036848, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.17233333333333334, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.2375, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-11-30 20:53:15,820 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv2046608936:80 , srv955649864:80 , srv1804422393:82 , srv1819746347:82 , srv2048513134:82 , srv1852600554:83 , srv2064385718:83 , srv254440348:83 , srv459294342:83 , srv487824988:83 , srv50214710:83 , srv1327355751:84 , srv1385882545:84 , srv1497889833:84 , srv1595883937:84 , srv1898712548:84 , srv2083064466:84 , srv2101298334:84 , srv803278379:84 , srv892176011:84 , srv906845627:84 , srv997093616:84 , srv1186223354:85 , srv1548423991:85 , srv1587942172:85 , srv1630339712:85 , srv18865251:85 , srv1935799915:85 , srv1942459334:85 , srv2067293975:85 , srv2119087444:85 , srv2131609936:85 , srv2140169144:85 , srv221695312:85 , srv249505951:85 , srv256312257:85 , srv344130064:85 , srv504209145:85 , srv588526745:85 , srv888707177:85 , srv89141746:85 , srv903627490:85 , srv911578749:85 , srv1027155410:86 , srv106430938:86 , srv1129457209:86 , srv1424002412:86 , srv1648342174:86 , srv2025555201:86 , srv2069783721:86 , srv211414903:86 , srv212489731:86 , srv227766135:86 , srv380725970:86 , srv398927745:86 , srv58179894:86 , srv585314857:86 , srv644264850:86 , srv661344457:86 , srv674603991:86 , srv975726337:86 , srv1039158884:87 , srv1110463955:87 , srv1153778642:87 , srv1643751281:87 , srv2006312910:87 , srv297908225:87 , srv497339703:87 , srv51748521:87 , srv639190420:87 , srv1095164675:88 , srv1867688825:88 , srv1908272348:88 , srv1994354428:88 , srv694867233:88 , srv745044805:88 , srv77931518:88 , srv886331236:88 , srv940446734:88 , srv944069738:88 , srv2032599326:89 , srv534588419:89 , srv764501074:89 , srv821768584:89 , srv973305970:89 , srv1151981047:90 , srv1314393639:90 , srv179028955:90 , srv2101341847:90 , srv1021664874:91 , srv1074363205:91 , srv1168177395:91 , srv1377593120:91 , srv1734353752:91 , srv184985513:91 , srv1031461578:92 , srv77792940:92 , srv1374190481:94 , srv1486992925:100 , srv1888763098:447 }
2023-11-30 20:53:15,826 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-11-30 20:53:15,827 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv674603991=79, srv1804422393=29, srv1908272348=37, srv1643751281=25, srv694867233=80, srv1497889833=20, srv2032599326=43, srv1888763098=35, srv1129457209=8, srv211414903=52, srv459294342=66, srv1548423991=21, srv50214710=69, srv89141746=89, srv2067293975=47, srv745044805=81, srv764501074=82, srv888707177=88, srv1385882545=17, srv179028955=28, srv212489731=54, srv1935799915=38, srv254440348=60, srv2048513134=45, srv249505951=59, srv2131609936=55, srv1095164675=6, srv2140169144=56, srv906845627=92, srv1031461578=2, srv1424002412=18, srv821768584=86, srv398927745=65, srv58179894=73, srv504209145=70, srv1153778642=10, srv497339703=68, srv77792940=83, srv940446734=94, srv344130064=63, srv1039158884=3, srv227766135=58, srv184985513=31, srv997093616=99, srv1486992925=19, srv1377593120=16, srv1327355751=14, srv297908225=62, srv1819746347=30, srv886331236=87, srv1074363205=5, srv1942459334=39, srv1587942172=22, srv2119087444=53, srv1852600554=32, srv903627490=91, srv639190420=76, srv51748521=71, srv944069738=95, srv1168177395=11, srv1186223354=12, srv1898712548=36, srv1374190481=15, srv2046608936=44, srv1314393639=13, srv2101341847=51, srv487824988=67, srv1027155410=1, srv1110463955=7, srv2069783721=48, srv380725970=64, srv588526745=75, srv1734353752=27, srv892176011=90, srv2101298334=50, srv585314857=74, srv955649864=96, srv77931518=84, srv18865251=34, srv803278379=85, srv975726337=98, srv106430938=4, srv1630339712=24, srv1867688825=33, srv911578749=93, srv644264850=77, srv2006312910=41, srv221695312=57, srv1151981047=9, srv2025555201=42, srv2083064466=49, srv256312257=61, srv1595883937=23, srv2064385718=46, srv661344457=78, srv973305970=97, srv1648342174=26, srv534588419=72, srv1994354428=40, srv1021664874=0} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-11-30 20:53:15,851 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-11-30 20:53:15,851 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-11-30 20:53:15,852 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-11-30 20:53:15,852 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-11-30 20:53:15,852 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-11-30 20:53:15,852 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-11-30 20:53:15,852 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-11-30 20:53:15,852 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-11-30 20:53:15,852 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-11-30 20:53:15,853 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-11-30 20:53:15,853 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-11-30 20:53:15,853 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-11-30 20:53:15,853 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-11-30 20:53:15,853 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-11-30 20:53:15,853 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-11-30 20:53:15,853 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-11-30 20:53:15,854 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-11-30 20:53:15,854 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-11-30 20:53:15,854 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-11-30 20:53:15,854 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-11-30 20:53:15,854 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-11-30 20:53:15,854 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-11-30 20:53:15,854 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-11-30 20:53:15,854 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-11-30 20:53:15,855 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-11-30 20:53:15,855 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-11-30 20:53:15,855 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-11-30 20:53:15,855 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-11-30 20:53:15,855 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-11-30 20:53:15,855 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-11-30 20:53:15,855 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-11-30 20:53:15,855 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-11-30 20:53:15,855 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-11-30 20:53:15,856 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-11-30 20:53:15,856 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-11-30 20:53:15,856 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-11-30 20:53:15,856 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-11-30 20:53:15,856 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-11-30 20:53:15,856 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-11-30 20:53:15,856 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-11-30 20:53:15,856 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-11-30 20:53:15,857 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-11-30 20:53:15,857 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-11-30 20:53:15,857 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-11-30 20:53:15,857 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-11-30 20:53:15,857 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-11-30 20:53:15,857 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-11-30 20:53:15,857 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-11-30 20:53:15,857 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-11-30 20:53:15,858 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-11-30 20:53:15,858 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-11-30 20:53:15,858 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-11-30 20:53:15,858 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-11-30 20:53:15,858 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-11-30 20:53:15,858 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-11-30 20:53:15,858 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-11-30 20:53:15,858 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-11-30 20:53:15,859 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-11-30 20:53:15,859 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-11-30 20:53:15,859 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-11-30 20:53:15,859 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-11-30 20:53:15,859 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-11-30 20:53:15,859 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-11-30 20:53:15,859 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-11-30 20:53:15,859 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-11-30 20:53:15,860 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-11-30 20:53:15,860 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-11-30 20:53:15,860 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-11-30 20:53:15,860 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-11-30 20:53:15,860 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-11-30 20:53:15,860 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-11-30 20:53:15,860 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-11-30 20:53:15,860 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-11-30 20:53:15,861 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-11-30 20:53:15,861 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-11-30 20:53:15,861 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-11-30 20:53:15,861 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-11-30 20:53:15,861 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-11-30 20:53:15,861 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-11-30 20:53:15,861 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-11-30 20:53:15,861 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-11-30 20:53:15,861 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-11-30 20:53:15,862 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-11-30 20:53:15,862 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-11-30 20:53:15,862 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-11-30 20:53:15,862 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-11-30 20:53:15,862 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-11-30 20:53:15,862 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-11-30 20:53:15,862 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-11-30 20:53:15,862 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-11-30 20:53:15,862 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-11-30 20:53:15,863 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-11-30 20:53:15,863 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-11-30 20:53:15,863 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-11-30 20:53:15,863 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-11-30 20:53:15,863 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-11-30 20:53:15,863 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-11-30 20:53:15,863 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-11-30 20:53:15,863 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-11-30 20:53:15,863 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-11-30 20:53:15,864 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-11-30 20:53:16,042 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.04020151261036848, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06184227430434264, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.04020151261036848, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.17233333333333334, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.2375, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-11-30 20:53:16,043 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-11-30 20:53:16,043 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.17700119988595345, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.04020151261036848, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06184227430434264, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.04020151261036848, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.17233333333333334, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.2375, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-11-30 20:53:16,379 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 483 ms to try 5000 different iterations.  Found a solution that moves 2615 regions; Going from a computed imbalance of 0.17700119988595345 to a new imbalance of 0.016647321351841673. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.023304187879323368); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.03759910212171491, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.29055555555555557, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.023304187879323368); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.013833333333333333); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.04325, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-11-30 20:53:16,392 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1486992925:73 , srv1031461578:79 , srv1374190481:79 , srv77792940:79 , srv1021664874:80 , srv1734353752:80 , srv1377593120:81 , srv184985513:81 , srv1908272348:81 , srv2032599326:81 , srv2101341847:81 , srv764501074:82 , srv886331236:82 , srv1074363205:83 , srv1110463955:83 , srv1151981047:83 , srv1153778642:83 , srv1994354428:83 , srv2025555201:83 , srv534588419:83 , srv585314857:83 , srv694867233:83 , srv973305970:83 , srv1168177395:84 , srv1314393639:84 , srv1867688825:84 , srv51748521:84 , srv644264850:84 , srv940446734:84 , srv1027155410:85 , srv106430938:85 , srv1129457209:85 , srv1548423991:85 , srv1648342174:85 , srv1942459334:85 , srv2067293975:85 , srv211414903:85 , srv2131609936:85 , srv227766135:85 , srv249505951:85 , srv297908225:85 , srv398927745:85 , srv674603991:85 , srv77931518:85 , srv821768584:85 , srv1039158884:86 , srv1095164675:86 , srv1186223354:86 , srv1385882545:86 , srv1595883937:86 , srv1898712548:86 , srv2069783721:86 , srv2083064466:86 , srv2119087444:86 , srv380725970:86 , srv497339703:86 , srv661344457:86 , srv745044805:86 , srv888707177:86 , srv892176011:86 , srv906845627:86 , srv911578749:86 , srv944069738:86 , srv1497889833:87 , srv1630339712:87 , srv179028955:87 , srv2006312910:87 , srv2064385718:87 , srv2101298334:87 , srv344130064:87 , srv588526745:87 , srv1424002412:88 , srv1587942172:88 , srv18865251:88 , srv212489731:88 , srv2140169144:88 , srv221695312:88 , srv256312257:88 , srv487824988:88 , srv504209145:88 , srv639190420:88 , srv803278379:88 , srv903627490:88 , srv975726337:88 , srv997093616:88 , srv1935799915:89 , srv2048513134:89 , srv254440348:89 , srv459294342:89 , srv58179894:89 , srv89141746:89 , srv1327355751:90 , srv1643751281:90 , srv1804422393:90 , srv1852600554:90 , srv2046608936:90 , srv50214710:90 , srv1819746347:91 , srv955649864:92 , srv1888763098:534 }
2023-11-30 20:53:16,399 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-11-30 20:53:16,400 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv674603991=79, srv1804422393=29, srv1908272348=37, srv1643751281=25, srv694867233=80, srv1497889833=20, srv2032599326=43, srv1888763098=35, srv1129457209=8, srv211414903=52, srv459294342=66, srv1548423991=21, srv50214710=69, srv89141746=89, srv2067293975=47, srv745044805=81, srv764501074=82, srv888707177=88, srv1385882545=17, srv179028955=28, srv212489731=54, srv1935799915=38, srv254440348=60, srv2048513134=45, srv249505951=59, srv2131609936=55, srv1095164675=6, srv2140169144=56, srv906845627=92, srv1031461578=2, srv1424002412=18, srv821768584=86, srv398927745=65, srv58179894=73, srv504209145=70, srv1153778642=10, srv497339703=68, srv77792940=83, srv940446734=94, srv344130064=63, srv1039158884=3, srv227766135=58, srv184985513=31, srv997093616=99, srv1486992925=19, srv1377593120=16, srv1327355751=14, srv297908225=62, srv1819746347=30, srv886331236=87, srv1074363205=5, srv1942459334=39, srv1587942172=22, srv2119087444=53, srv1852600554=32, srv903627490=91, srv639190420=76, srv51748521=71, srv944069738=95, srv1168177395=11, srv1186223354=12, srv1898712548=36, srv1374190481=15, srv2046608936=44, srv1314393639=13, srv2101341847=51, srv487824988=67, srv1027155410=1, srv1110463955=7, srv2069783721=48, srv380725970=64, srv588526745=75, srv1734353752=27, srv892176011=90, srv2101298334=50, srv585314857=74, srv955649864=96, srv77931518=84, srv18865251=34, srv803278379=85, srv975726337=98, srv106430938=4, srv1630339712=24, srv1867688825=33, srv911578749=93, srv644264850=77, srv2006312910=41, srv221695312=57, srv1151981047=9, srv2025555201=42, srv2083064466=49, srv256312257=61, srv1595883937=23, srv2064385718=46, srv661344457=78, srv973305970=97, srv1648342174=26, srv534588419=72, srv1994354428=40, srv1021664874=0} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-11-30 20:53:16,422 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-11-30 20:53:16,422 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-11-30 20:53:16,422 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-11-30 20:53:16,422 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-11-30 20:53:16,423 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-11-30 20:53:16,423 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-11-30 20:53:16,423 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-11-30 20:53:16,423 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-11-30 20:53:16,423 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-11-30 20:53:16,423 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-11-30 20:53:16,423 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-11-30 20:53:16,423 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-11-30 20:53:16,423 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-11-30 20:53:16,423 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-11-30 20:53:16,424 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-11-30 20:53:16,424 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-11-30 20:53:16,424 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-11-30 20:53:16,424 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-11-30 20:53:16,424 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-11-30 20:53:16,424 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-11-30 20:53:16,424 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-11-30 20:53:16,424 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-11-30 20:53:16,424 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-11-30 20:53:16,425 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-11-30 20:53:16,425 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-11-30 20:53:16,425 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-11-30 20:53:16,425 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-11-30 20:53:16,425 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-11-30 20:53:16,425 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-11-30 20:53:16,425 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-11-30 20:53:16,425 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-11-30 20:53:16,425 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-11-30 20:53:16,426 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-11-30 20:53:16,426 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-11-30 20:53:16,426 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-11-30 20:53:16,426 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-11-30 20:53:16,426 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-11-30 20:53:16,426 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-11-30 20:53:16,426 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-11-30 20:53:16,426 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-11-30 20:53:16,427 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-11-30 20:53:16,427 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-11-30 20:53:16,427 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-11-30 20:53:16,427 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-11-30 20:53:16,427 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-11-30 20:53:16,427 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-11-30 20:53:16,427 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-11-30 20:53:16,428 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-11-30 20:53:16,428 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-11-30 20:53:16,428 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-11-30 20:53:16,428 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-11-30 20:53:16,428 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-11-30 20:53:16,428 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-11-30 20:53:16,428 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-11-30 20:53:16,428 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-11-30 20:53:16,428 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-11-30 20:53:16,429 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-11-30 20:53:16,429 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-11-30 20:53:16,429 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-11-30 20:53:16,429 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-11-30 20:53:16,429 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-11-30 20:53:16,429 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-11-30 20:53:16,429 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-11-30 20:53:16,429 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-11-30 20:53:16,429 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-11-30 20:53:16,430 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-11-30 20:53:16,430 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-11-30 20:53:16,430 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-11-30 20:53:16,430 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-11-30 20:53:16,430 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-11-30 20:53:16,430 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-11-30 20:53:16,430 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-11-30 20:53:16,430 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-11-30 20:53:16,430 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-11-30 20:53:16,430 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-11-30 20:53:16,431 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-11-30 20:53:16,431 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-11-30 20:53:16,431 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-11-30 20:53:16,431 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-11-30 20:53:16,431 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-11-30 20:53:16,431 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-11-30 20:53:16,431 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-11-30 20:53:16,431 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-11-30 20:53:16,431 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-11-30 20:53:16,432 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-11-30 20:53:16,432 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-11-30 20:53:16,432 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-11-30 20:53:16,432 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-11-30 20:53:16,432 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-11-30 20:53:16,432 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-11-30 20:53:16,432 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-11-30 20:53:16,432 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-11-30 20:53:16,432 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-11-30 20:53:16,432 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-11-30 20:53:16,433 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-11-30 20:53:16,433 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-11-30 20:53:16,433 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-11-30 20:53:16,433 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-11-30 20:53:16,433 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-11-30 20:53:16,433 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-11-30 20:53:16,433 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-11-30 20:53:16,599 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.023304187879323368); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.03759910212171491, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.023304187879323368); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.013833333333333333); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.04325, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-11-30 20:53:16,599 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-11-30 20:53:16,599 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.016629010730480915, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.023304187879323368); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.03759910212171491, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.023304187879323368); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.013833333333333333); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.04325, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-11-30 20:53:16,851 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 393 ms to try 5000 different iterations.  Found a solution that moves 1044 regions; Going from a computed imbalance of 0.016629010730480915 to a new imbalance of 8.195094173648828E-4. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.00610013298189536); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.010572819481316787); MoveCostFunction : (multiplier=7.0, imbalance=0.116, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.00610013298189536); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=2.5E-4); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.005666666666666667); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-11-30 20:53:16,853 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1643751281:81 , srv179028955:81 , srv58179894:82 , srv1074363205:83 , srv1168177395:83 , srv1314393639:83 , srv1327355751:83 , srv1424002412:83 , srv2006312910:83 , srv212489731:83 , srv639190420:83 , srv745044805:83 , srv944069738:83 , srv975726337:83 , srv1039158884:84 , srv1095164675:84 , srv1151981047:84 , srv1374190481:84 , srv1819746347:84 , srv1852600554:84 , srv18865251:84 , srv1935799915:84 , srv256312257:84 , srv50214710:84 , srv821768584:84 , srv89141746:84 , srv903627490:84 , srv1486992925:85 , srv1497889833:85 , srv1587942172:85 , srv1804422393:85 , srv184985513:85 , srv1867688825:85 , srv211414903:85 , srv2140169144:85 , srv221695312:85 , srv254440348:85 , srv297908225:85 , srv344130064:85 , srv459294342:85 , srv497339703:85 , srv661344457:85 , srv77931518:85 , srv911578749:85 , srv973305970:85 , srv106430938:86 , srv1129457209:86 , srv1377593120:86 , srv1630339712:86 , srv1648342174:86 , srv1994354428:86 , srv2119087444:86 , srv227766135:86 , srv380725970:86 , srv398927745:86 , srv504209145:86 , srv51748521:86 , srv534588419:86 , srv588526745:86 , srv674603991:86 , srv764501074:86 , srv77792940:86 , srv803278379:86 , srv888707177:86 , srv940446734:86 , srv955649864:86 , srv997093616:86 , srv1027155410:87 , srv1031461578:87 , srv1153778642:87 , srv1186223354:87 , srv1385882545:87 , srv1595883937:87 , srv1734353752:87 , srv1898712548:87 , srv1942459334:87 , srv2048513134:87 , srv2064385718:87 , srv2067293975:87 , srv2069783721:87 , srv2083064466:87 , srv2101298334:87 , srv2101341847:87 , srv249505951:87 , srv487824988:87 , srv886331236:87 , srv892176011:87 , srv1021664874:88 , srv1110463955:88 , srv1548423991:88 , srv1908272348:88 , srv2032599326:88 , srv2046608936:88 , srv2131609936:88 , srv644264850:88 , srv694867233:88 , srv906845627:88 , srv2025555201:89 , srv585314857:89 , srv1888763098:531 }
2023-11-30 20:53:16,856 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-11-30 20:53:16,857 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv674603991=79, srv1804422393=29, srv1908272348=37, srv1643751281=25, srv694867233=80, srv1497889833=20, srv2032599326=43, srv1888763098=35, srv1129457209=8, srv211414903=52, srv459294342=66, srv1548423991=21, srv50214710=69, srv89141746=89, srv2067293975=47, srv745044805=81, srv764501074=82, srv888707177=88, srv1385882545=17, srv179028955=28, srv212489731=54, srv1935799915=38, srv254440348=60, srv2048513134=45, srv249505951=59, srv2131609936=55, srv1095164675=6, srv2140169144=56, srv906845627=92, srv1031461578=2, srv1424002412=18, srv821768584=86, srv398927745=65, srv58179894=73, srv504209145=70, srv1153778642=10, srv497339703=68, srv77792940=83, srv940446734=94, srv344130064=63, srv1039158884=3, srv227766135=58, srv184985513=31, srv997093616=99, srv1486992925=19, srv1377593120=16, srv1327355751=14, srv297908225=62, srv1819746347=30, srv886331236=87, srv1074363205=5, srv1942459334=39, srv1587942172=22, srv2119087444=53, srv1852600554=32, srv903627490=91, srv639190420=76, srv51748521=71, srv944069738=95, srv1168177395=11, srv1186223354=12, srv1898712548=36, srv1374190481=15, srv2046608936=44, srv1314393639=13, srv2101341847=51, srv487824988=67, srv1027155410=1, srv1110463955=7, srv2069783721=48, srv380725970=64, srv588526745=75, srv1734353752=27, srv892176011=90, srv2101298334=50, srv585314857=74, srv955649864=96, srv77931518=84, srv18865251=34, srv803278379=85, srv975726337=98, srv106430938=4, srv1630339712=24, srv1867688825=33, srv911578749=93, srv644264850=77, srv2006312910=41, srv221695312=57, srv1151981047=9, srv2025555201=42, srv2083064466=49, srv256312257=61, srv1595883937=23, srv2064385718=46, srv661344457=78, srv973305970=97, srv1648342174=26, srv534588419=72, srv1994354428=40, srv1021664874=0} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-11-30 20:53:16,870 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-11-30 20:53:16,870 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-11-30 20:53:16,870 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-11-30 20:53:16,870 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-11-30 20:53:16,870 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-11-30 20:53:16,870 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-11-30 20:53:16,870 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-11-30 20:53:16,870 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-11-30 20:53:16,870 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-11-30 20:53:16,870 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-11-30 20:53:16,870 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-11-30 20:53:16,870 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-11-30 20:53:16,870 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-11-30 20:53:16,870 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-11-30 20:53:16,871 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-11-30 20:53:16,871 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-11-30 20:53:16,871 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-11-30 20:53:16,871 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-11-30 20:53:16,871 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-11-30 20:53:16,871 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-11-30 20:53:16,871 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-11-30 20:53:16,871 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-11-30 20:53:16,871 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-11-30 20:53:16,871 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-11-30 20:53:16,871 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-11-30 20:53:16,871 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-11-30 20:53:16,872 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-11-30 20:53:16,872 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-11-30 20:53:16,872 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-11-30 20:53:16,872 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-11-30 20:53:16,872 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-11-30 20:53:16,872 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-11-30 20:53:16,872 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-11-30 20:53:16,872 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-11-30 20:53:16,872 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-11-30 20:53:16,872 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-11-30 20:53:16,873 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-11-30 20:53:16,873 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-11-30 20:53:16,873 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-11-30 20:53:16,873 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-11-30 20:53:16,873 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-11-30 20:53:16,873 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-11-30 20:53:16,873 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-11-30 20:53:16,873 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-11-30 20:53:16,873 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-11-30 20:53:16,873 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-11-30 20:53:16,874 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-11-30 20:53:16,874 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-11-30 20:53:16,874 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-11-30 20:53:16,874 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-11-30 20:53:16,874 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-11-30 20:53:16,874 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-11-30 20:53:16,874 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-11-30 20:53:16,874 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-11-30 20:53:16,874 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-11-30 20:53:16,874 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-11-30 20:53:16,874 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-11-30 20:53:16,875 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-11-30 20:53:16,875 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-11-30 20:53:16,875 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-11-30 20:53:16,875 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-11-30 20:53:16,875 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-11-30 20:53:16,875 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-11-30 20:53:16,875 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-11-30 20:53:16,875 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-11-30 20:53:16,875 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-11-30 20:53:16,875 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-11-30 20:53:16,875 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-11-30 20:53:16,876 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-11-30 20:53:16,876 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-11-30 20:53:16,876 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-11-30 20:53:16,876 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-11-30 20:53:16,876 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-11-30 20:53:16,876 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-11-30 20:53:16,876 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-11-30 20:53:16,876 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-11-30 20:53:16,876 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-11-30 20:53:16,876 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-11-30 20:53:16,877 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-11-30 20:53:16,877 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-11-30 20:53:16,877 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-11-30 20:53:16,877 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-11-30 20:53:16,877 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-11-30 20:53:16,877 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-11-30 20:53:16,877 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-11-30 20:53:16,877 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-11-30 20:53:16,877 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-11-30 20:53:16,877 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-11-30 20:53:16,877 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-11-30 20:53:16,878 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-11-30 20:53:16,878 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-11-30 20:53:16,878 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-11-30 20:53:16,878 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-11-30 20:53:16,878 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-11-30 20:53:16,878 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-11-30 20:53:16,878 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-11-30 20:53:16,878 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-11-30 20:53:16,878 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-11-30 20:53:16,878 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-11-30 20:53:16,879 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-11-30 20:53:16,879 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-11-30 20:53:16,996 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.00610013298189536); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.010572819481316787); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.00610013298189536); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=2.5E-4); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.005666666666666667); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-11-30 20:53:16,996 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-11-30 20:53:16,997 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=8.121991731198995E-4, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.00610013298189536); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.010572819481316787); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.00610013298189536); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=2.5E-4); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.005666666666666667); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-11-30 20:53:17,433 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 541 ms to try 5000 different iterations.  Found a solution that moves 285 regions; Going from a computed imbalance of 8.121991731198995E-4 to a new imbalance of 4.3170439886227204E-5. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=5.470732932414788E-4); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0018951174787165373); MoveCostFunction : (multiplier=7.0, imbalance=0.03166666666666667, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=5.470732932414788E-4); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=3.333333333333333E-4); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-11-30 20:53:17,435 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1021664874:83 , srv2069783721:83 , srv2101341847:83 , srv504209145:83 , srv694867233:83 , srv821768584:83 , srv903627490:83 , srv1031461578:84 , srv1039158884:84 , srv1110463955:84 , srv1168177395:84 , srv1186223354:84 , srv1377593120:84 , srv1486992925:84 , srv1548423991:84 , srv1587942172:84 , srv1630339712:84 , srv1643751281:84 , srv1734353752:84 , srv184985513:84 , srv1935799915:84 , srv2025555201:84 , srv2032599326:84 , srv2046608936:84 , srv2048513134:84 , srv2101298334:84 , srv2131609936:84 , srv2140169144:84 , srv221695312:84 , srv380725970:84 , srv487824988:84 , srv497339703:84 , srv534588419:84 , srv585314857:84 , srv588526745:84 , srv644264850:84 , srv674603991:84 , srv77792940:84 , srv77931518:84 , srv886331236:84 , srv89141746:84 , srv906845627:84 , srv940446734:84 , srv955649864:84 , srv973305970:84 , srv997093616:84 , srv1027155410:85 , srv106430938:85 , srv1074363205:85 , srv1095164675:85 , srv1129457209:85 , srv1151981047:85 , srv1153778642:85 , srv1314393639:85 , srv1327355751:85 , srv1374190481:85 , srv1385882545:85 , srv1424002412:85 , srv1497889833:85 , srv1595883937:85 , srv1648342174:85 , srv179028955:85 , srv1819746347:85 , srv1852600554:85 , srv1867688825:85 , srv18865251:85 , srv1898712548:85 , srv1908272348:85 , srv1942459334:85 , srv2006312910:85 , srv2067293975:85 , srv2083064466:85 , srv212489731:85 , srv227766135:85 , srv249505951:85 , srv254440348:85 , srv297908225:85 , srv344130064:85 , srv398927745:85 , srv459294342:85 , srv50214710:85 , srv51748521:85 , srv58179894:85 , srv639190420:85 , srv661344457:85 , srv745044805:85 , srv764501074:85 , srv803278379:85 , srv888707177:85 , srv892176011:85 , srv944069738:85 , srv975726337:85 , srv1804422393:86 , srv1994354428:86 , srv2064385718:86 , srv2119087444:86 , srv256312257:86 , srv911578749:86 , srv211414903:87 , srv1888763098:630 }
2023-11-30 20:53:17,438 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-11-30 20:53:17,438 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv674603991=79, srv1804422393=29, srv1908272348=37, srv1643751281=25, srv694867233=80, srv1497889833=20, srv2032599326=43, srv1888763098=35, srv1129457209=8, srv211414903=52, srv459294342=66, srv1548423991=21, srv50214710=69, srv89141746=89, srv2067293975=47, srv745044805=81, srv764501074=82, srv888707177=88, srv1385882545=17, srv179028955=28, srv212489731=54, srv1935799915=38, srv254440348=60, srv2048513134=45, srv249505951=59, srv2131609936=55, srv1095164675=6, srv2140169144=56, srv906845627=92, srv1031461578=2, srv1424002412=18, srv821768584=86, srv398927745=65, srv58179894=73, srv504209145=70, srv1153778642=10, srv497339703=68, srv77792940=83, srv940446734=94, srv344130064=63, srv1039158884=3, srv227766135=58, srv184985513=31, srv997093616=99, srv1486992925=19, srv1377593120=16, srv1327355751=14, srv297908225=62, srv1819746347=30, srv886331236=87, srv1074363205=5, srv1942459334=39, srv1587942172=22, srv2119087444=53, srv1852600554=32, srv903627490=91, srv639190420=76, srv51748521=71, srv944069738=95, srv1168177395=11, srv1186223354=12, srv1898712548=36, srv1374190481=15, srv2046608936=44, srv1314393639=13, srv2101341847=51, srv487824988=67, srv1027155410=1, srv1110463955=7, srv2069783721=48, srv380725970=64, srv588526745=75, srv1734353752=27, srv892176011=90, srv2101298334=50, srv585314857=74, srv955649864=96, srv77931518=84, srv18865251=34, srv803278379=85, srv975726337=98, srv106430938=4, srv1630339712=24, srv1867688825=33, srv911578749=93, srv644264850=77, srv2006312910=41, srv221695312=57, srv1151981047=9, srv2025555201=42, srv2083064466=49, srv256312257=61, srv1595883937=23, srv2064385718=46, srv661344457=78, srv973305970=97, srv1648342174=26, srv534588419=72, srv1994354428=40, srv1021664874=0} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-11-30 20:53:17,449 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-11-30 20:53:17,449 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-11-30 20:53:17,449 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-11-30 20:53:17,449 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-11-30 20:53:17,449 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-11-30 20:53:17,449 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-11-30 20:53:17,449 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-11-30 20:53:17,449 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-11-30 20:53:17,449 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-11-30 20:53:17,449 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-11-30 20:53:17,449 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-11-30 20:53:17,450 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-11-30 20:53:17,450 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-11-30 20:53:17,450 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-11-30 20:53:17,450 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-11-30 20:53:17,450 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-11-30 20:53:17,450 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-11-30 20:53:17,450 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-11-30 20:53:17,450 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-11-30 20:53:17,450 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-11-30 20:53:17,450 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-11-30 20:53:17,450 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-11-30 20:53:17,450 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-11-30 20:53:17,450 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-11-30 20:53:17,450 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-11-30 20:53:17,450 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-11-30 20:53:17,450 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-11-30 20:53:17,450 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-11-30 20:53:17,450 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-11-30 20:53:17,450 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-11-30 20:53:17,450 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-11-30 20:53:17,451 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-11-30 20:53:17,451 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-11-30 20:53:17,451 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-11-30 20:53:17,451 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-11-30 20:53:17,451 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-11-30 20:53:17,451 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-11-30 20:53:17,451 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-11-30 20:53:17,451 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-11-30 20:53:17,451 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-11-30 20:53:17,451 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-11-30 20:53:17,451 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-11-30 20:53:17,451 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-11-30 20:53:17,452 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-11-30 20:53:17,452 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-11-30 20:53:17,452 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-11-30 20:53:17,452 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-11-30 20:53:17,452 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-11-30 20:53:17,452 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-11-30 20:53:17,452 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-11-30 20:53:17,452 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-11-30 20:53:17,452 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-11-30 20:53:17,452 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-11-30 20:53:17,453 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-11-30 20:53:17,453 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-11-30 20:53:17,453 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-11-30 20:53:17,453 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-11-30 20:53:17,453 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-11-30 20:53:17,453 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-11-30 20:53:17,453 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-11-30 20:53:17,453 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-11-30 20:53:17,453 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-11-30 20:53:17,453 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-11-30 20:53:17,453 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-11-30 20:53:17,454 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-11-30 20:53:17,454 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-11-30 20:53:17,454 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-11-30 20:53:17,454 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-11-30 20:53:17,454 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-11-30 20:53:17,454 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-11-30 20:53:17,454 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-11-30 20:53:17,454 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-11-30 20:53:17,455 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-11-30 20:53:17,455 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-11-30 20:53:17,455 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-11-30 20:53:17,455 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-11-30 20:53:17,455 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-11-30 20:53:17,455 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-11-30 20:53:17,455 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-11-30 20:53:17,455 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-11-30 20:53:17,455 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-11-30 20:53:17,455 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-11-30 20:53:17,455 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-11-30 20:53:17,456 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-11-30 20:53:17,456 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-11-30 20:53:17,456 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-11-30 20:53:17,456 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-11-30 20:53:17,456 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-11-30 20:53:17,456 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-11-30 20:53:17,456 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-11-30 20:53:17,456 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-11-30 20:53:17,456 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-11-30 20:53:17,456 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-11-30 20:53:17,456 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-11-30 20:53:17,457 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-11-30 20:53:17,457 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-11-30 20:53:17,457 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-11-30 20:53:17,457 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-11-30 20:53:17,457 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-11-30 20:53:17,457 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-11-30 20:53:17,457 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-11-30 20:53:17,562 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=5.470732932414788E-4); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0018951174787165373); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=5.470732932414788E-4); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=3.333333333333333E-4); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-11-30 20:53:17,562 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-11-30 20:53:17,563 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=4.117482723314271E-5, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=5.470732932414788E-4); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0018951174787165373); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=5.470732932414788E-4); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=3.333333333333333E-4); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-11-30 20:53:17,818 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 351 ms to try 5000 different iterations.  Found a solution that moves 37 regions; Going from a computed imbalance of 4.117482723314271E-5 to a new imbalance of 5.901572530944662E-6. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0012535023884839248); MoveCostFunction : (multiplier=7.0, imbalance=0.004111111111111111); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-11-30 20:53:17,819 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1027155410:83 , srv1095164675:83 , srv179028955:83 , srv1804422393:83 , srv1994354428:83 , srv2064385718:83 , srv211414903:83 , srv2119087444:83 , srv256312257:83 , srv639190420:83 , srv803278379:83 , srv1021664874:84 , srv1031461578:84 , srv106430938:84 , srv1074363205:84 , srv1110463955:84 , srv1129457209:84 , srv1151981047:84 , srv1153778642:84 , srv1168177395:84 , srv1186223354:84 , srv1314393639:84 , srv1327355751:84 , srv1374190481:84 , srv1377593120:84 , srv1385882545:84 , srv1424002412:84 , srv1486992925:84 , srv1548423991:84 , srv1587942172:84 , srv1595883937:84 , srv1630339712:84 , srv1643751281:84 , srv1648342174:84 , srv1734353752:84 , srv1819746347:84 , srv1852600554:84 , srv1867688825:84 , srv18865251:84 , srv1898712548:84 , srv1908272348:84 , srv1935799915:84 , srv1942459334:84 , srv2006312910:84 , srv2025555201:84 , srv2032599326:84 , srv2046608936:84 , srv2048513134:84 , srv2067293975:84 , srv2069783721:84 , srv2083064466:84 , srv2101298334:84 , srv212489731:84 , srv2131609936:84 , srv2140169144:84 , srv221695312:84 , srv227766135:84 , srv249505951:84 , srv254440348:84 , srv297908225:84 , srv344130064:84 , srv380725970:84 , srv398927745:84 , srv459294342:84 , srv487824988:84 , srv497339703:84 , srv50214710:84 , srv504209145:84 , srv51748521:84 , srv534588419:84 , srv58179894:84 , srv585314857:84 , srv588526745:84 , srv644264850:84 , srv661344457:84 , srv694867233:84 , srv745044805:84 , srv764501074:84 , srv77931518:84 , srv888707177:84 , srv89141746:84 , srv892176011:84 , srv906845627:84 , srv911578749:84 , srv940446734:84 , srv944069738:84 , srv955649864:84 , srv975726337:84 , srv997093616:84 , srv1039158884:85 , srv1497889833:85 , srv184985513:85 , srv2101341847:85 , srv674603991:85 , srv77792940:85 , srv821768584:85 , srv886331236:85 , srv973305970:85 , srv903627490:86 , srv1888763098:684 }
2023-11-30 20:53:17,825 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-11-30 20:53:17,825 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv674603991=79, srv1804422393=29, srv1908272348=37, srv1643751281=25, srv694867233=80, srv1497889833=20, srv2032599326=43, srv1888763098=35, srv1129457209=8, srv211414903=52, srv459294342=66, srv1548423991=21, srv50214710=69, srv89141746=89, srv2067293975=47, srv745044805=81, srv764501074=82, srv888707177=88, srv1385882545=17, srv179028955=28, srv212489731=54, srv1935799915=38, srv254440348=60, srv2048513134=45, srv249505951=59, srv2131609936=55, srv1095164675=6, srv2140169144=56, srv906845627=92, srv1031461578=2, srv1424002412=18, srv821768584=86, srv398927745=65, srv58179894=73, srv504209145=70, srv1153778642=10, srv497339703=68, srv77792940=83, srv940446734=94, srv344130064=63, srv1039158884=3, srv227766135=58, srv184985513=31, srv997093616=99, srv1486992925=19, srv1377593120=16, srv1327355751=14, srv297908225=62, srv1819746347=30, srv886331236=87, srv1074363205=5, srv1942459334=39, srv1587942172=22, srv2119087444=53, srv1852600554=32, srv903627490=91, srv639190420=76, srv51748521=71, srv944069738=95, srv1168177395=11, srv1186223354=12, srv1898712548=36, srv1374190481=15, srv2046608936=44, srv1314393639=13, srv2101341847=51, srv487824988=67, srv1027155410=1, srv1110463955=7, srv2069783721=48, srv380725970=64, srv588526745=75, srv1734353752=27, srv892176011=90, srv2101298334=50, srv585314857=74, srv955649864=96, srv77931518=84, srv18865251=34, srv803278379=85, srv975726337=98, srv106430938=4, srv1630339712=24, srv1867688825=33, srv911578749=93, srv644264850=77, srv2006312910=41, srv221695312=57, srv1151981047=9, srv2025555201=42, srv2083064466=49, srv256312257=61, srv1595883937=23, srv2064385718=46, srv661344457=78, srv973305970=97, srv1648342174=26, srv534588419=72, srv1994354428=40, srv1021664874=0} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-11-30 20:53:17,868 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-11-30 20:53:17,868 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-11-30 20:53:17,868 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-11-30 20:53:17,868 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-11-30 20:53:17,868 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-11-30 20:53:17,868 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-11-30 20:53:17,868 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-11-30 20:53:17,869 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-11-30 20:53:17,869 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-11-30 20:53:17,869 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-11-30 20:53:17,869 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-11-30 20:53:17,869 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-11-30 20:53:17,869 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-11-30 20:53:17,869 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-11-30 20:53:17,869 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-11-30 20:53:17,869 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-11-30 20:53:17,869 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-11-30 20:53:17,869 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-11-30 20:53:17,869 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-11-30 20:53:17,870 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-11-30 20:53:17,870 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-11-30 20:53:17,870 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-11-30 20:53:17,870 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-11-30 20:53:17,870 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-11-30 20:53:17,870 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-11-30 20:53:17,870 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-11-30 20:53:17,870 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-11-30 20:53:17,870 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-11-30 20:53:17,870 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-11-30 20:53:17,870 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-11-30 20:53:17,870 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-11-30 20:53:17,871 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-11-30 20:53:17,871 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-11-30 20:53:17,871 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-11-30 20:53:17,871 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-11-30 20:53:17,871 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-11-30 20:53:17,871 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-11-30 20:53:17,871 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-11-30 20:53:17,871 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-11-30 20:53:17,871 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-11-30 20:53:17,871 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-11-30 20:53:17,871 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-11-30 20:53:17,871 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-11-30 20:53:17,871 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-11-30 20:53:17,872 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-11-30 20:53:17,872 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-11-30 20:53:17,872 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-11-30 20:53:17,872 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-11-30 20:53:17,872 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-11-30 20:53:17,872 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-11-30 20:53:17,872 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-11-30 20:53:17,872 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-11-30 20:53:17,872 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-11-30 20:53:17,872 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-11-30 20:53:17,872 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-11-30 20:53:17,872 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-11-30 20:53:17,872 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-11-30 20:53:17,873 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-11-30 20:53:17,873 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-11-30 20:53:17,873 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-11-30 20:53:17,873 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-11-30 20:53:17,873 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-11-30 20:53:17,873 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-11-30 20:53:17,873 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-11-30 20:53:17,873 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-11-30 20:53:17,873 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-11-30 20:53:17,873 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-11-30 20:53:17,873 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-11-30 20:53:17,873 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-11-30 20:53:17,873 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-11-30 20:53:17,874 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-11-30 20:53:17,874 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-11-30 20:53:17,874 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-11-30 20:53:17,874 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-11-30 20:53:17,874 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-11-30 20:53:17,874 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-11-30 20:53:17,874 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-11-30 20:53:17,874 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-11-30 20:53:17,874 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-11-30 20:53:17,874 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-11-30 20:53:17,874 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-11-30 20:53:17,874 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-11-30 20:53:17,874 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-11-30 20:53:17,875 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-11-30 20:53:17,875 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-11-30 20:53:17,875 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-11-30 20:53:17,875 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-11-30 20:53:17,875 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-11-30 20:53:17,875 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-11-30 20:53:17,875 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-11-30 20:53:17,875 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-11-30 20:53:17,875 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-11-30 20:53:17,875 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-11-30 20:53:17,875 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-11-30 20:53:17,876 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-11-30 20:53:17,876 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-11-30 20:53:17,876 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-11-30 20:53:17,876 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-11-30 20:53:17,876 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-11-30 20:53:17,876 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-11-30 20:53:17,876 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-11-30 20:53:18,025 INFO  [Time-limited test] balancer.StochasticLoadBalancer(381): Cluster wide - skipping load balancing because weighted average imbalance=5.642492993526674E-6 <= threshold(0.025). If you want more aggressive balancing, either lower hbase.master.balancer.stochastic.minCostNeedBalance from 0.025 or increase the relative multiplier(s) of the specific cost function(s). functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0012535023884839248); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-11-30 20:53:18,025 INFO  [Time-limited test] balancer.BalancerTestBase(570): Mock Final balance: { srv1027155410:83 , srv1095164675:83 , srv179028955:83 , srv1804422393:83 , srv1994354428:83 , srv2064385718:83 , srv211414903:83 , srv2119087444:83 , srv256312257:83 , srv639190420:83 , srv803278379:83 , srv1021664874:84 , srv1031461578:84 , srv106430938:84 , srv1074363205:84 , srv1110463955:84 , srv1129457209:84 , srv1151981047:84 , srv1153778642:84 , srv1168177395:84 , srv1186223354:84 , srv1314393639:84 , srv1327355751:84 , srv1374190481:84 , srv1377593120:84 , srv1385882545:84 , srv1424002412:84 , srv1486992925:84 , srv1548423991:84 , srv1587942172:84 , srv1595883937:84 , srv1630339712:84 , srv1643751281:84 , srv1648342174:84 , srv1734353752:84 , srv1819746347:84 , srv1852600554:84 , srv1867688825:84 , srv18865251:84 , srv1898712548:84 , srv1908272348:84 , srv1935799915:84 , srv1942459334:84 , srv2006312910:84 , srv2025555201:84 , srv2032599326:84 , srv2046608936:84 , srv2048513134:84 , srv2067293975:84 , srv2069783721:84 , srv2083064466:84 , srv2101298334:84 , srv212489731:84 , srv2131609936:84 , srv2140169144:84 , srv221695312:84 , srv227766135:84 , srv249505951:84 , srv254440348:84 , srv297908225:84 , srv344130064:84 , srv380725970:84 , srv398927745:84 , srv459294342:84 , srv487824988:84 , srv497339703:84 , srv50214710:84 , srv504209145:84 , srv51748521:84 , srv534588419:84 , srv58179894:84 , srv585314857:84 , srv588526745:84 , srv644264850:84 , srv661344457:84 , srv694867233:84 , srv745044805:84 , srv764501074:84 , srv77931518:84 , srv888707177:84 , srv89141746:84 , srv892176011:84 , srv906845627:84 , srv911578749:84 , srv940446734:84 , srv944069738:84 , srv955649864:84 , srv975726337:84 , srv997093616:84 , srv1039158884:85 , srv1497889833:85 , srv184985513:85 , srv2101341847:85 , srv674603991:85 , srv77792940:85 , srv821768584:85 , srv886331236:85 , srv973305970:85 , srv903627490:86 , srv1888763098:684 }
2023-11-30 20:53:18,059 INFO  [Time-limited test] hbase.ResourceChecker(175): after: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnLargeClusterWithRacks Thread=12 (was 12), OpenFileDescriptor=290 (was 290), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=344 (was 322) - SystemLoadAverage LEAK? -, ProcessCount=173 (was 174), AvailableMemoryMB=8107 (was 9004)
2023-11-30 20:53:18,067 INFO  [Time-limited test] hbase.ResourceChecker(147): before: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnMidClusterWithRacks Thread=12, OpenFileDescriptor=290, MaxFileDescriptor=60000, SystemLoadAverage=344, ProcessCount=173, AvailableMemoryMB=8106
2023-11-30 20:53:18,068 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2023-11-30 20:53:18,068 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=5000, runMaxSteps=true, stepsPerRegion=800, maxRunningTime=120000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 111077.0 etc.
2023-11-30 20:53:18,084 INFO  [Time-limited test] balancer.BalancerTestBase(547): Mock Cluster : { srv1202856484:84 , srv1219980380:84 , srv1285910902:84 , srv1316498914:84 , srv1319763691:84 , srv1491769874:84 , srv1506688441:84 , srv1617263088:84 , srv1649378626:84 , srv1680280941:84 , srv1805830660:84 , srv188656928:84 , srv2064440084:84 , srv2071001652:84 , srv2089212403:84 , srv2108037109:84 , srv436442485:84 , srv437698703:84 , srv52177168:84 , srv549583657:84 , srv575031396:84 , srv644202208:84 , srv656157506:84 , srv775077875:84 , srv783354017:84 , srv817202657:84 , srv898662025:84 , srv902224298:84 , srv923159895:84 , srv314217765:264 } [srvr=30 rgns=2700 avg=90.0 max=90 min=90]
2023-11-30 20:53:18,085 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-11-30 20:53:18,085 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1202856484=0, srv1319763691=4, srv314217765=16, srv1219980380=1, srv188656928=11, srv549583657=20, srv775077875=24, srv783354017=25, srv2089212403=14, srv1649378626=8, srv1316498914=3, srv902224298=28, srv644202208=22, srv52177168=19, srv2108037109=15, srv437698703=18, srv1805830660=10, srv1506688441=6, srv1680280941=9, srv898662025=27, srv2064440084=12, srv1617263088=7, srv1491769874=5, srv2071001652=13, srv923159895=29, srv656157506=23, srv436442485=17, srv575031396=21, srv817202657=26, srv1285910902=2} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-11-30 20:53:18,097 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-11-30 20:53:18,098 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-11-30 20:53:18,098 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-11-30 20:53:18,098 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-11-30 20:53:18,098 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-11-30 20:53:18,098 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-11-30 20:53:18,098 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-11-30 20:53:18,098 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-11-30 20:53:18,098 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-11-30 20:53:18,098 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-11-30 20:53:18,098 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-11-30 20:53:18,098 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-11-30 20:53:18,098 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-11-30 20:53:18,098 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-11-30 20:53:18,099 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-11-30 20:53:18,099 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-11-30 20:53:18,099 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-11-30 20:53:18,099 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-11-30 20:53:18,099 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-11-30 20:53:18,099 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-11-30 20:53:18,099 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-11-30 20:53:18,099 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-11-30 20:53:18,099 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-11-30 20:53:18,099 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-11-30 20:53:18,099 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-11-30 20:53:18,099 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-11-30 20:53:18,099 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-11-30 20:53:18,099 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-11-30 20:53:18,100 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-11-30 20:53:18,100 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-11-30 20:53:18,100 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=10, number of hosts=30, number of racks=4
2023-11-30 20:53:18,120 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=1.1128582775169953, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-11-30 20:53:18,120 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.9912548656011574, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=1.1128582775169953, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=64800000
2023-11-30 20:55:18,104 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 120001 ms to try 6178837 different iterations.  Found a solution that moves 1843 regions; Going from a computed imbalance of 0.9912548656011574 to a new imbalance of 4.3016539410932495E-5. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); MoveCostFunction : (multiplier=7.0, imbalance=0.6825925925925926, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-11-30 20:55:18,110 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1202856484:90 , srv1219980380:90 , srv1285910902:90 , srv1316498914:90 , srv1319763691:90 , srv1491769874:90 , srv1506688441:90 , srv1617263088:90 , srv1649378626:90 , srv1680280941:90 , srv1805830660:90 , srv188656928:90 , srv2064440084:90 , srv2071001652:90 , srv2089212403:90 , srv2108037109:90 , srv314217765:90 , srv436442485:90 , srv437698703:90 , srv52177168:90 , srv549583657:90 , srv575031396:90 , srv644202208:90 , srv656157506:90 , srv775077875:90 , srv783354017:90 , srv817202657:90 , srv898662025:90 , srv902224298:90 , srv923159895:90 }
2023-11-30 20:55:18,111 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-11-30 20:55:18,111 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1202856484=0, srv1319763691=4, srv314217765=16, srv1219980380=1, srv188656928=11, srv549583657=20, srv775077875=24, srv783354017=25, srv2089212403=14, srv1649378626=8, srv1316498914=3, srv902224298=28, srv644202208=22, srv52177168=19, srv2108037109=15, srv437698703=18, srv1805830660=10, srv1506688441=6, srv1680280941=9, srv898662025=27, srv2064440084=12, srv1617263088=7, srv1491769874=5, srv2071001652=13, srv923159895=29, srv656157506=23, srv436442485=17, srv575031396=21, srv817202657=26, srv1285910902=2} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-11-30 20:55:18,114 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-11-30 20:55:18,114 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-11-30 20:55:18,114 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-11-30 20:55:18,114 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-11-30 20:55:18,114 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-11-30 20:55:18,114 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-11-30 20:55:18,114 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-11-30 20:55:18,114 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-11-30 20:55:18,114 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-11-30 20:55:18,115 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-11-30 20:55:18,115 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-11-30 20:55:18,115 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-11-30 20:55:18,115 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-11-30 20:55:18,115 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-11-30 20:55:18,115 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-11-30 20:55:18,115 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-11-30 20:55:18,115 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-11-30 20:55:18,115 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-11-30 20:55:18,115 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-11-30 20:55:18,115 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-11-30 20:55:18,115 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-11-30 20:55:18,115 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-11-30 20:55:18,115 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-11-30 20:55:18,115 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-11-30 20:55:18,115 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-11-30 20:55:18,115 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-11-30 20:55:18,115 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-11-30 20:55:18,115 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-11-30 20:55:18,115 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-11-30 20:55:18,115 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-11-30 20:55:18,115 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=10, number of hosts=30, number of racks=4
2023-11-30 20:55:18,127 INFO  [Time-limited test] balancer.StochasticLoadBalancer(381): Cluster wide - skipping load balancing because weighted average imbalance=0.0 <= threshold(0.025). If you want more aggressive balancing, either lower hbase.master.balancer.stochastic.minCostNeedBalance from 0.025 or increase the relative multiplier(s) of the specific cost function(s). functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-11-30 20:55:18,127 INFO  [Time-limited test] balancer.BalancerTestBase(570): Mock Final balance: { srv1202856484:90 , srv1219980380:90 , srv1285910902:90 , srv1316498914:90 , srv1319763691:90 , srv1491769874:90 , srv1506688441:90 , srv1617263088:90 , srv1649378626:90 , srv1680280941:90 , srv1805830660:90 , srv188656928:90 , srv2064440084:90 , srv2071001652:90 , srv2089212403:90 , srv2108037109:90 , srv314217765:90 , srv436442485:90 , srv437698703:90 , srv52177168:90 , srv549583657:90 , srv575031396:90 , srv644202208:90 , srv656157506:90 , srv775077875:90 , srv783354017:90 , srv817202657:90 , srv898662025:90 , srv902224298:90 , srv923159895:90 }
2023-11-30 20:55:18,140 INFO  [Time-limited test] hbase.ResourceChecker(175): after: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnMidClusterWithRacks Thread=11 (was 12), OpenFileDescriptor=290 (was 290), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=211 (was 344), ProcessCount=172 (was 173), AvailableMemoryMB=7516 (was 8106)