2023-07-30 23:53:09,082 INFO  [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks timeout: 13 mins
2023-07-30 23:53:09,401 WARN  [Time-limited test] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties
2023-07-30 23:53:09,517 INFO  [Time-limited test] metrics.MetricRegistriesLoader(60): Loaded MetricRegistries class org.apache.hadoop.hbase.metrics.impl.MetricRegistriesImpl
2023-07-30 23:53:09,576 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2023-07-30 23:53:09,583 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc.
2023-07-30 23:53:09,601 INFO  [Time-limited test] hbase.ResourceChecker(147): before: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnLargeClusterWithRacks Thread=12, OpenFileDescriptor=263, MaxFileDescriptor=60000, SystemLoadAverage=282, ProcessCount=174, AvailableMemoryMB=2791
2023-07-30 23:53:09,604 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2023-07-30 23:53:09,604 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=5000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=10000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc.
2023-07-30 23:53:09,752 INFO  [Time-limited test] balancer.BalancerTestBase(547): Mock Cluster : { srv1017423361:84 , srv1018429308:84 , srv1065308594:84 , srv1162958401:84 , srv1172829423:84 , srv1182728555:84 , srv1224032969:84 , srv1242525967:84 , srv1266635199:84 , srv1273948567:84 , srv127512026:84 , srv1279067802:84 , srv1298946189:84 , srv1314262445:84 , srv1321964805:84 , srv1329785071:84 , srv1360823056:84 , srv1436402754:84 , srv1437356874:84 , srv1451082250:84 , srv1459195474:84 , srv1477986626:84 , srv1490202018:84 , srv1542640938:84 , srv1558571568:84 , srv1592441488:84 , srv1593898195:84 , srv1616557646:84 , srv1620169092:84 , srv1651001375:84 , srv1674966256:84 , srv1684266660:84 , srv1750142432:84 , srv1751646525:84 , srv1755792627:84 , srv1780363008:84 , srv1822483923:84 , srv1826293159:84 , srv1842192545:84 , srv1856757448:84 , srv1865531808:84 , srv18794682:84 , srv1894179564:84 , srv1904463717:84 , srv1931181264:84 , srv1932697550:84 , srv2006860857:84 , srv2018660857:84 , srv2028153733:84 , srv2044628518:84 , srv2065369071:84 , srv2101799798:84 , srv2104592279:84 , srv2111938047:84 , srv2118910572:84 , srv212137841:84 , srv222487311:84 , srv232116229:84 , srv252724830:84 , srv264303046:84 , srv286157745:84 , srv301025681:84 , srv317841881:84 , srv35875621:84 , srv368441433:84 , srv409739455:84 , srv42130394:84 , srv421890288:84 , srv425464170:84 , srv440197041:84 , srv463979428:84 , srv472319880:84 , srv528049269:84 , srv540503258:84 , srv567845825:84 , srv5778565:84 , srv591858803:84 , srv607740573:84 , srv636083960:84 , srv65906961:84 , srv667300925:84 , srv680112788:84 , srv683876978:84 , srv69898062:84 , srv726544300:84 , srv735360535:84 , srv744209460:84 , srv784384365:84 , srv787467077:84 , srv793118730:84 , srv820327088:84 , srv848964888:84 , srv8753755:84 , srv918988216:84 , srv919964945:84 , srv947837476:84 , srv960876684:84 , srv971239212:84 , srv976722938:84 , srv1095619407:684 } [srvr=100 rgns=9000 avg=90.0 max=90 min=90]
2023-07-30 23:53:09,765 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-07-30 23:53:09,774 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv2111938047=54, srv1750142432=33, srv1865531808=41, srv1273948567=10, srv1095619407=3, srv1321964805=15, srv368441433=65, srv1822483923=37, srv1018429308=1, srv1279067802=12, srv252724830=59, srv5778565=76, srv784384365=88, srv1242525967=8, srv1751646525=34, srv1904463717=44, srv848964888=92, srv1593898195=27, srv69898062=84, srv421890288=68, srv1674966256=31, srv820327088=91, srv317841881=63, srv1542640938=24, srv1329785071=16, srv18794682=42, srv1894179564=43, srv264303046=60, srv744209460=87, srv2104592279=53, srv947837476=96, srv8753755=93, srv2118910572=55, srv232116229=58, srv1298946189=13, srv42130394=67, srv1856757448=40, srv540503258=74, srv1651001375=30, srv286157745=61, srv2006860857=47, srv976722938=99, srv1932697550=46, srv1684266660=32, srv971239212=98, srv787467077=89, srv222487311=57, srv1558571568=25, srv2101799798=52, srv567845825=75, srv528049269=73, srv1162958401=4, srv726544300=85, srv1826293159=38, srv1360823056=17, srv425464170=69, srv127512026=11, srv1477986626=22, srv1842192545=39, srv683876978=83, srv960876684=97, srv2044628518=50, srv1437356874=19, srv607740573=78, srv1314262445=14, srv301025681=62, srv409739455=66, srv1620169092=29, srv636083960=79, srv2028153733=49, srv1436402754=18, srv667300925=81, srv1224032969=7, srv1065308594=2, srv735360535=86, srv919964945=95, srv1172829423=5, srv591858803=77, srv1451082250=20, srv35875621=64, srv212137841=56, srv2065369071=51, srv918988216=94, srv1490202018=23, srv1931181264=45, srv1755792627=35, srv793118730=90, srv65906961=80, srv1459195474=21, srv1182728555=6, srv463979428=71, srv1592441488=26, srv1780363008=36, srv1266635199=9, srv2018660857=48, srv1616557646=28, srv680112788=82, srv1017423361=0, srv440197041=70, srv472319880=72} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-07-30 23:53:09,854 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-07-30 23:53:09,854 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-07-30 23:53:09,855 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-07-30 23:53:09,855 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-07-30 23:53:09,855 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-07-30 23:53:09,855 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-07-30 23:53:09,855 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-07-30 23:53:09,855 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-07-30 23:53:09,855 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-07-30 23:53:09,855 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-07-30 23:53:09,855 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-07-30 23:53:09,855 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-07-30 23:53:09,855 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-07-30 23:53:09,856 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-07-30 23:53:09,856 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-07-30 23:53:09,856 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-07-30 23:53:09,856 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-07-30 23:53:09,856 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-07-30 23:53:09,856 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-07-30 23:53:09,856 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-07-30 23:53:09,857 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-07-30 23:53:09,857 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-07-30 23:53:09,857 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-07-30 23:53:09,857 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-07-30 23:53:09,857 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-07-30 23:53:09,857 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-07-30 23:53:09,857 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-07-30 23:53:09,858 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-07-30 23:53:09,858 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-07-30 23:53:09,858 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-07-30 23:53:09,858 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-07-30 23:53:09,858 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-07-30 23:53:09,858 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-07-30 23:53:09,859 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-07-30 23:53:09,859 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-07-30 23:53:09,859 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-07-30 23:53:09,859 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-07-30 23:53:09,859 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-07-30 23:53:09,859 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-07-30 23:53:09,860 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-07-30 23:53:09,860 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-07-30 23:53:09,860 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-07-30 23:53:09,860 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-07-30 23:53:09,860 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-07-30 23:53:09,860 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-07-30 23:53:09,861 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-07-30 23:53:09,861 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-07-30 23:53:09,861 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-07-30 23:53:09,861 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-07-30 23:53:09,861 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-07-30 23:53:09,861 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-07-30 23:53:09,862 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-07-30 23:53:09,862 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-07-30 23:53:09,862 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-07-30 23:53:09,862 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-07-30 23:53:09,862 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-07-30 23:53:09,862 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-07-30 23:53:09,863 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-07-30 23:53:09,863 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-07-30 23:53:09,863 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-07-30 23:53:09,863 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-07-30 23:53:09,863 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-07-30 23:53:09,863 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-07-30 23:53:09,864 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-07-30 23:53:09,864 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-07-30 23:53:09,864 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-07-30 23:53:09,864 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-07-30 23:53:09,864 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-07-30 23:53:09,864 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-07-30 23:53:09,865 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-07-30 23:53:09,865 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-07-30 23:53:09,865 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-07-30 23:53:09,865 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-07-30 23:53:09,865 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-07-30 23:53:09,865 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-07-30 23:53:09,866 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-07-30 23:53:09,866 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-07-30 23:53:09,866 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-07-30 23:53:09,866 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-07-30 23:53:09,866 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-07-30 23:53:09,866 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-07-30 23:53:09,866 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-07-30 23:53:09,867 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-07-30 23:53:09,867 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-07-30 23:53:09,867 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-07-30 23:53:09,867 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-07-30 23:53:09,867 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-07-30 23:53:09,867 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-07-30 23:53:09,868 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-07-30 23:53:09,868 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-07-30 23:53:09,868 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-07-30 23:53:09,868 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-07-30 23:53:09,868 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-07-30 23:53:09,869 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-07-30 23:53:09,869 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-07-30 23:53:09,869 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-07-30 23:53:09,869 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-07-30 23:53:09,869 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-07-30 23:53:09,869 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-07-30 23:53:09,869 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-07-30 23:53:09,870 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-07-30 23:53:10,076 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.06666666666666667, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-07-30 23:53:10,077 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-07-30 23:53:10,077 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.9909252140407105, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.06666666666666667, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-07-30 23:53:10,449 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 541 ms to try 5000 different iterations.  Found a solution that moves 4662 regions; Going from a computed imbalance of 0.9909252140407105 to a new imbalance of 0.18230666474779245. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.04103080092159261, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.057333176728311674, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.518, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.04103080092159261, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.17725, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.24708333333333332, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-07-30 23:53:10,478 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv69898062:81 , srv1616557646:82 , srv35875621:82 , srv127512026:83 , srv1436402754:83 , srv1592441488:83 , srv1651001375:83 , srv421890288:83 , srv540503258:83 , srv65906961:83 , srv1018429308:84 , srv1182728555:84 , srv1266635199:84 , srv1298946189:84 , srv1674966256:84 , srv1931181264:84 , srv1932697550:84 , srv425464170:84 , srv667300925:84 , srv1314262445:85 , srv1459195474:85 , srv1490202018:85 , srv1904463717:85 , srv2006860857:85 , srv2044628518:85 , srv2065369071:85 , srv2101799798:85 , srv2111938047:85 , srv2118910572:85 , srv591858803:85 , srv683876978:85 , srv726544300:85 , srv784384365:85 , srv787467077:85 , srv919964945:85 , srv1017423361:86 , srv1065308594:86 , srv1162958401:86 , srv1224032969:86 , srv1242525967:86 , srv1279067802:86 , srv1437356874:86 , srv1477986626:86 , srv1593898195:86 , srv1620169092:86 , srv1842192545:86 , srv2018660857:86 , srv2104592279:86 , srv286157745:86 , srv42130394:86 , srv440197041:86 , srv463979428:86 , srv918988216:86 , srv1321964805:87 , srv1329785071:87 , srv1360823056:87 , srv1542640938:87 , srv1684266660:87 , srv1751646525:87 , srv1780363008:87 , srv1822483923:87 , srv1856757448:87 , srv18794682:87 , srv212137841:87 , srv222487311:87 , srv232116229:87 , srv567845825:87 , srv5778565:87 , srv607740573:87 , srv636083960:87 , srv848964888:87 , srv1558571568:88 , srv1750142432:88 , srv1826293159:88 , srv1894179564:88 , srv2028153733:88 , srv368441433:88 , srv735360535:88 , srv744209460:88 , srv8753755:88 , srv960876684:88 , srv1273948567:89 , srv1451082250:89 , srv1755792627:89 , srv1865531808:89 , srv252724830:89 , srv301025681:89 , srv472319880:89 , srv680112788:89 , srv793118730:89 , srv971239212:89 , srv976722938:89 , srv1172829423:90 , srv264303046:90 , srv317841881:90 , srv409739455:90 , srv528049269:90 , srv820327088:90 , srv947837476:90 , srv1095619407:455 }
2023-07-30 23:53:10,482 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-07-30 23:53:10,483 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv2111938047=54, srv1750142432=33, srv1865531808=41, srv1273948567=10, srv1095619407=3, srv1321964805=15, srv368441433=65, srv1822483923=37, srv1018429308=1, srv1279067802=12, srv252724830=59, srv5778565=76, srv784384365=88, srv1242525967=8, srv1751646525=34, srv1904463717=44, srv848964888=92, srv1593898195=27, srv69898062=84, srv421890288=68, srv1674966256=31, srv820327088=91, srv317841881=63, srv1542640938=24, srv1329785071=16, srv18794682=42, srv1894179564=43, srv264303046=60, srv744209460=87, srv2104592279=53, srv947837476=96, srv8753755=93, srv2118910572=55, srv232116229=58, srv1298946189=13, srv42130394=67, srv1856757448=40, srv540503258=74, srv1651001375=30, srv286157745=61, srv2006860857=47, srv976722938=99, srv1932697550=46, srv1684266660=32, srv971239212=98, srv787467077=89, srv222487311=57, srv1558571568=25, srv2101799798=52, srv567845825=75, srv528049269=73, srv1162958401=4, srv726544300=85, srv1826293159=38, srv1360823056=17, srv425464170=69, srv127512026=11, srv1477986626=22, srv1842192545=39, srv683876978=83, srv960876684=97, srv2044628518=50, srv1437356874=19, srv607740573=78, srv1314262445=14, srv301025681=62, srv409739455=66, srv1620169092=29, srv636083960=79, srv2028153733=49, srv1436402754=18, srv667300925=81, srv1224032969=7, srv1065308594=2, srv735360535=86, srv919964945=95, srv1172829423=5, srv591858803=77, srv1451082250=20, srv35875621=64, srv212137841=56, srv2065369071=51, srv918988216=94, srv1490202018=23, srv1931181264=45, srv1755792627=35, srv793118730=90, srv65906961=80, srv1459195474=21, srv1182728555=6, srv463979428=71, srv1592441488=26, srv1780363008=36, srv1266635199=9, srv2018660857=48, srv1616557646=28, srv680112788=82, srv1017423361=0, srv440197041=70, srv472319880=72} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-07-30 23:53:10,505 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-07-30 23:53:10,505 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-07-30 23:53:10,505 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-07-30 23:53:10,505 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-07-30 23:53:10,505 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-07-30 23:53:10,506 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-07-30 23:53:10,506 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-07-30 23:53:10,506 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-07-30 23:53:10,506 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-07-30 23:53:10,506 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-07-30 23:53:10,506 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-07-30 23:53:10,506 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-07-30 23:53:10,507 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-07-30 23:53:10,507 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-07-30 23:53:10,507 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-07-30 23:53:10,507 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-07-30 23:53:10,507 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-07-30 23:53:10,507 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-07-30 23:53:10,507 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-07-30 23:53:10,507 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-07-30 23:53:10,508 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-07-30 23:53:10,508 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-07-30 23:53:10,508 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-07-30 23:53:10,508 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-07-30 23:53:10,508 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-07-30 23:53:10,508 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-07-30 23:53:10,508 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-07-30 23:53:10,509 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-07-30 23:53:10,509 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-07-30 23:53:10,509 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-07-30 23:53:10,509 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-07-30 23:53:10,509 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-07-30 23:53:10,509 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-07-30 23:53:10,509 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-07-30 23:53:10,509 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-07-30 23:53:10,510 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-07-30 23:53:10,510 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-07-30 23:53:10,510 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-07-30 23:53:10,510 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-07-30 23:53:10,510 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-07-30 23:53:10,510 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-07-30 23:53:10,510 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-07-30 23:53:10,510 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-07-30 23:53:10,510 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-07-30 23:53:10,510 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-07-30 23:53:10,510 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-07-30 23:53:10,511 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-07-30 23:53:10,511 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-07-30 23:53:10,511 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-07-30 23:53:10,511 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-07-30 23:53:10,511 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-07-30 23:53:10,511 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-07-30 23:53:10,511 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-07-30 23:53:10,511 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-07-30 23:53:10,511 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-07-30 23:53:10,511 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-07-30 23:53:10,511 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-07-30 23:53:10,512 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-07-30 23:53:10,512 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-07-30 23:53:10,512 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-07-30 23:53:10,512 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-07-30 23:53:10,512 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-07-30 23:53:10,512 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-07-30 23:53:10,512 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-07-30 23:53:10,512 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-07-30 23:53:10,512 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-07-30 23:53:10,512 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-07-30 23:53:10,512 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-07-30 23:53:10,513 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-07-30 23:53:10,513 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-07-30 23:53:10,513 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-07-30 23:53:10,513 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-07-30 23:53:10,513 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-07-30 23:53:10,513 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-07-30 23:53:10,513 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-07-30 23:53:10,513 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-07-30 23:53:10,513 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-07-30 23:53:10,514 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-07-30 23:53:10,514 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-07-30 23:53:10,514 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-07-30 23:53:10,514 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-07-30 23:53:10,514 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-07-30 23:53:10,514 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-07-30 23:53:10,514 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-07-30 23:53:10,514 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-07-30 23:53:10,514 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-07-30 23:53:10,514 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-07-30 23:53:10,514 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-07-30 23:53:10,515 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-07-30 23:53:10,515 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-07-30 23:53:10,515 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-07-30 23:53:10,515 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-07-30 23:53:10,515 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-07-30 23:53:10,515 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-07-30 23:53:10,515 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-07-30 23:53:10,515 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-07-30 23:53:10,515 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-07-30 23:53:10,515 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-07-30 23:53:10,515 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-07-30 23:53:10,515 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-07-30 23:53:10,515 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-07-30 23:53:10,655 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.04103080092159261, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.057333176728311674, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.04103080092159261, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.17725, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.24708333333333332, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-07-30 23:53:10,655 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-07-30 23:53:10,655 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.18227402072607776, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.04103080092159261, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.057333176728311674, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.04103080092159261, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.17725, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.24708333333333332, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-07-30 23:53:10,996 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 454 ms to try 5000 different iterations.  Found a solution that moves 2617 regions; Going from a computed imbalance of 0.18227402072607776 to a new imbalance of 0.015112275241051226. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.023405638598301234); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.03313747171142308, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.2907777777777778, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.023405638598301234); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.01175); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.04725, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-07-30 23:53:11,009 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv317841881:79 , srv301025681:80 , srv971239212:80 , srv1172829423:81 , srv264303046:81 , srv472319880:81 , srv793118730:81 , srv820327088:81 , srv1856757448:82 , srv680112788:82 , srv735360535:82 , srv1242525967:83 , srv1542640938:83 , srv1558571568:83 , srv1755792627:83 , srv1865531808:83 , srv2028153733:83 , srv222487311:83 , srv528049269:83 , srv1162958401:84 , srv1451082250:84 , srv1477986626:84 , srv18794682:84 , srv252724830:84 , srv368441433:84 , srv409739455:84 , srv591858803:84 , srv607740573:84 , srv683876978:84 , srv744209460:84 , srv960876684:84 , srv1065308594:85 , srv1314262445:85 , srv1329785071:85 , srv1360823056:85 , srv1437356874:85 , srv1593898195:85 , srv1684266660:85 , srv1750142432:85 , srv1751646525:85 , srv1822483923:85 , srv1826293159:85 , srv1894179564:85 , srv2111938047:85 , srv425464170:85 , srv5778565:85 , srv636083960:85 , srv947837476:85 , srv976722938:85 , srv1224032969:86 , srv1273948567:86 , srv1279067802:86 , srv1459195474:86 , srv1780363008:86 , srv2006860857:86 , srv2104592279:86 , srv2118910572:86 , srv232116229:86 , srv286157745:86 , srv42130394:86 , srv567845825:86 , srv787467077:86 , srv848964888:86 , srv918988216:86 , srv1018429308:87 , srv1321964805:87 , srv1490202018:87 , srv1620169092:87 , srv1904463717:87 , srv2044628518:87 , srv2101799798:87 , srv212137841:87 , srv463979428:87 , srv8753755:87 , srv919964945:87 , srv1182728555:88 , srv1674966256:88 , srv1931181264:88 , srv1932697550:88 , srv2018660857:88 , srv2065369071:88 , srv421890288:88 , srv540503258:88 , srv726544300:88 , srv1017423361:89 , srv127512026:89 , srv1436402754:89 , srv1592441488:89 , srv1651001375:89 , srv1842192545:89 , srv440197041:89 , srv667300925:89 , srv784384365:89 , srv1266635199:90 , srv1298946189:90 , srv1616557646:90 , srv65906961:90 , srv69898062:90 , srv35875621:91 , srv1095619407:527 }
2023-07-30 23:53:11,012 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-07-30 23:53:11,013 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv2111938047=54, srv1750142432=33, srv1865531808=41, srv1273948567=10, srv1095619407=3, srv1321964805=15, srv368441433=65, srv1822483923=37, srv1018429308=1, srv1279067802=12, srv252724830=59, srv5778565=76, srv784384365=88, srv1242525967=8, srv1751646525=34, srv1904463717=44, srv848964888=92, srv1593898195=27, srv69898062=84, srv421890288=68, srv1674966256=31, srv820327088=91, srv317841881=63, srv1542640938=24, srv1329785071=16, srv18794682=42, srv1894179564=43, srv264303046=60, srv744209460=87, srv2104592279=53, srv947837476=96, srv8753755=93, srv2118910572=55, srv232116229=58, srv1298946189=13, srv42130394=67, srv1856757448=40, srv540503258=74, srv1651001375=30, srv286157745=61, srv2006860857=47, srv976722938=99, srv1932697550=46, srv1684266660=32, srv971239212=98, srv787467077=89, srv222487311=57, srv1558571568=25, srv2101799798=52, srv567845825=75, srv528049269=73, srv1162958401=4, srv726544300=85, srv1826293159=38, srv1360823056=17, srv425464170=69, srv127512026=11, srv1477986626=22, srv1842192545=39, srv683876978=83, srv960876684=97, srv2044628518=50, srv1437356874=19, srv607740573=78, srv1314262445=14, srv301025681=62, srv409739455=66, srv1620169092=29, srv636083960=79, srv2028153733=49, srv1436402754=18, srv667300925=81, srv1224032969=7, srv1065308594=2, srv735360535=86, srv919964945=95, srv1172829423=5, srv591858803=77, srv1451082250=20, srv35875621=64, srv212137841=56, srv2065369071=51, srv918988216=94, srv1490202018=23, srv1931181264=45, srv1755792627=35, srv793118730=90, srv65906961=80, srv1459195474=21, srv1182728555=6, srv463979428=71, srv1592441488=26, srv1780363008=36, srv1266635199=9, srv2018660857=48, srv1616557646=28, srv680112788=82, srv1017423361=0, srv440197041=70, srv472319880=72} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-07-30 23:53:11,024 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-07-30 23:53:11,025 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-07-30 23:53:11,025 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-07-30 23:53:11,025 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-07-30 23:53:11,025 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-07-30 23:53:11,025 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-07-30 23:53:11,025 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-07-30 23:53:11,025 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-07-30 23:53:11,025 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-07-30 23:53:11,025 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-07-30 23:53:11,025 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-07-30 23:53:11,025 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-07-30 23:53:11,026 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-07-30 23:53:11,026 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-07-30 23:53:11,026 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-07-30 23:53:11,026 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-07-30 23:53:11,026 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-07-30 23:53:11,026 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-07-30 23:53:11,026 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-07-30 23:53:11,026 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-07-30 23:53:11,026 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-07-30 23:53:11,026 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-07-30 23:53:11,026 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-07-30 23:53:11,026 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-07-30 23:53:11,026 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-07-30 23:53:11,026 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-07-30 23:53:11,026 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-07-30 23:53:11,026 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-07-30 23:53:11,027 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-07-30 23:53:11,027 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-07-30 23:53:11,027 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-07-30 23:53:11,027 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-07-30 23:53:11,027 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-07-30 23:53:11,027 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-07-30 23:53:11,027 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-07-30 23:53:11,027 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-07-30 23:53:11,027 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-07-30 23:53:11,027 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-07-30 23:53:11,027 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-07-30 23:53:11,027 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-07-30 23:53:11,027 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-07-30 23:53:11,027 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-07-30 23:53:11,027 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-07-30 23:53:11,027 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-07-30 23:53:11,028 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-07-30 23:53:11,028 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-07-30 23:53:11,028 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-07-30 23:53:11,028 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-07-30 23:53:11,028 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-07-30 23:53:11,028 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-07-30 23:53:11,028 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-07-30 23:53:11,028 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-07-30 23:53:11,028 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-07-30 23:53:11,028 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-07-30 23:53:11,028 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-07-30 23:53:11,028 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-07-30 23:53:11,028 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-07-30 23:53:11,028 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-07-30 23:53:11,028 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-07-30 23:53:11,028 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-07-30 23:53:11,029 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-07-30 23:53:11,029 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-07-30 23:53:11,029 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-07-30 23:53:11,029 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-07-30 23:53:11,029 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-07-30 23:53:11,029 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-07-30 23:53:11,029 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-07-30 23:53:11,029 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-07-30 23:53:11,029 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-07-30 23:53:11,029 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-07-30 23:53:11,029 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-07-30 23:53:11,029 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-07-30 23:53:11,029 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-07-30 23:53:11,030 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-07-30 23:53:11,030 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-07-30 23:53:11,030 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-07-30 23:53:11,030 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-07-30 23:53:11,030 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-07-30 23:53:11,030 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-07-30 23:53:11,030 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-07-30 23:53:11,030 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-07-30 23:53:11,030 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-07-30 23:53:11,030 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-07-30 23:53:11,030 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-07-30 23:53:11,030 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-07-30 23:53:11,030 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-07-30 23:53:11,030 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-07-30 23:53:11,030 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-07-30 23:53:11,030 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-07-30 23:53:11,031 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-07-30 23:53:11,031 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-07-30 23:53:11,031 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-07-30 23:53:11,031 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-07-30 23:53:11,031 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-07-30 23:53:11,031 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-07-30 23:53:11,031 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-07-30 23:53:11,031 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-07-30 23:53:11,031 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-07-30 23:53:11,031 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-07-30 23:53:11,031 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-07-30 23:53:11,031 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-07-30 23:53:11,167 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.023405638598301234); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.03313747171142308, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.023405638598301234); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.01175); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.04725, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-07-30 23:53:11,167 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-07-30 23:53:11,168 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.01509395061539115, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.023405638598301234); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.03313747171142308, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.023405638598301234); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.01175); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.04725, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-07-30 23:53:11,471 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 429 ms to try 5000 different iterations.  Found a solution that moves 999 regions; Going from a computed imbalance of 0.01509395061539115 to a new imbalance of 7.494121093008183E-4. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.009239710002364602); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.011711074693750519); MoveCostFunction : (multiplier=7.0, imbalance=0.111, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.009239710002364602); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=2.5E-4); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.004666666666666667); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-07-30 23:53:11,473 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1017423361:82 , srv1273948567:82 , srv440197041:82 , srv1266635199:83 , srv1298946189:83 , srv1321964805:83 , srv1842192545:83 , srv2018660857:83 , srv212137841:83 , srv252724830:83 , srv409739455:83 , srv947837476:83 , srv976722938:83 , srv1224032969:84 , srv1436402754:84 , srv1451082250:84 , srv1490202018:84 , srv1620169092:84 , srv1750142432:84 , srv1755792627:84 , srv1822483923:84 , srv1894179564:84 , srv1932697550:84 , srv286157745:84 , srv463979428:84 , srv667300925:84 , srv784384365:84 , srv848964888:84 , srv8753755:84 , srv919964945:84 , srv1182728555:85 , srv127512026:85 , srv1279067802:85 , srv1360823056:85 , srv1459195474:85 , srv1592441488:85 , srv1674966256:85 , srv1751646525:85 , srv1780363008:85 , srv1826293159:85 , srv1865531808:85 , srv1904463717:85 , srv2006860857:85 , srv2044628518:85 , srv2065369071:85 , srv2104592279:85 , srv232116229:85 , srv35875621:85 , srv368441433:85 , srv42130394:85 , srv421890288:85 , srv528049269:85 , srv540503258:85 , srv636083960:85 , srv65906961:85 , srv726544300:85 , srv918988216:85 , srv960876684:85 , srv1065308594:86 , srv1172829423:86 , srv1314262445:86 , srv1329785071:86 , srv1437356874:86 , srv1593898195:86 , srv1616557646:86 , srv1651001375:86 , srv1684266660:86 , srv18794682:86 , srv1931181264:86 , srv2028153733:86 , srv264303046:86 , srv567845825:86 , srv5778565:86 , srv680112788:86 , srv69898062:86 , srv744209460:86 , srv787467077:86 , srv1018429308:87 , srv1162958401:87 , srv1242525967:87 , srv1477986626:87 , srv1542640938:87 , srv1558571568:87 , srv2101799798:87 , srv2118910572:87 , srv472319880:87 , srv607740573:87 , srv683876978:87 , srv793118730:87 , srv820327088:87 , srv1856757448:88 , srv2111938047:88 , srv222487311:88 , srv301025681:88 , srv317841881:88 , srv425464170:88 , srv591858803:88 , srv971239212:88 , srv735360535:89 , srv1095619407:558 }
2023-07-30 23:53:11,478 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-07-30 23:53:11,479 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv2111938047=54, srv1750142432=33, srv1865531808=41, srv1273948567=10, srv1095619407=3, srv1321964805=15, srv368441433=65, srv1822483923=37, srv1018429308=1, srv1279067802=12, srv252724830=59, srv5778565=76, srv784384365=88, srv1242525967=8, srv1751646525=34, srv1904463717=44, srv848964888=92, srv1593898195=27, srv69898062=84, srv421890288=68, srv1674966256=31, srv820327088=91, srv317841881=63, srv1542640938=24, srv1329785071=16, srv18794682=42, srv1894179564=43, srv264303046=60, srv744209460=87, srv2104592279=53, srv947837476=96, srv8753755=93, srv2118910572=55, srv232116229=58, srv1298946189=13, srv42130394=67, srv1856757448=40, srv540503258=74, srv1651001375=30, srv286157745=61, srv2006860857=47, srv976722938=99, srv1932697550=46, srv1684266660=32, srv971239212=98, srv787467077=89, srv222487311=57, srv1558571568=25, srv2101799798=52, srv567845825=75, srv528049269=73, srv1162958401=4, srv726544300=85, srv1826293159=38, srv1360823056=17, srv425464170=69, srv127512026=11, srv1477986626=22, srv1842192545=39, srv683876978=83, srv960876684=97, srv2044628518=50, srv1437356874=19, srv607740573=78, srv1314262445=14, srv301025681=62, srv409739455=66, srv1620169092=29, srv636083960=79, srv2028153733=49, srv1436402754=18, srv667300925=81, srv1224032969=7, srv1065308594=2, srv735360535=86, srv919964945=95, srv1172829423=5, srv591858803=77, srv1451082250=20, srv35875621=64, srv212137841=56, srv2065369071=51, srv918988216=94, srv1490202018=23, srv1931181264=45, srv1755792627=35, srv793118730=90, srv65906961=80, srv1459195474=21, srv1182728555=6, srv463979428=71, srv1592441488=26, srv1780363008=36, srv1266635199=9, srv2018660857=48, srv1616557646=28, srv680112788=82, srv1017423361=0, srv440197041=70, srv472319880=72} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-07-30 23:53:11,504 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-07-30 23:53:11,504 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-07-30 23:53:11,504 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-07-30 23:53:11,504 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-07-30 23:53:11,504 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-07-30 23:53:11,504 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-07-30 23:53:11,504 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-07-30 23:53:11,505 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-07-30 23:53:11,505 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-07-30 23:53:11,505 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-07-30 23:53:11,505 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-07-30 23:53:11,505 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-07-30 23:53:11,505 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-07-30 23:53:11,505 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-07-30 23:53:11,505 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-07-30 23:53:11,505 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-07-30 23:53:11,505 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-07-30 23:53:11,506 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-07-30 23:53:11,506 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-07-30 23:53:11,506 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-07-30 23:53:11,506 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-07-30 23:53:11,506 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-07-30 23:53:11,506 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-07-30 23:53:11,506 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-07-30 23:53:11,506 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-07-30 23:53:11,506 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-07-30 23:53:11,507 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-07-30 23:53:11,507 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-07-30 23:53:11,507 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-07-30 23:53:11,507 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-07-30 23:53:11,507 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-07-30 23:53:11,507 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-07-30 23:53:11,507 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-07-30 23:53:11,507 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-07-30 23:53:11,507 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-07-30 23:53:11,508 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-07-30 23:53:11,508 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-07-30 23:53:11,508 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-07-30 23:53:11,508 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-07-30 23:53:11,508 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-07-30 23:53:11,508 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-07-30 23:53:11,508 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-07-30 23:53:11,508 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-07-30 23:53:11,508 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-07-30 23:53:11,509 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-07-30 23:53:11,509 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-07-30 23:53:11,509 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-07-30 23:53:11,509 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-07-30 23:53:11,509 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-07-30 23:53:11,509 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-07-30 23:53:11,509 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-07-30 23:53:11,510 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-07-30 23:53:11,510 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-07-30 23:53:11,510 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-07-30 23:53:11,510 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-07-30 23:53:11,510 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-07-30 23:53:11,510 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-07-30 23:53:11,510 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-07-30 23:53:11,510 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-07-30 23:53:11,510 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-07-30 23:53:11,511 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-07-30 23:53:11,511 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-07-30 23:53:11,511 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-07-30 23:53:11,511 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-07-30 23:53:11,511 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-07-30 23:53:11,511 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-07-30 23:53:11,511 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-07-30 23:53:11,511 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-07-30 23:53:11,511 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-07-30 23:53:11,512 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-07-30 23:53:11,512 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-07-30 23:53:11,512 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-07-30 23:53:11,512 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-07-30 23:53:11,512 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-07-30 23:53:11,512 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-07-30 23:53:11,512 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-07-30 23:53:11,512 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-07-30 23:53:11,512 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-07-30 23:53:11,513 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-07-30 23:53:11,513 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-07-30 23:53:11,513 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-07-30 23:53:11,513 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-07-30 23:53:11,513 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-07-30 23:53:11,513 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-07-30 23:53:11,513 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-07-30 23:53:11,513 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-07-30 23:53:11,513 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-07-30 23:53:11,513 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-07-30 23:53:11,514 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-07-30 23:53:11,514 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-07-30 23:53:11,514 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-07-30 23:53:11,514 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-07-30 23:53:11,514 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-07-30 23:53:11,514 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-07-30 23:53:11,514 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-07-30 23:53:11,514 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-07-30 23:53:11,514 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-07-30 23:53:11,515 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-07-30 23:53:11,515 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-07-30 23:53:11,515 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-07-30 23:53:11,515 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-07-30 23:53:11,674 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.009239710002364602); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.011711074693750519); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.009239710002364602); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=2.5E-4); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.004666666666666667); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-07-30 23:53:11,674 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-07-30 23:53:11,675 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=7.424169617905327E-4, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.009239710002364602); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.011711074693750519); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.009239710002364602); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=2.5E-4); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.004666666666666667); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-07-30 23:53:12,024 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 489 ms to try 5000 different iterations.  Found a solution that moves 320 regions; Going from a computed imbalance of 7.424169617905327E-4 to a new imbalance of 2.8057890091487534E-5. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=4.737793696791342E-4); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0018951174787165373); MoveCostFunction : (multiplier=7.0, imbalance=0.035555555555555556, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=4.737793696791342E-4); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.6666666666666666E-4); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-07-30 23:53:12,026 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv2101799798:83 , srv2118910572:83 , srv567845825:83 , srv735360535:83 , srv1017423361:84 , srv1018429308:84 , srv1321964805:84 , srv1329785071:84 , srv1616557646:84 , srv1651001375:84 , srv1684266660:84 , srv1780363008:84 , srv1826293159:84 , srv1842192545:84 , srv1856757448:84 , srv1931181264:84 , srv2065369071:84 , srv2104592279:84 , srv2111938047:84 , srv222487311:84 , srv232116229:84 , srv528049269:84 , srv5778565:84 , srv607740573:84 , srv636083960:84 , srv726544300:84 , srv744209460:84 , srv784384365:84 , srv820327088:84 , srv8753755:84 , srv947837476:84 , srv1065308594:85 , srv1162958401:85 , srv1172829423:85 , srv1182728555:85 , srv1266635199:85 , srv1273948567:85 , srv127512026:85 , srv1279067802:85 , srv1298946189:85 , srv1360823056:85 , srv1436402754:85 , srv1437356874:85 , srv1451082250:85 , srv1477986626:85 , srv1542640938:85 , srv1558571568:85 , srv1592441488:85 , srv1593898195:85 , srv1620169092:85 , srv1674966256:85 , srv1750142432:85 , srv1751646525:85 , srv1865531808:85 , srv18794682:85 , srv1894179564:85 , srv2018660857:85 , srv2028153733:85 , srv2044628518:85 , srv212137841:85 , srv264303046:85 , srv301025681:85 , srv317841881:85 , srv35875621:85 , srv368441433:85 , srv409739455:85 , srv42130394:85 , srv425464170:85 , srv440197041:85 , srv463979428:85 , srv472319880:85 , srv540503258:85 , srv591858803:85 , srv65906961:85 , srv667300925:85 , srv680112788:85 , srv683876978:85 , srv787467077:85 , srv793118730:85 , srv848964888:85 , srv960876684:85 , srv976722938:85 , srv1224032969:86 , srv1242525967:86 , srv1314262445:86 , srv1459195474:86 , srv1490202018:86 , srv1755792627:86 , srv1822483923:86 , srv1904463717:86 , srv1932697550:86 , srv2006860857:86 , srv252724830:86 , srv286157745:86 , srv421890288:86 , srv69898062:86 , srv918988216:86 , srv971239212:86 , srv919964945:87 , srv1095619407:602 }
2023-07-30 23:53:12,032 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-07-30 23:53:12,032 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv2111938047=54, srv1750142432=33, srv1865531808=41, srv1273948567=10, srv1095619407=3, srv1321964805=15, srv368441433=65, srv1822483923=37, srv1018429308=1, srv1279067802=12, srv252724830=59, srv5778565=76, srv784384365=88, srv1242525967=8, srv1751646525=34, srv1904463717=44, srv848964888=92, srv1593898195=27, srv69898062=84, srv421890288=68, srv1674966256=31, srv820327088=91, srv317841881=63, srv1542640938=24, srv1329785071=16, srv18794682=42, srv1894179564=43, srv264303046=60, srv744209460=87, srv2104592279=53, srv947837476=96, srv8753755=93, srv2118910572=55, srv232116229=58, srv1298946189=13, srv42130394=67, srv1856757448=40, srv540503258=74, srv1651001375=30, srv286157745=61, srv2006860857=47, srv976722938=99, srv1932697550=46, srv1684266660=32, srv971239212=98, srv787467077=89, srv222487311=57, srv1558571568=25, srv2101799798=52, srv567845825=75, srv528049269=73, srv1162958401=4, srv726544300=85, srv1826293159=38, srv1360823056=17, srv425464170=69, srv127512026=11, srv1477986626=22, srv1842192545=39, srv683876978=83, srv960876684=97, srv2044628518=50, srv1437356874=19, srv607740573=78, srv1314262445=14, srv301025681=62, srv409739455=66, srv1620169092=29, srv636083960=79, srv2028153733=49, srv1436402754=18, srv667300925=81, srv1224032969=7, srv1065308594=2, srv735360535=86, srv919964945=95, srv1172829423=5, srv591858803=77, srv1451082250=20, srv35875621=64, srv212137841=56, srv2065369071=51, srv918988216=94, srv1490202018=23, srv1931181264=45, srv1755792627=35, srv793118730=90, srv65906961=80, srv1459195474=21, srv1182728555=6, srv463979428=71, srv1592441488=26, srv1780363008=36, srv1266635199=9, srv2018660857=48, srv1616557646=28, srv680112788=82, srv1017423361=0, srv440197041=70, srv472319880=72} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-07-30 23:53:12,050 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-07-30 23:53:12,050 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-07-30 23:53:12,050 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-07-30 23:53:12,050 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-07-30 23:53:12,050 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-07-30 23:53:12,050 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-07-30 23:53:12,051 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-07-30 23:53:12,051 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-07-30 23:53:12,051 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-07-30 23:53:12,051 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-07-30 23:53:12,051 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-07-30 23:53:12,051 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-07-30 23:53:12,051 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-07-30 23:53:12,051 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-07-30 23:53:12,051 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-07-30 23:53:12,051 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-07-30 23:53:12,051 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-07-30 23:53:12,051 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-07-30 23:53:12,051 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-07-30 23:53:12,052 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-07-30 23:53:12,052 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-07-30 23:53:12,052 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-07-30 23:53:12,052 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-07-30 23:53:12,052 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-07-30 23:53:12,052 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-07-30 23:53:12,052 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-07-30 23:53:12,052 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-07-30 23:53:12,052 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-07-30 23:53:12,052 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-07-30 23:53:12,052 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-07-30 23:53:12,052 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-07-30 23:53:12,052 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-07-30 23:53:12,053 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-07-30 23:53:12,053 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-07-30 23:53:12,053 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-07-30 23:53:12,053 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-07-30 23:53:12,053 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-07-30 23:53:12,053 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-07-30 23:53:12,053 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-07-30 23:53:12,053 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-07-30 23:53:12,053 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-07-30 23:53:12,053 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-07-30 23:53:12,053 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-07-30 23:53:12,053 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-07-30 23:53:12,053 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-07-30 23:53:12,054 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-07-30 23:53:12,054 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-07-30 23:53:12,054 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-07-30 23:53:12,054 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-07-30 23:53:12,054 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-07-30 23:53:12,054 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-07-30 23:53:12,054 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-07-30 23:53:12,054 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-07-30 23:53:12,054 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-07-30 23:53:12,054 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-07-30 23:53:12,054 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-07-30 23:53:12,054 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-07-30 23:53:12,055 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-07-30 23:53:12,055 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-07-30 23:53:12,055 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-07-30 23:53:12,055 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-07-30 23:53:12,055 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-07-30 23:53:12,055 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-07-30 23:53:12,055 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-07-30 23:53:12,055 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-07-30 23:53:12,055 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-07-30 23:53:12,055 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-07-30 23:53:12,055 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-07-30 23:53:12,056 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-07-30 23:53:12,056 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-07-30 23:53:12,056 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-07-30 23:53:12,056 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-07-30 23:53:12,056 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-07-30 23:53:12,056 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-07-30 23:53:12,056 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-07-30 23:53:12,056 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-07-30 23:53:12,056 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-07-30 23:53:12,057 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-07-30 23:53:12,057 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-07-30 23:53:12,057 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-07-30 23:53:12,057 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-07-30 23:53:12,057 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-07-30 23:53:12,057 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-07-30 23:53:12,057 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-07-30 23:53:12,057 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-07-30 23:53:12,057 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-07-30 23:53:12,057 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-07-30 23:53:12,057 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-07-30 23:53:12,057 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-07-30 23:53:12,058 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-07-30 23:53:12,058 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-07-30 23:53:12,058 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-07-30 23:53:12,058 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-07-30 23:53:12,058 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-07-30 23:53:12,058 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-07-30 23:53:12,058 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-07-30 23:53:12,058 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-07-30 23:53:12,058 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-07-30 23:53:12,058 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-07-30 23:53:12,058 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-07-30 23:53:12,058 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-07-30 23:53:12,215 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=4.737793696791342E-4); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0018951174787165373); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=4.737793696791342E-4); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.6666666666666666E-4); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-07-30 23:53:12,215 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-07-30 23:53:12,216 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=2.581720220030494E-5, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=4.737793696791342E-4); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0018951174787165373); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=4.737793696791342E-4); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.6666666666666666E-4); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-07-30 23:53:12,563 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 488 ms to try 5000 different iterations.  Found a solution that moves 25 regions; Going from a computed imbalance of 2.581720220030494E-5 to a new imbalance of 7.248293037828088E-6. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0015713484026367722); MoveCostFunction : (multiplier=7.0, imbalance=0.002777777777777778); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-07-30 23:53:12,564 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1558571568:83 , srv1904463717:83 , srv35875621:83 , srv65906961:83 , srv69898062:83 , srv8753755:83 , srv918988216:83 , srv919964945:83 , srv971239212:83 , srv1018429308:84 , srv1065308594:84 , srv1162958401:84 , srv1172829423:84 , srv1182728555:84 , srv1224032969:84 , srv1242525967:84 , srv1266635199:84 , srv1273948567:84 , srv127512026:84 , srv1279067802:84 , srv1298946189:84 , srv1314262445:84 , srv1329785071:84 , srv1360823056:84 , srv1437356874:84 , srv1451082250:84 , srv1459195474:84 , srv1477986626:84 , srv1490202018:84 , srv1542640938:84 , srv1592441488:84 , srv1593898195:84 , srv1616557646:84 , srv1620169092:84 , srv1651001375:84 , srv1674966256:84 , srv1684266660:84 , srv1750142432:84 , srv1751646525:84 , srv1755792627:84 , srv1780363008:84 , srv1822483923:84 , srv1826293159:84 , srv1842192545:84 , srv1865531808:84 , srv18794682:84 , srv1894179564:84 , srv1931181264:84 , srv1932697550:84 , srv2006860857:84 , srv2018660857:84 , srv2028153733:84 , srv2044628518:84 , srv2065369071:84 , srv2101799798:84 , srv2111938047:84 , srv212137841:84 , srv222487311:84 , srv232116229:84 , srv252724830:84 , srv264303046:84 , srv286157745:84 , srv301025681:84 , srv317841881:84 , srv368441433:84 , srv409739455:84 , srv42130394:84 , srv421890288:84 , srv425464170:84 , srv440197041:84 , srv463979428:84 , srv472319880:84 , srv528049269:84 , srv567845825:84 , srv5778565:84 , srv591858803:84 , srv607740573:84 , srv667300925:84 , srv680112788:84 , srv726544300:84 , srv735360535:84 , srv744209460:84 , srv784384365:84 , srv787467077:84 , srv793118730:84 , srv820327088:84 , srv848964888:84 , srv947837476:84 , srv960876684:84 , srv976722938:84 , srv1017423361:85 , srv1321964805:85 , srv1436402754:85 , srv1856757448:85 , srv2104592279:85 , srv2118910572:85 , srv540503258:85 , srv636083960:85 , srv683876978:85 , srv1095619407:684 }
2023-07-30 23:53:12,570 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-07-30 23:53:12,571 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv2111938047=54, srv1750142432=33, srv1865531808=41, srv1273948567=10, srv1095619407=3, srv1321964805=15, srv368441433=65, srv1822483923=37, srv1018429308=1, srv1279067802=12, srv252724830=59, srv5778565=76, srv784384365=88, srv1242525967=8, srv1751646525=34, srv1904463717=44, srv848964888=92, srv1593898195=27, srv69898062=84, srv421890288=68, srv1674966256=31, srv820327088=91, srv317841881=63, srv1542640938=24, srv1329785071=16, srv18794682=42, srv1894179564=43, srv264303046=60, srv744209460=87, srv2104592279=53, srv947837476=96, srv8753755=93, srv2118910572=55, srv232116229=58, srv1298946189=13, srv42130394=67, srv1856757448=40, srv540503258=74, srv1651001375=30, srv286157745=61, srv2006860857=47, srv976722938=99, srv1932697550=46, srv1684266660=32, srv971239212=98, srv787467077=89, srv222487311=57, srv1558571568=25, srv2101799798=52, srv567845825=75, srv528049269=73, srv1162958401=4, srv726544300=85, srv1826293159=38, srv1360823056=17, srv425464170=69, srv127512026=11, srv1477986626=22, srv1842192545=39, srv683876978=83, srv960876684=97, srv2044628518=50, srv1437356874=19, srv607740573=78, srv1314262445=14, srv301025681=62, srv409739455=66, srv1620169092=29, srv636083960=79, srv2028153733=49, srv1436402754=18, srv667300925=81, srv1224032969=7, srv1065308594=2, srv735360535=86, srv919964945=95, srv1172829423=5, srv591858803=77, srv1451082250=20, srv35875621=64, srv212137841=56, srv2065369071=51, srv918988216=94, srv1490202018=23, srv1931181264=45, srv1755792627=35, srv793118730=90, srv65906961=80, srv1459195474=21, srv1182728555=6, srv463979428=71, srv1592441488=26, srv1780363008=36, srv1266635199=9, srv2018660857=48, srv1616557646=28, srv680112788=82, srv1017423361=0, srv440197041=70, srv472319880=72} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-07-30 23:53:12,589 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-07-30 23:53:12,589 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-07-30 23:53:12,589 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-07-30 23:53:12,590 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-07-30 23:53:12,590 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-07-30 23:53:12,590 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-07-30 23:53:12,590 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-07-30 23:53:12,590 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-07-30 23:53:12,590 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-07-30 23:53:12,590 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-07-30 23:53:12,590 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-07-30 23:53:12,590 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-07-30 23:53:12,590 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-07-30 23:53:12,590 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-07-30 23:53:12,590 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-07-30 23:53:12,591 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-07-30 23:53:12,591 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-07-30 23:53:12,591 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-07-30 23:53:12,591 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-07-30 23:53:12,591 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-07-30 23:53:12,591 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-07-30 23:53:12,591 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-07-30 23:53:12,591 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-07-30 23:53:12,591 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-07-30 23:53:12,591 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-07-30 23:53:12,591 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-07-30 23:53:12,591 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-07-30 23:53:12,591 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-07-30 23:53:12,592 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-07-30 23:53:12,592 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-07-30 23:53:12,592 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-07-30 23:53:12,592 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-07-30 23:53:12,592 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-07-30 23:53:12,592 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-07-30 23:53:12,592 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-07-30 23:53:12,592 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-07-30 23:53:12,592 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-07-30 23:53:12,592 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-07-30 23:53:12,592 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-07-30 23:53:12,592 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-07-30 23:53:12,592 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-07-30 23:53:12,593 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-07-30 23:53:12,593 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-07-30 23:53:12,593 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-07-30 23:53:12,593 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-07-30 23:53:12,593 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-07-30 23:53:12,593 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-07-30 23:53:12,593 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-07-30 23:53:12,593 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-07-30 23:53:12,593 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-07-30 23:53:12,593 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-07-30 23:53:12,593 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-07-30 23:53:12,593 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-07-30 23:53:12,593 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-07-30 23:53:12,594 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-07-30 23:53:12,594 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-07-30 23:53:12,594 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-07-30 23:53:12,594 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-07-30 23:53:12,594 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-07-30 23:53:12,594 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-07-30 23:53:12,594 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-07-30 23:53:12,594 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-07-30 23:53:12,594 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-07-30 23:53:12,594 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-07-30 23:53:12,594 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-07-30 23:53:12,594 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-07-30 23:53:12,595 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-07-30 23:53:12,595 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-07-30 23:53:12,595 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-07-30 23:53:12,595 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-07-30 23:53:12,595 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-07-30 23:53:12,595 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-07-30 23:53:12,595 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-07-30 23:53:12,595 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-07-30 23:53:12,595 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-07-30 23:53:12,595 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-07-30 23:53:12,595 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-07-30 23:53:12,595 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-07-30 23:53:12,595 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-07-30 23:53:12,596 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-07-30 23:53:12,596 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-07-30 23:53:12,596 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-07-30 23:53:12,596 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-07-30 23:53:12,596 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-07-30 23:53:12,596 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-07-30 23:53:12,596 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-07-30 23:53:12,596 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-07-30 23:53:12,596 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-07-30 23:53:12,596 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-07-30 23:53:12,596 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-07-30 23:53:12,596 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-07-30 23:53:12,597 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-07-30 23:53:12,597 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-07-30 23:53:12,597 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-07-30 23:53:12,597 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-07-30 23:53:12,597 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-07-30 23:53:12,597 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-07-30 23:53:12,597 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-07-30 23:53:12,597 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-07-30 23:53:12,597 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-07-30 23:53:12,597 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-07-30 23:53:12,751 INFO  [Time-limited test] balancer.StochasticLoadBalancer(381): Cluster wide - skipping load balancing because weighted average imbalance=7.073239296329447E-6 <= threshold(0.025). If you want more aggressive balancing, either lower hbase.master.balancer.stochastic.minCostNeedBalance from 0.025 or increase the relative multiplier(s) of the specific cost function(s). functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0015713484026367722); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-07-30 23:53:12,752 INFO  [Time-limited test] balancer.BalancerTestBase(570): Mock Final balance: { srv1558571568:83 , srv1904463717:83 , srv35875621:83 , srv65906961:83 , srv69898062:83 , srv8753755:83 , srv918988216:83 , srv919964945:83 , srv971239212:83 , srv1018429308:84 , srv1065308594:84 , srv1162958401:84 , srv1172829423:84 , srv1182728555:84 , srv1224032969:84 , srv1242525967:84 , srv1266635199:84 , srv1273948567:84 , srv127512026:84 , srv1279067802:84 , srv1298946189:84 , srv1314262445:84 , srv1329785071:84 , srv1360823056:84 , srv1437356874:84 , srv1451082250:84 , srv1459195474:84 , srv1477986626:84 , srv1490202018:84 , srv1542640938:84 , srv1592441488:84 , srv1593898195:84 , srv1616557646:84 , srv1620169092:84 , srv1651001375:84 , srv1674966256:84 , srv1684266660:84 , srv1750142432:84 , srv1751646525:84 , srv1755792627:84 , srv1780363008:84 , srv1822483923:84 , srv1826293159:84 , srv1842192545:84 , srv1865531808:84 , srv18794682:84 , srv1894179564:84 , srv1931181264:84 , srv1932697550:84 , srv2006860857:84 , srv2018660857:84 , srv2028153733:84 , srv2044628518:84 , srv2065369071:84 , srv2101799798:84 , srv2111938047:84 , srv212137841:84 , srv222487311:84 , srv232116229:84 , srv252724830:84 , srv264303046:84 , srv286157745:84 , srv301025681:84 , srv317841881:84 , srv368441433:84 , srv409739455:84 , srv42130394:84 , srv421890288:84 , srv425464170:84 , srv440197041:84 , srv463979428:84 , srv472319880:84 , srv528049269:84 , srv567845825:84 , srv5778565:84 , srv591858803:84 , srv607740573:84 , srv667300925:84 , srv680112788:84 , srv726544300:84 , srv735360535:84 , srv744209460:84 , srv784384365:84 , srv787467077:84 , srv793118730:84 , srv820327088:84 , srv848964888:84 , srv947837476:84 , srv960876684:84 , srv976722938:84 , srv1017423361:85 , srv1321964805:85 , srv1436402754:85 , srv1856757448:85 , srv2104592279:85 , srv2118910572:85 , srv540503258:85 , srv636083960:85 , srv683876978:85 , srv1095619407:684 }
2023-07-30 23:53:12,786 INFO  [Time-limited test] hbase.ResourceChecker(175): after: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnLargeClusterWithRacks Thread=12 (was 12), OpenFileDescriptor=263 (was 263), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=282 (was 282), ProcessCount=174 (was 174), AvailableMemoryMB=1918 (was 2791)
2023-07-30 23:53:12,798 INFO  [Time-limited test] hbase.ResourceChecker(147): before: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnMidClusterWithRacks Thread=12, OpenFileDescriptor=263, MaxFileDescriptor=60000, SystemLoadAverage=282, ProcessCount=174, AvailableMemoryMB=1917
2023-07-30 23:53:12,799 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2023-07-30 23:53:12,799 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=5000, runMaxSteps=true, stepsPerRegion=800, maxRunningTime=120000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 111077.0 etc.
2023-07-30 23:53:12,814 INFO  [Time-limited test] balancer.BalancerTestBase(547): Mock Cluster : { srv1011552845:84 , srv103611052:84 , srv1088482817:84 , srv1112337910:84 , srv1157130044:84 , srv118098620:84 , srv1267198055:84 , srv1438603696:84 , srv1493954805:84 , srv1528258503:84 , srv1558364048:84 , srv1626714539:84 , srv1665015315:84 , srv17162747:84 , srv1782112755:84 , srv1871184406:84 , srv1914036981:84 , srv192730150:84 , srv1941010725:84 , srv1945555880:84 , srv1981525097:84 , srv1992212714:84 , srv2051974829:84 , srv2089409135:84 , srv386268394:84 , srv478736091:84 , srv569534541:84 , srv68628089:84 , srv972824204:84 , srv1742676040:264 } [srvr=30 rgns=2700 avg=90.0 max=90 min=90]
2023-07-30 23:53:12,816 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-07-30 23:53:12,817 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1871184406=16, srv972824204=29, srv1267198055=6, srv1493954805=8, srv103611052=1, srv478736091=26, srv1088482817=2, srv1941010725=19, srv1438603696=7, srv1742676040=14, srv1558364048=10, srv1945555880=20, srv1112337910=3, srv2051974829=23, srv1782112755=15, srv192730150=18, srv1914036981=17, srv2089409135=24, srv1665015315=12, srv1981525097=21, srv386268394=25, srv1528258503=9, srv17162747=13, srv1626714539=11, srv118098620=5, srv68628089=28, srv569534541=27, srv1157130044=4, srv1992212714=22, srv1011552845=0} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-07-30 23:53:12,830 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-07-30 23:53:12,830 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-07-30 23:53:12,830 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-07-30 23:53:12,830 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-07-30 23:53:12,830 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-07-30 23:53:12,831 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-07-30 23:53:12,831 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-07-30 23:53:12,831 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-07-30 23:53:12,831 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-07-30 23:53:12,831 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-07-30 23:53:12,831 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-07-30 23:53:12,831 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-07-30 23:53:12,831 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-07-30 23:53:12,831 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-07-30 23:53:12,831 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-07-30 23:53:12,831 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-07-30 23:53:12,831 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-07-30 23:53:12,831 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-07-30 23:53:12,832 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-07-30 23:53:12,832 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-07-30 23:53:12,832 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-07-30 23:53:12,832 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-07-30 23:53:12,832 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-07-30 23:53:12,832 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-07-30 23:53:12,832 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-07-30 23:53:12,832 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-07-30 23:53:12,832 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-07-30 23:53:12,832 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-07-30 23:53:12,832 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-07-30 23:53:12,832 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-07-30 23:53:12,833 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=10, number of hosts=30, number of racks=4
2023-07-30 23:53:12,863 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=1.0891587927697037, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-07-30 23:53:12,863 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.9912473979708996, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=1.0891587927697037, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=64800000
2023-07-30 23:55:12,837 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 120001 ms to try 6255432 different iterations.  Found a solution that moves 1845 regions; Going from a computed imbalance of 0.9912473979708996 to a new imbalance of 4.306322040866546E-5. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); MoveCostFunction : (multiplier=7.0, imbalance=0.6833333333333333, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-07-30 23:55:12,844 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1011552845:90 , srv103611052:90 , srv1088482817:90 , srv1112337910:90 , srv1157130044:90 , srv118098620:90 , srv1267198055:90 , srv1438603696:90 , srv1493954805:90 , srv1528258503:90 , srv1558364048:90 , srv1626714539:90 , srv1665015315:90 , srv17162747:90 , srv1742676040:90 , srv1782112755:90 , srv1871184406:90 , srv1914036981:90 , srv192730150:90 , srv1941010725:90 , srv1945555880:90 , srv1981525097:90 , srv1992212714:90 , srv2051974829:90 , srv2089409135:90 , srv386268394:90 , srv478736091:90 , srv569534541:90 , srv68628089:90 , srv972824204:90 }
2023-07-30 23:55:12,845 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-07-30 23:55:12,846 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1871184406=16, srv972824204=29, srv1267198055=6, srv1493954805=8, srv103611052=1, srv478736091=26, srv1088482817=2, srv1941010725=19, srv1438603696=7, srv1742676040=14, srv1558364048=10, srv1945555880=20, srv1112337910=3, srv2051974829=23, srv1782112755=15, srv192730150=18, srv1914036981=17, srv2089409135=24, srv1665015315=12, srv1981525097=21, srv386268394=25, srv1528258503=9, srv17162747=13, srv1626714539=11, srv118098620=5, srv68628089=28, srv569534541=27, srv1157130044=4, srv1992212714=22, srv1011552845=0} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-07-30 23:55:12,849 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-07-30 23:55:12,849 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-07-30 23:55:12,849 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-07-30 23:55:12,849 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-07-30 23:55:12,849 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-07-30 23:55:12,849 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-07-30 23:55:12,850 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-07-30 23:55:12,850 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-07-30 23:55:12,850 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-07-30 23:55:12,850 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-07-30 23:55:12,850 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-07-30 23:55:12,850 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-07-30 23:55:12,850 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-07-30 23:55:12,850 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-07-30 23:55:12,850 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-07-30 23:55:12,850 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-07-30 23:55:12,850 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-07-30 23:55:12,850 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-07-30 23:55:12,850 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-07-30 23:55:12,850 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-07-30 23:55:12,850 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-07-30 23:55:12,850 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-07-30 23:55:12,850 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-07-30 23:55:12,850 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-07-30 23:55:12,850 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-07-30 23:55:12,850 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-07-30 23:55:12,850 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-07-30 23:55:12,850 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-07-30 23:55:12,850 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-07-30 23:55:12,850 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-07-30 23:55:12,851 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=10, number of hosts=30, number of racks=4
2023-07-30 23:55:12,862 INFO  [Time-limited test] balancer.StochasticLoadBalancer(381): Cluster wide - skipping load balancing because weighted average imbalance=0.0 <= threshold(0.025). If you want more aggressive balancing, either lower hbase.master.balancer.stochastic.minCostNeedBalance from 0.025 or increase the relative multiplier(s) of the specific cost function(s). functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-07-30 23:55:12,862 INFO  [Time-limited test] balancer.BalancerTestBase(570): Mock Final balance: { srv1011552845:90 , srv103611052:90 , srv1088482817:90 , srv1112337910:90 , srv1157130044:90 , srv118098620:90 , srv1267198055:90 , srv1438603696:90 , srv1493954805:90 , srv1528258503:90 , srv1558364048:90 , srv1626714539:90 , srv1665015315:90 , srv17162747:90 , srv1742676040:90 , srv1782112755:90 , srv1871184406:90 , srv1914036981:90 , srv192730150:90 , srv1941010725:90 , srv1945555880:90 , srv1981525097:90 , srv1992212714:90 , srv2051974829:90 , srv2089409135:90 , srv386268394:90 , srv478736091:90 , srv569534541:90 , srv68628089:90 , srv972824204:90 }
2023-07-30 23:55:12,877 INFO  [Time-limited test] hbase.ResourceChecker(175): after: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnMidClusterWithRacks Thread=11 (was 12), OpenFileDescriptor=263 (was 263), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=181 (was 282), ProcessCount=171 (was 174), AvailableMemoryMB=1625 (was 1917)