2023-03-06 11:56:42,399 INFO  [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks timeout: 13 mins
2023-03-06 11:56:42,703 WARN  [Time-limited test] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties
2023-03-06 11:56:42,824 INFO  [Time-limited test] metrics.MetricRegistriesLoader(60): Loaded MetricRegistries class org.apache.hadoop.hbase.metrics.impl.MetricRegistriesImpl
2023-03-06 11:56:42,884 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2023-03-06 11:56:42,891 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc.
2023-03-06 11:56:42,904 INFO  [Time-limited test] hbase.ResourceChecker(147): before: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnLargeClusterWithRacks Thread=10, OpenFileDescriptor=260, MaxFileDescriptor=60000, SystemLoadAverage=122, ProcessCount=160, AvailableMemoryMB=10347
2023-03-06 11:56:42,906 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2023-03-06 11:56:42,907 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=5000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=10000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc.
2023-03-06 11:56:43,029 INFO  [Time-limited test] balancer.BalancerTestBase(547): Mock Cluster : { srv1018950174:84 , srv103856685:84 , srv1039981707:84 , srv1064708242:84 , srv1076918807:84 , srv1086665465:84 , srv1088843196:84 , srv1096263651:84 , srv1098194120:84 , srv112714369:84 , srv1133859647:84 , srv1189529839:84 , srv1216851968:84 , srv1229143223:84 , srv124185763:84 , srv1354455621:84 , srv1426988749:84 , srv1442983247:84 , srv1449342005:84 , srv1476403339:84 , srv1476953418:84 , srv1487045186:84 , srv1487766459:84 , srv1519952642:84 , srv1543680496:84 , srv1631560373:84 , srv1650148266:84 , srv1670680181:84 , srv1689346667:84 , srv1692343596:84 , srv1694693404:84 , srv1732423844:84 , srv1755212123:84 , srv1771897556:84 , srv1781603888:84 , srv1798521045:84 , srv1848513374:84 , srv1855987275:84 , srv1896649383:84 , srv1910942438:84 , srv1928778746:84 , srv193131541:84 , srv1935328245:84 , srv193839950:84 , srv1979376123:84 , srv2003956100:84 , srv2004090059:84 , srv2005315705:84 , srv2006978060:84 , srv2042976938:84 , srv2060765228:84 , srv2074762874:84 , srv2101251484:84 , srv2127011557:84 , srv2140060196:84 , srv215399398:84 , srv21692785:84 , srv26557170:84 , srv277142814:84 , srv291182214:84 , srv319971100:84 , srv32375039:84 , srv402539024:84 , srv418328707:84 , srv424080502:84 , srv446544917:84 , srv447242879:84 , srv448251313:84 , srv459346697:84 , srv466375218:84 , srv470579193:84 , srv493712054:84 , srv513810153:84 , srv53234696:84 , srv541358544:84 , srv545040576:84 , srv549596723:84 , srv592550618:84 , srv604370518:84 , srv616736807:84 , srv622095310:84 , srv638495942:84 , srv646435751:84 , srv647676173:84 , srv649482713:84 , srv713225425:84 , srv718113540:84 , srv797645655:84 , srv800624519:84 , srv814972491:84 , srv828554286:84 , srv862942409:84 , srv867729862:84 , srv902972223:84 , srv902991191:84 , srv911820029:84 , srv916227302:84 , srv94546226:84 , srv997444158:84 , srv1999734977:684 } [srvr=100 rgns=9000 avg=90.0 max=90 min=90]
2023-03-06 11:56:43,037 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-03-06 11:56:43,043 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv646435751=83, srv1848513374=36, srv2074762874=52, srv2004090059=47, srv902972223=94, srv1935328245=42, srv647676173=84, srv1732423844=31, srv1979376123=44, srv549596723=77, srv622095310=81, srv1189529839=11, srv1088843196=6, srv997444158=99, srv1910942438=39, srv1781603888=34, srv1216851968=12, srv1631560373=25, srv1896649383=38, srv916227302=97, srv402539024=63, srv124185763=14, srv53234696=74, srv1098194120=8, srv814972491=90, srv1133859647=10, srv1670680181=27, srv32375039=62, srv2042976938=50, srv1076918807=4, srv21692785=57, srv103856685=1, srv1771897556=33, srv1999734977=45, srv1426988749=16, srv649482713=85, srv466375218=70, srv1487045186=21, srv1039981707=2, srv1519952642=23, srv513810153=73, srv319971100=61, srv1692343596=29, srv1442983247=17, srv2140060196=55, srv862942409=92, srv1096263651=7, srv545040576=76, srv193131541=41, srv1354455621=15, srv713225425=86, srv2006978060=49, srv2005315705=48, srv1229143223=13, srv604370518=79, srv1086665465=5, srv470579193=71, srv1449342005=18, srv2060765228=51, srv718113540=87, srv424080502=65, srv902991191=95, srv418328707=64, srv112714369=9, srv797645655=88, srv1689346667=28, srv800624519=89, srv2003956100=46, srv1487766459=22, srv2101251484=53, srv1650148266=26, srv447242879=67, srv446544917=66, srv1855987275=37, srv2127011557=54, srv1694693404=30, srv94546226=98, srv215399398=56, srv867729862=93, srv828554286=91, srv277142814=59, srv459346697=69, srv1928778746=40, srv1064708242=3, srv911820029=96, srv1476953418=20, srv1798521045=35, srv493712054=72, srv291182214=60, srv26557170=58, srv592550618=78, srv616736807=80, srv638495942=82, srv1755212123=32, srv1018950174=0, srv1543680496=24, srv1476403339=19, srv193839950=43, srv448251313=68, srv541358544=75} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-03-06 11:56:43,125 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-03-06 11:56:43,125 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-03-06 11:56:43,125 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-03-06 11:56:43,125 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-03-06 11:56:43,126 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-03-06 11:56:43,126 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-03-06 11:56:43,126 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-03-06 11:56:43,126 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-03-06 11:56:43,126 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-03-06 11:56:43,126 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-03-06 11:56:43,126 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-03-06 11:56:43,126 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-03-06 11:56:43,126 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-03-06 11:56:43,127 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-03-06 11:56:43,127 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-03-06 11:56:43,127 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-03-06 11:56:43,127 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-03-06 11:56:43,127 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-03-06 11:56:43,127 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-03-06 11:56:43,127 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-03-06 11:56:43,127 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-03-06 11:56:43,127 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-03-06 11:56:43,127 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-03-06 11:56:43,128 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-03-06 11:56:43,128 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-03-06 11:56:43,128 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-03-06 11:56:43,128 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-03-06 11:56:43,128 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-03-06 11:56:43,128 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-03-06 11:56:43,128 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-03-06 11:56:43,128 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-03-06 11:56:43,128 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-03-06 11:56:43,129 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-03-06 11:56:43,129 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-03-06 11:56:43,129 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-03-06 11:56:43,129 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-03-06 11:56:43,129 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-03-06 11:56:43,129 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-03-06 11:56:43,129 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-03-06 11:56:43,130 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-03-06 11:56:43,130 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-03-06 11:56:43,130 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-03-06 11:56:43,130 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-03-06 11:56:43,130 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-03-06 11:56:43,130 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-03-06 11:56:43,130 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-03-06 11:56:43,131 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-03-06 11:56:43,131 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-03-06 11:56:43,131 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-03-06 11:56:43,131 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-03-06 11:56:43,131 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-03-06 11:56:43,131 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-03-06 11:56:43,131 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-03-06 11:56:43,131 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-03-06 11:56:43,132 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-03-06 11:56:43,132 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-03-06 11:56:43,132 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-03-06 11:56:43,132 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-03-06 11:56:43,132 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-03-06 11:56:43,132 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-03-06 11:56:43,132 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-03-06 11:56:43,132 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-03-06 11:56:43,132 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-03-06 11:56:43,133 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-03-06 11:56:43,133 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-03-06 11:56:43,133 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-03-06 11:56:43,133 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-03-06 11:56:43,133 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-03-06 11:56:43,133 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-03-06 11:56:43,133 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-03-06 11:56:43,134 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-03-06 11:56:43,134 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-03-06 11:56:43,134 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-03-06 11:56:43,134 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-03-06 11:56:43,134 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-03-06 11:56:43,134 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-03-06 11:56:43,134 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-03-06 11:56:43,134 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-03-06 11:56:43,134 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-03-06 11:56:43,135 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-03-06 11:56:43,135 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-03-06 11:56:43,135 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-03-06 11:56:43,135 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-03-06 11:56:43,135 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-03-06 11:56:43,135 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-03-06 11:56:43,135 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-03-06 11:56:43,135 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-03-06 11:56:43,135 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-03-06 11:56:43,135 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-03-06 11:56:43,135 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-03-06 11:56:43,136 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-03-06 11:56:43,136 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-03-06 11:56:43,136 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-03-06 11:56:43,136 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-03-06 11:56:43,136 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-03-06 11:56:43,136 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-03-06 11:56:43,136 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-03-06 11:56:43,136 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-03-06 11:56:43,136 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-03-06 11:56:43,136 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-03-06 11:56:43,137 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-03-06 11:56:43,331 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.06666666666666667, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-03-06 11:56:43,331 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-03-06 11:56:43,331 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.9909252140407105, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.06666666666666667, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-03-06 11:56:43,670 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 500 ms to try 5000 different iterations.  Found a solution that moves 4673 regions; Going from a computed imbalance of 0.9909252140407105 to a new imbalance of 0.17945214535018902. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.04139541335599368, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.05611636139053103, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.5192222222222223, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.04139541335599368, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.17425, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.24541666666666667, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-03-06 11:56:43,691 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv2074762874:82 , srv545040576:82 , srv1076918807:83 , srv1543680496:83 , srv1670680181:83 , srv1694693404:83 , srv2006978060:83 , srv2140060196:83 , srv446544917:83 , srv448251313:83 , srv541358544:83 , srv94546226:83 , srv1039981707:84 , srv1086665465:84 , srv1096263651:84 , srv1133859647:84 , srv1426988749:84 , srv1449342005:84 , srv1476403339:84 , srv1689346667:84 , srv1781603888:84 , srv1935328245:84 , srv291182214:84 , srv418328707:84 , srv549596723:84 , srv647676173:84 , srv718113540:84 , srv828554286:84 , srv1018950174:85 , srv1088843196:85 , srv1692343596:85 , srv1732423844:85 , srv1755212123:85 , srv1910942438:85 , srv193839950:85 , srv2003956100:85 , srv2101251484:85 , srv32375039:85 , srv402539024:85 , srv424080502:85 , srv616736807:85 , srv1064708242:86 , srv1189529839:86 , srv1476953418:86 , srv1519952642:86 , srv1798521045:86 , srv1896649383:86 , srv1928778746:86 , srv2004090059:86 , srv2005315705:86 , srv2060765228:86 , srv493712054:86 , srv53234696:86 , srv649482713:86 , srv1098194120:87 , srv1216851968:87 , srv1442983247:87 , srv1487766459:87 , srv193131541:87 , srv2042976938:87 , srv2127011557:87 , srv215399398:87 , srv26557170:87 , srv319971100:87 , srv466375218:87 , srv604370518:87 , srv622095310:87 , srv638495942:87 , srv713225425:87 , srv862942409:87 , srv902972223:87 , srv911820029:87 , srv997444158:87 , srv112714369:88 , srv1229143223:88 , srv124185763:88 , srv1354455621:88 , srv1650148266:88 , srv21692785:88 , srv277142814:88 , srv447242879:88 , srv459346697:88 , srv646435751:88 , srv814972491:88 , srv103856685:89 , srv1771897556:89 , srv1848513374:89 , srv1855987275:89 , srv797645655:89 , srv592550618:90 , srv867729862:90 , srv916227302:90 , srv513810153:91 , srv800624519:91 , srv902991191:91 , srv1487045186:92 , srv1631560373:93 , srv1979376123:93 , srv470579193:94 , srv1999734977:458 }
2023-03-06 11:56:43,695 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-03-06 11:56:43,695 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv646435751=83, srv1848513374=36, srv2074762874=52, srv2004090059=47, srv902972223=94, srv1935328245=42, srv647676173=84, srv1732423844=31, srv1979376123=44, srv549596723=77, srv622095310=81, srv1189529839=11, srv1088843196=6, srv997444158=99, srv1910942438=39, srv1781603888=34, srv1216851968=12, srv1631560373=25, srv1896649383=38, srv916227302=97, srv402539024=63, srv124185763=14, srv53234696=74, srv1098194120=8, srv814972491=90, srv1133859647=10, srv1670680181=27, srv32375039=62, srv2042976938=50, srv1076918807=4, srv21692785=57, srv103856685=1, srv1771897556=33, srv1999734977=45, srv1426988749=16, srv649482713=85, srv466375218=70, srv1487045186=21, srv1039981707=2, srv1519952642=23, srv513810153=73, srv319971100=61, srv1692343596=29, srv1442983247=17, srv2140060196=55, srv862942409=92, srv1096263651=7, srv545040576=76, srv193131541=41, srv1354455621=15, srv713225425=86, srv2006978060=49, srv2005315705=48, srv1229143223=13, srv604370518=79, srv1086665465=5, srv470579193=71, srv1449342005=18, srv2060765228=51, srv718113540=87, srv424080502=65, srv902991191=95, srv418328707=64, srv112714369=9, srv797645655=88, srv1689346667=28, srv800624519=89, srv2003956100=46, srv1487766459=22, srv2101251484=53, srv1650148266=26, srv447242879=67, srv446544917=66, srv1855987275=37, srv2127011557=54, srv1694693404=30, srv94546226=98, srv215399398=56, srv867729862=93, srv828554286=91, srv277142814=59, srv459346697=69, srv1928778746=40, srv1064708242=3, srv911820029=96, srv1476953418=20, srv1798521045=35, srv493712054=72, srv291182214=60, srv26557170=58, srv592550618=78, srv616736807=80, srv638495942=82, srv1755212123=32, srv1018950174=0, srv1543680496=24, srv1476403339=19, srv193839950=43, srv448251313=68, srv541358544=75} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-03-06 11:56:43,713 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-03-06 11:56:43,714 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-03-06 11:56:43,714 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-03-06 11:56:43,714 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-03-06 11:56:43,714 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-03-06 11:56:43,714 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-03-06 11:56:43,714 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-03-06 11:56:43,714 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-03-06 11:56:43,714 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-03-06 11:56:43,714 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-03-06 11:56:43,714 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-03-06 11:56:43,714 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-03-06 11:56:43,714 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-03-06 11:56:43,715 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-03-06 11:56:43,715 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-03-06 11:56:43,715 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-03-06 11:56:43,715 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-03-06 11:56:43,715 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-03-06 11:56:43,715 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-03-06 11:56:43,715 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-03-06 11:56:43,715 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-03-06 11:56:43,715 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-03-06 11:56:43,715 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-03-06 11:56:43,715 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-03-06 11:56:43,715 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-03-06 11:56:43,716 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-03-06 11:56:43,716 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-03-06 11:56:43,716 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-03-06 11:56:43,716 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-03-06 11:56:43,716 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-03-06 11:56:43,716 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-03-06 11:56:43,716 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-03-06 11:56:43,716 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-03-06 11:56:43,716 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-03-06 11:56:43,716 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-03-06 11:56:43,716 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-03-06 11:56:43,716 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-03-06 11:56:43,716 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-03-06 11:56:43,717 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-03-06 11:56:43,717 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-03-06 11:56:43,717 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-03-06 11:56:43,717 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-03-06 11:56:43,717 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-03-06 11:56:43,717 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-03-06 11:56:43,717 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-03-06 11:56:43,717 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-03-06 11:56:43,717 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-03-06 11:56:43,717 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-03-06 11:56:43,717 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-03-06 11:56:43,717 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-03-06 11:56:43,717 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-03-06 11:56:43,717 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-03-06 11:56:43,718 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-03-06 11:56:43,718 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-03-06 11:56:43,718 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-03-06 11:56:43,718 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-03-06 11:56:43,718 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-03-06 11:56:43,718 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-03-06 11:56:43,718 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-03-06 11:56:43,718 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-03-06 11:56:43,718 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-03-06 11:56:43,718 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-03-06 11:56:43,718 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-03-06 11:56:43,718 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-03-06 11:56:43,718 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-03-06 11:56:43,718 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-03-06 11:56:43,719 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-03-06 11:56:43,719 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-03-06 11:56:43,719 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-03-06 11:56:43,719 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-03-06 11:56:43,719 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-03-06 11:56:43,719 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-03-06 11:56:43,719 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-03-06 11:56:43,719 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-03-06 11:56:43,719 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-03-06 11:56:43,719 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-03-06 11:56:43,719 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-03-06 11:56:43,719 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-03-06 11:56:43,719 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-03-06 11:56:43,719 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-03-06 11:56:43,719 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-03-06 11:56:43,720 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-03-06 11:56:43,720 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-03-06 11:56:43,720 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-03-06 11:56:43,720 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-03-06 11:56:43,720 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-03-06 11:56:43,720 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-03-06 11:56:43,720 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-03-06 11:56:43,720 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-03-06 11:56:43,720 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-03-06 11:56:43,720 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-03-06 11:56:43,720 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-03-06 11:56:43,720 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-03-06 11:56:43,720 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-03-06 11:56:43,720 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-03-06 11:56:43,721 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-03-06 11:56:43,721 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-03-06 11:56:43,721 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-03-06 11:56:43,721 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-03-06 11:56:43,721 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-03-06 11:56:43,721 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-03-06 11:56:43,837 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.04139541335599368, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.05611636139053103, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.04139541335599368, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.17425, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.24541666666666667, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-03-06 11:56:43,837 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-03-06 11:56:43,837 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.1794194243048281, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.04139541335599368, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.05611636139053103, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.04139541335599368, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.17425, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.24541666666666667, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-03-06 11:56:44,117 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 377 ms to try 5000 different iterations.  Found a solution that moves 2671 regions; Going from a computed imbalance of 0.1794194243048281 to a new imbalance of 0.01713432270700573. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.02282843181024655); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.03454368239296432, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.29677777777777775, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.02282843181024655); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.01375); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.049666666666666665, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-03-06 11:56:44,128 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1979376123:78 , srv1631560373:79 , srv470579193:79 , srv1487045186:80 , srv513810153:80 , srv103856685:81 , srv814972491:81 , srv902991191:81 , srv916227302:81 , srv1855987275:82 , srv21692785:82 , srv797645655:82 , srv800624519:82 , srv867729862:82 , srv1229143223:83 , srv1487766459:83 , srv1771897556:83 , srv1848513374:83 , srv193131541:83 , srv592550618:83 , srv112714369:84 , srv1189529839:84 , srv2005315705:84 , srv459346697:84 , srv604370518:84 , srv638495942:84 , srv646435751:84 , srv713225425:84 , srv1216851968:85 , srv124185763:85 , srv1442983247:85 , srv1476953418:85 , srv1519952642:85 , srv1798521045:85 , srv2042976938:85 , srv447242879:85 , srv622095310:85 , srv902972223:85 , srv911820029:85 , srv997444158:85 , srv1039981707:86 , srv1064708242:86 , srv1098194120:86 , srv1650148266:86 , srv1692343596:86 , srv1732423844:86 , srv1755212123:86 , srv1910942438:86 , srv1935328245:86 , srv193839950:86 , srv2004090059:86 , srv2060765228:86 , srv2101251484:86 , srv215399398:86 , srv26557170:86 , srv319971100:86 , srv493712054:86 , srv53234696:86 , srv649482713:86 , srv862942409:86 , srv1086665465:87 , srv1354455621:87 , srv1670680181:87 , srv1689346667:87 , srv1896649383:87 , srv1928778746:87 , srv2127011557:87 , srv291182214:87 , srv402539024:87 , srv828554286:87 , srv1018950174:88 , srv1088843196:88 , srv1096263651:88 , srv1133859647:88 , srv1476403339:88 , srv1543680496:88 , srv1694693404:88 , srv2140060196:88 , srv277142814:88 , srv418328707:88 , srv424080502:88 , srv446544917:88 , srv541358544:88 , srv549596723:88 , srv647676173:88 , srv718113540:88 , srv1076918807:89 , srv1449342005:89 , srv1781603888:89 , srv2003956100:89 , srv2006978060:89 , srv448251313:89 , srv466375218:89 , srv1426988749:90 , srv2074762874:90 , srv32375039:90 , srv545040576:90 , srv616736807:90 , srv94546226:90 , srv1999734977:519 }
2023-03-06 11:56:44,131 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-03-06 11:56:44,132 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv646435751=83, srv1848513374=36, srv2074762874=52, srv2004090059=47, srv902972223=94, srv1935328245=42, srv647676173=84, srv1732423844=31, srv1979376123=44, srv549596723=77, srv622095310=81, srv1189529839=11, srv1088843196=6, srv997444158=99, srv1910942438=39, srv1781603888=34, srv1216851968=12, srv1631560373=25, srv1896649383=38, srv916227302=97, srv402539024=63, srv124185763=14, srv53234696=74, srv1098194120=8, srv814972491=90, srv1133859647=10, srv1670680181=27, srv32375039=62, srv2042976938=50, srv1076918807=4, srv21692785=57, srv103856685=1, srv1771897556=33, srv1999734977=45, srv1426988749=16, srv649482713=85, srv466375218=70, srv1487045186=21, srv1039981707=2, srv1519952642=23, srv513810153=73, srv319971100=61, srv1692343596=29, srv1442983247=17, srv2140060196=55, srv862942409=92, srv1096263651=7, srv545040576=76, srv193131541=41, srv1354455621=15, srv713225425=86, srv2006978060=49, srv2005315705=48, srv1229143223=13, srv604370518=79, srv1086665465=5, srv470579193=71, srv1449342005=18, srv2060765228=51, srv718113540=87, srv424080502=65, srv902991191=95, srv418328707=64, srv112714369=9, srv797645655=88, srv1689346667=28, srv800624519=89, srv2003956100=46, srv1487766459=22, srv2101251484=53, srv1650148266=26, srv447242879=67, srv446544917=66, srv1855987275=37, srv2127011557=54, srv1694693404=30, srv94546226=98, srv215399398=56, srv867729862=93, srv828554286=91, srv277142814=59, srv459346697=69, srv1928778746=40, srv1064708242=3, srv911820029=96, srv1476953418=20, srv1798521045=35, srv493712054=72, srv291182214=60, srv26557170=58, srv592550618=78, srv616736807=80, srv638495942=82, srv1755212123=32, srv1018950174=0, srv1543680496=24, srv1476403339=19, srv193839950=43, srv448251313=68, srv541358544=75} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-03-06 11:56:44,145 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-03-06 11:56:44,145 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-03-06 11:56:44,145 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-03-06 11:56:44,145 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-03-06 11:56:44,145 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-03-06 11:56:44,145 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-03-06 11:56:44,146 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-03-06 11:56:44,146 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-03-06 11:56:44,146 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-03-06 11:56:44,146 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-03-06 11:56:44,146 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-03-06 11:56:44,146 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-03-06 11:56:44,146 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-03-06 11:56:44,146 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-03-06 11:56:44,146 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-03-06 11:56:44,146 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-03-06 11:56:44,146 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-03-06 11:56:44,146 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-03-06 11:56:44,146 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-03-06 11:56:44,146 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-03-06 11:56:44,146 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-03-06 11:56:44,147 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-03-06 11:56:44,147 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-03-06 11:56:44,147 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-03-06 11:56:44,147 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-03-06 11:56:44,147 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-03-06 11:56:44,147 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-03-06 11:56:44,147 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-03-06 11:56:44,147 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-03-06 11:56:44,148 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-03-06 11:56:44,148 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-03-06 11:56:44,148 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-03-06 11:56:44,148 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-03-06 11:56:44,148 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-03-06 11:56:44,148 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-03-06 11:56:44,148 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-03-06 11:56:44,148 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-03-06 11:56:44,148 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-03-06 11:56:44,148 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-03-06 11:56:44,148 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-03-06 11:56:44,148 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-03-06 11:56:44,148 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-03-06 11:56:44,148 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-03-06 11:56:44,148 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-03-06 11:56:44,149 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-03-06 11:56:44,149 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-03-06 11:56:44,149 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-03-06 11:56:44,149 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-03-06 11:56:44,149 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-03-06 11:56:44,149 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-03-06 11:56:44,149 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-03-06 11:56:44,149 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-03-06 11:56:44,149 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-03-06 11:56:44,149 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-03-06 11:56:44,149 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-03-06 11:56:44,149 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-03-06 11:56:44,149 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-03-06 11:56:44,149 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-03-06 11:56:44,149 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-03-06 11:56:44,149 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-03-06 11:56:44,150 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-03-06 11:56:44,150 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-03-06 11:56:44,150 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-03-06 11:56:44,150 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-03-06 11:56:44,150 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-03-06 11:56:44,150 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-03-06 11:56:44,150 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-03-06 11:56:44,150 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-03-06 11:56:44,150 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-03-06 11:56:44,150 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-03-06 11:56:44,150 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-03-06 11:56:44,150 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-03-06 11:56:44,150 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-03-06 11:56:44,150 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-03-06 11:56:44,150 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-03-06 11:56:44,150 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-03-06 11:56:44,150 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-03-06 11:56:44,151 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-03-06 11:56:44,151 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-03-06 11:56:44,151 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-03-06 11:56:44,151 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-03-06 11:56:44,151 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-03-06 11:56:44,151 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-03-06 11:56:44,151 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-03-06 11:56:44,151 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-03-06 11:56:44,151 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-03-06 11:56:44,151 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-03-06 11:56:44,151 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-03-06 11:56:44,151 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-03-06 11:56:44,151 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-03-06 11:56:44,151 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-03-06 11:56:44,151 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-03-06 11:56:44,151 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-03-06 11:56:44,151 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-03-06 11:56:44,152 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-03-06 11:56:44,152 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-03-06 11:56:44,152 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-03-06 11:56:44,152 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-03-06 11:56:44,152 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-03-06 11:56:44,152 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-03-06 11:56:44,152 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-03-06 11:56:44,264 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.02282843181024655); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.03454368239296432, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.02282843181024655); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.01375); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.049666666666666665, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-03-06 11:56:44,264 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-03-06 11:56:44,264 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.01711561996526401, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.02282843181024655); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.03454368239296432, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.02282843181024655); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.01375); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.049666666666666665, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-03-06 11:56:44,537 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 373 ms to try 5000 different iterations.  Found a solution that moves 1041 regions; Going from a computed imbalance of 0.01711561996526401 to a new imbalance of 9.508334027809749E-4. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.007223301309353738); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.010216511360396188); MoveCostFunction : (multiplier=7.0, imbalance=0.11566666666666667, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.007223301309353738); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=4.166666666666667E-4); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.005416666666666667); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-03-06 11:56:44,541 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv466375218:81 , srv277142814:82 , srv1354455621:83 , srv1449342005:83 , srv1650148266:83 , srv2127011557:83 , srv32375039:83 , srv447242879:83 , srv616736807:83 , srv1088843196:84 , srv124185763:84 , srv1426988749:84 , srv1631560373:84 , srv1781603888:84 , srv1896649383:84 , srv1928778746:84 , srv2003956100:84 , srv424080502:84 , srv470579193:84 , srv800624519:84 , srv862942409:84 , srv94546226:84 , srv1018950174:85 , srv1098194120:85 , srv112714369:85 , srv1442983247:85 , srv1476403339:85 , srv1519952642:85 , srv1771897556:85 , srv1848513374:85 , srv2004090059:85 , srv2006978060:85 , srv2042976938:85 , srv215399398:85 , srv26557170:85 , srv319971100:85 , srv402539024:85 , srv446544917:85 , srv448251313:85 , srv459346697:85 , srv53234696:85 , srv541358544:85 , srv549596723:85 , srv622095310:85 , srv646435751:85 , srv649482713:85 , srv718113540:85 , srv902972223:85 , srv902991191:85 , srv911820029:85 , srv997444158:85 , srv1064708242:86 , srv1076918807:86 , srv1086665465:86 , srv1096263651:86 , srv1133859647:86 , srv1189529839:86 , srv1216851968:86 , srv1487045186:86 , srv1487766459:86 , srv1689346667:86 , srv1732423844:86 , srv1755212123:86 , srv1855987275:86 , srv1910942438:86 , srv193839950:86 , srv1979376123:86 , srv2060765228:86 , srv2074762874:86 , srv2101251484:86 , srv2140060196:86 , srv545040576:86 , srv592550618:86 , srv638495942:86 , srv647676173:86 , srv713225425:86 , srv867729862:86 , srv103856685:87 , srv1039981707:87 , srv1229143223:87 , srv1476953418:87 , srv1543680496:87 , srv1670680181:87 , srv1694693404:87 , srv1798521045:87 , srv2005315705:87 , srv21692785:87 , srv291182214:87 , srv418328707:87 , srv493712054:87 , srv513810153:87 , srv604370518:87 , srv797645655:87 , srv828554286:87 , srv916227302:87 , srv1692343596:88 , srv193131541:88 , srv1935328245:88 , srv814972491:88 , srv1999734977:545 }
2023-03-06 11:56:44,544 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-03-06 11:56:44,545 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv646435751=83, srv1848513374=36, srv2074762874=52, srv2004090059=47, srv902972223=94, srv1935328245=42, srv647676173=84, srv1732423844=31, srv1979376123=44, srv549596723=77, srv622095310=81, srv1189529839=11, srv1088843196=6, srv997444158=99, srv1910942438=39, srv1781603888=34, srv1216851968=12, srv1631560373=25, srv1896649383=38, srv916227302=97, srv402539024=63, srv124185763=14, srv53234696=74, srv1098194120=8, srv814972491=90, srv1133859647=10, srv1670680181=27, srv32375039=62, srv2042976938=50, srv1076918807=4, srv21692785=57, srv103856685=1, srv1771897556=33, srv1999734977=45, srv1426988749=16, srv649482713=85, srv466375218=70, srv1487045186=21, srv1039981707=2, srv1519952642=23, srv513810153=73, srv319971100=61, srv1692343596=29, srv1442983247=17, srv2140060196=55, srv862942409=92, srv1096263651=7, srv545040576=76, srv193131541=41, srv1354455621=15, srv713225425=86, srv2006978060=49, srv2005315705=48, srv1229143223=13, srv604370518=79, srv1086665465=5, srv470579193=71, srv1449342005=18, srv2060765228=51, srv718113540=87, srv424080502=65, srv902991191=95, srv418328707=64, srv112714369=9, srv797645655=88, srv1689346667=28, srv800624519=89, srv2003956100=46, srv1487766459=22, srv2101251484=53, srv1650148266=26, srv447242879=67, srv446544917=66, srv1855987275=37, srv2127011557=54, srv1694693404=30, srv94546226=98, srv215399398=56, srv867729862=93, srv828554286=91, srv277142814=59, srv459346697=69, srv1928778746=40, srv1064708242=3, srv911820029=96, srv1476953418=20, srv1798521045=35, srv493712054=72, srv291182214=60, srv26557170=58, srv592550618=78, srv616736807=80, srv638495942=82, srv1755212123=32, srv1018950174=0, srv1543680496=24, srv1476403339=19, srv193839950=43, srv448251313=68, srv541358544=75} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-03-06 11:56:44,565 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-03-06 11:56:44,565 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-03-06 11:56:44,566 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-03-06 11:56:44,566 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-03-06 11:56:44,566 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-03-06 11:56:44,566 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-03-06 11:56:44,566 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-03-06 11:56:44,566 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-03-06 11:56:44,566 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-03-06 11:56:44,566 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-03-06 11:56:44,566 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-03-06 11:56:44,567 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-03-06 11:56:44,567 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-03-06 11:56:44,567 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-03-06 11:56:44,567 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-03-06 11:56:44,567 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-03-06 11:56:44,567 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-03-06 11:56:44,567 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-03-06 11:56:44,567 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-03-06 11:56:44,567 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-03-06 11:56:44,568 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-03-06 11:56:44,568 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-03-06 11:56:44,568 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-03-06 11:56:44,568 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-03-06 11:56:44,568 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-03-06 11:56:44,568 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-03-06 11:56:44,568 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-03-06 11:56:44,568 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-03-06 11:56:44,568 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-03-06 11:56:44,568 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-03-06 11:56:44,569 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-03-06 11:56:44,569 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-03-06 11:56:44,569 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-03-06 11:56:44,569 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-03-06 11:56:44,569 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-03-06 11:56:44,569 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-03-06 11:56:44,569 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-03-06 11:56:44,569 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-03-06 11:56:44,569 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-03-06 11:56:44,569 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-03-06 11:56:44,570 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-03-06 11:56:44,570 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-03-06 11:56:44,570 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-03-06 11:56:44,570 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-03-06 11:56:44,570 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-03-06 11:56:44,570 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-03-06 11:56:44,570 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-03-06 11:56:44,570 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-03-06 11:56:44,570 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-03-06 11:56:44,571 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-03-06 11:56:44,571 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-03-06 11:56:44,571 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-03-06 11:56:44,571 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-03-06 11:56:44,571 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-03-06 11:56:44,571 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-03-06 11:56:44,571 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-03-06 11:56:44,571 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-03-06 11:56:44,571 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-03-06 11:56:44,571 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-03-06 11:56:44,572 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-03-06 11:56:44,572 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-03-06 11:56:44,572 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-03-06 11:56:44,572 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-03-06 11:56:44,572 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-03-06 11:56:44,572 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-03-06 11:56:44,572 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-03-06 11:56:44,572 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-03-06 11:56:44,572 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-03-06 11:56:44,573 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-03-06 11:56:44,573 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-03-06 11:56:44,573 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-03-06 11:56:44,573 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-03-06 11:56:44,573 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-03-06 11:56:44,573 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-03-06 11:56:44,573 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-03-06 11:56:44,573 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-03-06 11:56:44,573 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-03-06 11:56:44,573 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-03-06 11:56:44,574 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-03-06 11:56:44,574 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-03-06 11:56:44,574 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-03-06 11:56:44,574 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-03-06 11:56:44,574 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-03-06 11:56:44,574 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-03-06 11:56:44,574 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-03-06 11:56:44,574 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-03-06 11:56:44,574 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-03-06 11:56:44,575 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-03-06 11:56:44,575 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-03-06 11:56:44,575 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-03-06 11:56:44,575 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-03-06 11:56:44,575 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-03-06 11:56:44,575 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-03-06 11:56:44,575 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-03-06 11:56:44,575 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-03-06 11:56:44,575 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-03-06 11:56:44,575 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-03-06 11:56:44,576 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-03-06 11:56:44,576 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-03-06 11:56:44,576 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-03-06 11:56:44,576 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-03-06 11:56:44,690 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.007223301309353738); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.010216511360396188); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.007223301309353738); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=4.166666666666667E-4); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.005416666666666667); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-03-06 11:56:44,690 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-03-06 11:56:44,691 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=9.435441649849716E-4, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.007223301309353738); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.010216511360396188); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.007223301309353738); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=4.166666666666667E-4); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.005416666666666667); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-03-06 11:56:44,983 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 390 ms to try 5000 different iterations.  Found a solution that moves 275 regions; Going from a computed imbalance of 9.435441649849716E-4 to a new imbalance of 2.761228655085024E-5. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=4.4668347344853864E-4); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0018951174787165373); MoveCostFunction : (multiplier=7.0, imbalance=0.030555555555555555, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=4.4668347344853864E-4); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.6666666666666666E-4); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-03-06 11:56:44,984 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1229143223:83 , srv1692343596:83 , srv418328707:83 , srv493712054:83 , srv592550618:83 , srv916227302:83 , srv1018950174:84 , srv1064708242:84 , srv1076918807:84 , srv1096263651:84 , srv1098194120:84 , srv1133859647:84 , srv1216851968:84 , srv1354455621:84 , srv1426988749:84 , srv1476953418:84 , srv1487045186:84 , srv1694693404:84 , srv1798521045:84 , srv193131541:84 , srv1935328245:84 , srv2003956100:84 , srv2006978060:84 , srv2060765228:84 , srv2074762874:84 , srv2101251484:84 , srv215399398:84 , srv26557170:84 , srv277142814:84 , srv291182214:84 , srv319971100:84 , srv32375039:84 , srv466375218:84 , srv513810153:84 , srv545040576:84 , srv549596723:84 , srv647676173:84 , srv718113540:84 , srv828554286:84 , srv867729862:84 , srv103856685:85 , srv1086665465:85 , srv1088843196:85 , srv112714369:85 , srv124185763:85 , srv1442983247:85 , srv1476403339:85 , srv1543680496:85 , srv1631560373:85 , srv1650148266:85 , srv1670680181:85 , srv1732423844:85 , srv1755212123:85 , srv1771897556:85 , srv1781603888:85 , srv1848513374:85 , srv1855987275:85 , srv1896649383:85 , srv1910942438:85 , srv1928778746:85 , srv193839950:85 , srv1979376123:85 , srv2004090059:85 , srv2005315705:85 , srv2042976938:85 , srv2127011557:85 , srv2140060196:85 , srv21692785:85 , srv402539024:85 , srv424080502:85 , srv448251313:85 , srv459346697:85 , srv470579193:85 , srv53234696:85 , srv604370518:85 , srv616736807:85 , srv622095310:85 , srv638495942:85 , srv646435751:85 , srv649482713:85 , srv713225425:85 , srv797645655:85 , srv800624519:85 , srv814972491:85 , srv862942409:85 , srv902991191:85 , srv911820029:85 , srv997444158:85 , srv1039981707:86 , srv1189529839:86 , srv1449342005:86 , srv1487766459:86 , srv1519952642:86 , srv1689346667:86 , srv446544917:86 , srv447242879:86 , srv541358544:86 , srv902972223:86 , srv94546226:86 , srv1999734977:620 }
2023-03-06 11:56:44,990 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-03-06 11:56:44,991 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv646435751=83, srv1848513374=36, srv2074762874=52, srv2004090059=47, srv902972223=94, srv1935328245=42, srv647676173=84, srv1732423844=31, srv1979376123=44, srv549596723=77, srv622095310=81, srv1189529839=11, srv1088843196=6, srv997444158=99, srv1910942438=39, srv1781603888=34, srv1216851968=12, srv1631560373=25, srv1896649383=38, srv916227302=97, srv402539024=63, srv124185763=14, srv53234696=74, srv1098194120=8, srv814972491=90, srv1133859647=10, srv1670680181=27, srv32375039=62, srv2042976938=50, srv1076918807=4, srv21692785=57, srv103856685=1, srv1771897556=33, srv1999734977=45, srv1426988749=16, srv649482713=85, srv466375218=70, srv1487045186=21, srv1039981707=2, srv1519952642=23, srv513810153=73, srv319971100=61, srv1692343596=29, srv1442983247=17, srv2140060196=55, srv862942409=92, srv1096263651=7, srv545040576=76, srv193131541=41, srv1354455621=15, srv713225425=86, srv2006978060=49, srv2005315705=48, srv1229143223=13, srv604370518=79, srv1086665465=5, srv470579193=71, srv1449342005=18, srv2060765228=51, srv718113540=87, srv424080502=65, srv902991191=95, srv418328707=64, srv112714369=9, srv797645655=88, srv1689346667=28, srv800624519=89, srv2003956100=46, srv1487766459=22, srv2101251484=53, srv1650148266=26, srv447242879=67, srv446544917=66, srv1855987275=37, srv2127011557=54, srv1694693404=30, srv94546226=98, srv215399398=56, srv867729862=93, srv828554286=91, srv277142814=59, srv459346697=69, srv1928778746=40, srv1064708242=3, srv911820029=96, srv1476953418=20, srv1798521045=35, srv493712054=72, srv291182214=60, srv26557170=58, srv592550618=78, srv616736807=80, srv638495942=82, srv1755212123=32, srv1018950174=0, srv1543680496=24, srv1476403339=19, srv193839950=43, srv448251313=68, srv541358544=75} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-03-06 11:56:45,006 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-03-06 11:56:45,006 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-03-06 11:56:45,006 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-03-06 11:56:45,006 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-03-06 11:56:45,006 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-03-06 11:56:45,006 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-03-06 11:56:45,006 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-03-06 11:56:45,006 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-03-06 11:56:45,006 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-03-06 11:56:45,006 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-03-06 11:56:45,006 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-03-06 11:56:45,006 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-03-06 11:56:45,006 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-03-06 11:56:45,006 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-03-06 11:56:45,007 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-03-06 11:56:45,007 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-03-06 11:56:45,007 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-03-06 11:56:45,007 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-03-06 11:56:45,007 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-03-06 11:56:45,007 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-03-06 11:56:45,007 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-03-06 11:56:45,007 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-03-06 11:56:45,007 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-03-06 11:56:45,007 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-03-06 11:56:45,007 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-03-06 11:56:45,007 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-03-06 11:56:45,007 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-03-06 11:56:45,007 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-03-06 11:56:45,007 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-03-06 11:56:45,007 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-03-06 11:56:45,007 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-03-06 11:56:45,007 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-03-06 11:56:45,007 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-03-06 11:56:45,008 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-03-06 11:56:45,008 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-03-06 11:56:45,008 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-03-06 11:56:45,008 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-03-06 11:56:45,008 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-03-06 11:56:45,008 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-03-06 11:56:45,008 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-03-06 11:56:45,008 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-03-06 11:56:45,008 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-03-06 11:56:45,008 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-03-06 11:56:45,008 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-03-06 11:56:45,008 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-03-06 11:56:45,008 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-03-06 11:56:45,008 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-03-06 11:56:45,008 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-03-06 11:56:45,008 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-03-06 11:56:45,008 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-03-06 11:56:45,009 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-03-06 11:56:45,009 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-03-06 11:56:45,009 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-03-06 11:56:45,009 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-03-06 11:56:45,009 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-03-06 11:56:45,009 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-03-06 11:56:45,009 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-03-06 11:56:45,009 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-03-06 11:56:45,009 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-03-06 11:56:45,009 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-03-06 11:56:45,009 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-03-06 11:56:45,009 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-03-06 11:56:45,009 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-03-06 11:56:45,009 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-03-06 11:56:45,009 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-03-06 11:56:45,009 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-03-06 11:56:45,009 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-03-06 11:56:45,010 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-03-06 11:56:45,010 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-03-06 11:56:45,010 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-03-06 11:56:45,010 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-03-06 11:56:45,010 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-03-06 11:56:45,010 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-03-06 11:56:45,010 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-03-06 11:56:45,010 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-03-06 11:56:45,010 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-03-06 11:56:45,010 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-03-06 11:56:45,010 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-03-06 11:56:45,010 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-03-06 11:56:45,010 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-03-06 11:56:45,011 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-03-06 11:56:45,011 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-03-06 11:56:45,011 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-03-06 11:56:45,011 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-03-06 11:56:45,011 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-03-06 11:56:45,011 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-03-06 11:56:45,011 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-03-06 11:56:45,011 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-03-06 11:56:45,011 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-03-06 11:56:45,011 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-03-06 11:56:45,011 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-03-06 11:56:45,011 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-03-06 11:56:45,011 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-03-06 11:56:45,011 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-03-06 11:56:45,011 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-03-06 11:56:45,011 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-03-06 11:56:45,011 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-03-06 11:56:45,011 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-03-06 11:56:45,011 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-03-06 11:56:45,012 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-03-06 11:56:45,012 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-03-06 11:56:45,120 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=4.4668347344853864E-4); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0018951174787165373); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=4.4668347344853864E-4); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.6666666666666666E-4); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-03-06 11:56:45,120 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-03-06 11:56:45,120 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=2.56866953943652E-5, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=4.4668347344853864E-4); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0018951174787165373); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=4.4668347344853864E-4); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.6666666666666666E-4); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-03-06 11:56:45,341 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 321 ms to try 5000 different iterations.  Found a solution that moves 24 regions; Going from a computed imbalance of 2.56866953943652E-5 to a new imbalance of 6.566037264108393E-6. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0014213381090374027); MoveCostFunction : (multiplier=7.0, imbalance=0.0026666666666666666); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-03-06 11:56:45,342 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1039981707:83 , srv1543680496:83 , srv1689346667:83 , srv604370518:83 , srv616736807:83 , srv797645655:83 , srv902972223:83 , srv94546226:83 , srv1018950174:84 , srv103856685:84 , srv1064708242:84 , srv1076918807:84 , srv1086665465:84 , srv1088843196:84 , srv1096263651:84 , srv1098194120:84 , srv112714369:84 , srv1133859647:84 , srv1189529839:84 , srv1216851968:84 , srv124185763:84 , srv1354455621:84 , srv1426988749:84 , srv1442983247:84 , srv1449342005:84 , srv1476403339:84 , srv1476953418:84 , srv1487045186:84 , srv1487766459:84 , srv1519952642:84 , srv1650148266:84 , srv1670680181:84 , srv1692343596:84 , srv1694693404:84 , srv1732423844:84 , srv1755212123:84 , srv1771897556:84 , srv1781603888:84 , srv1798521045:84 , srv1848513374:84 , srv1855987275:84 , srv1896649383:84 , srv1910942438:84 , srv1928778746:84 , srv193131541:84 , srv1935328245:84 , srv193839950:84 , srv1979376123:84 , srv2003956100:84 , srv2004090059:84 , srv2005315705:84 , srv2042976938:84 , srv2060765228:84 , srv2074762874:84 , srv2127011557:84 , srv2140060196:84 , srv215399398:84 , srv21692785:84 , srv26557170:84 , srv277142814:84 , srv291182214:84 , srv319971100:84 , srv32375039:84 , srv402539024:84 , srv418328707:84 , srv424080502:84 , srv446544917:84 , srv447242879:84 , srv448251313:84 , srv459346697:84 , srv470579193:84 , srv493712054:84 , srv513810153:84 , srv53234696:84 , srv541358544:84 , srv545040576:84 , srv592550618:84 , srv622095310:84 , srv638495942:84 , srv646435751:84 , srv647676173:84 , srv649482713:84 , srv713225425:84 , srv800624519:84 , srv814972491:84 , srv828554286:84 , srv862942409:84 , srv867729862:84 , srv902991191:84 , srv911820029:84 , srv997444158:84 , srv1229143223:85 , srv1631560373:85 , srv2006978060:85 , srv2101251484:85 , srv466375218:85 , srv549596723:85 , srv718113540:85 , srv916227302:85 , srv1999734977:684 }
2023-03-06 11:56:45,347 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-03-06 11:56:45,348 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv646435751=83, srv1848513374=36, srv2074762874=52, srv2004090059=47, srv902972223=94, srv1935328245=42, srv647676173=84, srv1732423844=31, srv1979376123=44, srv549596723=77, srv622095310=81, srv1189529839=11, srv1088843196=6, srv997444158=99, srv1910942438=39, srv1781603888=34, srv1216851968=12, srv1631560373=25, srv1896649383=38, srv916227302=97, srv402539024=63, srv124185763=14, srv53234696=74, srv1098194120=8, srv814972491=90, srv1133859647=10, srv1670680181=27, srv32375039=62, srv2042976938=50, srv1076918807=4, srv21692785=57, srv103856685=1, srv1771897556=33, srv1999734977=45, srv1426988749=16, srv649482713=85, srv466375218=70, srv1487045186=21, srv1039981707=2, srv1519952642=23, srv513810153=73, srv319971100=61, srv1692343596=29, srv1442983247=17, srv2140060196=55, srv862942409=92, srv1096263651=7, srv545040576=76, srv193131541=41, srv1354455621=15, srv713225425=86, srv2006978060=49, srv2005315705=48, srv1229143223=13, srv604370518=79, srv1086665465=5, srv470579193=71, srv1449342005=18, srv2060765228=51, srv718113540=87, srv424080502=65, srv902991191=95, srv418328707=64, srv112714369=9, srv797645655=88, srv1689346667=28, srv800624519=89, srv2003956100=46, srv1487766459=22, srv2101251484=53, srv1650148266=26, srv447242879=67, srv446544917=66, srv1855987275=37, srv2127011557=54, srv1694693404=30, srv94546226=98, srv215399398=56, srv867729862=93, srv828554286=91, srv277142814=59, srv459346697=69, srv1928778746=40, srv1064708242=3, srv911820029=96, srv1476953418=20, srv1798521045=35, srv493712054=72, srv291182214=60, srv26557170=58, srv592550618=78, srv616736807=80, srv638495942=82, srv1755212123=32, srv1018950174=0, srv1543680496=24, srv1476403339=19, srv193839950=43, srv448251313=68, srv541358544=75} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-03-06 11:56:45,366 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-03-06 11:56:45,366 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-03-06 11:56:45,367 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-03-06 11:56:45,367 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-03-06 11:56:45,367 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-03-06 11:56:45,367 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-03-06 11:56:45,367 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-03-06 11:56:45,367 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-03-06 11:56:45,367 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-03-06 11:56:45,367 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-03-06 11:56:45,367 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-03-06 11:56:45,367 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-03-06 11:56:45,367 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-03-06 11:56:45,367 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-03-06 11:56:45,367 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-03-06 11:56:45,367 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-03-06 11:56:45,367 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-03-06 11:56:45,367 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-03-06 11:56:45,367 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-03-06 11:56:45,368 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-03-06 11:56:45,368 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-03-06 11:56:45,368 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-03-06 11:56:45,368 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-03-06 11:56:45,368 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-03-06 11:56:45,368 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-03-06 11:56:45,368 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-03-06 11:56:45,368 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-03-06 11:56:45,368 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-03-06 11:56:45,368 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-03-06 11:56:45,368 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-03-06 11:56:45,368 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-03-06 11:56:45,368 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-03-06 11:56:45,368 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-03-06 11:56:45,368 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-03-06 11:56:45,368 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-03-06 11:56:45,368 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-03-06 11:56:45,368 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-03-06 11:56:45,368 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-03-06 11:56:45,369 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-03-06 11:56:45,369 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-03-06 11:56:45,369 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-03-06 11:56:45,369 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-03-06 11:56:45,369 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-03-06 11:56:45,369 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-03-06 11:56:45,369 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-03-06 11:56:45,369 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-03-06 11:56:45,369 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-03-06 11:56:45,369 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-03-06 11:56:45,369 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-03-06 11:56:45,369 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-03-06 11:56:45,369 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-03-06 11:56:45,369 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-03-06 11:56:45,369 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-03-06 11:56:45,369 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-03-06 11:56:45,369 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-03-06 11:56:45,369 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-03-06 11:56:45,369 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-03-06 11:56:45,370 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-03-06 11:56:45,370 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-03-06 11:56:45,370 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-03-06 11:56:45,370 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-03-06 11:56:45,370 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-03-06 11:56:45,370 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-03-06 11:56:45,370 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-03-06 11:56:45,370 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-03-06 11:56:45,370 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-03-06 11:56:45,370 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-03-06 11:56:45,370 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-03-06 11:56:45,370 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-03-06 11:56:45,370 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-03-06 11:56:45,370 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-03-06 11:56:45,370 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-03-06 11:56:45,370 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-03-06 11:56:45,370 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-03-06 11:56:45,370 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-03-06 11:56:45,370 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-03-06 11:56:45,370 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-03-06 11:56:45,370 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-03-06 11:56:45,371 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-03-06 11:56:45,371 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-03-06 11:56:45,371 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-03-06 11:56:45,371 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-03-06 11:56:45,371 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-03-06 11:56:45,371 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-03-06 11:56:45,371 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-03-06 11:56:45,371 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-03-06 11:56:45,371 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-03-06 11:56:45,371 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-03-06 11:56:45,371 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-03-06 11:56:45,371 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-03-06 11:56:45,371 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-03-06 11:56:45,371 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-03-06 11:56:45,371 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-03-06 11:56:45,372 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-03-06 11:56:45,372 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-03-06 11:56:45,372 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-03-06 11:56:45,372 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-03-06 11:56:45,372 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-03-06 11:56:45,372 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-03-06 11:56:45,372 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-03-06 11:56:45,372 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-03-06 11:56:45,479 INFO  [Time-limited test] balancer.StochasticLoadBalancer(381): Cluster wide - skipping load balancing because weighted average imbalance=6.397985672269699E-6 <= threshold(0.025). If you want more aggressive balancing, either lower hbase.master.balancer.stochastic.minCostNeedBalance from 0.025 or increase the relative multiplier(s) of the specific cost function(s). functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0014213381090374027); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-03-06 11:56:45,479 INFO  [Time-limited test] balancer.BalancerTestBase(570): Mock Final balance: { srv1039981707:83 , srv1543680496:83 , srv1689346667:83 , srv604370518:83 , srv616736807:83 , srv797645655:83 , srv902972223:83 , srv94546226:83 , srv1018950174:84 , srv103856685:84 , srv1064708242:84 , srv1076918807:84 , srv1086665465:84 , srv1088843196:84 , srv1096263651:84 , srv1098194120:84 , srv112714369:84 , srv1133859647:84 , srv1189529839:84 , srv1216851968:84 , srv124185763:84 , srv1354455621:84 , srv1426988749:84 , srv1442983247:84 , srv1449342005:84 , srv1476403339:84 , srv1476953418:84 , srv1487045186:84 , srv1487766459:84 , srv1519952642:84 , srv1650148266:84 , srv1670680181:84 , srv1692343596:84 , srv1694693404:84 , srv1732423844:84 , srv1755212123:84 , srv1771897556:84 , srv1781603888:84 , srv1798521045:84 , srv1848513374:84 , srv1855987275:84 , srv1896649383:84 , srv1910942438:84 , srv1928778746:84 , srv193131541:84 , srv1935328245:84 , srv193839950:84 , srv1979376123:84 , srv2003956100:84 , srv2004090059:84 , srv2005315705:84 , srv2042976938:84 , srv2060765228:84 , srv2074762874:84 , srv2127011557:84 , srv2140060196:84 , srv215399398:84 , srv21692785:84 , srv26557170:84 , srv277142814:84 , srv291182214:84 , srv319971100:84 , srv32375039:84 , srv402539024:84 , srv418328707:84 , srv424080502:84 , srv446544917:84 , srv447242879:84 , srv448251313:84 , srv459346697:84 , srv470579193:84 , srv493712054:84 , srv513810153:84 , srv53234696:84 , srv541358544:84 , srv545040576:84 , srv592550618:84 , srv622095310:84 , srv638495942:84 , srv646435751:84 , srv647676173:84 , srv649482713:84 , srv713225425:84 , srv800624519:84 , srv814972491:84 , srv828554286:84 , srv862942409:84 , srv867729862:84 , srv902991191:84 , srv911820029:84 , srv997444158:84 , srv1229143223:85 , srv1631560373:85 , srv2006978060:85 , srv2101251484:85 , srv466375218:85 , srv549596723:85 , srv718113540:85 , srv916227302:85 , srv1999734977:684 }
2023-03-06 11:56:45,509 INFO  [Time-limited test] hbase.ResourceChecker(175): after: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnLargeClusterWithRacks Thread=10 (was 10), OpenFileDescriptor=260 (was 260), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=169 (was 122) - SystemLoadAverage LEAK? -, ProcessCount=160 (was 160), AvailableMemoryMB=9852 (was 10347)
2023-03-06 11:56:45,518 INFO  [Time-limited test] hbase.ResourceChecker(147): before: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnMidClusterWithRacks Thread=10, OpenFileDescriptor=260, MaxFileDescriptor=60000, SystemLoadAverage=169, ProcessCount=160, AvailableMemoryMB=9850
2023-03-06 11:56:45,519 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2023-03-06 11:56:45,519 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=5000, runMaxSteps=true, stepsPerRegion=800, maxRunningTime=120000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 111077.0 etc.
2023-03-06 11:56:45,526 INFO  [Time-limited test] balancer.BalancerTestBase(547): Mock Cluster : { srv1002840406:84 , srv1009160300:84 , srv1052793169:84 , srv1143813994:84 , srv129101642:84 , srv1306582446:84 , srv1435793771:84 , srv1436716433:84 , srv1524268963:84 , srv1646631004:84 , srv1679083914:84 , srv1770445736:84 , srv1805394799:84 , srv1806847107:84 , srv1845617399:84 , srv1861468094:84 , srv187532886:84 , srv1901294814:84 , srv1939400125:84 , srv2030033601:84 , srv2032182550:84 , srv2111335061:84 , srv301557002:84 , srv381401171:84 , srv545350946:84 , srv723800050:84 , srv731536821:84 , srv740991871:84 , srv906934934:84 , srv538535012:264 } [srvr=30 rgns=2700 avg=90.0 max=90 min=90]
2023-03-06 11:56:45,527 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-03-06 11:56:45,528 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1052793169=2, srv1939400125=18, srv1646631004=9, srv1901294814=17, srv129101642=4, srv1845617399=14, srv1679083914=10, srv545350946=25, srv906934934=29, srv1770445736=11, srv1436716433=7, srv187532886=16, srv2030033601=19, srv1524268963=8, srv2111335061=21, srv381401171=23, srv723800050=26, srv1805394799=12, srv731536821=27, srv740991871=28, srv1002840406=0, srv1861468094=15, srv538535012=24, srv1009160300=1, srv1143813994=3, srv1435793771=6, srv2032182550=20, srv1806847107=13, srv301557002=22, srv1306582446=5} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-03-06 11:56:45,535 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-03-06 11:56:45,535 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-03-06 11:56:45,535 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-03-06 11:56:45,536 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-03-06 11:56:45,536 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-03-06 11:56:45,536 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-03-06 11:56:45,536 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-03-06 11:56:45,536 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-03-06 11:56:45,536 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-03-06 11:56:45,536 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-03-06 11:56:45,536 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-03-06 11:56:45,536 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-03-06 11:56:45,536 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-03-06 11:56:45,536 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-03-06 11:56:45,536 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-03-06 11:56:45,536 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-03-06 11:56:45,536 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-03-06 11:56:45,536 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-03-06 11:56:45,536 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-03-06 11:56:45,536 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-03-06 11:56:45,536 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-03-06 11:56:45,536 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-03-06 11:56:45,536 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-03-06 11:56:45,536 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-03-06 11:56:45,536 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-03-06 11:56:45,536 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-03-06 11:56:45,537 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-03-06 11:56:45,537 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-03-06 11:56:45,537 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-03-06 11:56:45,537 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-03-06 11:56:45,537 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=10, number of hosts=30, number of racks=4
2023-03-06 11:56:45,552 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=1.0868672448591437, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-03-06 11:56:45,552 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.9912466759116355, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=1.0868672448591437, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=64800000
2023-03-06 11:58:45,540 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 120001 ms to try 6194300 different iterations.  Found a solution that moves 1861 regions; Going from a computed imbalance of 0.9912466759116355 to a new imbalance of 4.3436668390529226E-5. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); MoveCostFunction : (multiplier=7.0, imbalance=0.6892592592592592, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-03-06 11:58:45,546 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1002840406:90 , srv1009160300:90 , srv1052793169:90 , srv1143813994:90 , srv129101642:90 , srv1306582446:90 , srv1435793771:90 , srv1436716433:90 , srv1524268963:90 , srv1646631004:90 , srv1679083914:90 , srv1770445736:90 , srv1805394799:90 , srv1806847107:90 , srv1845617399:90 , srv1861468094:90 , srv187532886:90 , srv1901294814:90 , srv1939400125:90 , srv2030033601:90 , srv2032182550:90 , srv2111335061:90 , srv301557002:90 , srv381401171:90 , srv538535012:90 , srv545350946:90 , srv723800050:90 , srv731536821:90 , srv740991871:90 , srv906934934:90 }
2023-03-06 11:58:45,547 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-03-06 11:58:45,547 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1052793169=2, srv1939400125=18, srv1646631004=9, srv1901294814=17, srv129101642=4, srv1845617399=14, srv1679083914=10, srv545350946=25, srv906934934=29, srv1770445736=11, srv1436716433=7, srv187532886=16, srv2030033601=19, srv1524268963=8, srv2111335061=21, srv381401171=23, srv723800050=26, srv1805394799=12, srv731536821=27, srv740991871=28, srv1002840406=0, srv1861468094=15, srv538535012=24, srv1009160300=1, srv1143813994=3, srv1435793771=6, srv2032182550=20, srv1806847107=13, srv301557002=22, srv1306582446=5} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-03-06 11:58:45,550 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-03-06 11:58:45,550 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-03-06 11:58:45,550 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-03-06 11:58:45,550 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-03-06 11:58:45,550 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-03-06 11:58:45,550 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-03-06 11:58:45,550 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-03-06 11:58:45,550 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-03-06 11:58:45,550 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-03-06 11:58:45,550 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-03-06 11:58:45,550 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-03-06 11:58:45,550 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-03-06 11:58:45,551 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-03-06 11:58:45,551 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-03-06 11:58:45,551 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-03-06 11:58:45,551 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-03-06 11:58:45,551 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-03-06 11:58:45,551 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-03-06 11:58:45,551 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-03-06 11:58:45,551 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-03-06 11:58:45,551 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-03-06 11:58:45,551 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-03-06 11:58:45,551 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-03-06 11:58:45,551 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-03-06 11:58:45,551 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-03-06 11:58:45,551 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-03-06 11:58:45,551 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-03-06 11:58:45,551 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-03-06 11:58:45,551 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-03-06 11:58:45,551 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-03-06 11:58:45,551 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=10, number of hosts=30, number of racks=4
2023-03-06 11:58:45,563 INFO  [Time-limited test] balancer.StochasticLoadBalancer(381): Cluster wide - skipping load balancing because weighted average imbalance=0.0 <= threshold(0.025). If you want more aggressive balancing, either lower hbase.master.balancer.stochastic.minCostNeedBalance from 0.025 or increase the relative multiplier(s) of the specific cost function(s). functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-03-06 11:58:45,563 INFO  [Time-limited test] balancer.BalancerTestBase(570): Mock Final balance: { srv1002840406:90 , srv1009160300:90 , srv1052793169:90 , srv1143813994:90 , srv129101642:90 , srv1306582446:90 , srv1435793771:90 , srv1436716433:90 , srv1524268963:90 , srv1646631004:90 , srv1679083914:90 , srv1770445736:90 , srv1805394799:90 , srv1806847107:90 , srv1845617399:90 , srv1861468094:90 , srv187532886:90 , srv1901294814:90 , srv1939400125:90 , srv2030033601:90 , srv2032182550:90 , srv2111335061:90 , srv301557002:90 , srv381401171:90 , srv538535012:90 , srv545350946:90 , srv723800050:90 , srv731536821:90 , srv740991871:90 , srv906934934:90 }
2023-03-06 11:58:45,574 INFO  [Time-limited test] hbase.ResourceChecker(175): after: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnMidClusterWithRacks Thread=9 (was 10), OpenFileDescriptor=260 (was 260), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=208 (was 169) - SystemLoadAverage LEAK? -, ProcessCount=160 (was 160), AvailableMemoryMB=10169 (was 9850) - AvailableMemoryMB LEAK? -