2023-05-05 21:53:37,273 INFO  [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks timeout: 13 mins
2023-05-05 21:53:37,623 WARN  [Time-limited test] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties
2023-05-05 21:53:37,746 INFO  [Time-limited test] metrics.MetricRegistriesLoader(60): Loaded MetricRegistries class org.apache.hadoop.hbase.metrics.impl.MetricRegistriesImpl
2023-05-05 21:53:37,816 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2023-05-05 21:53:37,824 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc.
2023-05-05 21:53:37,839 INFO  [Time-limited test] hbase.ResourceChecker(147): before: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnLargeClusterWithRacks Thread=10, OpenFileDescriptor=260, MaxFileDescriptor=60000, SystemLoadAverage=358, ProcessCount=179, AvailableMemoryMB=5257
2023-05-05 21:53:37,841 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2023-05-05 21:53:37,841 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=5000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=10000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc.
2023-05-05 21:53:37,964 INFO  [Time-limited test] balancer.BalancerTestBase(547): Mock Cluster : { srv1013780056:84 , srv101432701:84 , srv1060895493:84 , srv1065664989:84 , srv1067380250:84 , srv1104637956:84 , srv1125494311:84 , srv1130085172:84 , srv1176057305:84 , srv1176712219:84 , srv1222506182:84 , srv1269710662:84 , srv1271217733:84 , srv1273252226:84 , srv1287800268:84 , srv1309363563:84 , srv1325000511:84 , srv1347049731:84 , srv1349631790:84 , srv1358594204:84 , srv137097010:84 , srv1397043598:84 , srv1403733195:84 , srv141323346:84 , srv1417652179:84 , srv1425394657:84 , srv1456165265:84 , srv146766421:84 , srv1476144442:84 , srv1485958639:84 , srv1488202889:84 , srv1492333508:84 , srv1497113366:84 , srv1520935832:84 , srv1522359005:84 , srv1539006269:84 , srv1540865232:84 , srv1545616941:84 , srv159680990:84 , srv1601590993:84 , srv1609674170:84 , srv1620457803:84 , srv1621000152:84 , srv1674649220:84 , srv172425998:84 , srv1728431265:84 , srv1746232265:84 , srv1753550613:84 , srv1755777723:84 , srv1759564392:84 , srv1803489393:84 , srv1808098695:84 , srv1812575051:84 , srv1858359411:84 , srv1858906621:84 , srv1940643464:84 , srv1954062761:84 , srv1986693979:84 , srv204660955:84 , srv2060028046:84 , srv2066132569:84 , srv2085479205:84 , srv2108646594:84 , srv2123116319:84 , srv240613773:84 , srv254746344:84 , srv263264517:84 , srv272996431:84 , srv346856668:84 , srv377795708:84 , srv388754598:84 , srv418228527:84 , srv423803195:84 , srv438230171:84 , srv446441798:84 , srv475667110:84 , srv479565015:84 , srv491135328:84 , srv548363619:84 , srv549786612:84 , srv559565979:84 , srv59826110:84 , srv61769824:84 , srv678063674:84 , srv719499368:84 , srv732669832:84 , srv738155301:84 , srv792830922:84 , srv794713600:84 , srv797181729:84 , srv820460700:84 , srv841111061:84 , srv841930279:84 , srv844456896:84 , srv873206553:84 , srv884673201:84 , srv898411181:84 , srv906678537:84 , srv933740393:84 , srv5858927:684 } [srvr=100 rgns=9000 avg=90.0 max=90 min=90]
2023-05-05 21:53:37,972 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-05-05 21:53:37,980 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv738155301=87, srv1349631790=18, srv377795708=69, srv446441798=74, srv1986693979=57, srv61769824=83, srv1104637956=5, srv479565015=76, srv1125494311=6, srv423803195=72, srv1273252226=13, srv1325000511=16, srv1485958639=29, srv475667110=75, srv873206553=95, srv346856668=68, srv719499368=85, srv1545616941=37, srv1176712219=9, srv146766421=27, srv1858906621=54, srv1803489393=50, srv841930279=93, srv1176057305=8, srv1621000152=42, srv1067380250=4, srv792830922=88, srv884673201=96, srv1476144442=28, srv204660955=58, srv1222506182=10, srv418228527=71, srv1425394657=25, srv1488202889=30, srv1609674170=40, srv263264517=66, srv1497113366=32, srv678063674=84, srv559565979=80, srv898411181=97, srv1674649220=43, srv172425998=44, srv1759564392=49, srv1397043598=21, srv1620457803=41, srv1065664989=3, srv933740393=99, srv1287800268=14, srv1309363563=15, srv732669832=86, srv1954062761=56, srv548363619=78, srv1755777723=48, srv549786612=79, srv1520935832=33, srv1539006269=35, srv5858927=81, srv1492333508=31, srv491135328=77, srv240613773=64, srv2123116319=63, srv159680990=38, srv1808098695=51, srv137097010=20, srv1417652179=24, srv1060895493=2, srv1540865232=36, srv841111061=92, srv1746232265=46, srv1013780056=0, srv844456896=94, srv1347049731=17, srv2066132569=60, srv820460700=91, srv906678537=98, srv1269710662=11, srv1522359005=34, srv797181729=90, srv794713600=89, srv272996431=67, srv388754598=70, srv438230171=73, srv1456165265=26, srv2085479205=61, srv1753550613=47, srv1812575051=52, srv2108646594=62, srv1130085172=7, srv1940643464=55, srv2060028046=59, srv1358594204=19, srv254746344=65, srv1403733195=22, srv141323346=23, srv1728431265=45, srv101432701=1, srv59826110=82, srv1858359411=53, srv1271217733=12, srv1601590993=39} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-05-05 21:53:38,090 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-05-05 21:53:38,091 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-05-05 21:53:38,091 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-05-05 21:53:38,091 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-05-05 21:53:38,091 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-05-05 21:53:38,091 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-05-05 21:53:38,092 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-05-05 21:53:38,092 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-05-05 21:53:38,092 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-05-05 21:53:38,092 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-05-05 21:53:38,092 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-05-05 21:53:38,092 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-05-05 21:53:38,093 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-05-05 21:53:38,093 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-05-05 21:53:38,093 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-05-05 21:53:38,093 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-05-05 21:53:38,093 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-05-05 21:53:38,093 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-05-05 21:53:38,094 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-05-05 21:53:38,094 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-05-05 21:53:38,094 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-05-05 21:53:38,094 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-05-05 21:53:38,094 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-05-05 21:53:38,094 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-05-05 21:53:38,094 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-05-05 21:53:38,095 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-05-05 21:53:38,095 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-05-05 21:53:38,095 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-05-05 21:53:38,095 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-05-05 21:53:38,095 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-05-05 21:53:38,095 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-05-05 21:53:38,095 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-05-05 21:53:38,095 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-05-05 21:53:38,095 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-05-05 21:53:38,095 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-05-05 21:53:38,095 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-05-05 21:53:38,096 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-05-05 21:53:38,096 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-05-05 21:53:38,096 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-05-05 21:53:38,096 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-05-05 21:53:38,096 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-05-05 21:53:38,096 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-05-05 21:53:38,096 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-05-05 21:53:38,096 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-05-05 21:53:38,096 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-05-05 21:53:38,096 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-05-05 21:53:38,096 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-05-05 21:53:38,097 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-05-05 21:53:38,097 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-05-05 21:53:38,097 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-05-05 21:53:38,097 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-05-05 21:53:38,097 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-05-05 21:53:38,097 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-05-05 21:53:38,097 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-05-05 21:53:38,097 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-05-05 21:53:38,097 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-05-05 21:53:38,097 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-05-05 21:53:38,097 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-05-05 21:53:38,098 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-05-05 21:53:38,098 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-05-05 21:53:38,098 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-05-05 21:53:38,098 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-05-05 21:53:38,098 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-05-05 21:53:38,098 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-05-05 21:53:38,098 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-05-05 21:53:38,098 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-05-05 21:53:38,098 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-05-05 21:53:38,098 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-05-05 21:53:38,098 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-05-05 21:53:38,099 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-05-05 21:53:38,099 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-05-05 21:53:38,099 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-05-05 21:53:38,099 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-05-05 21:53:38,099 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-05-05 21:53:38,099 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-05-05 21:53:38,099 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-05-05 21:53:38,099 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-05-05 21:53:38,099 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-05-05 21:53:38,099 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-05-05 21:53:38,099 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-05-05 21:53:38,099 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-05-05 21:53:38,099 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-05-05 21:53:38,100 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-05-05 21:53:38,100 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-05-05 21:53:38,100 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-05-05 21:53:38,100 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-05-05 21:53:38,100 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-05-05 21:53:38,100 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-05-05 21:53:38,100 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-05-05 21:53:38,100 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-05-05 21:53:38,100 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-05-05 21:53:38,100 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-05-05 21:53:38,100 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-05-05 21:53:38,100 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-05-05 21:53:38,101 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-05-05 21:53:38,101 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-05-05 21:53:38,101 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-05-05 21:53:38,101 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-05-05 21:53:38,101 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-05-05 21:53:38,101 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-05-05 21:53:38,101 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-05-05 21:53:38,443 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.06666666666666667, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-05-05 21:53:38,443 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-05-05 21:53:38,444 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.9909252140407105, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.06666666666666667, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-05-05 21:53:38,832 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 697 ms to try 5000 different iterations.  Found a solution that moves 4714 regions; Going from a computed imbalance of 0.9909252140407105 to a new imbalance of 0.1747110357544427. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.04030560399535779, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.05896221849520711, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.5237777777777778, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.04030560399535779, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.17, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.23516666666666666, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-05-05 21:53:38,854 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1065664989:80 , srv1753550613:80 , srv418228527:80 , srv1620457803:81 , srv1803489393:81 , srv792830922:81 , srv1522359005:82 , srv1539006269:82 , srv59826110:82 , srv797181729:82 , srv1269710662:83 , srv1621000152:83 , srv204660955:83 , srv61769824:83 , srv1013780056:84 , srv1125494311:84 , srv141323346:84 , srv1485958639:84 , srv263264517:84 , srv549786612:84 , srv884673201:84 , srv1130085172:85 , srv1176057305:85 , srv1222506182:85 , srv1287800268:85 , srv1358594204:85 , srv1403733195:85 , srv172425998:85 , srv1746232265:85 , srv1858359411:85 , srv1940643464:85 , srv1954062761:85 , srv2108646594:85 , srv2123116319:85 , srv272996431:85 , srv423803195:85 , srv475667110:85 , srv678063674:85 , srv820460700:85 , srv841111061:85 , srv906678537:85 , srv1397043598:86 , srv1456165265:86 , srv146766421:86 , srv1728431265:86 , srv1755777723:86 , srv2085479205:86 , srv240613773:86 , srv388754598:86 , srv479565015:86 , srv794713600:86 , srv841930279:86 , srv898411181:86 , srv1060895493:87 , srv1271217733:87 , srv1347049731:87 , srv1417652179:87 , srv1488202889:87 , srv1674649220:87 , srv2066132569:87 , srv738155301:87 , srv844456896:87 , srv1325000511:88 , srv137097010:88 , srv159680990:88 , srv1601590993:88 , srv1808098695:88 , srv1858906621:88 , srv346856668:88 , srv446441798:88 , srv719499368:88 , srv873206553:88 , srv101432701:89 , srv1067380250:89 , srv1273252226:89 , srv1309363563:89 , srv1349631790:89 , srv1425394657:89 , srv1476144442:89 , srv1492333508:89 , srv1497113366:89 , srv1812575051:89 , srv1986693979:89 , srv2060028046:89 , srv377795708:89 , srv438230171:89 , srv491135328:89 , srv548363619:89 , srv933740393:89 , srv1520935832:90 , srv1609674170:90 , srv559565979:90 , srv1104637956:91 , srv1759564392:91 , srv254746344:91 , srv732669832:91 , srv1176712219:93 , srv1540865232:93 , srv1545616941:93 , srv5858927:448 }
2023-05-05 21:53:38,858 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-05-05 21:53:38,859 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv738155301=87, srv1349631790=18, srv377795708=69, srv446441798=74, srv1986693979=57, srv61769824=83, srv1104637956=5, srv479565015=76, srv1125494311=6, srv423803195=72, srv1273252226=13, srv1325000511=16, srv1485958639=29, srv475667110=75, srv873206553=95, srv346856668=68, srv719499368=85, srv1545616941=37, srv1176712219=9, srv146766421=27, srv1858906621=54, srv1803489393=50, srv841930279=93, srv1176057305=8, srv1621000152=42, srv1067380250=4, srv792830922=88, srv884673201=96, srv1476144442=28, srv204660955=58, srv1222506182=10, srv418228527=71, srv1425394657=25, srv1488202889=30, srv1609674170=40, srv263264517=66, srv1497113366=32, srv678063674=84, srv559565979=80, srv898411181=97, srv1674649220=43, srv172425998=44, srv1759564392=49, srv1397043598=21, srv1620457803=41, srv1065664989=3, srv933740393=99, srv1287800268=14, srv1309363563=15, srv732669832=86, srv1954062761=56, srv548363619=78, srv1755777723=48, srv549786612=79, srv1520935832=33, srv1539006269=35, srv5858927=81, srv1492333508=31, srv491135328=77, srv240613773=64, srv2123116319=63, srv159680990=38, srv1808098695=51, srv137097010=20, srv1417652179=24, srv1060895493=2, srv1540865232=36, srv841111061=92, srv1746232265=46, srv1013780056=0, srv844456896=94, srv1347049731=17, srv2066132569=60, srv820460700=91, srv906678537=98, srv1269710662=11, srv1522359005=34, srv797181729=90, srv794713600=89, srv272996431=67, srv388754598=70, srv438230171=73, srv1456165265=26, srv2085479205=61, srv1753550613=47, srv1812575051=52, srv2108646594=62, srv1130085172=7, srv1940643464=55, srv2060028046=59, srv1358594204=19, srv254746344=65, srv1403733195=22, srv141323346=23, srv1728431265=45, srv101432701=1, srv59826110=82, srv1858359411=53, srv1271217733=12, srv1601590993=39} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-05-05 21:53:38,879 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-05-05 21:53:38,879 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-05-05 21:53:38,879 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-05-05 21:53:38,879 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-05-05 21:53:38,880 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-05-05 21:53:38,880 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-05-05 21:53:38,880 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-05-05 21:53:38,880 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-05-05 21:53:38,880 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-05-05 21:53:38,880 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-05-05 21:53:38,881 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-05-05 21:53:38,881 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-05-05 21:53:38,881 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-05-05 21:53:38,881 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-05-05 21:53:38,881 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-05-05 21:53:38,881 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-05-05 21:53:38,881 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-05-05 21:53:38,881 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-05-05 21:53:38,881 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-05-05 21:53:38,882 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-05-05 21:53:38,882 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-05-05 21:53:38,882 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-05-05 21:53:38,882 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-05-05 21:53:38,882 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-05-05 21:53:38,882 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-05-05 21:53:38,882 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-05-05 21:53:38,882 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-05-05 21:53:38,883 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-05-05 21:53:38,883 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-05-05 21:53:38,883 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-05-05 21:53:38,883 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-05-05 21:53:38,883 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-05-05 21:53:38,883 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-05-05 21:53:38,883 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-05-05 21:53:38,883 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-05-05 21:53:38,883 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-05-05 21:53:38,883 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-05-05 21:53:38,883 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-05-05 21:53:38,884 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-05-05 21:53:38,884 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-05-05 21:53:38,884 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-05-05 21:53:38,884 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-05-05 21:53:38,884 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-05-05 21:53:38,884 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-05-05 21:53:38,884 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-05-05 21:53:38,884 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-05-05 21:53:38,884 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-05-05 21:53:38,884 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-05-05 21:53:38,884 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-05-05 21:53:38,884 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-05-05 21:53:38,884 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-05-05 21:53:38,884 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-05-05 21:53:38,885 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-05-05 21:53:38,885 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-05-05 21:53:38,885 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-05-05 21:53:38,885 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-05-05 21:53:38,885 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-05-05 21:53:38,885 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-05-05 21:53:38,885 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-05-05 21:53:38,885 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-05-05 21:53:38,886 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-05-05 21:53:38,886 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-05-05 21:53:38,886 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-05-05 21:53:38,886 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-05-05 21:53:38,886 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-05-05 21:53:38,886 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-05-05 21:53:38,886 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-05-05 21:53:38,887 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-05-05 21:53:38,887 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-05-05 21:53:38,887 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-05-05 21:53:38,887 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-05-05 21:53:38,887 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-05-05 21:53:38,887 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-05-05 21:53:38,887 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-05-05 21:53:38,887 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-05-05 21:53:38,887 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-05-05 21:53:38,887 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-05-05 21:53:38,887 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-05-05 21:53:38,888 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-05-05 21:53:38,888 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-05-05 21:53:38,888 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-05-05 21:53:38,888 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-05-05 21:53:38,888 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-05-05 21:53:38,888 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-05-05 21:53:38,888 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-05-05 21:53:38,888 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-05-05 21:53:38,888 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-05-05 21:53:38,888 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-05-05 21:53:38,889 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-05-05 21:53:38,889 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-05-05 21:53:38,889 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-05-05 21:53:38,889 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-05-05 21:53:38,889 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-05-05 21:53:38,889 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-05-05 21:53:38,889 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-05-05 21:53:38,889 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-05-05 21:53:38,889 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-05-05 21:53:38,889 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-05-05 21:53:38,889 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-05-05 21:53:38,890 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-05-05 21:53:38,890 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-05-05 21:53:39,053 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.04030560399535779, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.05896221849520711, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.04030560399535779, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.17, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.23516666666666666, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-05-05 21:53:39,053 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-05-05 21:53:39,054 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.17467802762094572, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.04030560399535779, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.05896221849520711, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.04030560399535779, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.17, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.23516666666666666, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-05-05 21:53:39,471 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 553 ms to try 5000 different iterations.  Found a solution that moves 2638 regions; Going from a computed imbalance of 0.17467802762094572 to a new imbalance of 0.01520929428910004. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.02161343427626936); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.03324229993623343, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.2931111111111111, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.02161343427626936); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.012166666666666666); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.04425, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-05-05 21:53:39,482 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1545616941:78 , srv1176712219:79 , srv1759564392:80 , srv254746344:80 , srv732669832:80 , srv1273252226:81 , srv1520935832:81 , srv548363619:81 , srv101432701:82 , srv1067380250:82 , srv1492333508:82 , srv1609674170:82 , srv1858906621:82 , srv377795708:82 , srv1104637956:83 , srv1309363563:83 , srv1347049731:83 , srv1349631790:83 , srv1417652179:83 , srv1425394657:83 , srv1540865232:83 , srv1674649220:83 , srv2060028046:83 , srv438230171:83 , srv559565979:83 , srv719499368:83 , srv1488202889:84 , srv1497113366:84 , srv1601590993:84 , srv1755777723:84 , srv1808098695:84 , srv1812575051:84 , srv1986693979:84 , srv346856668:84 , srv491135328:84 , srv844456896:84 , srv1271217733:85 , srv1325000511:85 , srv137097010:85 , srv146766421:85 , srv1746232265:85 , srv1858359411:85 , srv240613773:85 , srv446441798:85 , srv479565015:85 , srv873206553:85 , srv898411181:85 , srv1222506182:86 , srv1287800268:86 , srv1397043598:86 , srv1403733195:86 , srv1456165265:86 , srv1476144442:86 , srv1954062761:86 , srv2085479205:86 , srv2123116319:86 , srv272996431:86 , srv423803195:86 , srv738155301:86 , srv906678537:86 , srv933740393:86 , srv1013780056:87 , srv1060895493:87 , srv1130085172:87 , srv141323346:87 , srv1485958639:87 , srv2066132569:87 , srv263264517:87 , srv475667110:87 , srv794713600:87 , srv820460700:87 , srv1269710662:88 , srv1358594204:88 , srv159680990:88 , srv172425998:88 , srv1728431265:88 , srv1940643464:88 , srv204660955:88 , srv549786612:88 , srv678063674:88 , srv841111061:88 , srv841930279:88 , srv1522359005:89 , srv1620457803:89 , srv2108646594:89 , srv388754598:89 , srv418228527:89 , srv61769824:89 , srv1125494311:90 , srv1539006269:90 , srv1621000152:90 , srv59826110:90 , srv792830922:90 , srv1176057305:91 , srv1803489393:92 , srv797181729:92 , srv884673201:92 , srv1065664989:93 , srv1753550613:93 , srv5858927:518 }
2023-05-05 21:53:39,487 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-05-05 21:53:39,488 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv738155301=87, srv1349631790=18, srv377795708=69, srv446441798=74, srv1986693979=57, srv61769824=83, srv1104637956=5, srv479565015=76, srv1125494311=6, srv423803195=72, srv1273252226=13, srv1325000511=16, srv1485958639=29, srv475667110=75, srv873206553=95, srv346856668=68, srv719499368=85, srv1545616941=37, srv1176712219=9, srv146766421=27, srv1858906621=54, srv1803489393=50, srv841930279=93, srv1176057305=8, srv1621000152=42, srv1067380250=4, srv792830922=88, srv884673201=96, srv1476144442=28, srv204660955=58, srv1222506182=10, srv418228527=71, srv1425394657=25, srv1488202889=30, srv1609674170=40, srv263264517=66, srv1497113366=32, srv678063674=84, srv559565979=80, srv898411181=97, srv1674649220=43, srv172425998=44, srv1759564392=49, srv1397043598=21, srv1620457803=41, srv1065664989=3, srv933740393=99, srv1287800268=14, srv1309363563=15, srv732669832=86, srv1954062761=56, srv548363619=78, srv1755777723=48, srv549786612=79, srv1520935832=33, srv1539006269=35, srv5858927=81, srv1492333508=31, srv491135328=77, srv240613773=64, srv2123116319=63, srv159680990=38, srv1808098695=51, srv137097010=20, srv1417652179=24, srv1060895493=2, srv1540865232=36, srv841111061=92, srv1746232265=46, srv1013780056=0, srv844456896=94, srv1347049731=17, srv2066132569=60, srv820460700=91, srv906678537=98, srv1269710662=11, srv1522359005=34, srv797181729=90, srv794713600=89, srv272996431=67, srv388754598=70, srv438230171=73, srv1456165265=26, srv2085479205=61, srv1753550613=47, srv1812575051=52, srv2108646594=62, srv1130085172=7, srv1940643464=55, srv2060028046=59, srv1358594204=19, srv254746344=65, srv1403733195=22, srv141323346=23, srv1728431265=45, srv101432701=1, srv59826110=82, srv1858359411=53, srv1271217733=12, srv1601590993=39} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-05-05 21:53:39,510 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-05-05 21:53:39,510 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-05-05 21:53:39,510 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-05-05 21:53:39,510 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-05-05 21:53:39,510 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-05-05 21:53:39,510 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-05-05 21:53:39,510 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-05-05 21:53:39,511 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-05-05 21:53:39,511 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-05-05 21:53:39,511 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-05-05 21:53:39,511 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-05-05 21:53:39,511 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-05-05 21:53:39,511 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-05-05 21:53:39,511 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-05-05 21:53:39,511 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-05-05 21:53:39,511 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-05-05 21:53:39,512 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-05-05 21:53:39,512 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-05-05 21:53:39,512 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-05-05 21:53:39,512 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-05-05 21:53:39,512 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-05-05 21:53:39,512 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-05-05 21:53:39,512 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-05-05 21:53:39,512 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-05-05 21:53:39,512 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-05-05 21:53:39,512 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-05-05 21:53:39,513 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-05-05 21:53:39,513 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-05-05 21:53:39,513 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-05-05 21:53:39,513 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-05-05 21:53:39,513 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-05-05 21:53:39,513 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-05-05 21:53:39,513 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-05-05 21:53:39,513 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-05-05 21:53:39,514 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-05-05 21:53:39,514 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-05-05 21:53:39,514 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-05-05 21:53:39,514 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-05-05 21:53:39,514 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-05-05 21:53:39,514 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-05-05 21:53:39,514 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-05-05 21:53:39,514 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-05-05 21:53:39,514 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-05-05 21:53:39,514 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-05-05 21:53:39,515 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-05-05 21:53:39,515 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-05-05 21:53:39,515 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-05-05 21:53:39,515 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-05-05 21:53:39,515 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-05-05 21:53:39,515 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-05-05 21:53:39,515 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-05-05 21:53:39,515 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-05-05 21:53:39,515 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-05-05 21:53:39,515 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-05-05 21:53:39,515 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-05-05 21:53:39,516 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-05-05 21:53:39,516 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-05-05 21:53:39,516 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-05-05 21:53:39,516 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-05-05 21:53:39,516 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-05-05 21:53:39,516 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-05-05 21:53:39,516 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-05-05 21:53:39,516 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-05-05 21:53:39,516 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-05-05 21:53:39,516 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-05-05 21:53:39,517 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-05-05 21:53:39,517 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-05-05 21:53:39,517 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-05-05 21:53:39,517 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-05-05 21:53:39,517 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-05-05 21:53:39,517 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-05-05 21:53:39,517 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-05-05 21:53:39,517 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-05-05 21:53:39,517 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-05-05 21:53:39,518 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-05-05 21:53:39,518 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-05-05 21:53:39,518 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-05-05 21:53:39,518 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-05-05 21:53:39,518 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-05-05 21:53:39,518 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-05-05 21:53:39,518 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-05-05 21:53:39,518 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-05-05 21:53:39,518 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-05-05 21:53:39,518 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-05-05 21:53:39,519 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-05-05 21:53:39,519 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-05-05 21:53:39,519 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-05-05 21:53:39,519 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-05-05 21:53:39,519 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-05-05 21:53:39,519 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-05-05 21:53:39,519 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-05-05 21:53:39,519 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-05-05 21:53:39,519 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-05-05 21:53:39,519 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-05-05 21:53:39,520 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-05-05 21:53:39,520 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-05-05 21:53:39,520 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-05-05 21:53:39,520 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-05-05 21:53:39,520 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-05-05 21:53:39,520 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-05-05 21:53:39,520 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-05-05 21:53:39,667 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.02161343427626936); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.03324229993623343, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.02161343427626936); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.012166666666666666); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.04425, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-05-05 21:53:39,668 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-05-05 21:53:39,668 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.015190822618297102, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.02161343427626936); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.03324229993623343, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.02161343427626936); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.012166666666666666); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.04425, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-05-05 21:53:40,100 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 561 ms to try 5000 different iterations.  Found a solution that moves 996 regions; Going from a computed imbalance of 0.015190822618297102 to a new imbalance of 5.024580373234331E-4. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.005213965342504877); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.007828119907069723); MoveCostFunction : (multiplier=7.0, imbalance=0.11066666666666666, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.005213965342504877); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=8.333333333333333E-5); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.004); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-05-05 21:53:40,103 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1540865232:81 , srv159680990:81 , srv1176057305:82 , srv2108646594:82 , srv388754598:82 , srv884673201:82 , srv1060895493:83 , srv1104637956:83 , srv1476144442:83 , srv1986693979:83 , srv841930279:83 , srv933740393:83 , srv1125494311:84 , srv1325000511:84 , srv1349631790:84 , srv1497113366:84 , srv1728431265:84 , srv1803489393:84 , srv2066132569:84 , srv446441798:84 , srv794713600:84 , srv797181729:84 , srv873206553:84 , srv1065664989:85 , srv1130085172:85 , srv1456165265:85 , srv1621000152:85 , srv172425998:85 , srv1753550613:85 , srv1812575051:85 , srv1940643464:85 , srv204660955:85 , srv2060028046:85 , srv2085479205:85 , srv346856668:85 , srv438230171:85 , srv491135328:85 , srv559565979:85 , srv59826110:85 , srv678063674:85 , srv738155301:85 , srv820460700:85 , srv101432701:86 , srv1067380250:86 , srv1176712219:86 , srv1222506182:86 , srv1269710662:86 , srv1271217733:86 , srv1287800268:86 , srv1309363563:86 , srv1358594204:86 , srv137097010:86 , srv1397043598:86 , srv1425394657:86 , srv1485958639:86 , srv1488202889:86 , srv1492333508:86 , srv1522359005:86 , srv1539006269:86 , srv1545616941:86 , srv1601590993:86 , srv1609674170:86 , srv1808098695:86 , srv2123116319:86 , srv254746344:86 , srv263264517:86 , srv475667110:86 , srv549786612:86 , srv719499368:86 , srv732669832:86 , srv792830922:86 , srv841111061:86 , srv844456896:86 , srv898411181:86 , srv1013780056:87 , srv1273252226:87 , srv1403733195:87 , srv146766421:87 , srv1520935832:87 , srv1620457803:87 , srv1674649220:87 , srv1746232265:87 , srv1759564392:87 , srv1858359411:87 , srv1954062761:87 , srv240613773:87 , srv272996431:87 , srv377795708:87 , srv423803195:87 , srv479565015:87 , srv61769824:87 , srv906678537:87 , srv1347049731:88 , srv141323346:88 , srv1417652179:88 , srv1755777723:88 , srv1858906621:88 , srv548363619:88 , srv418228527:89 , srv5858927:538 }
2023-05-05 21:53:40,110 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-05-05 21:53:40,111 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv738155301=87, srv1349631790=18, srv377795708=69, srv446441798=74, srv1986693979=57, srv61769824=83, srv1104637956=5, srv479565015=76, srv1125494311=6, srv423803195=72, srv1273252226=13, srv1325000511=16, srv1485958639=29, srv475667110=75, srv873206553=95, srv346856668=68, srv719499368=85, srv1545616941=37, srv1176712219=9, srv146766421=27, srv1858906621=54, srv1803489393=50, srv841930279=93, srv1176057305=8, srv1621000152=42, srv1067380250=4, srv792830922=88, srv884673201=96, srv1476144442=28, srv204660955=58, srv1222506182=10, srv418228527=71, srv1425394657=25, srv1488202889=30, srv1609674170=40, srv263264517=66, srv1497113366=32, srv678063674=84, srv559565979=80, srv898411181=97, srv1674649220=43, srv172425998=44, srv1759564392=49, srv1397043598=21, srv1620457803=41, srv1065664989=3, srv933740393=99, srv1287800268=14, srv1309363563=15, srv732669832=86, srv1954062761=56, srv548363619=78, srv1755777723=48, srv549786612=79, srv1520935832=33, srv1539006269=35, srv5858927=81, srv1492333508=31, srv491135328=77, srv240613773=64, srv2123116319=63, srv159680990=38, srv1808098695=51, srv137097010=20, srv1417652179=24, srv1060895493=2, srv1540865232=36, srv841111061=92, srv1746232265=46, srv1013780056=0, srv844456896=94, srv1347049731=17, srv2066132569=60, srv820460700=91, srv906678537=98, srv1269710662=11, srv1522359005=34, srv797181729=90, srv794713600=89, srv272996431=67, srv388754598=70, srv438230171=73, srv1456165265=26, srv2085479205=61, srv1753550613=47, srv1812575051=52, srv2108646594=62, srv1130085172=7, srv1940643464=55, srv2060028046=59, srv1358594204=19, srv254746344=65, srv1403733195=22, srv141323346=23, srv1728431265=45, srv101432701=1, srv59826110=82, srv1858359411=53, srv1271217733=12, srv1601590993=39} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-05-05 21:53:40,138 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-05-05 21:53:40,138 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-05-05 21:53:40,138 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-05-05 21:53:40,138 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-05-05 21:53:40,138 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-05-05 21:53:40,139 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-05-05 21:53:40,139 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-05-05 21:53:40,139 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-05-05 21:53:40,139 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-05-05 21:53:40,139 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-05-05 21:53:40,139 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-05-05 21:53:40,139 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-05-05 21:53:40,139 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-05-05 21:53:40,139 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-05-05 21:53:40,140 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-05-05 21:53:40,140 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-05-05 21:53:40,140 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-05-05 21:53:40,140 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-05-05 21:53:40,140 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-05-05 21:53:40,140 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-05-05 21:53:40,140 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-05-05 21:53:40,140 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-05-05 21:53:40,141 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-05-05 21:53:40,141 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-05-05 21:53:40,141 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-05-05 21:53:40,141 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-05-05 21:53:40,141 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-05-05 21:53:40,141 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-05-05 21:53:40,141 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-05-05 21:53:40,141 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-05-05 21:53:40,141 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-05-05 21:53:40,142 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-05-05 21:53:40,142 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-05-05 21:53:40,142 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-05-05 21:53:40,142 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-05-05 21:53:40,142 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-05-05 21:53:40,142 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-05-05 21:53:40,142 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-05-05 21:53:40,142 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-05-05 21:53:40,142 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-05-05 21:53:40,142 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-05-05 21:53:40,143 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-05-05 21:53:40,143 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-05-05 21:53:40,143 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-05-05 21:53:40,143 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-05-05 21:53:40,143 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-05-05 21:53:40,143 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-05-05 21:53:40,143 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-05-05 21:53:40,143 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-05-05 21:53:40,143 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-05-05 21:53:40,144 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-05-05 21:53:40,144 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-05-05 21:53:40,144 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-05-05 21:53:40,144 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-05-05 21:53:40,144 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-05-05 21:53:40,144 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-05-05 21:53:40,144 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-05-05 21:53:40,144 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-05-05 21:53:40,144 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-05-05 21:53:40,144 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-05-05 21:53:40,144 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-05-05 21:53:40,145 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-05-05 21:53:40,145 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-05-05 21:53:40,145 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-05-05 21:53:40,145 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-05-05 21:53:40,145 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-05-05 21:53:40,145 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-05-05 21:53:40,145 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-05-05 21:53:40,145 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-05-05 21:53:40,145 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-05-05 21:53:40,145 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-05-05 21:53:40,145 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-05-05 21:53:40,146 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-05-05 21:53:40,146 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-05-05 21:53:40,146 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-05-05 21:53:40,146 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-05-05 21:53:40,146 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-05-05 21:53:40,146 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-05-05 21:53:40,146 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-05-05 21:53:40,146 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-05-05 21:53:40,146 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-05-05 21:53:40,146 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-05-05 21:53:40,146 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-05-05 21:53:40,147 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-05-05 21:53:40,147 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-05-05 21:53:40,147 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-05-05 21:53:40,147 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-05-05 21:53:40,147 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-05-05 21:53:40,147 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-05-05 21:53:40,147 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-05-05 21:53:40,147 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-05-05 21:53:40,147 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-05-05 21:53:40,147 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-05-05 21:53:40,147 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-05-05 21:53:40,148 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-05-05 21:53:40,148 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-05-05 21:53:40,148 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-05-05 21:53:40,148 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-05-05 21:53:40,148 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-05-05 21:53:40,148 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-05-05 21:53:40,148 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-05-05 21:53:40,295 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.005213965342504877); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.007828119907069723); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.005213965342504877); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=8.333333333333333E-5); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.004); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-05-05 21:53:40,295 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-05-05 21:53:40,295 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=4.954838962621272E-4, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.005213965342504877); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.007828119907069723); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.005213965342504877); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=8.333333333333333E-5); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.004); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-05-05 21:53:40,710 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 543 ms to try 5000 different iterations.  Found a solution that moves 205 regions; Going from a computed imbalance of 4.954838962621272E-4 to a new imbalance of 5.6992396653513745E-5. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=4.178341294946416E-4); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0018951174787165373); MoveCostFunction : (multiplier=7.0, imbalance=0.02277777777777778); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=4.178341294946416E-4); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=5.0E-4); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-05-05 21:53:40,725 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1358594204:83 , srv137097010:83 , srv1397043598:83 , srv141323346:83 , srv1425394657:83 , srv61769824:83 , srv101432701:84 , srv1065664989:84 , srv1104637956:84 , srv1125494311:84 , srv1176057305:84 , srv1176712219:84 , srv1271217733:84 , srv1287800268:84 , srv1309363563:84 , srv1347049731:84 , srv1403733195:84 , srv1417652179:84 , srv146766421:84 , srv1476144442:84 , srv1520935832:84 , srv1539006269:84 , srv1601590993:84 , srv1609674170:84 , srv1621000152:84 , srv172425998:84 , srv1728431265:84 , srv1753550613:84 , srv1755777723:84 , srv1808098695:84 , srv1812575051:84 , srv1858906621:84 , srv1940643464:84 , srv1954062761:84 , srv240613773:84 , srv272996431:84 , srv377795708:84 , srv423803195:84 , srv446441798:84 , srv475667110:84 , srv491135328:84 , srv548363619:84 , srv549786612:84 , srv559565979:84 , srv59826110:84 , srv678063674:84 , srv738155301:84 , srv797181729:84 , srv841111061:84 , srv906678537:84 , srv933740393:84 , srv1013780056:85 , srv1060895493:85 , srv1067380250:85 , srv1130085172:85 , srv1222506182:85 , srv1269710662:85 , srv1273252226:85 , srv1325000511:85 , srv1456165265:85 , srv1485958639:85 , srv1488202889:85 , srv1492333508:85 , srv1497113366:85 , srv1522359005:85 , srv1540865232:85 , srv1545616941:85 , srv159680990:85 , srv1620457803:85 , srv1674649220:85 , srv1746232265:85 , srv1759564392:85 , srv1803489393:85 , srv1858359411:85 , srv2060028046:85 , srv2066132569:85 , srv2085479205:85 , srv2123116319:85 , srv254746344:85 , srv263264517:85 , srv346856668:85 , srv388754598:85 , srv418228527:85 , srv438230171:85 , srv479565015:85 , srv719499368:85 , srv732669832:85 , srv792830922:85 , srv794713600:85 , srv820460700:85 , srv841930279:85 , srv844456896:85 , srv873206553:85 , srv884673201:85 , srv898411181:85 , srv1349631790:86 , srv1986693979:86 , srv204660955:86 , srv2108646594:86 , srv5858927:638 }
2023-05-05 21:53:40,730 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-05-05 21:53:40,731 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv738155301=87, srv1349631790=18, srv377795708=69, srv446441798=74, srv1986693979=57, srv61769824=83, srv1104637956=5, srv479565015=76, srv1125494311=6, srv423803195=72, srv1273252226=13, srv1325000511=16, srv1485958639=29, srv475667110=75, srv873206553=95, srv346856668=68, srv719499368=85, srv1545616941=37, srv1176712219=9, srv146766421=27, srv1858906621=54, srv1803489393=50, srv841930279=93, srv1176057305=8, srv1621000152=42, srv1067380250=4, srv792830922=88, srv884673201=96, srv1476144442=28, srv204660955=58, srv1222506182=10, srv418228527=71, srv1425394657=25, srv1488202889=30, srv1609674170=40, srv263264517=66, srv1497113366=32, srv678063674=84, srv559565979=80, srv898411181=97, srv1674649220=43, srv172425998=44, srv1759564392=49, srv1397043598=21, srv1620457803=41, srv1065664989=3, srv933740393=99, srv1287800268=14, srv1309363563=15, srv732669832=86, srv1954062761=56, srv548363619=78, srv1755777723=48, srv549786612=79, srv1520935832=33, srv1539006269=35, srv5858927=81, srv1492333508=31, srv491135328=77, srv240613773=64, srv2123116319=63, srv159680990=38, srv1808098695=51, srv137097010=20, srv1417652179=24, srv1060895493=2, srv1540865232=36, srv841111061=92, srv1746232265=46, srv1013780056=0, srv844456896=94, srv1347049731=17, srv2066132569=60, srv820460700=91, srv906678537=98, srv1269710662=11, srv1522359005=34, srv797181729=90, srv794713600=89, srv272996431=67, srv388754598=70, srv438230171=73, srv1456165265=26, srv2085479205=61, srv1753550613=47, srv1812575051=52, srv2108646594=62, srv1130085172=7, srv1940643464=55, srv2060028046=59, srv1358594204=19, srv254746344=65, srv1403733195=22, srv141323346=23, srv1728431265=45, srv101432701=1, srv59826110=82, srv1858359411=53, srv1271217733=12, srv1601590993=39} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-05-05 21:53:40,749 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-05-05 21:53:40,749 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-05-05 21:53:40,749 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-05-05 21:53:40,749 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-05-05 21:53:40,749 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-05-05 21:53:40,749 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-05-05 21:53:40,750 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-05-05 21:53:40,750 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-05-05 21:53:40,751 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-05-05 21:53:40,751 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-05-05 21:53:40,751 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-05-05 21:53:40,751 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-05-05 21:53:40,751 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-05-05 21:53:40,751 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-05-05 21:53:40,751 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-05-05 21:53:40,751 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-05-05 21:53:40,751 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-05-05 21:53:40,751 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-05-05 21:53:40,751 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-05-05 21:53:40,751 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-05-05 21:53:40,751 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-05-05 21:53:40,752 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-05-05 21:53:40,752 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-05-05 21:53:40,752 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-05-05 21:53:40,752 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-05-05 21:53:40,752 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-05-05 21:53:40,752 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-05-05 21:53:40,752 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-05-05 21:53:40,752 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-05-05 21:53:40,752 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-05-05 21:53:40,752 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-05-05 21:53:40,752 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-05-05 21:53:40,752 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-05-05 21:53:40,752 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-05-05 21:53:40,752 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-05-05 21:53:40,752 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-05-05 21:53:40,752 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-05-05 21:53:40,752 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-05-05 21:53:40,752 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-05-05 21:53:40,752 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-05-05 21:53:40,752 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-05-05 21:53:40,753 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-05-05 21:53:40,753 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-05-05 21:53:40,753 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-05-05 21:53:40,753 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-05-05 21:53:40,753 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-05-05 21:53:40,753 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-05-05 21:53:40,753 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-05-05 21:53:40,753 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-05-05 21:53:40,753 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-05-05 21:53:40,753 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-05-05 21:53:40,753 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-05-05 21:53:40,753 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-05-05 21:53:40,753 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-05-05 21:53:40,753 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-05-05 21:53:40,754 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-05-05 21:53:40,754 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-05-05 21:53:40,754 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-05-05 21:53:40,754 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-05-05 21:53:40,754 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-05-05 21:53:40,754 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-05-05 21:53:40,754 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-05-05 21:53:40,754 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-05-05 21:53:40,754 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-05-05 21:53:40,755 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-05-05 21:53:40,755 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-05-05 21:53:40,755 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-05-05 21:53:40,755 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-05-05 21:53:40,755 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-05-05 21:53:40,755 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-05-05 21:53:40,755 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-05-05 21:53:40,756 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-05-05 21:53:40,756 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-05-05 21:53:40,756 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-05-05 21:53:40,756 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-05-05 21:53:40,756 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-05-05 21:53:40,756 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-05-05 21:53:40,756 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-05-05 21:53:40,756 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-05-05 21:53:40,756 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-05-05 21:53:40,757 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-05-05 21:53:40,757 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-05-05 21:53:40,757 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-05-05 21:53:40,757 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-05-05 21:53:40,757 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-05-05 21:53:40,757 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-05-05 21:53:40,757 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-05-05 21:53:40,757 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-05-05 21:53:40,757 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-05-05 21:53:40,757 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-05-05 21:53:40,758 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-05-05 21:53:40,758 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-05-05 21:53:40,758 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-05-05 21:53:40,758 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-05-05 21:53:40,758 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-05-05 21:53:40,758 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-05-05 21:53:40,758 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-05-05 21:53:40,758 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-05-05 21:53:40,758 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-05-05 21:53:40,758 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-05-05 21:53:40,759 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-05-05 21:53:40,906 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=4.178341294946416E-4); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0018951174787165373); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=4.178341294946416E-4); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=5.0E-4); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-05-05 21:53:40,907 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-05-05 21:53:40,907 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=5.55569559732249E-5, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=4.178341294946416E-4); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0018951174787165373); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=4.178341294946416E-4); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=5.0E-4); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-05-05 21:53:41,261 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 490 ms to try 5000 different iterations.  Found a solution that moves 29 regions; Going from a computed imbalance of 5.55569559732249E-5 to a new imbalance of 7.892484140489204E-6. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0017082358106351274); MoveCostFunction : (multiplier=7.0, imbalance=0.0032222222222222222); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-05-05 21:53:41,262 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1013780056:83 , srv1759564392:83 , srv2066132569:83 , srv418228527:83 , srv479565015:83 , srv841111061:83 , srv884673201:83 , srv1060895493:84 , srv1065664989:84 , srv1067380250:84 , srv1125494311:84 , srv1130085172:84 , srv1176057305:84 , srv1176712219:84 , srv1222506182:84 , srv1269710662:84 , srv1271217733:84 , srv1273252226:84 , srv1309363563:84 , srv1325000511:84 , srv1347049731:84 , srv1349631790:84 , srv1358594204:84 , srv137097010:84 , srv1403733195:84 , srv141323346:84 , srv1417652179:84 , srv1456165265:84 , srv146766421:84 , srv1476144442:84 , srv1485958639:84 , srv1488202889:84 , srv1492333508:84 , srv1497113366:84 , srv1520935832:84 , srv1522359005:84 , srv1539006269:84 , srv1540865232:84 , srv1545616941:84 , srv159680990:84 , srv1601590993:84 , srv1609674170:84 , srv1620457803:84 , srv1621000152:84 , srv1674649220:84 , srv172425998:84 , srv1728431265:84 , srv1746232265:84 , srv1753550613:84 , srv1755777723:84 , srv1803489393:84 , srv1808098695:84 , srv1812575051:84 , srv1858359411:84 , srv1858906621:84 , srv1940643464:84 , srv1954062761:84 , srv1986693979:84 , srv204660955:84 , srv2060028046:84 , srv2085479205:84 , srv2108646594:84 , srv2123116319:84 , srv240613773:84 , srv254746344:84 , srv263264517:84 , srv272996431:84 , srv346856668:84 , srv377795708:84 , srv388754598:84 , srv423803195:84 , srv438230171:84 , srv475667110:84 , srv491135328:84 , srv548363619:84 , srv549786612:84 , srv559565979:84 , srv61769824:84 , srv678063674:84 , srv719499368:84 , srv732669832:84 , srv738155301:84 , srv792830922:84 , srv794713600:84 , srv797181729:84 , srv820460700:84 , srv841930279:84 , srv844456896:84 , srv873206553:84 , srv898411181:84 , srv906678537:84 , srv933740393:84 , srv101432701:85 , srv1104637956:85 , srv1287800268:85 , srv1397043598:85 , srv1425394657:85 , srv446441798:85 , srv59826110:85 , srv5858927:684 }
2023-05-05 21:53:41,266 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-05-05 21:53:41,266 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv738155301=87, srv1349631790=18, srv377795708=69, srv446441798=74, srv1986693979=57, srv61769824=83, srv1104637956=5, srv479565015=76, srv1125494311=6, srv423803195=72, srv1273252226=13, srv1325000511=16, srv1485958639=29, srv475667110=75, srv873206553=95, srv346856668=68, srv719499368=85, srv1545616941=37, srv1176712219=9, srv146766421=27, srv1858906621=54, srv1803489393=50, srv841930279=93, srv1176057305=8, srv1621000152=42, srv1067380250=4, srv792830922=88, srv884673201=96, srv1476144442=28, srv204660955=58, srv1222506182=10, srv418228527=71, srv1425394657=25, srv1488202889=30, srv1609674170=40, srv263264517=66, srv1497113366=32, srv678063674=84, srv559565979=80, srv898411181=97, srv1674649220=43, srv172425998=44, srv1759564392=49, srv1397043598=21, srv1620457803=41, srv1065664989=3, srv933740393=99, srv1287800268=14, srv1309363563=15, srv732669832=86, srv1954062761=56, srv548363619=78, srv1755777723=48, srv549786612=79, srv1520935832=33, srv1539006269=35, srv5858927=81, srv1492333508=31, srv491135328=77, srv240613773=64, srv2123116319=63, srv159680990=38, srv1808098695=51, srv137097010=20, srv1417652179=24, srv1060895493=2, srv1540865232=36, srv841111061=92, srv1746232265=46, srv1013780056=0, srv844456896=94, srv1347049731=17, srv2066132569=60, srv820460700=91, srv906678537=98, srv1269710662=11, srv1522359005=34, srv797181729=90, srv794713600=89, srv272996431=67, srv388754598=70, srv438230171=73, srv1456165265=26, srv2085479205=61, srv1753550613=47, srv1812575051=52, srv2108646594=62, srv1130085172=7, srv1940643464=55, srv2060028046=59, srv1358594204=19, srv254746344=65, srv1403733195=22, srv141323346=23, srv1728431265=45, srv101432701=1, srv59826110=82, srv1858359411=53, srv1271217733=12, srv1601590993=39} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-05-05 21:53:41,278 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-05-05 21:53:41,278 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-05-05 21:53:41,278 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-05-05 21:53:41,278 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-05-05 21:53:41,278 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-05-05 21:53:41,279 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-05-05 21:53:41,279 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-05-05 21:53:41,279 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-05-05 21:53:41,279 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-05-05 21:53:41,279 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-05-05 21:53:41,279 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-05-05 21:53:41,279 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-05-05 21:53:41,279 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-05-05 21:53:41,279 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-05-05 21:53:41,279 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-05-05 21:53:41,279 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-05-05 21:53:41,279 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-05-05 21:53:41,279 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-05-05 21:53:41,279 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-05-05 21:53:41,279 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-05-05 21:53:41,279 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-05-05 21:53:41,279 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-05-05 21:53:41,279 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-05-05 21:53:41,279 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-05-05 21:53:41,279 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-05-05 21:53:41,279 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-05-05 21:53:41,279 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-05-05 21:53:41,280 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-05-05 21:53:41,280 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-05-05 21:53:41,280 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-05-05 21:53:41,280 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-05-05 21:53:41,280 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-05-05 21:53:41,280 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-05-05 21:53:41,280 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-05-05 21:53:41,280 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-05-05 21:53:41,280 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-05-05 21:53:41,280 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-05-05 21:53:41,280 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-05-05 21:53:41,280 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-05-05 21:53:41,280 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-05-05 21:53:41,280 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-05-05 21:53:41,280 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-05-05 21:53:41,280 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-05-05 21:53:41,280 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-05-05 21:53:41,280 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-05-05 21:53:41,280 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-05-05 21:53:41,280 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-05-05 21:53:41,281 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-05-05 21:53:41,281 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-05-05 21:53:41,281 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-05-05 21:53:41,281 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-05-05 21:53:41,281 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-05-05 21:53:41,281 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-05-05 21:53:41,281 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-05-05 21:53:41,281 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-05-05 21:53:41,281 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-05-05 21:53:41,281 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-05-05 21:53:41,281 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-05-05 21:53:41,282 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-05-05 21:53:41,282 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-05-05 21:53:41,282 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-05-05 21:53:41,282 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-05-05 21:53:41,282 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-05-05 21:53:41,282 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-05-05 21:53:41,282 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-05-05 21:53:41,282 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-05-05 21:53:41,282 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-05-05 21:53:41,282 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-05-05 21:53:41,282 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-05-05 21:53:41,282 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-05-05 21:53:41,283 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-05-05 21:53:41,283 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-05-05 21:53:41,283 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-05-05 21:53:41,283 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-05-05 21:53:41,283 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-05-05 21:53:41,283 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-05-05 21:53:41,283 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-05-05 21:53:41,283 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-05-05 21:53:41,283 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-05-05 21:53:41,283 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-05-05 21:53:41,283 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-05-05 21:53:41,283 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-05-05 21:53:41,283 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-05-05 21:53:41,284 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-05-05 21:53:41,284 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-05-05 21:53:41,284 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-05-05 21:53:41,284 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-05-05 21:53:41,284 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-05-05 21:53:41,284 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-05-05 21:53:41,284 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-05-05 21:53:41,284 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-05-05 21:53:41,284 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-05-05 21:53:41,284 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-05-05 21:53:41,285 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-05-05 21:53:41,285 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-05-05 21:53:41,285 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-05-05 21:53:41,285 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-05-05 21:53:41,285 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-05-05 21:53:41,285 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-05-05 21:53:41,285 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-05-05 21:53:41,285 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-05-05 21:53:41,404 INFO  [Time-limited test] balancer.StochasticLoadBalancer(381): Cluster wide - skipping load balancing because weighted average imbalance=7.689421800350782E-6 <= threshold(0.025). If you want more aggressive balancing, either lower hbase.master.balancer.stochastic.minCostNeedBalance from 0.025 or increase the relative multiplier(s) of the specific cost function(s). functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0017082358106351274); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-05-05 21:53:41,404 INFO  [Time-limited test] balancer.BalancerTestBase(570): Mock Final balance: { srv1013780056:83 , srv1759564392:83 , srv2066132569:83 , srv418228527:83 , srv479565015:83 , srv841111061:83 , srv884673201:83 , srv1060895493:84 , srv1065664989:84 , srv1067380250:84 , srv1125494311:84 , srv1130085172:84 , srv1176057305:84 , srv1176712219:84 , srv1222506182:84 , srv1269710662:84 , srv1271217733:84 , srv1273252226:84 , srv1309363563:84 , srv1325000511:84 , srv1347049731:84 , srv1349631790:84 , srv1358594204:84 , srv137097010:84 , srv1403733195:84 , srv141323346:84 , srv1417652179:84 , srv1456165265:84 , srv146766421:84 , srv1476144442:84 , srv1485958639:84 , srv1488202889:84 , srv1492333508:84 , srv1497113366:84 , srv1520935832:84 , srv1522359005:84 , srv1539006269:84 , srv1540865232:84 , srv1545616941:84 , srv159680990:84 , srv1601590993:84 , srv1609674170:84 , srv1620457803:84 , srv1621000152:84 , srv1674649220:84 , srv172425998:84 , srv1728431265:84 , srv1746232265:84 , srv1753550613:84 , srv1755777723:84 , srv1803489393:84 , srv1808098695:84 , srv1812575051:84 , srv1858359411:84 , srv1858906621:84 , srv1940643464:84 , srv1954062761:84 , srv1986693979:84 , srv204660955:84 , srv2060028046:84 , srv2085479205:84 , srv2108646594:84 , srv2123116319:84 , srv240613773:84 , srv254746344:84 , srv263264517:84 , srv272996431:84 , srv346856668:84 , srv377795708:84 , srv388754598:84 , srv423803195:84 , srv438230171:84 , srv475667110:84 , srv491135328:84 , srv548363619:84 , srv549786612:84 , srv559565979:84 , srv61769824:84 , srv678063674:84 , srv719499368:84 , srv732669832:84 , srv738155301:84 , srv792830922:84 , srv794713600:84 , srv797181729:84 , srv820460700:84 , srv841930279:84 , srv844456896:84 , srv873206553:84 , srv898411181:84 , srv906678537:84 , srv933740393:84 , srv101432701:85 , srv1104637956:85 , srv1287800268:85 , srv1397043598:85 , srv1425394657:85 , srv446441798:85 , srv59826110:85 , srv5858927:684 }
2023-05-05 21:53:41,435 INFO  [Time-limited test] hbase.ResourceChecker(175): after: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnLargeClusterWithRacks Thread=10 (was 10), OpenFileDescriptor=260 (was 260), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=393 (was 358) - SystemLoadAverage LEAK? -, ProcessCount=179 (was 179), AvailableMemoryMB=4376 (was 5257)
2023-05-05 21:53:41,448 INFO  [Time-limited test] hbase.ResourceChecker(147): before: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnMidClusterWithRacks Thread=10, OpenFileDescriptor=260, MaxFileDescriptor=60000, SystemLoadAverage=393, ProcessCount=179, AvailableMemoryMB=4379
2023-05-05 21:53:41,449 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2023-05-05 21:53:41,449 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=5000, runMaxSteps=true, stepsPerRegion=800, maxRunningTime=120000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 111077.0 etc.
2023-05-05 21:53:41,458 INFO  [Time-limited test] balancer.BalancerTestBase(547): Mock Cluster : { srv1066279:84 , srv1193859081:84 , srv1245352249:84 , srv125839757:84 , srv1423014435:84 , srv1451713423:84 , srv1526517759:84 , srv1563549573:84 , srv1683425429:84 , srv1750780472:84 , srv1763174355:84 , srv1872436810:84 , srv1898089879:84 , srv2017114004:84 , srv2028279664:84 , srv2048323703:84 , srv206766257:84 , srv230198585:84 , srv240633699:84 , srv251014428:84 , srv299332560:84 , srv316636103:84 , srv429625469:84 , srv630874166:84 , srv679729613:84 , srv784760302:84 , srv824292307:84 , srv922692338:84 , srv989263379:84 , srv1237276619:264 } [srvr=30 rgns=2700 avg=90.0 max=90 min=90]
2023-05-05 21:53:41,460 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-05-05 21:53:41,460 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv2028279664=15, srv251014428=20, srv922692338=28, srv240633699=19, srv1898089879=13, srv989263379=29, srv1750780472=10, srv206766257=17, srv1563549573=8, srv679729613=25, srv1451713423=6, srv1526517759=7, srv630874166=24, srv1423014435=5, srv429625469=23, srv1193859081=1, srv1763174355=11, srv784760302=26, srv230198585=18, srv316636103=22, srv299332560=21, srv125839757=4, srv1683425429=9, srv1066279=0, srv824292307=27, srv2048323703=16, srv1237276619=2, srv1872436810=12, srv2017114004=14, srv1245352249=3} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-05-05 21:53:41,470 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-05-05 21:53:41,471 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-05-05 21:53:41,471 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-05-05 21:53:41,471 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-05-05 21:53:41,471 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-05-05 21:53:41,471 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-05-05 21:53:41,471 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-05-05 21:53:41,471 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-05-05 21:53:41,471 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-05-05 21:53:41,471 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-05-05 21:53:41,471 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-05-05 21:53:41,471 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-05-05 21:53:41,471 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-05-05 21:53:41,471 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-05-05 21:53:41,472 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-05-05 21:53:41,472 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-05-05 21:53:41,472 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-05-05 21:53:41,472 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-05-05 21:53:41,472 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-05-05 21:53:41,472 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-05-05 21:53:41,472 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-05-05 21:53:41,472 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-05-05 21:53:41,472 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-05-05 21:53:41,472 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-05-05 21:53:41,472 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-05-05 21:53:41,472 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-05-05 21:53:41,472 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-05-05 21:53:41,473 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-05-05 21:53:41,473 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-05-05 21:53:41,473 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-05-05 21:53:41,473 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=10, number of hosts=30, number of racks=4
2023-05-05 21:53:41,493 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=1.057872657432134, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-05-05 21:53:41,493 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.9912375398118134, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=1.057872657432134, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=64800000
2023-05-05 21:55:41,476 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 120001 ms to try 5889218 different iterations.  Found a solution that moves 1857 regions; Going from a computed imbalance of 0.9912375398118134 to a new imbalance of 4.334330639506329E-5. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); MoveCostFunction : (multiplier=7.0, imbalance=0.6877777777777778, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-05-05 21:55:41,482 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1066279:90 , srv1193859081:90 , srv1237276619:90 , srv1245352249:90 , srv125839757:90 , srv1423014435:90 , srv1451713423:90 , srv1526517759:90 , srv1563549573:90 , srv1683425429:90 , srv1750780472:90 , srv1763174355:90 , srv1872436810:90 , srv1898089879:90 , srv2017114004:90 , srv2028279664:90 , srv2048323703:90 , srv206766257:90 , srv230198585:90 , srv240633699:90 , srv251014428:90 , srv299332560:90 , srv316636103:90 , srv429625469:90 , srv630874166:90 , srv679729613:90 , srv784760302:90 , srv824292307:90 , srv922692338:90 , srv989263379:90 }
2023-05-05 21:55:41,483 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-05-05 21:55:41,484 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv2028279664=15, srv251014428=20, srv922692338=28, srv240633699=19, srv1898089879=13, srv989263379=29, srv1750780472=10, srv206766257=17, srv1563549573=8, srv679729613=25, srv1451713423=6, srv1526517759=7, srv630874166=24, srv1423014435=5, srv429625469=23, srv1193859081=1, srv1763174355=11, srv784760302=26, srv230198585=18, srv316636103=22, srv299332560=21, srv125839757=4, srv1683425429=9, srv1066279=0, srv824292307=27, srv2048323703=16, srv1237276619=2, srv1872436810=12, srv2017114004=14, srv1245352249=3} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-05-05 21:55:41,487 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-05-05 21:55:41,487 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-05-05 21:55:41,487 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-05-05 21:55:41,487 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-05-05 21:55:41,487 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-05-05 21:55:41,487 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-05-05 21:55:41,487 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-05-05 21:55:41,487 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-05-05 21:55:41,487 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-05-05 21:55:41,487 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-05-05 21:55:41,487 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-05-05 21:55:41,487 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-05-05 21:55:41,487 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-05-05 21:55:41,487 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-05-05 21:55:41,487 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-05-05 21:55:41,487 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-05-05 21:55:41,488 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-05-05 21:55:41,488 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-05-05 21:55:41,488 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-05-05 21:55:41,488 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-05-05 21:55:41,488 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-05-05 21:55:41,488 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-05-05 21:55:41,488 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-05-05 21:55:41,488 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-05-05 21:55:41,488 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-05-05 21:55:41,488 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-05-05 21:55:41,488 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-05-05 21:55:41,488 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-05-05 21:55:41,488 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-05-05 21:55:41,488 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-05-05 21:55:41,488 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=10, number of hosts=30, number of racks=4
2023-05-05 21:55:41,507 INFO  [Time-limited test] balancer.StochasticLoadBalancer(381): Cluster wide - skipping load balancing because weighted average imbalance=0.0 <= threshold(0.025). If you want more aggressive balancing, either lower hbase.master.balancer.stochastic.minCostNeedBalance from 0.025 or increase the relative multiplier(s) of the specific cost function(s). functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-05-05 21:55:41,507 INFO  [Time-limited test] balancer.BalancerTestBase(570): Mock Final balance: { srv1066279:90 , srv1193859081:90 , srv1237276619:90 , srv1245352249:90 , srv125839757:90 , srv1423014435:90 , srv1451713423:90 , srv1526517759:90 , srv1563549573:90 , srv1683425429:90 , srv1750780472:90 , srv1763174355:90 , srv1872436810:90 , srv1898089879:90 , srv2017114004:90 , srv2028279664:90 , srv2048323703:90 , srv206766257:90 , srv230198585:90 , srv240633699:90 , srv251014428:90 , srv299332560:90 , srv316636103:90 , srv429625469:90 , srv630874166:90 , srv679729613:90 , srv784760302:90 , srv824292307:90 , srv922692338:90 , srv989263379:90 }
2023-05-05 21:55:41,524 INFO  [Time-limited test] hbase.ResourceChecker(175): after: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnMidClusterWithRacks Thread=9 (was 10), OpenFileDescriptor=260 (was 260), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=206 (was 393), ProcessCount=179 (was 179), AvailableMemoryMB=4565 (was 4379) - AvailableMemoryMB LEAK? -