2023-07-18 09:53:11,466 INFO  [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks timeout: 13 mins
2023-07-18 09:53:11,789 WARN  [Time-limited test] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties
2023-07-18 09:53:11,911 INFO  [Time-limited test] metrics.MetricRegistriesLoader(60): Loaded MetricRegistries class org.apache.hadoop.hbase.metrics.impl.MetricRegistriesImpl
2023-07-18 09:53:11,976 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2023-07-18 09:53:11,984 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc.
2023-07-18 09:53:12,000 INFO  [Time-limited test] hbase.ResourceChecker(147): before: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnLargeClusterWithRacks Thread=12, OpenFileDescriptor=263, MaxFileDescriptor=60000, SystemLoadAverage=400, ProcessCount=173, AvailableMemoryMB=7503
2023-07-18 09:53:12,002 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2023-07-18 09:53:12,002 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=5000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=10000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc.
2023-07-18 09:53:12,160 INFO  [Time-limited test] balancer.BalancerTestBase(547): Mock Cluster : { srv1040004791:84 , srv1056095943:84 , srv1066291526:84 , srv1081685755:84 , srv1112031058:84 , srv1127412855:84 , srv1128722504:84 , srv1129966624:84 , srv1168886090:84 , srv1170900167:84 , srv1172056506:84 , srv118109733:84 , srv1226411393:84 , srv1244435984:84 , srv1259073025:84 , srv1294628448:84 , srv130498449:84 , srv1353442047:84 , srv1360073979:84 , srv1367532665:84 , srv137493061:84 , srv1376931144:84 , srv1377384548:84 , srv1410428559:84 , srv1429567334:84 , srv1450270635:84 , srv1491016983:84 , srv1491897794:84 , srv1497420800:84 , srv1525010224:84 , srv1546656273:84 , srv1568555885:84 , srv1570437316:84 , srv1635937952:84 , srv1637558185:84 , srv1691650208:84 , srv1703754087:84 , srv1760931353:84 , srv1836944261:84 , srv1840221071:84 , srv1872991902:84 , srv1909311796:84 , srv1909475245:84 , srv1911191083:84 , srv193747532:84 , srv194548074:84 , srv1966635040:84 , srv1985527141:84 , srv1986987964:84 , srv1992590418:84 , srv2021124054:84 , srv2057081870:84 , srv2124147502:84 , srv2138067315:84 , srv2141120019:84 , srv228580640:84 , srv229121506:84 , srv265717540:84 , srv281207008:84 , srv282841838:84 , srv293594691:84 , srv315923330:84 , srv360882830:84 , srv37831980:84 , srv404867802:84 , srv408305420:84 , srv409785724:84 , srv443119061:84 , srv456405346:84 , srv458750034:84 , srv496684375:84 , srv507660741:84 , srv512119981:84 , srv520604596:84 , srv527351443:84 , srv530367749:84 , srv556042870:84 , srv557994528:84 , srv590964965:84 , srv621206354:84 , srv648394008:84 , srv655239866:84 , srv665894793:84 , srv691942416:84 , srv716312882:84 , srv719027909:84 , srv799874990:84 , srv819111662:84 , srv836020899:84 , srv839624158:84 , srv84130841:84 , srv869545883:84 , srv881297944:84 , srv891713641:84 , srv905061427:84 , srv941795676:84 , srv945212785:84 , srv960093439:84 , srv998504815:84 , srv1390051695:684 } [srvr=100 rgns=9000 avg=90.0 max=90 min=90]
2023-07-18 09:53:12,173 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-07-18 09:53:12,180 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv869545883=92, srv1691650208=36, srv1353442047=17, srv1760931353=38, srv716312882=85, srv194548074=46, srv456405346=69, srv556042870=77, srv2124147502=53, srv84130841=91, srv665894793=83, srv2021124054=51, srv2138067315=54, srv1360073979=18, srv1546656273=31, srv1840221071=40, srv1410428559=24, srv1909311796=42, srv819111662=88, srv37831980=64, srv839624158=90, srv520604596=74, srv1525010224=30, srv799874990=87, srv1112031058=4, srv1259073025=14, srv881297944=93, srv1703754087=37, srv229121506=57, srv891713641=94, srv2057081870=52, srv1128722504=6, srv1986987964=49, srv621206354=80, srv281207008=59, srv1985527141=48, srv1966635040=47, srv1056095943=1, srv1872991902=41, srv1040004791=0, srv905061427=95, srv458750034=70, srv1244435984=13, srv1226411393=12, srv1909475245=43, srv315923330=62, srv945212785=97, srv1170900167=9, srv512119981=73, srv1376931144=21, srv408305420=66, srv941795676=96, srv1367532665=19, srv193747532=45, srv130498449=16, srv1066291526=2, srv1429567334=25, srv998504815=99, srv1911191083=44, srv1491016983=27, srv1172056506=10, srv496684375=71, srv137493061=20, srv1491897794=28, srv1127412855=5, srv1637558185=35, srv1570437316=33, srv409785724=67, srv527351443=75, srv1635937952=34, srv282841838=60, srv404867802=65, srv648394008=81, srv530367749=76, srv836020899=89, srv1168886090=8, srv228580640=56, srv557994528=78, srv1294628448=15, srv1836944261=39, srv590964965=79, srv691942416=84, srv1129966624=7, srv265717540=58, srv443119061=68, srv960093439=98, srv507660741=72, srv719027909=86, srv2141120019=55, srv655239866=82, srv1568555885=32, srv1450270635=26, srv118109733=11, srv1992590418=50, srv293594691=61, srv1497420800=29, srv1377384548=22, srv1390051695=23, srv360882830=63, srv1081685755=3} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-07-18 09:53:12,282 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-07-18 09:53:12,282 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-07-18 09:53:12,282 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-07-18 09:53:12,283 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-07-18 09:53:12,283 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-07-18 09:53:12,283 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-07-18 09:53:12,283 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-07-18 09:53:12,283 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-07-18 09:53:12,283 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-07-18 09:53:12,284 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-07-18 09:53:12,284 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-07-18 09:53:12,284 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-07-18 09:53:12,284 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-07-18 09:53:12,284 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-07-18 09:53:12,284 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-07-18 09:53:12,285 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-07-18 09:53:12,285 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-07-18 09:53:12,285 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-07-18 09:53:12,285 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-07-18 09:53:12,285 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-07-18 09:53:12,285 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-07-18 09:53:12,285 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-07-18 09:53:12,286 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-07-18 09:53:12,286 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-07-18 09:53:12,286 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-07-18 09:53:12,286 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-07-18 09:53:12,286 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-07-18 09:53:12,286 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-07-18 09:53:12,286 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-07-18 09:53:12,287 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-07-18 09:53:12,287 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-07-18 09:53:12,287 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-07-18 09:53:12,287 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-07-18 09:53:12,287 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-07-18 09:53:12,287 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-07-18 09:53:12,288 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-07-18 09:53:12,288 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-07-18 09:53:12,288 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-07-18 09:53:12,288 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-07-18 09:53:12,288 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-07-18 09:53:12,288 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-07-18 09:53:12,289 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-07-18 09:53:12,289 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-07-18 09:53:12,289 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-07-18 09:53:12,289 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-07-18 09:53:12,289 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-07-18 09:53:12,289 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-07-18 09:53:12,289 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-07-18 09:53:12,290 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-07-18 09:53:12,290 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-07-18 09:53:12,290 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-07-18 09:53:12,290 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-07-18 09:53:12,290 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-07-18 09:53:12,290 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-07-18 09:53:12,291 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-07-18 09:53:12,291 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-07-18 09:53:12,291 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-07-18 09:53:12,291 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-07-18 09:53:12,291 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-07-18 09:53:12,291 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-07-18 09:53:12,291 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-07-18 09:53:12,291 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-07-18 09:53:12,291 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-07-18 09:53:12,291 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-07-18 09:53:12,291 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-07-18 09:53:12,291 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-07-18 09:53:12,292 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-07-18 09:53:12,292 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-07-18 09:53:12,292 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-07-18 09:53:12,292 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-07-18 09:53:12,292 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-07-18 09:53:12,292 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-07-18 09:53:12,292 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-07-18 09:53:12,292 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-07-18 09:53:12,292 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-07-18 09:53:12,292 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-07-18 09:53:12,292 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-07-18 09:53:12,292 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-07-18 09:53:12,293 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-07-18 09:53:12,293 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-07-18 09:53:12,293 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-07-18 09:53:12,293 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-07-18 09:53:12,293 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-07-18 09:53:12,293 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-07-18 09:53:12,293 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-07-18 09:53:12,293 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-07-18 09:53:12,293 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-07-18 09:53:12,293 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-07-18 09:53:12,293 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-07-18 09:53:12,293 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-07-18 09:53:12,293 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-07-18 09:53:12,294 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-07-18 09:53:12,294 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-07-18 09:53:12,294 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-07-18 09:53:12,294 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-07-18 09:53:12,294 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-07-18 09:53:12,294 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-07-18 09:53:12,294 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-07-18 09:53:12,294 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-07-18 09:53:12,294 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-07-18 09:53:12,294 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-07-18 09:53:12,473 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.06666666666666667, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-07-18 09:53:12,473 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-07-18 09:53:12,474 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.9909252140407105, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.06666666666666667, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-07-18 09:53:12,892 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 580 ms to try 5000 different iterations.  Found a solution that moves 4674 regions; Going from a computed imbalance of 0.9909252140407105 to a new imbalance of 0.1809020173951716. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.041183392640786194, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.05510320894796996, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.5193333333333333, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.041183392640786194, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.17633333333333334, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.24075, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-07-18 09:53:12,912 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv193747532:82 , srv443119061:82 , srv1056095943:83 , srv1168886090:83 , srv130498449:83 , srv137493061:83 , srv1568555885:83 , srv1911191083:83 , srv282841838:83 , srv408305420:83 , srv512119981:83 , srv839624158:83 , srv1066291526:84 , srv1244435984:84 , srv1491897794:84 , srv1497420800:84 , srv1840221071:84 , srv1985527141:84 , srv2021124054:84 , srv2138067315:84 , srv37831980:84 , srv404867802:84 , srv456405346:84 , srv458750034:84 , srv590964965:84 , srv621206354:84 , srv648394008:84 , srv819111662:84 , srv836020899:84 , srv881297944:84 , srv941795676:84 , srv998504815:84 , srv1127412855:85 , srv1635937952:85 , srv1909475245:85 , srv1992590418:85 , srv2057081870:85 , srv229121506:85 , srv265717540:85 , srv655239866:85 , srv691942416:85 , srv719027909:85 , srv891713641:85 , srv960093439:85 , srv1040004791:86 , srv118109733:86 , srv1360073979:86 , srv1367532665:86 , srv1691650208:86 , srv1836944261:86 , srv1872991902:86 , srv1986987964:86 , srv2124147502:86 , srv360882830:86 , srv557994528:86 , srv84130841:86 , srv905061427:86 , srv1170900167:87 , srv1226411393:87 , srv1259073025:87 , srv1377384548:87 , srv1429567334:87 , srv1491016983:87 , srv1525010224:87 , srv194548074:87 , srv228580640:87 , srv409785724:87 , srv507660741:87 , srv530367749:87 , srv799874990:87 , srv1112031058:88 , srv1128722504:88 , srv1129966624:88 , srv1450270635:88 , srv1570437316:88 , srv556042870:88 , srv869545883:88 , srv945212785:88 , srv1081685755:89 , srv1353442047:89 , srv1410428559:89 , srv1703754087:89 , srv1760931353:89 , srv1909311796:89 , srv1966635040:89 , srv293594691:89 , srv315923330:89 , srv520604596:89 , srv665894793:89 , srv716312882:90 , srv1294628448:91 , srv1376931144:91 , srv1637558185:91 , srv281207008:91 , srv1172056506:92 , srv2141120019:92 , srv1546656273:93 , srv496684375:93 , srv527351443:94 , srv1390051695:456 }
2023-07-18 09:53:12,916 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-07-18 09:53:12,918 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv869545883=92, srv1691650208=36, srv1353442047=17, srv1760931353=38, srv716312882=85, srv194548074=46, srv456405346=69, srv556042870=77, srv2124147502=53, srv84130841=91, srv665894793=83, srv2021124054=51, srv2138067315=54, srv1360073979=18, srv1546656273=31, srv1840221071=40, srv1410428559=24, srv1909311796=42, srv819111662=88, srv37831980=64, srv839624158=90, srv520604596=74, srv1525010224=30, srv799874990=87, srv1112031058=4, srv1259073025=14, srv881297944=93, srv1703754087=37, srv229121506=57, srv891713641=94, srv2057081870=52, srv1128722504=6, srv1986987964=49, srv621206354=80, srv281207008=59, srv1985527141=48, srv1966635040=47, srv1056095943=1, srv1872991902=41, srv1040004791=0, srv905061427=95, srv458750034=70, srv1244435984=13, srv1226411393=12, srv1909475245=43, srv315923330=62, srv945212785=97, srv1170900167=9, srv512119981=73, srv1376931144=21, srv408305420=66, srv941795676=96, srv1367532665=19, srv193747532=45, srv130498449=16, srv1066291526=2, srv1429567334=25, srv998504815=99, srv1911191083=44, srv1491016983=27, srv1172056506=10, srv496684375=71, srv137493061=20, srv1491897794=28, srv1127412855=5, srv1637558185=35, srv1570437316=33, srv409785724=67, srv527351443=75, srv1635937952=34, srv282841838=60, srv404867802=65, srv648394008=81, srv530367749=76, srv836020899=89, srv1168886090=8, srv228580640=56, srv557994528=78, srv1294628448=15, srv1836944261=39, srv590964965=79, srv691942416=84, srv1129966624=7, srv265717540=58, srv443119061=68, srv960093439=98, srv507660741=72, srv719027909=86, srv2141120019=55, srv655239866=82, srv1568555885=32, srv1450270635=26, srv118109733=11, srv1992590418=50, srv293594691=61, srv1497420800=29, srv1377384548=22, srv1390051695=23, srv360882830=63, srv1081685755=3} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-07-18 09:53:12,936 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-07-18 09:53:12,936 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-07-18 09:53:12,936 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-07-18 09:53:12,936 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-07-18 09:53:12,936 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-07-18 09:53:12,936 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-07-18 09:53:12,936 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-07-18 09:53:12,936 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-07-18 09:53:12,937 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-07-18 09:53:12,937 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-07-18 09:53:12,937 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-07-18 09:53:12,937 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-07-18 09:53:12,937 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-07-18 09:53:12,937 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-07-18 09:53:12,937 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-07-18 09:53:12,937 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-07-18 09:53:12,937 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-07-18 09:53:12,937 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-07-18 09:53:12,937 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-07-18 09:53:12,937 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-07-18 09:53:12,937 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-07-18 09:53:12,938 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-07-18 09:53:12,938 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-07-18 09:53:12,938 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-07-18 09:53:12,938 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-07-18 09:53:12,938 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-07-18 09:53:12,938 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-07-18 09:53:12,938 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-07-18 09:53:12,938 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-07-18 09:53:12,938 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-07-18 09:53:12,938 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-07-18 09:53:12,938 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-07-18 09:53:12,938 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-07-18 09:53:12,938 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-07-18 09:53:12,938 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-07-18 09:53:12,939 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-07-18 09:53:12,939 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-07-18 09:53:12,939 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-07-18 09:53:12,939 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-07-18 09:53:12,939 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-07-18 09:53:12,939 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-07-18 09:53:12,939 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-07-18 09:53:12,939 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-07-18 09:53:12,939 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-07-18 09:53:12,939 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-07-18 09:53:12,939 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-07-18 09:53:12,939 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-07-18 09:53:12,939 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-07-18 09:53:12,940 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-07-18 09:53:12,940 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-07-18 09:53:12,940 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-07-18 09:53:12,940 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-07-18 09:53:12,940 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-07-18 09:53:12,940 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-07-18 09:53:12,940 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-07-18 09:53:12,940 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-07-18 09:53:12,940 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-07-18 09:53:12,940 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-07-18 09:53:12,941 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-07-18 09:53:12,941 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-07-18 09:53:12,941 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-07-18 09:53:12,941 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-07-18 09:53:12,941 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-07-18 09:53:12,941 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-07-18 09:53:12,941 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-07-18 09:53:12,941 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-07-18 09:53:12,941 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-07-18 09:53:12,942 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-07-18 09:53:12,942 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-07-18 09:53:12,942 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-07-18 09:53:12,942 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-07-18 09:53:12,942 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-07-18 09:53:12,942 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-07-18 09:53:12,943 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-07-18 09:53:12,943 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-07-18 09:53:12,943 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-07-18 09:53:12,943 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-07-18 09:53:12,943 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-07-18 09:53:12,943 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-07-18 09:53:12,944 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-07-18 09:53:12,944 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-07-18 09:53:12,945 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-07-18 09:53:12,945 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-07-18 09:53:12,945 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-07-18 09:53:12,945 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-07-18 09:53:12,945 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-07-18 09:53:12,945 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-07-18 09:53:12,945 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-07-18 09:53:12,945 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-07-18 09:53:12,945 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-07-18 09:53:12,945 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-07-18 09:53:12,945 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-07-18 09:53:12,946 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-07-18 09:53:12,946 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-07-18 09:53:12,946 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-07-18 09:53:12,946 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-07-18 09:53:12,946 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-07-18 09:53:12,946 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-07-18 09:53:12,946 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-07-18 09:53:12,946 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-07-18 09:53:12,947 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-07-18 09:53:13,157 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.041183392640786194, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.05510320894796996, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.041183392640786194, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.17633333333333334, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.24075, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-07-18 09:53:13,157 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-07-18 09:53:13,157 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.180869289347661, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.041183392640786194, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.05510320894796996, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.041183392640786194, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.17633333333333334, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.24075, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-07-18 09:53:13,501 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 518 ms to try 5000 different iterations.  Found a solution that moves 2605 regions; Going from a computed imbalance of 0.180869289347661 to a new imbalance of 0.016147933688184457. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.022837716434259848); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.037172815091383406, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.28944444444444445, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.022837716434259848); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.013); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.04608333333333333, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-07-18 09:53:13,514 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1172056506:79 , srv1546656273:79 , srv281207008:79 , srv496684375:79 , srv1294628448:80 , srv527351443:80 , srv2141120019:81 , srv716312882:81 , srv1376931144:82 , srv1410428559:82 , srv1570437316:82 , srv293594691:82 , srv665894793:82 , srv869545883:82 , srv1128722504:83 , srv1170900167:83 , srv1259073025:83 , srv1450270635:83 , srv1491016983:83 , srv1760931353:83 , srv315923330:83 , srv409785724:83 , srv1040004791:84 , srv1081685755:84 , srv1112031058:84 , srv1377384548:84 , srv1703754087:84 , srv530367749:84 , srv556042870:84 , srv1127412855:85 , srv1129966624:85 , srv1226411393:85 , srv1353442047:85 , srv1429567334:85 , srv2124147502:85 , srv228580640:85 , srv360882830:85 , srv799874990:85 , srv84130841:85 , srv118109733:86 , srv1525010224:86 , srv1637558185:86 , srv1909311796:86 , srv194548074:86 , srv1966635040:86 , srv1985527141:86 , srv1986987964:86 , srv1992590418:86 , srv2138067315:86 , srv265717540:86 , srv507660741:86 , srv557994528:86 , srv590964965:86 , srv648394008:86 , srv691942416:86 , srv905061427:86 , srv941795676:86 , srv945212785:86 , srv130498449:87 , srv1360073979:87 , srv137493061:87 , srv1635937952:87 , srv1691650208:87 , srv1836944261:87 , srv1872991902:87 , srv2057081870:87 , srv229121506:87 , srv891713641:87 , srv998504815:87 , srv1056095943:88 , srv1066291526:88 , srv1168886090:88 , srv1367532665:88 , srv1491897794:88 , srv1909475245:88 , srv1911191083:88 , srv2021124054:88 , srv37831980:88 , srv404867802:88 , srv456405346:88 , srv512119981:88 , srv520604596:88 , srv719027909:88 , srv819111662:88 , srv836020899:88 , srv839624158:88 , srv960093439:88 , srv1497420800:89 , srv1568555885:89 , srv1840221071:89 , srv282841838:89 , srv458750034:89 , srv621206354:89 , srv655239866:89 , srv881297944:89 , srv1244435984:90 , srv193747532:90 , srv408305420:90 , srv443119061:90 , srv1390051695:521 }
2023-07-18 09:53:13,521 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-07-18 09:53:13,522 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv869545883=92, srv1691650208=36, srv1353442047=17, srv1760931353=38, srv716312882=85, srv194548074=46, srv456405346=69, srv556042870=77, srv2124147502=53, srv84130841=91, srv665894793=83, srv2021124054=51, srv2138067315=54, srv1360073979=18, srv1546656273=31, srv1840221071=40, srv1410428559=24, srv1909311796=42, srv819111662=88, srv37831980=64, srv839624158=90, srv520604596=74, srv1525010224=30, srv799874990=87, srv1112031058=4, srv1259073025=14, srv881297944=93, srv1703754087=37, srv229121506=57, srv891713641=94, srv2057081870=52, srv1128722504=6, srv1986987964=49, srv621206354=80, srv281207008=59, srv1985527141=48, srv1966635040=47, srv1056095943=1, srv1872991902=41, srv1040004791=0, srv905061427=95, srv458750034=70, srv1244435984=13, srv1226411393=12, srv1909475245=43, srv315923330=62, srv945212785=97, srv1170900167=9, srv512119981=73, srv1376931144=21, srv408305420=66, srv941795676=96, srv1367532665=19, srv193747532=45, srv130498449=16, srv1066291526=2, srv1429567334=25, srv998504815=99, srv1911191083=44, srv1491016983=27, srv1172056506=10, srv496684375=71, srv137493061=20, srv1491897794=28, srv1127412855=5, srv1637558185=35, srv1570437316=33, srv409785724=67, srv527351443=75, srv1635937952=34, srv282841838=60, srv404867802=65, srv648394008=81, srv530367749=76, srv836020899=89, srv1168886090=8, srv228580640=56, srv557994528=78, srv1294628448=15, srv1836944261=39, srv590964965=79, srv691942416=84, srv1129966624=7, srv265717540=58, srv443119061=68, srv960093439=98, srv507660741=72, srv719027909=86, srv2141120019=55, srv655239866=82, srv1568555885=32, srv1450270635=26, srv118109733=11, srv1992590418=50, srv293594691=61, srv1497420800=29, srv1377384548=22, srv1390051695=23, srv360882830=63, srv1081685755=3} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-07-18 09:53:13,541 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-07-18 09:53:13,541 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-07-18 09:53:13,541 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-07-18 09:53:13,541 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-07-18 09:53:13,542 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-07-18 09:53:13,542 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-07-18 09:53:13,542 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-07-18 09:53:13,542 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-07-18 09:53:13,542 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-07-18 09:53:13,542 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-07-18 09:53:13,542 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-07-18 09:53:13,542 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-07-18 09:53:13,543 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-07-18 09:53:13,543 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-07-18 09:53:13,543 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-07-18 09:53:13,543 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-07-18 09:53:13,543 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-07-18 09:53:13,543 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-07-18 09:53:13,543 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-07-18 09:53:13,543 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-07-18 09:53:13,544 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-07-18 09:53:13,544 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-07-18 09:53:13,544 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-07-18 09:53:13,544 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-07-18 09:53:13,544 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-07-18 09:53:13,544 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-07-18 09:53:13,544 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-07-18 09:53:13,544 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-07-18 09:53:13,545 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-07-18 09:53:13,545 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-07-18 09:53:13,545 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-07-18 09:53:13,545 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-07-18 09:53:13,545 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-07-18 09:53:13,545 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-07-18 09:53:13,545 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-07-18 09:53:13,545 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-07-18 09:53:13,546 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-07-18 09:53:13,546 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-07-18 09:53:13,546 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-07-18 09:53:13,546 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-07-18 09:53:13,546 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-07-18 09:53:13,546 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-07-18 09:53:13,546 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-07-18 09:53:13,546 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-07-18 09:53:13,546 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-07-18 09:53:13,547 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-07-18 09:53:13,547 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-07-18 09:53:13,547 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-07-18 09:53:13,547 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-07-18 09:53:13,547 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-07-18 09:53:13,547 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-07-18 09:53:13,547 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-07-18 09:53:13,547 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-07-18 09:53:13,547 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-07-18 09:53:13,548 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-07-18 09:53:13,548 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-07-18 09:53:13,548 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-07-18 09:53:13,548 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-07-18 09:53:13,548 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-07-18 09:53:13,548 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-07-18 09:53:13,548 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-07-18 09:53:13,548 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-07-18 09:53:13,548 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-07-18 09:53:13,549 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-07-18 09:53:13,549 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-07-18 09:53:13,549 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-07-18 09:53:13,549 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-07-18 09:53:13,549 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-07-18 09:53:13,549 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-07-18 09:53:13,549 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-07-18 09:53:13,549 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-07-18 09:53:13,549 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-07-18 09:53:13,549 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-07-18 09:53:13,550 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-07-18 09:53:13,550 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-07-18 09:53:13,550 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-07-18 09:53:13,550 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-07-18 09:53:13,550 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-07-18 09:53:13,550 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-07-18 09:53:13,550 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-07-18 09:53:13,550 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-07-18 09:53:13,550 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-07-18 09:53:13,551 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-07-18 09:53:13,551 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-07-18 09:53:13,551 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-07-18 09:53:13,551 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-07-18 09:53:13,551 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-07-18 09:53:13,551 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-07-18 09:53:13,551 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-07-18 09:53:13,551 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-07-18 09:53:13,551 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-07-18 09:53:13,551 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-07-18 09:53:13,552 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-07-18 09:53:13,552 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-07-18 09:53:13,552 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-07-18 09:53:13,552 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-07-18 09:53:13,552 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-07-18 09:53:13,552 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-07-18 09:53:13,552 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-07-18 09:53:13,552 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-07-18 09:53:13,552 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-07-18 09:53:13,720 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.022837716434259848); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.037172815091383406, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.022837716434259848); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.013); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.04608333333333333, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-07-18 09:53:13,720 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-07-18 09:53:13,720 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.0161296930883203, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.022837716434259848); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.037172815091383406, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.022837716434259848); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.013); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.04608333333333333, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-07-18 09:53:13,964 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 381 ms to try 5000 different iterations.  Found a solution that moves 967 regions; Going from a computed imbalance of 0.0161296930883203 to a new imbalance of 8.026208626757794E-4. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.007327855655802953); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.007293740686277048); MoveCostFunction : (multiplier=7.0, imbalance=0.10744444444444444, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.007327855655802953); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=4.166666666666667E-4); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.003916666666666666); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-07-18 09:53:13,966 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1637558185:80 , srv1244435984:82 , srv520604596:82 , srv1367532665:83 , srv1909311796:83 , srv1966635040:83 , srv527351443:83 , srv655239866:83 , srv945212785:83 , srv1081685755:84 , srv1129966624:84 , srv1353442047:84 , srv1376931144:84 , srv1429567334:84 , srv1691650208:84 , srv1836944261:84 , srv1872991902:84 , srv1909475245:84 , srv1986987964:84 , srv228580640:84 , srv458750034:84 , srv507660741:84 , srv621206354:84 , srv719027909:84 , srv881297944:84 , srv960093439:84 , srv1226411393:85 , srv1360073979:85 , srv1410428559:85 , srv1497420800:85 , srv1546656273:85 , srv1703754087:85 , srv1760931353:85 , srv1840221071:85 , srv193747532:85 , srv194548074:85 , srv2021124054:85 , srv2141120019:85 , srv229121506:85 , srv282841838:85 , srv37831980:85 , srv408305420:85 , srv496684375:85 , srv799874990:85 , srv819111662:85 , srv836020899:85 , srv891713641:85 , srv905061427:85 , srv1066291526:86 , srv1112031058:86 , srv1128722504:86 , srv118109733:86 , srv1294628448:86 , srv1377384548:86 , srv1491016983:86 , srv1491897794:86 , srv1525010224:86 , srv1568555885:86 , srv1635937952:86 , srv2057081870:86 , srv2124147502:86 , srv265717540:86 , srv315923330:86 , srv360882830:86 , srv404867802:86 , srv443119061:86 , srv456405346:86 , srv530367749:86 , srv556042870:86 , srv557994528:86 , srv665894793:86 , srv691942416:86 , srv716312882:86 , srv839624158:86 , srv998504815:86 , srv1040004791:87 , srv1056095943:87 , srv1127412855:87 , srv1168886090:87 , srv1170900167:87 , srv1172056506:87 , srv1259073025:87 , srv137493061:87 , srv1450270635:87 , srv1570437316:87 , srv1911191083:87 , srv1985527141:87 , srv1992590418:87 , srv293594691:87 , srv512119981:87 , srv590964965:87 , srv648394008:87 , srv84130841:87 , srv869545883:87 , srv941795676:87 , srv130498449:88 , srv2138067315:88 , srv281207008:88 , srv409785724:88 , srv1390051695:546 }
2023-07-18 09:53:13,969 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-07-18 09:53:13,970 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv869545883=92, srv1691650208=36, srv1353442047=17, srv1760931353=38, srv716312882=85, srv194548074=46, srv456405346=69, srv556042870=77, srv2124147502=53, srv84130841=91, srv665894793=83, srv2021124054=51, srv2138067315=54, srv1360073979=18, srv1546656273=31, srv1840221071=40, srv1410428559=24, srv1909311796=42, srv819111662=88, srv37831980=64, srv839624158=90, srv520604596=74, srv1525010224=30, srv799874990=87, srv1112031058=4, srv1259073025=14, srv881297944=93, srv1703754087=37, srv229121506=57, srv891713641=94, srv2057081870=52, srv1128722504=6, srv1986987964=49, srv621206354=80, srv281207008=59, srv1985527141=48, srv1966635040=47, srv1056095943=1, srv1872991902=41, srv1040004791=0, srv905061427=95, srv458750034=70, srv1244435984=13, srv1226411393=12, srv1909475245=43, srv315923330=62, srv945212785=97, srv1170900167=9, srv512119981=73, srv1376931144=21, srv408305420=66, srv941795676=96, srv1367532665=19, srv193747532=45, srv130498449=16, srv1066291526=2, srv1429567334=25, srv998504815=99, srv1911191083=44, srv1491016983=27, srv1172056506=10, srv496684375=71, srv137493061=20, srv1491897794=28, srv1127412855=5, srv1637558185=35, srv1570437316=33, srv409785724=67, srv527351443=75, srv1635937952=34, srv282841838=60, srv404867802=65, srv648394008=81, srv530367749=76, srv836020899=89, srv1168886090=8, srv228580640=56, srv557994528=78, srv1294628448=15, srv1836944261=39, srv590964965=79, srv691942416=84, srv1129966624=7, srv265717540=58, srv443119061=68, srv960093439=98, srv507660741=72, srv719027909=86, srv2141120019=55, srv655239866=82, srv1568555885=32, srv1450270635=26, srv118109733=11, srv1992590418=50, srv293594691=61, srv1497420800=29, srv1377384548=22, srv1390051695=23, srv360882830=63, srv1081685755=3} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-07-18 09:53:13,981 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-07-18 09:53:13,981 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-07-18 09:53:13,982 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-07-18 09:53:13,982 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-07-18 09:53:13,982 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-07-18 09:53:13,982 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-07-18 09:53:13,982 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-07-18 09:53:13,982 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-07-18 09:53:13,982 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-07-18 09:53:13,982 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-07-18 09:53:13,982 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-07-18 09:53:13,982 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-07-18 09:53:13,982 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-07-18 09:53:13,982 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-07-18 09:53:13,982 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-07-18 09:53:13,982 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-07-18 09:53:13,982 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-07-18 09:53:13,982 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-07-18 09:53:13,982 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-07-18 09:53:13,982 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-07-18 09:53:13,983 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-07-18 09:53:13,983 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-07-18 09:53:13,983 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-07-18 09:53:13,983 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-07-18 09:53:13,983 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-07-18 09:53:13,983 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-07-18 09:53:13,983 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-07-18 09:53:13,983 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-07-18 09:53:13,983 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-07-18 09:53:13,983 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-07-18 09:53:13,983 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-07-18 09:53:13,983 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-07-18 09:53:13,983 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-07-18 09:53:13,984 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-07-18 09:53:13,984 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-07-18 09:53:13,984 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-07-18 09:53:13,984 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-07-18 09:53:13,984 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-07-18 09:53:13,984 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-07-18 09:53:13,984 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-07-18 09:53:13,984 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-07-18 09:53:13,984 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-07-18 09:53:13,984 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-07-18 09:53:13,985 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-07-18 09:53:13,985 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-07-18 09:53:13,985 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-07-18 09:53:13,985 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-07-18 09:53:13,985 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-07-18 09:53:13,985 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-07-18 09:53:13,985 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-07-18 09:53:13,985 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-07-18 09:53:13,985 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-07-18 09:53:13,985 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-07-18 09:53:13,985 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-07-18 09:53:13,985 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-07-18 09:53:13,986 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-07-18 09:53:13,986 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-07-18 09:53:13,986 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-07-18 09:53:13,986 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-07-18 09:53:13,986 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-07-18 09:53:13,986 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-07-18 09:53:13,986 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-07-18 09:53:13,986 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-07-18 09:53:13,986 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-07-18 09:53:13,987 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-07-18 09:53:13,987 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-07-18 09:53:13,987 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-07-18 09:53:13,987 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-07-18 09:53:13,987 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-07-18 09:53:13,987 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-07-18 09:53:13,987 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-07-18 09:53:13,987 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-07-18 09:53:13,987 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-07-18 09:53:13,987 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-07-18 09:53:13,987 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-07-18 09:53:13,988 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-07-18 09:53:13,988 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-07-18 09:53:13,988 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-07-18 09:53:13,988 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-07-18 09:53:13,988 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-07-18 09:53:13,988 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-07-18 09:53:13,988 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-07-18 09:53:13,988 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-07-18 09:53:13,988 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-07-18 09:53:13,988 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-07-18 09:53:13,988 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-07-18 09:53:13,989 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-07-18 09:53:13,989 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-07-18 09:53:13,989 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-07-18 09:53:13,989 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-07-18 09:53:13,989 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-07-18 09:53:13,989 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-07-18 09:53:13,989 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-07-18 09:53:13,989 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-07-18 09:53:13,989 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-07-18 09:53:13,989 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-07-18 09:53:13,989 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-07-18 09:53:13,989 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-07-18 09:53:13,990 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-07-18 09:53:13,990 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-07-18 09:53:13,990 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-07-18 09:53:14,124 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.007327855655802953); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.007293740686277048); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.007327855655802953); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=4.166666666666667E-4); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.003916666666666666); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-07-18 09:53:14,124 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-07-18 09:53:14,124 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=7.958497839546119E-4, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.007327855655802953); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.007293740686277048); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.007327855655802953); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=4.166666666666667E-4); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.003916666666666666); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-07-18 09:53:14,487 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 486 ms to try 5000 different iterations.  Found a solution that moves 278 regions; Going from a computed imbalance of 7.958497839546119E-4 to a new imbalance of 3.429437044423917E-5. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=4.4668347344853864E-4); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0017082358106351274); MoveCostFunction : (multiplier=7.0, imbalance=0.03088888888888889, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=4.4668347344853864E-4); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=2.5E-4); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-07-18 09:53:14,488 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv520604596:82 , srv1525010224:83 , srv1056095943:84 , srv1066291526:84 , srv1112031058:84 , srv1129966624:84 , srv1168886090:84 , srv1172056506:84 , srv118109733:84 , srv130498449:84 , srv1353442047:84 , srv1360073979:84 , srv1367532665:84 , srv1450270635:84 , srv1491897794:84 , srv1497420800:84 , srv1703754087:84 , srv1840221071:84 , srv1909311796:84 , srv1911191083:84 , srv1966635040:84 , srv1992590418:84 , srv2057081870:84 , srv2138067315:84 , srv2141120019:84 , srv281207008:84 , srv293594691:84 , srv315923330:84 , srv360882830:84 , srv404867802:84 , srv408305420:84 , srv409785724:84 , srv443119061:84 , srv456405346:84 , srv512119981:84 , srv556042870:84 , srv557994528:84 , srv590964965:84 , srv648394008:84 , srv84130841:84 , srv881297944:84 , srv1040004791:85 , srv1081685755:85 , srv1127412855:85 , srv1128722504:85 , srv1170900167:85 , srv1226411393:85 , srv1259073025:85 , srv1294628448:85 , srv137493061:85 , srv1376931144:85 , srv1377384548:85 , srv1491016983:85 , srv1546656273:85 , srv1568555885:85 , srv1570437316:85 , srv1635937952:85 , srv1637558185:85 , srv1691650208:85 , srv1760931353:85 , srv1836944261:85 , srv1872991902:85 , srv1909475245:85 , srv194548074:85 , srv1985527141:85 , srv2021124054:85 , srv2124147502:85 , srv229121506:85 , srv265717540:85 , srv37831980:85 , srv458750034:85 , srv496684375:85 , srv507660741:85 , srv527351443:85 , srv621206354:85 , srv655239866:85 , srv665894793:85 , srv691942416:85 , srv719027909:85 , srv799874990:85 , srv819111662:85 , srv836020899:85 , srv839624158:85 , srv869545883:85 , srv891713641:85 , srv905061427:85 , srv941795676:85 , srv945212785:85 , srv998504815:85 , srv1244435984:86 , srv1410428559:86 , srv1429567334:86 , srv193747532:86 , srv1986987964:86 , srv228580640:86 , srv282841838:86 , srv530367749:86 , srv716312882:86 , srv960093439:86 , srv1390051695:619 }
2023-07-18 09:53:14,491 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-07-18 09:53:14,492 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv869545883=92, srv1691650208=36, srv1353442047=17, srv1760931353=38, srv716312882=85, srv194548074=46, srv456405346=69, srv556042870=77, srv2124147502=53, srv84130841=91, srv665894793=83, srv2021124054=51, srv2138067315=54, srv1360073979=18, srv1546656273=31, srv1840221071=40, srv1410428559=24, srv1909311796=42, srv819111662=88, srv37831980=64, srv839624158=90, srv520604596=74, srv1525010224=30, srv799874990=87, srv1112031058=4, srv1259073025=14, srv881297944=93, srv1703754087=37, srv229121506=57, srv891713641=94, srv2057081870=52, srv1128722504=6, srv1986987964=49, srv621206354=80, srv281207008=59, srv1985527141=48, srv1966635040=47, srv1056095943=1, srv1872991902=41, srv1040004791=0, srv905061427=95, srv458750034=70, srv1244435984=13, srv1226411393=12, srv1909475245=43, srv315923330=62, srv945212785=97, srv1170900167=9, srv512119981=73, srv1376931144=21, srv408305420=66, srv941795676=96, srv1367532665=19, srv193747532=45, srv130498449=16, srv1066291526=2, srv1429567334=25, srv998504815=99, srv1911191083=44, srv1491016983=27, srv1172056506=10, srv496684375=71, srv137493061=20, srv1491897794=28, srv1127412855=5, srv1637558185=35, srv1570437316=33, srv409785724=67, srv527351443=75, srv1635937952=34, srv282841838=60, srv404867802=65, srv648394008=81, srv530367749=76, srv836020899=89, srv1168886090=8, srv228580640=56, srv557994528=78, srv1294628448=15, srv1836944261=39, srv590964965=79, srv691942416=84, srv1129966624=7, srv265717540=58, srv443119061=68, srv960093439=98, srv507660741=72, srv719027909=86, srv2141120019=55, srv655239866=82, srv1568555885=32, srv1450270635=26, srv118109733=11, srv1992590418=50, srv293594691=61, srv1497420800=29, srv1377384548=22, srv1390051695=23, srv360882830=63, srv1081685755=3} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-07-18 09:53:14,505 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-07-18 09:53:14,505 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-07-18 09:53:14,505 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-07-18 09:53:14,505 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-07-18 09:53:14,505 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-07-18 09:53:14,505 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-07-18 09:53:14,505 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-07-18 09:53:14,505 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-07-18 09:53:14,505 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-07-18 09:53:14,505 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-07-18 09:53:14,505 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-07-18 09:53:14,505 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-07-18 09:53:14,505 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-07-18 09:53:14,505 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-07-18 09:53:14,505 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-07-18 09:53:14,505 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-07-18 09:53:14,505 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-07-18 09:53:14,505 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-07-18 09:53:14,505 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-07-18 09:53:14,506 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-07-18 09:53:14,506 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-07-18 09:53:14,506 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-07-18 09:53:14,506 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-07-18 09:53:14,506 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-07-18 09:53:14,506 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-07-18 09:53:14,506 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-07-18 09:53:14,506 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-07-18 09:53:14,506 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-07-18 09:53:14,506 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-07-18 09:53:14,506 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-07-18 09:53:14,506 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-07-18 09:53:14,506 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-07-18 09:53:14,506 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-07-18 09:53:14,506 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-07-18 09:53:14,506 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-07-18 09:53:14,506 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-07-18 09:53:14,506 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-07-18 09:53:14,506 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-07-18 09:53:14,506 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-07-18 09:53:14,506 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-07-18 09:53:14,506 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-07-18 09:53:14,507 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-07-18 09:53:14,507 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-07-18 09:53:14,507 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-07-18 09:53:14,507 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-07-18 09:53:14,507 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-07-18 09:53:14,507 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-07-18 09:53:14,507 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-07-18 09:53:14,507 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-07-18 09:53:14,507 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-07-18 09:53:14,507 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-07-18 09:53:14,507 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-07-18 09:53:14,507 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-07-18 09:53:14,507 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-07-18 09:53:14,507 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-07-18 09:53:14,507 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-07-18 09:53:14,507 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-07-18 09:53:14,507 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-07-18 09:53:14,507 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-07-18 09:53:14,507 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-07-18 09:53:14,507 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-07-18 09:53:14,507 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-07-18 09:53:14,507 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-07-18 09:53:14,508 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-07-18 09:53:14,508 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-07-18 09:53:14,508 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-07-18 09:53:14,508 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-07-18 09:53:14,508 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-07-18 09:53:14,508 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-07-18 09:53:14,508 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-07-18 09:53:14,508 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-07-18 09:53:14,508 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-07-18 09:53:14,508 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-07-18 09:53:14,508 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-07-18 09:53:14,508 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-07-18 09:53:14,508 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-07-18 09:53:14,508 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-07-18 09:53:14,508 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-07-18 09:53:14,508 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-07-18 09:53:14,508 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-07-18 09:53:14,509 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-07-18 09:53:14,509 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-07-18 09:53:14,509 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-07-18 09:53:14,509 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-07-18 09:53:14,509 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-07-18 09:53:14,509 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-07-18 09:53:14,509 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-07-18 09:53:14,509 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-07-18 09:53:14,509 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-07-18 09:53:14,509 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-07-18 09:53:14,509 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-07-18 09:53:14,509 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-07-18 09:53:14,509 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-07-18 09:53:14,509 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-07-18 09:53:14,509 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-07-18 09:53:14,509 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-07-18 09:53:14,509 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-07-18 09:53:14,509 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-07-18 09:53:14,509 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-07-18 09:53:14,509 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-07-18 09:53:14,509 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-07-18 09:53:14,641 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=4.4668347344853864E-4); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0017082358106351274); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=4.4668347344853864E-4); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=2.5E-4); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-07-18 09:53:14,642 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-07-18 09:53:14,642 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=3.2347772838774294E-5, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=4.4668347344853864E-4); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0017082358106351274); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=4.4668347344853864E-4); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=2.5E-4); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-07-18 09:53:14,896 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 376 ms to try 5000 different iterations.  Found a solution that moves 25 regions; Going from a computed imbalance of 3.2347772838774294E-5 to a new imbalance of 6.5730394137683395E-6. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0014213381090374027); MoveCostFunction : (multiplier=7.0, imbalance=0.002777777777777778); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-07-18 09:53:14,897 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1568555885:83 , srv1635937952:83 , srv193747532:83 , srv194548074:83 , srv282841838:83 , srv530367749:83 , srv716312882:83 , srv960093439:83 , srv1040004791:84 , srv1056095943:84 , srv1066291526:84 , srv1081685755:84 , srv1112031058:84 , srv1127412855:84 , srv1128722504:84 , srv1168886090:84 , srv1170900167:84 , srv1172056506:84 , srv118109733:84 , srv1226411393:84 , srv1244435984:84 , srv1259073025:84 , srv1294628448:84 , srv130498449:84 , srv1353442047:84 , srv1360073979:84 , srv137493061:84 , srv1376931144:84 , srv1377384548:84 , srv1410428559:84 , srv1429567334:84 , srv1450270635:84 , srv1491897794:84 , srv1497420800:84 , srv1525010224:84 , srv1546656273:84 , srv1570437316:84 , srv1637558185:84 , srv1691650208:84 , srv1703754087:84 , srv1760931353:84 , srv1836944261:84 , srv1840221071:84 , srv1872991902:84 , srv1909311796:84 , srv1909475245:84 , srv1911191083:84 , srv1966635040:84 , srv1985527141:84 , srv1986987964:84 , srv1992590418:84 , srv2021124054:84 , srv2057081870:84 , srv2124147502:84 , srv2138067315:84 , srv2141120019:84 , srv228580640:84 , srv229121506:84 , srv265717540:84 , srv281207008:84 , srv293594691:84 , srv315923330:84 , srv37831980:84 , srv404867802:84 , srv408305420:84 , srv409785724:84 , srv443119061:84 , srv456405346:84 , srv458750034:84 , srv496684375:84 , srv507660741:84 , srv512119981:84 , srv527351443:84 , srv556042870:84 , srv557994528:84 , srv621206354:84 , srv655239866:84 , srv665894793:84 , srv691942416:84 , srv719027909:84 , srv799874990:84 , srv819111662:84 , srv836020899:84 , srv839624158:84 , srv84130841:84 , srv869545883:84 , srv891713641:84 , srv905061427:84 , srv941795676:84 , srv945212785:84 , srv998504815:84 , srv1129966624:85 , srv1367532665:85 , srv1491016983:85 , srv360882830:85 , srv520604596:85 , srv590964965:85 , srv648394008:85 , srv881297944:85 , srv1390051695:684 }
2023-07-18 09:53:14,902 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-07-18 09:53:14,902 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv869545883=92, srv1691650208=36, srv1353442047=17, srv1760931353=38, srv716312882=85, srv194548074=46, srv456405346=69, srv556042870=77, srv2124147502=53, srv84130841=91, srv665894793=83, srv2021124054=51, srv2138067315=54, srv1360073979=18, srv1546656273=31, srv1840221071=40, srv1410428559=24, srv1909311796=42, srv819111662=88, srv37831980=64, srv839624158=90, srv520604596=74, srv1525010224=30, srv799874990=87, srv1112031058=4, srv1259073025=14, srv881297944=93, srv1703754087=37, srv229121506=57, srv891713641=94, srv2057081870=52, srv1128722504=6, srv1986987964=49, srv621206354=80, srv281207008=59, srv1985527141=48, srv1966635040=47, srv1056095943=1, srv1872991902=41, srv1040004791=0, srv905061427=95, srv458750034=70, srv1244435984=13, srv1226411393=12, srv1909475245=43, srv315923330=62, srv945212785=97, srv1170900167=9, srv512119981=73, srv1376931144=21, srv408305420=66, srv941795676=96, srv1367532665=19, srv193747532=45, srv130498449=16, srv1066291526=2, srv1429567334=25, srv998504815=99, srv1911191083=44, srv1491016983=27, srv1172056506=10, srv496684375=71, srv137493061=20, srv1491897794=28, srv1127412855=5, srv1637558185=35, srv1570437316=33, srv409785724=67, srv527351443=75, srv1635937952=34, srv282841838=60, srv404867802=65, srv648394008=81, srv530367749=76, srv836020899=89, srv1168886090=8, srv228580640=56, srv557994528=78, srv1294628448=15, srv1836944261=39, srv590964965=79, srv691942416=84, srv1129966624=7, srv265717540=58, srv443119061=68, srv960093439=98, srv507660741=72, srv719027909=86, srv2141120019=55, srv655239866=82, srv1568555885=32, srv1450270635=26, srv118109733=11, srv1992590418=50, srv293594691=61, srv1497420800=29, srv1377384548=22, srv1390051695=23, srv360882830=63, srv1081685755=3} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-07-18 09:53:14,922 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-07-18 09:53:14,922 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-07-18 09:53:14,922 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-07-18 09:53:14,922 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-07-18 09:53:14,922 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-07-18 09:53:14,922 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-07-18 09:53:14,922 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-07-18 09:53:14,922 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-07-18 09:53:14,922 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-07-18 09:53:14,923 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-07-18 09:53:14,923 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-07-18 09:53:14,923 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-07-18 09:53:14,923 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-07-18 09:53:14,923 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-07-18 09:53:14,923 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-07-18 09:53:14,923 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-07-18 09:53:14,923 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-07-18 09:53:14,923 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-07-18 09:53:14,923 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-07-18 09:53:14,923 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-07-18 09:53:14,923 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-07-18 09:53:14,923 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-07-18 09:53:14,923 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-07-18 09:53:14,924 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-07-18 09:53:14,924 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-07-18 09:53:14,924 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-07-18 09:53:14,924 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-07-18 09:53:14,924 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-07-18 09:53:14,924 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-07-18 09:53:14,924 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-07-18 09:53:14,924 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-07-18 09:53:14,924 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-07-18 09:53:14,924 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-07-18 09:53:14,924 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-07-18 09:53:14,924 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-07-18 09:53:14,924 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-07-18 09:53:14,925 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-07-18 09:53:14,925 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-07-18 09:53:14,925 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-07-18 09:53:14,925 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-07-18 09:53:14,925 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-07-18 09:53:14,925 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-07-18 09:53:14,925 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-07-18 09:53:14,925 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-07-18 09:53:14,925 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-07-18 09:53:14,925 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-07-18 09:53:14,925 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-07-18 09:53:14,925 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-07-18 09:53:14,925 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-07-18 09:53:14,925 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-07-18 09:53:14,926 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-07-18 09:53:14,926 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-07-18 09:53:14,926 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-07-18 09:53:14,926 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-07-18 09:53:14,926 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-07-18 09:53:14,926 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-07-18 09:53:14,926 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-07-18 09:53:14,926 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-07-18 09:53:14,926 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-07-18 09:53:14,926 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-07-18 09:53:14,926 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-07-18 09:53:14,926 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-07-18 09:53:14,926 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-07-18 09:53:14,927 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-07-18 09:53:14,927 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-07-18 09:53:14,927 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-07-18 09:53:14,927 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-07-18 09:53:14,927 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-07-18 09:53:14,927 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-07-18 09:53:14,927 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-07-18 09:53:14,927 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-07-18 09:53:14,927 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-07-18 09:53:14,927 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-07-18 09:53:14,927 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-07-18 09:53:14,927 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-07-18 09:53:14,927 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-07-18 09:53:14,927 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-07-18 09:53:14,927 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-07-18 09:53:14,928 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-07-18 09:53:14,928 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-07-18 09:53:14,928 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-07-18 09:53:14,928 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-07-18 09:53:14,928 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-07-18 09:53:14,928 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-07-18 09:53:14,928 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-07-18 09:53:14,928 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-07-18 09:53:14,928 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-07-18 09:53:14,928 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-07-18 09:53:14,928 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-07-18 09:53:14,928 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-07-18 09:53:14,929 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-07-18 09:53:14,929 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-07-18 09:53:14,929 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-07-18 09:53:14,929 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-07-18 09:53:14,929 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-07-18 09:53:14,929 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-07-18 09:53:14,929 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-07-18 09:53:14,929 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-07-18 09:53:14,929 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-07-18 09:53:14,929 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-07-18 09:53:14,929 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-07-18 09:53:15,085 INFO  [Time-limited test] balancer.StochasticLoadBalancer(381): Cluster wide - skipping load balancing because weighted average imbalance=6.397985672269699E-6 <= threshold(0.025). If you want more aggressive balancing, either lower hbase.master.balancer.stochastic.minCostNeedBalance from 0.025 or increase the relative multiplier(s) of the specific cost function(s). functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0014213381090374027); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-07-18 09:53:15,085 INFO  [Time-limited test] balancer.BalancerTestBase(570): Mock Final balance: { srv1568555885:83 , srv1635937952:83 , srv193747532:83 , srv194548074:83 , srv282841838:83 , srv530367749:83 , srv716312882:83 , srv960093439:83 , srv1040004791:84 , srv1056095943:84 , srv1066291526:84 , srv1081685755:84 , srv1112031058:84 , srv1127412855:84 , srv1128722504:84 , srv1168886090:84 , srv1170900167:84 , srv1172056506:84 , srv118109733:84 , srv1226411393:84 , srv1244435984:84 , srv1259073025:84 , srv1294628448:84 , srv130498449:84 , srv1353442047:84 , srv1360073979:84 , srv137493061:84 , srv1376931144:84 , srv1377384548:84 , srv1410428559:84 , srv1429567334:84 , srv1450270635:84 , srv1491897794:84 , srv1497420800:84 , srv1525010224:84 , srv1546656273:84 , srv1570437316:84 , srv1637558185:84 , srv1691650208:84 , srv1703754087:84 , srv1760931353:84 , srv1836944261:84 , srv1840221071:84 , srv1872991902:84 , srv1909311796:84 , srv1909475245:84 , srv1911191083:84 , srv1966635040:84 , srv1985527141:84 , srv1986987964:84 , srv1992590418:84 , srv2021124054:84 , srv2057081870:84 , srv2124147502:84 , srv2138067315:84 , srv2141120019:84 , srv228580640:84 , srv229121506:84 , srv265717540:84 , srv281207008:84 , srv293594691:84 , srv315923330:84 , srv37831980:84 , srv404867802:84 , srv408305420:84 , srv409785724:84 , srv443119061:84 , srv456405346:84 , srv458750034:84 , srv496684375:84 , srv507660741:84 , srv512119981:84 , srv527351443:84 , srv556042870:84 , srv557994528:84 , srv621206354:84 , srv655239866:84 , srv665894793:84 , srv691942416:84 , srv719027909:84 , srv799874990:84 , srv819111662:84 , srv836020899:84 , srv839624158:84 , srv84130841:84 , srv869545883:84 , srv891713641:84 , srv905061427:84 , srv941795676:84 , srv945212785:84 , srv998504815:84 , srv1129966624:85 , srv1367532665:85 , srv1491016983:85 , srv360882830:85 , srv520604596:85 , srv590964965:85 , srv648394008:85 , srv881297944:85 , srv1390051695:684 }
2023-07-18 09:53:15,128 INFO  [Time-limited test] hbase.ResourceChecker(175): after: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnLargeClusterWithRacks Thread=12 (was 12), OpenFileDescriptor=263 (was 263), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=455 (was 400) - SystemLoadAverage LEAK? -, ProcessCount=173 (was 173), AvailableMemoryMB=6664 (was 7503)
2023-07-18 09:53:15,145 INFO  [Time-limited test] hbase.ResourceChecker(147): before: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnMidClusterWithRacks Thread=12, OpenFileDescriptor=263, MaxFileDescriptor=60000, SystemLoadAverage=455, ProcessCount=173, AvailableMemoryMB=6661
2023-07-18 09:53:15,146 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2023-07-18 09:53:15,147 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=5000, runMaxSteps=true, stepsPerRegion=800, maxRunningTime=120000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 111077.0 etc.
2023-07-18 09:53:15,165 INFO  [Time-limited test] balancer.BalancerTestBase(547): Mock Cluster : { srv1061719232:84 , srv1140218697:84 , srv1178140219:84 , srv1212850157:84 , srv1346968432:84 , srv1384342260:84 , srv1405607853:84 , srv1406992571:84 , srv1479675339:84 , srv1526774003:84 , srv1606591225:84 , srv1654942110:84 , srv1874042856:84 , srv1933396531:84 , srv1991687038:84 , srv2123948141:84 , srv2147188720:84 , srv299822472:84 , srv310234777:84 , srv407195647:84 , srv413782540:84 , srv419542436:84 , srv49755879:84 , srv549294092:84 , srv777934507:84 , srv802277:84 , srv812548392:84 , srv987876371:84 , srv988629958:84 , srv1385815300:264 } [srvr=30 rgns=2700 avg=90.0 max=90 min=90]
2023-07-18 09:53:15,167 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-07-18 09:53:15,167 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv310234777=19, srv1479675339=9, srv1991687038=15, srv1406992571=8, srv1405607853=7, srv49755879=23, srv812548392=27, srv549294092=24, srv2147188720=17, srv1874042856=13, srv1654942110=12, srv987876371=28, srv777934507=25, srv1178140219=2, srv1061719232=0, srv1526774003=10, srv407195647=20, srv802277=26, srv1384342260=5, srv1346968432=4, srv1933396531=14, srv1212850157=3, srv419542436=22, srv2123948141=16, srv1385815300=6, srv299822472=18, srv988629958=29, srv413782540=21, srv1606591225=11, srv1140218697=1} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-07-18 09:53:15,179 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-07-18 09:53:15,179 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-07-18 09:53:15,179 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-07-18 09:53:15,180 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-07-18 09:53:15,180 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-07-18 09:53:15,180 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-07-18 09:53:15,180 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-07-18 09:53:15,180 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-07-18 09:53:15,180 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-07-18 09:53:15,180 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-07-18 09:53:15,180 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-07-18 09:53:15,180 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-07-18 09:53:15,180 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-07-18 09:53:15,180 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-07-18 09:53:15,180 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-07-18 09:53:15,180 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-07-18 09:53:15,181 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-07-18 09:53:15,181 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-07-18 09:53:15,181 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-07-18 09:53:15,181 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-07-18 09:53:15,181 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-07-18 09:53:15,181 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-07-18 09:53:15,181 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-07-18 09:53:15,181 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-07-18 09:53:15,181 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-07-18 09:53:15,181 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-07-18 09:53:15,181 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-07-18 09:53:15,181 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-07-18 09:53:15,181 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-07-18 09:53:15,181 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-07-18 09:53:15,182 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=10, number of hosts=30, number of racks=4
2023-07-18 09:53:15,206 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=1.2042525782767144, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-07-18 09:53:15,207 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.9912836636468968, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=1.2042525782767144, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=64800000
2023-07-18 09:55:15,186 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 120001 ms to try 6017626 different iterations.  Found a solution that moves 1860 regions; Going from a computed imbalance of 0.9912836636468968 to a new imbalance of 4.341332789166274E-5. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); MoveCostFunction : (multiplier=7.0, imbalance=0.6888888888888889, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-07-18 09:55:15,194 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1061719232:90 , srv1140218697:90 , srv1178140219:90 , srv1212850157:90 , srv1346968432:90 , srv1384342260:90 , srv1385815300:90 , srv1405607853:90 , srv1406992571:90 , srv1479675339:90 , srv1526774003:90 , srv1606591225:90 , srv1654942110:90 , srv1874042856:90 , srv1933396531:90 , srv1991687038:90 , srv2123948141:90 , srv2147188720:90 , srv299822472:90 , srv310234777:90 , srv407195647:90 , srv413782540:90 , srv419542436:90 , srv49755879:90 , srv549294092:90 , srv777934507:90 , srv802277:90 , srv812548392:90 , srv987876371:90 , srv988629958:90 }
2023-07-18 09:55:15,195 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-07-18 09:55:15,195 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv310234777=19, srv1479675339=9, srv1991687038=15, srv1406992571=8, srv1405607853=7, srv49755879=23, srv812548392=27, srv549294092=24, srv2147188720=17, srv1874042856=13, srv1654942110=12, srv987876371=28, srv777934507=25, srv1178140219=2, srv1061719232=0, srv1526774003=10, srv407195647=20, srv802277=26, srv1384342260=5, srv1346968432=4, srv1933396531=14, srv1212850157=3, srv419542436=22, srv2123948141=16, srv1385815300=6, srv299822472=18, srv988629958=29, srv413782540=21, srv1606591225=11, srv1140218697=1} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-07-18 09:55:15,198 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-07-18 09:55:15,198 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-07-18 09:55:15,198 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-07-18 09:55:15,198 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-07-18 09:55:15,198 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-07-18 09:55:15,198 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-07-18 09:55:15,198 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-07-18 09:55:15,198 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-07-18 09:55:15,198 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-07-18 09:55:15,198 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-07-18 09:55:15,199 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-07-18 09:55:15,199 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-07-18 09:55:15,199 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-07-18 09:55:15,199 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-07-18 09:55:15,199 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-07-18 09:55:15,199 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-07-18 09:55:15,199 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-07-18 09:55:15,199 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-07-18 09:55:15,199 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-07-18 09:55:15,199 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-07-18 09:55:15,199 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-07-18 09:55:15,199 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-07-18 09:55:15,199 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-07-18 09:55:15,199 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-07-18 09:55:15,199 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-07-18 09:55:15,199 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-07-18 09:55:15,199 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-07-18 09:55:15,199 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-07-18 09:55:15,199 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-07-18 09:55:15,199 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-07-18 09:55:15,199 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=10, number of hosts=30, number of racks=4
2023-07-18 09:55:15,212 INFO  [Time-limited test] balancer.StochasticLoadBalancer(381): Cluster wide - skipping load balancing because weighted average imbalance=0.0 <= threshold(0.025). If you want more aggressive balancing, either lower hbase.master.balancer.stochastic.minCostNeedBalance from 0.025 or increase the relative multiplier(s) of the specific cost function(s). functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-07-18 09:55:15,212 INFO  [Time-limited test] balancer.BalancerTestBase(570): Mock Final balance: { srv1061719232:90 , srv1140218697:90 , srv1178140219:90 , srv1212850157:90 , srv1346968432:90 , srv1384342260:90 , srv1385815300:90 , srv1405607853:90 , srv1406992571:90 , srv1479675339:90 , srv1526774003:90 , srv1606591225:90 , srv1654942110:90 , srv1874042856:90 , srv1933396531:90 , srv1991687038:90 , srv2123948141:90 , srv2147188720:90 , srv299822472:90 , srv310234777:90 , srv407195647:90 , srv413782540:90 , srv419542436:90 , srv49755879:90 , srv549294092:90 , srv777934507:90 , srv802277:90 , srv812548392:90 , srv987876371:90 , srv988629958:90 }
2023-07-18 09:55:15,224 INFO  [Time-limited test] hbase.ResourceChecker(175): after: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnMidClusterWithRacks Thread=11 (was 12), OpenFileDescriptor=263 (was 263), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=223 (was 455), ProcessCount=171 (was 173), AvailableMemoryMB=6919 (was 6661) - AvailableMemoryMB LEAK? -