2023-07-24 13:53:10,247 INFO  [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks timeout: 13 mins
2023-07-24 13:53:10,568 WARN  [Time-limited test] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties
2023-07-24 13:53:10,677 INFO  [Time-limited test] metrics.MetricRegistriesLoader(60): Loaded MetricRegistries class org.apache.hadoop.hbase.metrics.impl.MetricRegistriesImpl
2023-07-24 13:53:10,747 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2023-07-24 13:53:10,757 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc.
2023-07-24 13:53:10,773 INFO  [Time-limited test] hbase.ResourceChecker(147): before: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnLargeClusterWithRacks Thread=12, OpenFileDescriptor=263, MaxFileDescriptor=60000, SystemLoadAverage=290, ProcessCount=179, AvailableMemoryMB=10323
2023-07-24 13:53:10,776 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2023-07-24 13:53:10,777 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=5000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=10000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc.
2023-07-24 13:53:10,930 INFO  [Time-limited test] balancer.BalancerTestBase(547): Mock Cluster : { srv1002497276:84 , srv1006426636:84 , srv1035852050:84 , srv1037999038:84 , srv1069685721:84 , srv1125637940:84 , srv1140371444:84 , srv1146400017:84 , srv1219460168:84 , srv1223578838:84 , srv1225245940:84 , srv1253373447:84 , srv1267437677:84 , srv1269605976:84 , srv1322923:84 , srv135040570:84 , srv136787715:84 , srv1373550557:84 , srv1380860451:84 , srv1419597606:84 , srv1443854327:84 , srv1447658605:84 , srv147001871:84 , srv1497600555:84 , srv1501454361:84 , srv1520526213:84 , srv1567110751:84 , srv1590786104:84 , srv1598349821:84 , srv1600672745:84 , srv1619745368:84 , srv1619867787:84 , srv1630981818:84 , srv165397559:84 , srv1668920425:84 , srv1668985308:84 , srv1679129033:84 , srv1706531171:84 , srv1712605818:84 , srv1718932119:84 , srv173284381:84 , srv1744889616:84 , srv1763310480:84 , srv1805024678:84 , srv1807136836:84 , srv1865073600:84 , srv1881136594:84 , srv189031227:84 , srv1898780897:84 , srv1900144442:84 , srv1945343491:84 , srv196430439:84 , srv1992119467:84 , srv2004575013:84 , srv2025238402:84 , srv2035871647:84 , srv2038304739:84 , srv2124783007:84 , srv2128197662:84 , srv216074333:84 , srv223136657:84 , srv235450818:84 , srv244259047:84 , srv255966810:84 , srv296408607:84 , srv315549198:84 , srv324135438:84 , srv350367217:84 , srv445441035:84 , srv450992929:84 , srv452580525:84 , srv461221499:84 , srv554695076:84 , srv570029561:84 , srv581498613:84 , srv584121893:84 , srv616327893:84 , srv642817702:84 , srv651278219:84 , srv664528053:84 , srv693190486:84 , srv728649368:84 , srv739036515:84 , srv751057517:84 , srv753655471:84 , srv766497774:84 , srv766882674:84 , srv8271051:84 , srv827824056:84 , srv850890617:84 , srv853419561:84 , srv931813679:84 , srv934287525:84 , srv934557009:84 , srv936408705:84 , srv940025528:84 , srv950182090:84 , srv975902957:84 , srv990967288:84 , srv842943941:684 } [srvr=100 rgns=9000 avg=90.0 max=90 min=90]
2023-07-24 13:53:10,941 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-07-24 13:53:10,948 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv2004575013=53, srv1225245940=10, srv165397559=33, srv581498613=74, srv751057517=83, srv196430439=51, srv235450818=61, srv1253373447=11, srv554695076=72, srv1520526213=25, srv584121893=75, srv223136657=60, srv324135438=66, srv2124783007=57, srv693190486=80, srv1419597606=19, srv1945343491=50, srv1898780897=48, srv8271051=87, srv651278219=78, srv1706531171=37, srv2128197662=58, srv1267437677=12, srv1125637940=5, srv1668985308=35, srv1035852050=2, srv2025238402=54, srv1590786104=27, srv445441035=68, srv135040570=15, srv616327893=76, srv1269605976=13, srv664528053=79, srv853419561=91, srv1630981818=32, srv1807136836=44, srv1219460168=8, srv1322923=14, srv296408607=64, srv934287525=93, srv842943941=89, srv461221499=71, srv1805024678=43, srv642817702=77, srv975902957=98, srv1037999038=3, srv1140371444=6, srv244259047=62, srv739036515=82, srv1881136594=46, srv766497774=85, srv1712605818=38, srv1865073600=45, srv1443854327=20, srv350367217=67, srv850890617=90, srv173284381=40, srv1598349821=28, srv1900144442=49, srv1600672745=29, srv1069685721=4, srv1567110751=26, srv728649368=81, srv936408705=95, srv216074333=59, srv1668920425=34, srv2038304739=56, srv136787715=16, srv1501454361=24, srv1146400017=7, srv950182090=97, srv1002497276=0, srv1744889616=41, srv452580525=70, srv1619867787=31, srv1718932119=39, srv255966810=63, srv1497600555=23, srv1992119467=52, srv450992929=69, srv1619745368=30, srv990967288=99, srv934557009=94, srv1006426636=1, srv1223578838=9, srv315549198=65, srv940025528=96, srv1763310480=42, srv570029561=73, srv1447658605=21, srv1679129033=36, srv827824056=88, srv147001871=22, srv753655471=84, srv189031227=47, srv1380860451=18, srv2035871647=55, srv931813679=92, srv1373550557=17, srv766882674=86} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-07-24 13:53:11,031 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-07-24 13:53:11,031 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-07-24 13:53:11,032 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-07-24 13:53:11,032 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-07-24 13:53:11,032 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-07-24 13:53:11,032 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-07-24 13:53:11,032 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-07-24 13:53:11,032 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-07-24 13:53:11,032 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-07-24 13:53:11,032 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-07-24 13:53:11,033 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-07-24 13:53:11,033 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-07-24 13:53:11,033 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-07-24 13:53:11,033 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-07-24 13:53:11,033 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-07-24 13:53:11,033 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-07-24 13:53:11,033 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-07-24 13:53:11,033 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-07-24 13:53:11,034 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-07-24 13:53:11,034 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-07-24 13:53:11,034 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-07-24 13:53:11,034 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-07-24 13:53:11,034 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-07-24 13:53:11,034 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-07-24 13:53:11,034 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-07-24 13:53:11,034 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-07-24 13:53:11,034 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-07-24 13:53:11,034 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-07-24 13:53:11,034 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-07-24 13:53:11,035 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-07-24 13:53:11,035 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-07-24 13:53:11,035 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-07-24 13:53:11,035 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-07-24 13:53:11,035 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-07-24 13:53:11,035 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-07-24 13:53:11,035 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-07-24 13:53:11,035 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-07-24 13:53:11,035 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-07-24 13:53:11,035 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-07-24 13:53:11,035 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-07-24 13:53:11,035 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-07-24 13:53:11,036 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-07-24 13:53:11,036 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-07-24 13:53:11,036 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-07-24 13:53:11,036 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-07-24 13:53:11,036 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-07-24 13:53:11,036 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-07-24 13:53:11,036 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-07-24 13:53:11,036 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-07-24 13:53:11,036 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-07-24 13:53:11,036 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-07-24 13:53:11,036 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-07-24 13:53:11,037 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-07-24 13:53:11,037 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-07-24 13:53:11,037 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-07-24 13:53:11,037 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-07-24 13:53:11,037 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-07-24 13:53:11,037 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-07-24 13:53:11,037 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-07-24 13:53:11,037 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-07-24 13:53:11,037 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-07-24 13:53:11,037 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-07-24 13:53:11,037 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-07-24 13:53:11,037 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-07-24 13:53:11,038 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-07-24 13:53:11,038 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-07-24 13:53:11,038 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-07-24 13:53:11,038 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-07-24 13:53:11,038 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-07-24 13:53:11,038 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-07-24 13:53:11,038 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-07-24 13:53:11,038 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-07-24 13:53:11,039 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-07-24 13:53:11,039 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-07-24 13:53:11,039 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-07-24 13:53:11,039 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-07-24 13:53:11,039 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-07-24 13:53:11,039 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-07-24 13:53:11,039 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-07-24 13:53:11,039 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-07-24 13:53:11,040 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-07-24 13:53:11,040 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-07-24 13:53:11,040 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-07-24 13:53:11,040 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-07-24 13:53:11,040 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-07-24 13:53:11,040 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-07-24 13:53:11,040 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-07-24 13:53:11,041 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-07-24 13:53:11,041 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-07-24 13:53:11,041 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-07-24 13:53:11,041 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-07-24 13:53:11,041 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-07-24 13:53:11,041 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-07-24 13:53:11,041 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-07-24 13:53:11,042 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-07-24 13:53:11,042 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-07-24 13:53:11,042 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-07-24 13:53:11,042 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-07-24 13:53:11,042 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-07-24 13:53:11,042 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-07-24 13:53:11,043 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-07-24 13:53:11,229 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.06666666666666667, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-07-24 13:53:11,229 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-07-24 13:53:11,230 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.9909252140407105, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.06666666666666667, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-07-24 13:53:11,613 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 550 ms to try 5000 different iterations.  Found a solution that moves 4713 regions; Going from a computed imbalance of 0.9909252140407105 to a new imbalance of 0.17435843978930538. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.03712548361782092, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.05236923214894228, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.5236666666666666, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.03712548361782092, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.16975, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.23425, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-07-24 13:53:11,650 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1002497276:82 , srv570029561:82 , srv1146400017:83 , srv1225245940:83 , srv1253373447:83 , srv1898780897:83 , srv445441035:83 , srv8271051:83 , srv990967288:83 , srv1380860451:84 , srv1630981818:84 , srv196430439:84 , srv255966810:84 , srv827824056:84 , srv936408705:84 , srv975902957:84 , srv1006426636:85 , srv1035852050:85 , srv1037999038:85 , srv1419597606:85 , srv1497600555:85 , srv1712605818:85 , srv1805024678:85 , srv189031227:85 , srv2035871647:85 , srv2038304739:85 , srv223136657:85 , srv693190486:85 , srv728649368:85 , srv739036515:85 , srv753655471:85 , srv931813679:85 , srv1069685721:86 , srv1219460168:86 , srv1223578838:86 , srv1267437677:86 , srv147001871:86 , srv1501454361:86 , srv1520526213:86 , srv1567110751:86 , srv1590786104:86 , srv1598349821:86 , srv1600672745:86 , srv1668920425:86 , srv1881136594:86 , srv461221499:86 , srv554695076:86 , srv584121893:86 , srv934557009:86 , srv1125637940:87 , srv1269605976:87 , srv1322923:87 , srv136787715:87 , srv1443854327:87 , srv1668985308:87 , srv1744889616:87 , srv2004575013:87 , srv244259047:87 , srv452580525:87 , srv642817702:87 , srv651278219:87 , srv664528053:87 , srv850890617:87 , srv853419561:87 , srv934287525:87 , srv940025528:87 , srv950182090:87 , srv1140371444:88 , srv135040570:88 , srv1373550557:88 , srv1718932119:88 , srv1763310480:88 , srv1865073600:88 , srv1945343491:88 , srv1992119467:88 , srv324135438:88 , srv751057517:88 , srv766882674:88 , srv1447658605:89 , srv165397559:89 , srv1807136836:89 , srv1900144442:89 , srv2124783007:89 , srv216074333:89 , srv315549198:89 , srv350367217:89 , srv766497774:89 , srv1619867787:90 , srv1679129033:90 , srv173284381:90 , srv2128197662:90 , srv296408607:90 , srv1706531171:91 , srv2025238402:91 , srv235450818:91 , srv616327893:91 , srv1619745368:92 , srv450992929:92 , srv581498613:92 , srv842943941:420 }
2023-07-24 13:53:11,655 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-07-24 13:53:11,656 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv2004575013=53, srv1225245940=10, srv165397559=33, srv581498613=74, srv751057517=83, srv196430439=51, srv235450818=61, srv1253373447=11, srv554695076=72, srv1520526213=25, srv584121893=75, srv223136657=60, srv324135438=66, srv2124783007=57, srv693190486=80, srv1419597606=19, srv1945343491=50, srv1898780897=48, srv8271051=87, srv651278219=78, srv1706531171=37, srv2128197662=58, srv1267437677=12, srv1125637940=5, srv1668985308=35, srv1035852050=2, srv2025238402=54, srv1590786104=27, srv445441035=68, srv135040570=15, srv616327893=76, srv1269605976=13, srv664528053=79, srv853419561=91, srv1630981818=32, srv1807136836=44, srv1219460168=8, srv1322923=14, srv296408607=64, srv934287525=93, srv842943941=89, srv461221499=71, srv1805024678=43, srv642817702=77, srv975902957=98, srv1037999038=3, srv1140371444=6, srv244259047=62, srv739036515=82, srv1881136594=46, srv766497774=85, srv1712605818=38, srv1865073600=45, srv1443854327=20, srv350367217=67, srv850890617=90, srv173284381=40, srv1598349821=28, srv1900144442=49, srv1600672745=29, srv1069685721=4, srv1567110751=26, srv728649368=81, srv936408705=95, srv216074333=59, srv1668920425=34, srv2038304739=56, srv136787715=16, srv1501454361=24, srv1146400017=7, srv950182090=97, srv1002497276=0, srv1744889616=41, srv452580525=70, srv1619867787=31, srv1718932119=39, srv255966810=63, srv1497600555=23, srv1992119467=52, srv450992929=69, srv1619745368=30, srv990967288=99, srv934557009=94, srv1006426636=1, srv1223578838=9, srv315549198=65, srv940025528=96, srv1763310480=42, srv570029561=73, srv1447658605=21, srv1679129033=36, srv827824056=88, srv147001871=22, srv753655471=84, srv189031227=47, srv1380860451=18, srv2035871647=55, srv931813679=92, srv1373550557=17, srv766882674=86} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-07-24 13:53:11,678 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-07-24 13:53:11,678 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-07-24 13:53:11,679 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-07-24 13:53:11,679 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-07-24 13:53:11,679 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-07-24 13:53:11,679 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-07-24 13:53:11,679 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-07-24 13:53:11,679 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-07-24 13:53:11,679 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-07-24 13:53:11,679 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-07-24 13:53:11,680 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-07-24 13:53:11,680 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-07-24 13:53:11,680 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-07-24 13:53:11,680 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-07-24 13:53:11,680 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-07-24 13:53:11,680 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-07-24 13:53:11,680 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-07-24 13:53:11,680 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-07-24 13:53:11,680 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-07-24 13:53:11,681 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-07-24 13:53:11,681 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-07-24 13:53:11,681 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-07-24 13:53:11,681 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-07-24 13:53:11,681 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-07-24 13:53:11,681 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-07-24 13:53:11,681 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-07-24 13:53:11,681 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-07-24 13:53:11,681 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-07-24 13:53:11,682 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-07-24 13:53:11,682 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-07-24 13:53:11,682 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-07-24 13:53:11,682 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-07-24 13:53:11,682 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-07-24 13:53:11,682 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-07-24 13:53:11,682 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-07-24 13:53:11,682 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-07-24 13:53:11,682 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-07-24 13:53:11,683 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-07-24 13:53:11,683 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-07-24 13:53:11,683 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-07-24 13:53:11,683 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-07-24 13:53:11,683 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-07-24 13:53:11,683 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-07-24 13:53:11,683 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-07-24 13:53:11,683 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-07-24 13:53:11,683 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-07-24 13:53:11,684 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-07-24 13:53:11,684 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-07-24 13:53:11,684 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-07-24 13:53:11,684 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-07-24 13:53:11,684 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-07-24 13:53:11,684 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-07-24 13:53:11,684 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-07-24 13:53:11,684 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-07-24 13:53:11,684 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-07-24 13:53:11,685 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-07-24 13:53:11,685 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-07-24 13:53:11,685 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-07-24 13:53:11,685 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-07-24 13:53:11,685 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-07-24 13:53:11,685 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-07-24 13:53:11,685 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-07-24 13:53:11,685 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-07-24 13:53:11,686 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-07-24 13:53:11,686 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-07-24 13:53:11,686 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-07-24 13:53:11,686 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-07-24 13:53:11,686 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-07-24 13:53:11,686 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-07-24 13:53:11,686 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-07-24 13:53:11,686 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-07-24 13:53:11,686 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-07-24 13:53:11,686 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-07-24 13:53:11,687 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-07-24 13:53:11,687 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-07-24 13:53:11,687 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-07-24 13:53:11,687 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-07-24 13:53:11,687 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-07-24 13:53:11,687 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-07-24 13:53:11,687 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-07-24 13:53:11,687 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-07-24 13:53:11,687 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-07-24 13:53:11,688 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-07-24 13:53:11,688 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-07-24 13:53:11,688 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-07-24 13:53:11,688 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-07-24 13:53:11,688 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-07-24 13:53:11,688 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-07-24 13:53:11,688 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-07-24 13:53:11,688 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-07-24 13:53:11,688 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-07-24 13:53:11,688 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-07-24 13:53:11,689 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-07-24 13:53:11,689 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-07-24 13:53:11,689 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-07-24 13:53:11,689 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-07-24 13:53:11,689 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-07-24 13:53:11,689 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-07-24 13:53:11,689 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-07-24 13:53:11,689 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-07-24 13:53:11,689 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-07-24 13:53:11,826 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.03712548361782092, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.05236923214894228, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.03712548361782092, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.16975, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.23425, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-07-24 13:53:11,826 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-07-24 13:53:11,826 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.17432543865795802, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.03712548361782092, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.05236923214894228, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.03712548361782092, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.16975, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.23425, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-07-24 13:53:12,109 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 389 ms to try 5000 different iterations.  Found a solution that moves 2647 regions; Going from a computed imbalance of 0.17432543865795802 to a new imbalance of 0.013575161718489999. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.018818446586041836); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.026523183006806898, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.2941111111111111, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.018818446586041836); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.010583333333333333); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.042416666666666665, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-07-24 13:53:12,121 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1619745368:79 , srv165397559:80 , srv235450818:80 , srv581498613:80 , srv2128197662:81 , srv450992929:81 , srv1706531171:82 , srv173284381:82 , srv1763310480:82 , srv1865073600:82 , srv1945343491:82 , srv2025238402:82 , srv296408607:82 , srv315549198:82 , srv616327893:82 , srv1140371444:83 , srv1373550557:83 , srv1679129033:83 , srv1744889616:83 , srv1900144442:83 , srv751057517:83 , srv1069685721:84 , srv135040570:84 , srv136787715:84 , srv1443854327:84 , srv1447658605:84 , srv1619867787:84 , srv1881136594:84 , srv2124783007:84 , srv244259047:84 , srv452580525:84 , srv554695076:84 , srv766497774:84 , srv766882674:84 , srv934287525:84 , srv950182090:84 , srv1223578838:85 , srv1322923:85 , srv1501454361:85 , srv1590786104:85 , srv1598349821:85 , srv1718932119:85 , srv216074333:85 , srv324135438:85 , srv350367217:85 , srv931813679:85 , srv934557009:85 , srv940025528:85 , srv1267437677:86 , srv1497600555:86 , srv1668920425:86 , srv1668985308:86 , srv1805024678:86 , srv1807136836:86 , srv2038304739:86 , srv223136657:86 , srv584121893:86 , srv651278219:86 , srv739036515:86 , srv827824056:86 , srv1125637940:87 , srv1219460168:87 , srv1269605976:87 , srv1520526213:87 , srv1567110751:87 , srv189031227:87 , srv196430439:87 , srv2035871647:87 , srv461221499:87 , srv642817702:87 , srv664528053:87 , srv853419561:87 , srv1006426636:88 , srv1035852050:88 , srv1419597606:88 , srv147001871:88 , srv1600672745:88 , srv1630981818:88 , srv1712605818:88 , srv1992119467:88 , srv2004575013:88 , srv728649368:88 , srv753655471:88 , srv850890617:88 , srv936408705:88 , srv1002497276:89 , srv1898780897:89 , srv570029561:89 , srv693190486:89 , srv1146400017:90 , srv1253373447:90 , srv1380860451:90 , srv255966810:90 , srv445441035:90 , srv8271051:90 , srv1037999038:91 , srv975902957:91 , srv990967288:91 , srv1225245940:93 , srv842943941:521 }
2023-07-24 13:53:12,127 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-07-24 13:53:12,128 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv2004575013=53, srv1225245940=10, srv165397559=33, srv581498613=74, srv751057517=83, srv196430439=51, srv235450818=61, srv1253373447=11, srv554695076=72, srv1520526213=25, srv584121893=75, srv223136657=60, srv324135438=66, srv2124783007=57, srv693190486=80, srv1419597606=19, srv1945343491=50, srv1898780897=48, srv8271051=87, srv651278219=78, srv1706531171=37, srv2128197662=58, srv1267437677=12, srv1125637940=5, srv1668985308=35, srv1035852050=2, srv2025238402=54, srv1590786104=27, srv445441035=68, srv135040570=15, srv616327893=76, srv1269605976=13, srv664528053=79, srv853419561=91, srv1630981818=32, srv1807136836=44, srv1219460168=8, srv1322923=14, srv296408607=64, srv934287525=93, srv842943941=89, srv461221499=71, srv1805024678=43, srv642817702=77, srv975902957=98, srv1037999038=3, srv1140371444=6, srv244259047=62, srv739036515=82, srv1881136594=46, srv766497774=85, srv1712605818=38, srv1865073600=45, srv1443854327=20, srv350367217=67, srv850890617=90, srv173284381=40, srv1598349821=28, srv1900144442=49, srv1600672745=29, srv1069685721=4, srv1567110751=26, srv728649368=81, srv936408705=95, srv216074333=59, srv1668920425=34, srv2038304739=56, srv136787715=16, srv1501454361=24, srv1146400017=7, srv950182090=97, srv1002497276=0, srv1744889616=41, srv452580525=70, srv1619867787=31, srv1718932119=39, srv255966810=63, srv1497600555=23, srv1992119467=52, srv450992929=69, srv1619745368=30, srv990967288=99, srv934557009=94, srv1006426636=1, srv1223578838=9, srv315549198=65, srv940025528=96, srv1763310480=42, srv570029561=73, srv1447658605=21, srv1679129033=36, srv827824056=88, srv147001871=22, srv753655471=84, srv189031227=47, srv1380860451=18, srv2035871647=55, srv931813679=92, srv1373550557=17, srv766882674=86} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-07-24 13:53:12,148 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-07-24 13:53:12,148 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-07-24 13:53:12,148 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-07-24 13:53:12,148 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-07-24 13:53:12,148 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-07-24 13:53:12,148 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-07-24 13:53:12,148 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-07-24 13:53:12,148 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-07-24 13:53:12,148 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-07-24 13:53:12,149 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-07-24 13:53:12,149 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-07-24 13:53:12,149 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-07-24 13:53:12,149 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-07-24 13:53:12,149 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-07-24 13:53:12,149 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-07-24 13:53:12,149 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-07-24 13:53:12,149 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-07-24 13:53:12,149 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-07-24 13:53:12,149 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-07-24 13:53:12,149 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-07-24 13:53:12,149 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-07-24 13:53:12,149 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-07-24 13:53:12,149 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-07-24 13:53:12,149 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-07-24 13:53:12,150 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-07-24 13:53:12,150 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-07-24 13:53:12,150 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-07-24 13:53:12,150 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-07-24 13:53:12,150 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-07-24 13:53:12,150 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-07-24 13:53:12,150 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-07-24 13:53:12,150 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-07-24 13:53:12,150 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-07-24 13:53:12,150 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-07-24 13:53:12,150 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-07-24 13:53:12,150 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-07-24 13:53:12,150 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-07-24 13:53:12,150 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-07-24 13:53:12,151 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-07-24 13:53:12,151 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-07-24 13:53:12,151 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-07-24 13:53:12,151 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-07-24 13:53:12,151 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-07-24 13:53:12,151 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-07-24 13:53:12,151 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-07-24 13:53:12,151 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-07-24 13:53:12,151 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-07-24 13:53:12,151 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-07-24 13:53:12,151 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-07-24 13:53:12,151 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-07-24 13:53:12,152 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-07-24 13:53:12,152 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-07-24 13:53:12,152 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-07-24 13:53:12,152 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-07-24 13:53:12,152 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-07-24 13:53:12,152 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-07-24 13:53:12,152 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-07-24 13:53:12,152 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-07-24 13:53:12,152 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-07-24 13:53:12,152 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-07-24 13:53:12,152 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-07-24 13:53:12,152 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-07-24 13:53:12,152 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-07-24 13:53:12,152 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-07-24 13:53:12,152 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-07-24 13:53:12,153 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-07-24 13:53:12,153 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-07-24 13:53:12,153 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-07-24 13:53:12,153 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-07-24 13:53:12,153 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-07-24 13:53:12,153 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-07-24 13:53:12,153 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-07-24 13:53:12,153 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-07-24 13:53:12,153 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-07-24 13:53:12,153 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-07-24 13:53:12,153 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-07-24 13:53:12,153 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-07-24 13:53:12,153 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-07-24 13:53:12,153 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-07-24 13:53:12,153 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-07-24 13:53:12,153 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-07-24 13:53:12,154 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-07-24 13:53:12,154 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-07-24 13:53:12,154 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-07-24 13:53:12,154 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-07-24 13:53:12,154 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-07-24 13:53:12,154 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-07-24 13:53:12,154 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-07-24 13:53:12,154 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-07-24 13:53:12,154 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-07-24 13:53:12,154 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-07-24 13:53:12,154 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-07-24 13:53:12,154 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-07-24 13:53:12,154 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-07-24 13:53:12,154 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-07-24 13:53:12,154 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-07-24 13:53:12,155 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-07-24 13:53:12,155 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-07-24 13:53:12,155 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-07-24 13:53:12,155 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-07-24 13:53:12,155 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-07-24 13:53:12,324 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.018818446586041836); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.026523183006806898, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.018818446586041836); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.010583333333333333); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.042416666666666665, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-07-24 13:53:12,324 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-07-24 13:53:12,324 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.013556627028340124, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.018818446586041836); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.026523183006806898, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.018818446586041836); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.010583333333333333); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.042416666666666665, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-07-24 13:53:12,601 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 410 ms to try 5000 different iterations.  Found a solution that moves 975 regions; Going from a computed imbalance of 0.013556627028340124 to a new imbalance of 4.6938452748862314E-4. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.004327876503183902); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.006461489127967465); MoveCostFunction : (multiplier=7.0, imbalance=0.10833333333333334, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.004327876503183902); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.6666666666666666E-4); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.002916666666666667); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-07-24 13:53:12,604 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1037999038:81 , srv1992119467:81 , srv1225245940:82 , srv1269605976:83 , srv147001871:83 , srv1600672745:83 , srv2004575013:83 , srv216074333:83 , srv255966810:83 , srv850890617:83 , srv990967288:83 , srv1125637940:84 , srv1146400017:84 , srv1219460168:84 , srv1253373447:84 , srv1380860451:84 , srv1447658605:84 , srv1619867787:84 , srv1679129033:84 , srv1706531171:84 , srv1712605818:84 , srv1807136836:84 , srv324135438:84 , srv350367217:84 , srv445441035:84 , srv461221499:84 , srv642817702:84 , srv664528053:84 , srv693190486:84 , srv728649368:84 , srv766497774:84 , srv853419561:84 , srv975902957:84 , srv1006426636:85 , srv1035852050:85 , srv1322923:85 , srv135040570:85 , srv1419597606:85 , srv1520526213:85 , srv1567110751:85 , srv1668920425:85 , srv1718932119:85 , srv173284381:85 , srv2025238402:85 , srv2035871647:85 , srv2124783007:85 , srv651278219:85 , srv753655471:85 , srv766882674:85 , srv936408705:85 , srv1069685721:86 , srv1267437677:86 , srv1373550557:86 , srv1497600555:86 , srv1501454361:86 , srv1590786104:86 , srv1619745368:86 , srv1630981818:86 , srv189031227:86 , srv1898780897:86 , srv1900144442:86 , srv2128197662:86 , srv235450818:86 , srv450992929:86 , srv452580525:86 , srv581498613:86 , srv584121893:86 , srv616327893:86 , srv739036515:86 , srv8271051:86 , srv934287525:86 , srv934557009:86 , srv940025528:86 , srv950182090:86 , srv1002497276:87 , srv1140371444:87 , srv1223578838:87 , srv136787715:87 , srv1443854327:87 , srv1598349821:87 , srv1668985308:87 , srv1744889616:87 , srv1763310480:87 , srv1805024678:87 , srv196430439:87 , srv2038304739:87 , srv223136657:87 , srv244259047:87 , srv296408607:87 , srv315549198:87 , srv554695076:87 , srv570029561:87 , srv751057517:87 , srv827824056:87 , srv165397559:88 , srv1865073600:88 , srv1881136594:88 , srv1945343491:88 , srv931813679:88 , srv842943941:555 }
2023-07-24 13:53:12,610 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-07-24 13:53:12,611 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv2004575013=53, srv1225245940=10, srv165397559=33, srv581498613=74, srv751057517=83, srv196430439=51, srv235450818=61, srv1253373447=11, srv554695076=72, srv1520526213=25, srv584121893=75, srv223136657=60, srv324135438=66, srv2124783007=57, srv693190486=80, srv1419597606=19, srv1945343491=50, srv1898780897=48, srv8271051=87, srv651278219=78, srv1706531171=37, srv2128197662=58, srv1267437677=12, srv1125637940=5, srv1668985308=35, srv1035852050=2, srv2025238402=54, srv1590786104=27, srv445441035=68, srv135040570=15, srv616327893=76, srv1269605976=13, srv664528053=79, srv853419561=91, srv1630981818=32, srv1807136836=44, srv1219460168=8, srv1322923=14, srv296408607=64, srv934287525=93, srv842943941=89, srv461221499=71, srv1805024678=43, srv642817702=77, srv975902957=98, srv1037999038=3, srv1140371444=6, srv244259047=62, srv739036515=82, srv1881136594=46, srv766497774=85, srv1712605818=38, srv1865073600=45, srv1443854327=20, srv350367217=67, srv850890617=90, srv173284381=40, srv1598349821=28, srv1900144442=49, srv1600672745=29, srv1069685721=4, srv1567110751=26, srv728649368=81, srv936408705=95, srv216074333=59, srv1668920425=34, srv2038304739=56, srv136787715=16, srv1501454361=24, srv1146400017=7, srv950182090=97, srv1002497276=0, srv1744889616=41, srv452580525=70, srv1619867787=31, srv1718932119=39, srv255966810=63, srv1497600555=23, srv1992119467=52, srv450992929=69, srv1619745368=30, srv990967288=99, srv934557009=94, srv1006426636=1, srv1223578838=9, srv315549198=65, srv940025528=96, srv1763310480=42, srv570029561=73, srv1447658605=21, srv1679129033=36, srv827824056=88, srv147001871=22, srv753655471=84, srv189031227=47, srv1380860451=18, srv2035871647=55, srv931813679=92, srv1373550557=17, srv766882674=86} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-07-24 13:53:12,623 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-07-24 13:53:12,623 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-07-24 13:53:12,623 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-07-24 13:53:12,623 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-07-24 13:53:12,623 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-07-24 13:53:12,623 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-07-24 13:53:12,623 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-07-24 13:53:12,623 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-07-24 13:53:12,623 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-07-24 13:53:12,623 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-07-24 13:53:12,623 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-07-24 13:53:12,624 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-07-24 13:53:12,624 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-07-24 13:53:12,624 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-07-24 13:53:12,624 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-07-24 13:53:12,624 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-07-24 13:53:12,624 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-07-24 13:53:12,624 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-07-24 13:53:12,624 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-07-24 13:53:12,624 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-07-24 13:53:12,624 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-07-24 13:53:12,624 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-07-24 13:53:12,624 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-07-24 13:53:12,624 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-07-24 13:53:12,624 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-07-24 13:53:12,624 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-07-24 13:53:12,625 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-07-24 13:53:12,625 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-07-24 13:53:12,625 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-07-24 13:53:12,625 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-07-24 13:53:12,625 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-07-24 13:53:12,625 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-07-24 13:53:12,625 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-07-24 13:53:12,625 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-07-24 13:53:12,625 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-07-24 13:53:12,625 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-07-24 13:53:12,625 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-07-24 13:53:12,626 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-07-24 13:53:12,626 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-07-24 13:53:12,626 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-07-24 13:53:12,626 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-07-24 13:53:12,626 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-07-24 13:53:12,626 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-07-24 13:53:12,626 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-07-24 13:53:12,626 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-07-24 13:53:12,626 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-07-24 13:53:12,627 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-07-24 13:53:12,627 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-07-24 13:53:12,627 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-07-24 13:53:12,627 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-07-24 13:53:12,627 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-07-24 13:53:12,627 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-07-24 13:53:12,627 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-07-24 13:53:12,627 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-07-24 13:53:12,627 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-07-24 13:53:12,628 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-07-24 13:53:12,628 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-07-24 13:53:12,628 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-07-24 13:53:12,628 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-07-24 13:53:12,628 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-07-24 13:53:12,628 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-07-24 13:53:12,628 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-07-24 13:53:12,628 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-07-24 13:53:12,628 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-07-24 13:53:12,628 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-07-24 13:53:12,629 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-07-24 13:53:12,629 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-07-24 13:53:12,629 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-07-24 13:53:12,629 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-07-24 13:53:12,629 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-07-24 13:53:12,629 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-07-24 13:53:12,629 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-07-24 13:53:12,629 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-07-24 13:53:12,629 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-07-24 13:53:12,629 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-07-24 13:53:12,629 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-07-24 13:53:12,630 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-07-24 13:53:12,630 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-07-24 13:53:12,630 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-07-24 13:53:12,630 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-07-24 13:53:12,630 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-07-24 13:53:12,630 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-07-24 13:53:12,630 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-07-24 13:53:12,630 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-07-24 13:53:12,630 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-07-24 13:53:12,630 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-07-24 13:53:12,631 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-07-24 13:53:12,631 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-07-24 13:53:12,631 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-07-24 13:53:12,631 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-07-24 13:53:12,631 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-07-24 13:53:12,631 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-07-24 13:53:12,631 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-07-24 13:53:12,631 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-07-24 13:53:12,631 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-07-24 13:53:12,631 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-07-24 13:53:12,631 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-07-24 13:53:12,632 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-07-24 13:53:12,632 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-07-24 13:53:12,632 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-07-24 13:53:12,632 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-07-24 13:53:12,747 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.004327876503183902); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.006461489127967465); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.004327876503183902); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.6666666666666666E-4); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.002916666666666667); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-07-24 13:53:12,747 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-07-24 13:53:12,748 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=4.625574315701761E-4, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.004327876503183902); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.006461489127967465); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.004327876503183902); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.6666666666666666E-4); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.002916666666666667); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-07-24 13:53:13,172 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 527 ms to try 5000 different iterations.  Found a solution that moves 193 regions; Going from a computed imbalance of 4.625574315701761E-4 to a new imbalance of 1.5597787145286025E-5. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0014982219165849825); MoveCostFunction : (multiplier=7.0, imbalance=0.021444444444444443); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=8.333333333333333E-5); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-07-24 13:53:13,173 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1668985308:82 , srv1807136836:83 , srv296408607:83 , srv450992929:83 , srv616327893:83 , srv8271051:83 , srv975902957:83 , srv1002497276:84 , srv1006426636:84 , srv1035852050:84 , srv1125637940:84 , srv1140371444:84 , srv1223578838:84 , srv1225245940:84 , srv1267437677:84 , srv136787715:84 , srv1380860451:84 , srv1419597606:84 , srv1443854327:84 , srv1520526213:84 , srv1567110751:84 , srv1598349821:84 , srv1619867787:84 , srv1630981818:84 , srv1718932119:84 , srv1805024678:84 , srv1865073600:84 , srv1881136594:84 , srv189031227:84 , srv1898780897:84 , srv1900144442:84 , srv1945343491:84 , srv196430439:84 , srv2004575013:84 , srv2025238402:84 , srv2038304739:84 , srv2124783007:84 , srv223136657:84 , srv244259047:84 , srv315549198:84 , srv350367217:84 , srv570029561:84 , srv581498613:84 , srv584121893:84 , srv642817702:84 , srv651278219:84 , srv664528053:84 , srv693190486:84 , srv751057517:84 , srv753655471:84 , srv850890617:84 , srv853419561:84 , srv931813679:84 , srv940025528:84 , srv1037999038:85 , srv1146400017:85 , srv1219460168:85 , srv1253373447:85 , srv1269605976:85 , srv1322923:85 , srv135040570:85 , srv1373550557:85 , srv1447658605:85 , srv147001871:85 , srv1497600555:85 , srv1501454361:85 , srv1590786104:85 , srv1600672745:85 , srv1619745368:85 , srv165397559:85 , srv1668920425:85 , srv1679129033:85 , srv1706531171:85 , srv1712605818:85 , srv173284381:85 , srv1744889616:85 , srv1763310480:85 , srv1992119467:85 , srv2035871647:85 , srv2128197662:85 , srv216074333:85 , srv235450818:85 , srv255966810:85 , srv324135438:85 , srv445441035:85 , srv452580525:85 , srv461221499:85 , srv554695076:85 , srv728649368:85 , srv739036515:85 , srv766497774:85 , srv766882674:85 , srv827824056:85 , srv934287525:85 , srv934557009:85 , srv936408705:85 , srv950182090:85 , srv990967288:85 , srv1069685721:86 , srv842943941:646 }
2023-07-24 13:53:13,179 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-07-24 13:53:13,180 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv2004575013=53, srv1225245940=10, srv165397559=33, srv581498613=74, srv751057517=83, srv196430439=51, srv235450818=61, srv1253373447=11, srv554695076=72, srv1520526213=25, srv584121893=75, srv223136657=60, srv324135438=66, srv2124783007=57, srv693190486=80, srv1419597606=19, srv1945343491=50, srv1898780897=48, srv8271051=87, srv651278219=78, srv1706531171=37, srv2128197662=58, srv1267437677=12, srv1125637940=5, srv1668985308=35, srv1035852050=2, srv2025238402=54, srv1590786104=27, srv445441035=68, srv135040570=15, srv616327893=76, srv1269605976=13, srv664528053=79, srv853419561=91, srv1630981818=32, srv1807136836=44, srv1219460168=8, srv1322923=14, srv296408607=64, srv934287525=93, srv842943941=89, srv461221499=71, srv1805024678=43, srv642817702=77, srv975902957=98, srv1037999038=3, srv1140371444=6, srv244259047=62, srv739036515=82, srv1881136594=46, srv766497774=85, srv1712605818=38, srv1865073600=45, srv1443854327=20, srv350367217=67, srv850890617=90, srv173284381=40, srv1598349821=28, srv1900144442=49, srv1600672745=29, srv1069685721=4, srv1567110751=26, srv728649368=81, srv936408705=95, srv216074333=59, srv1668920425=34, srv2038304739=56, srv136787715=16, srv1501454361=24, srv1146400017=7, srv950182090=97, srv1002497276=0, srv1744889616=41, srv452580525=70, srv1619867787=31, srv1718932119=39, srv255966810=63, srv1497600555=23, srv1992119467=52, srv450992929=69, srv1619745368=30, srv990967288=99, srv934557009=94, srv1006426636=1, srv1223578838=9, srv315549198=65, srv940025528=96, srv1763310480=42, srv570029561=73, srv1447658605=21, srv1679129033=36, srv827824056=88, srv147001871=22, srv753655471=84, srv189031227=47, srv1380860451=18, srv2035871647=55, srv931813679=92, srv1373550557=17, srv766882674=86} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-07-24 13:53:13,194 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-07-24 13:53:13,194 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-07-24 13:53:13,194 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-07-24 13:53:13,194 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-07-24 13:53:13,194 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-07-24 13:53:13,194 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-07-24 13:53:13,194 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-07-24 13:53:13,194 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-07-24 13:53:13,195 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-07-24 13:53:13,195 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-07-24 13:53:13,195 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-07-24 13:53:13,195 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-07-24 13:53:13,195 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-07-24 13:53:13,196 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-07-24 13:53:13,196 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-07-24 13:53:13,196 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-07-24 13:53:13,196 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-07-24 13:53:13,196 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-07-24 13:53:13,196 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-07-24 13:53:13,196 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-07-24 13:53:13,196 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-07-24 13:53:13,196 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-07-24 13:53:13,196 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-07-24 13:53:13,197 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-07-24 13:53:13,197 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-07-24 13:53:13,197 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-07-24 13:53:13,197 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-07-24 13:53:13,197 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-07-24 13:53:13,197 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-07-24 13:53:13,197 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-07-24 13:53:13,197 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-07-24 13:53:13,197 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-07-24 13:53:13,197 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-07-24 13:53:13,197 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-07-24 13:53:13,197 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-07-24 13:53:13,197 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-07-24 13:53:13,197 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-07-24 13:53:13,198 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-07-24 13:53:13,198 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-07-24 13:53:13,198 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-07-24 13:53:13,198 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-07-24 13:53:13,198 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-07-24 13:53:13,198 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-07-24 13:53:13,198 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-07-24 13:53:13,198 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-07-24 13:53:13,198 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-07-24 13:53:13,198 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-07-24 13:53:13,198 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-07-24 13:53:13,199 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-07-24 13:53:13,199 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-07-24 13:53:13,199 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-07-24 13:53:13,199 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-07-24 13:53:13,199 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-07-24 13:53:13,199 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-07-24 13:53:13,199 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-07-24 13:53:13,199 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-07-24 13:53:13,199 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-07-24 13:53:13,199 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-07-24 13:53:13,199 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-07-24 13:53:13,199 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-07-24 13:53:13,199 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-07-24 13:53:13,199 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-07-24 13:53:13,199 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-07-24 13:53:13,200 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-07-24 13:53:13,200 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-07-24 13:53:13,200 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-07-24 13:53:13,200 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-07-24 13:53:13,200 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-07-24 13:53:13,200 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-07-24 13:53:13,200 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-07-24 13:53:13,200 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-07-24 13:53:13,200 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-07-24 13:53:13,200 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-07-24 13:53:13,200 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-07-24 13:53:13,200 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-07-24 13:53:13,200 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-07-24 13:53:13,200 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-07-24 13:53:13,200 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-07-24 13:53:13,201 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-07-24 13:53:13,201 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-07-24 13:53:13,201 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-07-24 13:53:13,201 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-07-24 13:53:13,201 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-07-24 13:53:13,201 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-07-24 13:53:13,201 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-07-24 13:53:13,201 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-07-24 13:53:13,201 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-07-24 13:53:13,201 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-07-24 13:53:13,201 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-07-24 13:53:13,201 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-07-24 13:53:13,201 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-07-24 13:53:13,201 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-07-24 13:53:13,201 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-07-24 13:53:13,201 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-07-24 13:53:13,201 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-07-24 13:53:13,201 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-07-24 13:53:13,201 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-07-24 13:53:13,201 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-07-24 13:53:13,202 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-07-24 13:53:13,202 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-07-24 13:53:13,202 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-07-24 13:53:13,350 INFO  [Time-limited test] balancer.StochasticLoadBalancer(381): Cluster wide - skipping load balancing because weighted average imbalance=1.4246372260916522E-5 <= threshold(0.025). If you want more aggressive balancing, either lower hbase.master.balancer.stochastic.minCostNeedBalance from 0.025 or increase the relative multiplier(s) of the specific cost function(s). functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0014982219165849825); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=8.333333333333333E-5); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-07-24 13:53:13,350 INFO  [Time-limited test] balancer.BalancerTestBase(570): Mock Final balance: { srv1668985308:82 , srv1807136836:83 , srv296408607:83 , srv450992929:83 , srv616327893:83 , srv8271051:83 , srv975902957:83 , srv1002497276:84 , srv1006426636:84 , srv1035852050:84 , srv1125637940:84 , srv1140371444:84 , srv1223578838:84 , srv1225245940:84 , srv1267437677:84 , srv136787715:84 , srv1380860451:84 , srv1419597606:84 , srv1443854327:84 , srv1520526213:84 , srv1567110751:84 , srv1598349821:84 , srv1619867787:84 , srv1630981818:84 , srv1718932119:84 , srv1805024678:84 , srv1865073600:84 , srv1881136594:84 , srv189031227:84 , srv1898780897:84 , srv1900144442:84 , srv1945343491:84 , srv196430439:84 , srv2004575013:84 , srv2025238402:84 , srv2038304739:84 , srv2124783007:84 , srv223136657:84 , srv244259047:84 , srv315549198:84 , srv350367217:84 , srv570029561:84 , srv581498613:84 , srv584121893:84 , srv642817702:84 , srv651278219:84 , srv664528053:84 , srv693190486:84 , srv751057517:84 , srv753655471:84 , srv850890617:84 , srv853419561:84 , srv931813679:84 , srv940025528:84 , srv1037999038:85 , srv1146400017:85 , srv1219460168:85 , srv1253373447:85 , srv1269605976:85 , srv1322923:85 , srv135040570:85 , srv1373550557:85 , srv1447658605:85 , srv147001871:85 , srv1497600555:85 , srv1501454361:85 , srv1590786104:85 , srv1600672745:85 , srv1619745368:85 , srv165397559:85 , srv1668920425:85 , srv1679129033:85 , srv1706531171:85 , srv1712605818:85 , srv173284381:85 , srv1744889616:85 , srv1763310480:85 , srv1992119467:85 , srv2035871647:85 , srv2128197662:85 , srv216074333:85 , srv235450818:85 , srv255966810:85 , srv324135438:85 , srv445441035:85 , srv452580525:85 , srv461221499:85 , srv554695076:85 , srv728649368:85 , srv739036515:85 , srv766497774:85 , srv766882674:85 , srv827824056:85 , srv934287525:85 , srv934557009:85 , srv936408705:85 , srv950182090:85 , srv990967288:85 , srv1069685721:86 , srv842943941:646 }
2023-07-24 13:53:13,412 INFO  [Time-limited test] hbase.ResourceChecker(175): after: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnLargeClusterWithRacks Thread=12 (was 12), OpenFileDescriptor=263 (was 263), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=322 (was 290) - SystemLoadAverage LEAK? -, ProcessCount=179 (was 179), AvailableMemoryMB=9538 (was 10323)
2023-07-24 13:53:13,458 INFO  [Time-limited test] hbase.ResourceChecker(147): before: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnMidClusterWithRacks Thread=12, OpenFileDescriptor=263, MaxFileDescriptor=60000, SystemLoadAverage=322, ProcessCount=179, AvailableMemoryMB=9524
2023-07-24 13:53:13,459 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2023-07-24 13:53:13,459 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=5000, runMaxSteps=true, stepsPerRegion=800, maxRunningTime=120000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 111077.0 etc.
2023-07-24 13:53:13,472 INFO  [Time-limited test] balancer.BalancerTestBase(547): Mock Cluster : { srv108247995:84 , srv1111220322:84 , srv1366355702:84 , srv1433004435:84 , srv1508306002:84 , srv1522581119:84 , srv1526227644:84 , srv1641109205:84 , srv1658610341:84 , srv1708503660:84 , srv1868105132:84 , srv1885680172:84 , srv1900907969:84 , srv1911944114:84 , srv2043621293:84 , srv2069056349:84 , srv237537900:84 , srv256215163:84 , srv314373449:84 , srv490151471:84 , srv571049266:84 , srv611637658:84 , srv655406986:84 , srv699176818:84 , srv757125417:84 , srv771473218:84 , srv811287455:84 , srv841979813:84 , srv94929137:84 , srv274840677:264 } [srvr=30 rgns=2700 avg=90.0 max=90 min=90]
2023-07-24 13:53:13,474 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-07-24 13:53:13,474 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv2069056349=15, srv490151471=20, srv1900907969=12, srv1508306002=4, srv2043621293=14, srv655406986=23, srv108247995=0, srv757125417=25, srv841979813=28, srv611637658=22, srv1868105132=10, srv699176818=24, srv1641109205=7, srv274840677=18, srv1885680172=11, srv1111220322=1, srv94929137=29, srv811287455=27, srv571049266=21, srv1433004435=3, srv1911944114=13, srv1522581119=5, srv1526227644=6, srv314373449=19, srv1658610341=8, srv1366355702=2, srv237537900=16, srv1708503660=9, srv771473218=26, srv256215163=17} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-07-24 13:53:13,511 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-07-24 13:53:13,512 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-07-24 13:53:13,512 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-07-24 13:53:13,512 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-07-24 13:53:13,512 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-07-24 13:53:13,512 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-07-24 13:53:13,512 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-07-24 13:53:13,512 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-07-24 13:53:13,512 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-07-24 13:53:13,512 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-07-24 13:53:13,512 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-07-24 13:53:13,513 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-07-24 13:53:13,513 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-07-24 13:53:13,513 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-07-24 13:53:13,513 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-07-24 13:53:13,513 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-07-24 13:53:13,513 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-07-24 13:53:13,513 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-07-24 13:53:13,513 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-07-24 13:53:13,513 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-07-24 13:53:13,513 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-07-24 13:53:13,513 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-07-24 13:53:13,513 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-07-24 13:53:13,513 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-07-24 13:53:13,514 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-07-24 13:53:13,514 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-07-24 13:53:13,514 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-07-24 13:53:13,514 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-07-24 13:53:13,514 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-07-24 13:53:13,514 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-07-24 13:53:13,515 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=10, number of hosts=30, number of racks=4
2023-07-24 13:53:13,552 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=1.0943837791778834, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-07-24 13:53:13,552 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.9912490443470555, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=1.0943837791778834, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=64800000
2023-07-24 13:55:13,519 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 120001 ms to try 5959849 different iterations.  Found a solution that moves 1848 regions; Going from a computed imbalance of 0.9912490443470555 to a new imbalance of 4.313324190526491E-5. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); MoveCostFunction : (multiplier=7.0, imbalance=0.6844444444444444, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-07-24 13:55:13,525 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv108247995:90 , srv1111220322:90 , srv1366355702:90 , srv1433004435:90 , srv1508306002:90 , srv1522581119:90 , srv1526227644:90 , srv1641109205:90 , srv1658610341:90 , srv1708503660:90 , srv1868105132:90 , srv1885680172:90 , srv1900907969:90 , srv1911944114:90 , srv2043621293:90 , srv2069056349:90 , srv237537900:90 , srv256215163:90 , srv274840677:90 , srv314373449:90 , srv490151471:90 , srv571049266:90 , srv611637658:90 , srv655406986:90 , srv699176818:90 , srv757125417:90 , srv771473218:90 , srv811287455:90 , srv841979813:90 , srv94929137:90 }
2023-07-24 13:55:13,526 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-07-24 13:55:13,526 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv2069056349=15, srv490151471=20, srv1900907969=12, srv1508306002=4, srv2043621293=14, srv655406986=23, srv108247995=0, srv757125417=25, srv841979813=28, srv611637658=22, srv1868105132=10, srv699176818=24, srv1641109205=7, srv274840677=18, srv1885680172=11, srv1111220322=1, srv94929137=29, srv811287455=27, srv571049266=21, srv1433004435=3, srv1911944114=13, srv1522581119=5, srv1526227644=6, srv314373449=19, srv1658610341=8, srv1366355702=2, srv237537900=16, srv1708503660=9, srv771473218=26, srv256215163=17} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-07-24 13:55:13,529 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-07-24 13:55:13,529 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-07-24 13:55:13,529 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-07-24 13:55:13,529 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-07-24 13:55:13,529 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-07-24 13:55:13,529 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-07-24 13:55:13,529 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-07-24 13:55:13,529 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-07-24 13:55:13,529 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-07-24 13:55:13,529 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-07-24 13:55:13,530 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-07-24 13:55:13,530 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-07-24 13:55:13,530 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-07-24 13:55:13,530 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-07-24 13:55:13,530 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-07-24 13:55:13,530 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-07-24 13:55:13,530 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-07-24 13:55:13,530 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-07-24 13:55:13,530 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-07-24 13:55:13,530 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-07-24 13:55:13,530 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-07-24 13:55:13,530 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-07-24 13:55:13,530 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-07-24 13:55:13,530 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-07-24 13:55:13,530 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-07-24 13:55:13,530 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-07-24 13:55:13,530 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-07-24 13:55:13,530 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-07-24 13:55:13,530 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-07-24 13:55:13,530 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-07-24 13:55:13,530 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=10, number of hosts=30, number of racks=4
2023-07-24 13:55:13,542 INFO  [Time-limited test] balancer.StochasticLoadBalancer(381): Cluster wide - skipping load balancing because weighted average imbalance=0.0 <= threshold(0.025). If you want more aggressive balancing, either lower hbase.master.balancer.stochastic.minCostNeedBalance from 0.025 or increase the relative multiplier(s) of the specific cost function(s). functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-07-24 13:55:13,542 INFO  [Time-limited test] balancer.BalancerTestBase(570): Mock Final balance: { srv108247995:90 , srv1111220322:90 , srv1366355702:90 , srv1433004435:90 , srv1508306002:90 , srv1522581119:90 , srv1526227644:90 , srv1641109205:90 , srv1658610341:90 , srv1708503660:90 , srv1868105132:90 , srv1885680172:90 , srv1900907969:90 , srv1911944114:90 , srv2043621293:90 , srv2069056349:90 , srv237537900:90 , srv256215163:90 , srv274840677:90 , srv314373449:90 , srv490151471:90 , srv571049266:90 , srv611637658:90 , srv655406986:90 , srv699176818:90 , srv757125417:90 , srv771473218:90 , srv811287455:90 , srv841979813:90 , srv94929137:90 }
2023-07-24 13:55:13,558 INFO  [Time-limited test] hbase.ResourceChecker(175): after: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnMidClusterWithRacks Thread=11 (was 12), OpenFileDescriptor=263 (was 263), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=354 (was 322) - SystemLoadAverage LEAK? -, ProcessCount=175 (was 179), AvailableMemoryMB=9390 (was 9524)