2023-10-15 17:53:31,891 INFO  [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks timeout: 13 mins
2023-10-15 17:53:32,220 WARN  [Time-limited test] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties
2023-10-15 17:53:32,366 INFO  [Time-limited test] metrics.MetricRegistriesLoader(60): Loaded MetricRegistries class org.apache.hadoop.hbase.metrics.impl.MetricRegistriesImpl
2023-10-15 17:53:32,450 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2023-10-15 17:53:32,457 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc.
2023-10-15 17:53:32,471 INFO  [Time-limited test] hbase.ResourceChecker(147): before: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnLargeClusterWithRacks Thread=12, OpenFileDescriptor=263, MaxFileDescriptor=60000, SystemLoadAverage=258, ProcessCount=173, AvailableMemoryMB=6677
2023-10-15 17:53:32,473 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2023-10-15 17:53:32,474 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=5000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=10000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc.
2023-10-15 17:53:32,622 INFO  [Time-limited test] balancer.BalancerTestBase(547): Mock Cluster : { srv1092603807:84 , srv1096656305:84 , srv1118628386:84 , srv112196613:84 , srv112343788:84 , srv1132715393:84 , srv1140967692:84 , srv1151280966:84 , srv1155102866:84 , srv1156866766:84 , srv1163395568:84 , srv1178101037:84 , srv1184069212:84 , srv1187286726:84 , srv1192607252:84 , srv1207142480:84 , srv1211136973:84 , srv1219278328:84 , srv1224050964:84 , srv1241473294:84 , srv1242657262:84 , srv1247138403:84 , srv1260380829:84 , srv1261119382:84 , srv1281988215:84 , srv129427640:84 , srv1331412058:84 , srv1351448994:84 , srv1361409486:84 , srv136478915:84 , srv1383285361:84 , srv1387662481:84 , srv1409526543:84 , srv1431610664:84 , srv1456935157:84 , srv1466041576:84 , srv1526775145:84 , srv1562505066:84 , srv1563128942:84 , srv1593816005:84 , srv1600382163:84 , srv162817656:84 , srv1629429342:84 , srv1641669872:84 , srv1703150257:84 , srv1704186162:84 , srv1711025381:84 , srv1729656915:84 , srv174731057:84 , srv1758850861:84 , srv1769157614:84 , srv1797912208:84 , srv1802695180:84 , srv1872514303:84 , srv1894175705:84 , srv191089956:84 , srv1941294590:84 , srv195001017:84 , srv1959705273:84 , srv1964893350:84 , srv1987796236:84 , srv2003645522:84 , srv2016662109:84 , srv2027859583:84 , srv2042964732:84 , srv2067121928:84 , srv2084380979:84 , srv2106919916:84 , srv2108046416:84 , srv2133598220:84 , srv2133642873:84 , srv2137761043:84 , srv231908221:84 , srv259321589:84 , srv32446480:84 , srv334153850:84 , srv400206868:84 , srv417238138:84 , srv430396803:84 , srv484715566:84 , srv487910106:84 , srv504405485:84 , srv508855954:84 , srv519576785:84 , srv539715165:84 , srv553508938:84 , srv59679720:84 , srv597271407:84 , srv638097255:84 , srv728652853:84 , srv742313657:84 , srv749248609:84 , srv799616027:84 , srv81200218:84 , srv863117908:84 , srv876211811:84 , srv900750708:84 , srv951783653:84 , srv976074429:84 , srv579937806:684 } [srvr=100 rgns=9000 avg=90.0 max=90 min=90]
2023-10-15 17:53:32,636 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-10-15 17:53:32,644 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv112196613=3, srv1211136973=16, srv2137761043=71, srv2133598220=69, srv1600382163=40, srv1331412058=26, srv951783653=98, srv2003645522=61, srv2027859583=63, srv191089956=55, srv1456935157=34, srv1409526543=32, srv1351448994=27, srv553508938=85, srv1156866766=9, srv1941294590=56, srv1118628386=2, srv1247138403=21, srv508855954=82, srv1163395568=10, srv1155102866=8, srv579937806=86, srv728652853=90, srv484715566=79, srv638097255=89, srv1729656915=47, srv1563128942=38, srv81200218=94, srv1629429342=42, srv1802695180=52, srv2016662109=62, srv32446480=74, srv1261119382=23, srv1224050964=18, srv1704186162=45, srv1096656305=1, srv129427640=25, srv539715165=84, srv1219278328=17, srv1593816005=39, srv1281988215=24, srv259321589=73, srv597271407=88, srv1140967692=6, srv1466041576=35, srv1987796236=60, srv162817656=41, srv112343788=4, srv504405485=81, srv174731057=48, srv1260380829=22, srv799616027=93, srv1207142480=15, srv1151280966=7, srv742313657=91, srv1178101037=11, srv2067121928=65, srv1383285361=30, srv876211811=96, srv1431610664=33, srv231908221=72, srv400206868=76, srv1711025381=46, srv1132715393=5, srv1894175705=54, srv1562505066=37, srv487910106=80, srv2133642873=70, srv1387662481=31, srv417238138=77, srv863117908=95, srv1797912208=51, srv59679720=87, srv1964893350=59, srv2108046416=68, srv1241473294=19, srv1192607252=14, srv1872514303=53, srv2042964732=64, srv1758850861=49, srv1703150257=44, srv195001017=57, srv1959705273=58, srv900750708=97, srv1361409486=28, srv976074429=99, srv1526775145=36, srv334153850=75, srv1242657262=20, srv2084380979=66, srv136478915=29, srv1769157614=50, srv749248609=92, srv430396803=78, srv1092603807=0, srv1184069212=12, srv1187286726=13, srv1641669872=43, srv2106919916=67, srv519576785=83} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-10-15 17:53:32,763 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-10-15 17:53:32,763 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-10-15 17:53:32,763 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-10-15 17:53:32,763 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-10-15 17:53:32,763 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-10-15 17:53:32,763 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-10-15 17:53:32,763 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-10-15 17:53:32,763 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-10-15 17:53:32,764 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-10-15 17:53:32,764 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-10-15 17:53:32,764 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-10-15 17:53:32,764 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-10-15 17:53:32,764 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-10-15 17:53:32,764 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-10-15 17:53:32,765 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-10-15 17:53:32,765 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-10-15 17:53:32,765 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-10-15 17:53:32,765 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-10-15 17:53:32,765 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-10-15 17:53:32,766 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-10-15 17:53:32,766 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-10-15 17:53:32,766 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-10-15 17:53:32,766 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-10-15 17:53:32,766 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-10-15 17:53:32,766 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-10-15 17:53:32,766 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-10-15 17:53:32,767 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-10-15 17:53:32,767 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-10-15 17:53:32,767 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-10-15 17:53:32,767 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-10-15 17:53:32,767 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-10-15 17:53:32,767 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-10-15 17:53:32,767 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-10-15 17:53:32,767 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-10-15 17:53:32,767 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-10-15 17:53:32,768 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-10-15 17:53:32,768 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-10-15 17:53:32,768 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-10-15 17:53:32,768 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-10-15 17:53:32,768 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-10-15 17:53:32,768 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-10-15 17:53:32,768 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-10-15 17:53:32,768 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-10-15 17:53:32,768 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-10-15 17:53:32,768 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-10-15 17:53:32,768 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-10-15 17:53:32,769 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-10-15 17:53:32,769 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-10-15 17:53:32,769 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-10-15 17:53:32,769 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-10-15 17:53:32,769 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-10-15 17:53:32,769 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-10-15 17:53:32,769 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-10-15 17:53:32,769 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-10-15 17:53:32,769 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-10-15 17:53:32,769 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-10-15 17:53:32,770 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-10-15 17:53:32,770 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-10-15 17:53:32,770 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-10-15 17:53:32,770 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-10-15 17:53:32,770 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-10-15 17:53:32,770 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-10-15 17:53:32,770 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-10-15 17:53:32,770 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-10-15 17:53:32,770 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-10-15 17:53:32,770 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-10-15 17:53:32,770 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-10-15 17:53:32,771 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-10-15 17:53:32,771 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-10-15 17:53:32,771 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-10-15 17:53:32,771 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-10-15 17:53:32,771 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-10-15 17:53:32,771 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-10-15 17:53:32,771 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-10-15 17:53:32,771 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-10-15 17:53:32,771 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-10-15 17:53:32,771 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-10-15 17:53:32,771 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-10-15 17:53:32,771 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-10-15 17:53:32,772 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-10-15 17:53:32,772 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-10-15 17:53:32,772 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-10-15 17:53:32,772 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-10-15 17:53:32,772 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-10-15 17:53:32,772 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-10-15 17:53:32,772 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-10-15 17:53:32,772 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-10-15 17:53:32,772 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-10-15 17:53:32,772 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-10-15 17:53:32,772 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-10-15 17:53:32,773 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-10-15 17:53:32,773 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-10-15 17:53:32,773 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-10-15 17:53:32,773 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-10-15 17:53:32,773 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-10-15 17:53:32,773 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-10-15 17:53:32,773 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-10-15 17:53:32,773 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-10-15 17:53:32,773 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-10-15 17:53:32,773 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-10-15 17:53:32,773 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-10-15 17:53:33,011 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.06666666666666667, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-10-15 17:53:33,011 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-10-15 17:53:33,011 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.9909252140407105, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.06666666666666667, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-10-15 17:53:33,970 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 1166 ms to try 5000 different iterations.  Found a solution that moves 4687 regions; Going from a computed imbalance of 0.9909252140407105 to a new imbalance of 0.17553139593422967. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.04027527179788877, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.05461630266023003, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.5207777777777778, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.04027527179788877, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.17033333333333334, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.24116666666666667, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-10-15 17:53:34,008 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1703150257:82 , srv2027859583:82 , srv2067121928:82 , srv1092603807:83 , srv1207142480:83 , srv1641669872:83 , srv1769157614:83 , srv1872514303:83 , srv1964893350:83 , srv519576785:83 , srv638097255:83 , srv742313657:83 , srv863117908:83 , srv136478915:84 , srv1466041576:84 , srv174731057:84 , srv1797912208:84 , srv1802695180:84 , srv1959705273:84 , srv2003645522:84 , srv2108046416:84 , srv728652853:84 , srv81200218:84 , srv1151280966:85 , srv1155102866:85 , srv1156866766:85 , srv1178101037:85 , srv1219278328:85 , srv1281988215:85 , srv1431610664:85 , srv1456935157:85 , srv162817656:85 , srv1758850861:85 , srv2137761043:85 , srv484715566:85 , srv487910106:85 , srv749248609:85 , srv876211811:85 , srv112196613:86 , srv1132715393:86 , srv1163395568:86 , srv1224050964:86 , srv1562505066:86 , srv1593816005:86 , srv1600382163:86 , srv1629429342:86 , srv1704186162:86 , srv1711025381:86 , srv1941294590:86 , srv2084380979:86 , srv259321589:86 , srv32446480:86 , srv334153850:86 , srv417238138:86 , srv976074429:86 , srv1184069212:87 , srv1247138403:87 , srv1387662481:87 , srv191089956:87 , srv1987796236:87 , srv2042964732:87 , srv430396803:87 , srv504405485:87 , srv508855954:87 , srv539715165:87 , srv900750708:87 , srv951783653:87 , srv1096656305:88 , srv112343788:88 , srv1192607252:88 , srv1241473294:88 , srv1261119382:88 , srv1331412058:88 , srv1351448994:88 , srv1361409486:88 , srv1383285361:88 , srv1563128942:88 , srv2016662109:88 , srv400206868:88 , srv59679720:88 , srv597271407:88 , srv799616027:88 , srv1242657262:89 , srv1260380829:89 , srv129427640:89 , srv1409526543:89 , srv1729656915:89 , srv195001017:89 , srv2106919916:89 , srv2133642873:89 , srv553508938:89 , srv1211136973:90 , srv2133598220:90 , srv231908221:90 , srv1140967692:91 , srv1187286726:92 , srv1526775145:93 , srv1118628386:94 , srv1894175705:94 , srv579937806:448 }
2023-10-15 17:53:34,014 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-10-15 17:53:34,015 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv112196613=3, srv1211136973=16, srv2137761043=71, srv2133598220=69, srv1600382163=40, srv1331412058=26, srv951783653=98, srv2003645522=61, srv2027859583=63, srv191089956=55, srv1456935157=34, srv1409526543=32, srv1351448994=27, srv553508938=85, srv1156866766=9, srv1941294590=56, srv1118628386=2, srv1247138403=21, srv508855954=82, srv1163395568=10, srv1155102866=8, srv579937806=86, srv728652853=90, srv484715566=79, srv638097255=89, srv1729656915=47, srv1563128942=38, srv81200218=94, srv1629429342=42, srv1802695180=52, srv2016662109=62, srv32446480=74, srv1261119382=23, srv1224050964=18, srv1704186162=45, srv1096656305=1, srv129427640=25, srv539715165=84, srv1219278328=17, srv1593816005=39, srv1281988215=24, srv259321589=73, srv597271407=88, srv1140967692=6, srv1466041576=35, srv1987796236=60, srv162817656=41, srv112343788=4, srv504405485=81, srv174731057=48, srv1260380829=22, srv799616027=93, srv1207142480=15, srv1151280966=7, srv742313657=91, srv1178101037=11, srv2067121928=65, srv1383285361=30, srv876211811=96, srv1431610664=33, srv231908221=72, srv400206868=76, srv1711025381=46, srv1132715393=5, srv1894175705=54, srv1562505066=37, srv487910106=80, srv2133642873=70, srv1387662481=31, srv417238138=77, srv863117908=95, srv1797912208=51, srv59679720=87, srv1964893350=59, srv2108046416=68, srv1241473294=19, srv1192607252=14, srv1872514303=53, srv2042964732=64, srv1758850861=49, srv1703150257=44, srv195001017=57, srv1959705273=58, srv900750708=97, srv1361409486=28, srv976074429=99, srv1526775145=36, srv334153850=75, srv1242657262=20, srv2084380979=66, srv136478915=29, srv1769157614=50, srv749248609=92, srv430396803=78, srv1092603807=0, srv1184069212=12, srv1187286726=13, srv1641669872=43, srv2106919916=67, srv519576785=83} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-10-15 17:53:34,039 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-10-15 17:53:34,040 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-10-15 17:53:34,040 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-10-15 17:53:34,040 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-10-15 17:53:34,040 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-10-15 17:53:34,040 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-10-15 17:53:34,040 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-10-15 17:53:34,040 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-10-15 17:53:34,041 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-10-15 17:53:34,041 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-10-15 17:53:34,041 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-10-15 17:53:34,041 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-10-15 17:53:34,041 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-10-15 17:53:34,041 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-10-15 17:53:34,042 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-10-15 17:53:34,042 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-10-15 17:53:34,042 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-10-15 17:53:34,042 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-10-15 17:53:34,042 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-10-15 17:53:34,042 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-10-15 17:53:34,042 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-10-15 17:53:34,042 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-10-15 17:53:34,043 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-10-15 17:53:34,043 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-10-15 17:53:34,043 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-10-15 17:53:34,043 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-10-15 17:53:34,043 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-10-15 17:53:34,043 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-10-15 17:53:34,043 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-10-15 17:53:34,043 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-10-15 17:53:34,044 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-10-15 17:53:34,044 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-10-15 17:53:34,044 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-10-15 17:53:34,044 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-10-15 17:53:34,044 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-10-15 17:53:34,044 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-10-15 17:53:34,044 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-10-15 17:53:34,044 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-10-15 17:53:34,045 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-10-15 17:53:34,045 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-10-15 17:53:34,045 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-10-15 17:53:34,045 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-10-15 17:53:34,045 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-10-15 17:53:34,045 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-10-15 17:53:34,045 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-10-15 17:53:34,045 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-10-15 17:53:34,045 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-10-15 17:53:34,046 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-10-15 17:53:34,046 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-10-15 17:53:34,046 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-10-15 17:53:34,046 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-10-15 17:53:34,046 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-10-15 17:53:34,046 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-10-15 17:53:34,046 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-10-15 17:53:34,046 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-10-15 17:53:34,047 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-10-15 17:53:34,047 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-10-15 17:53:34,047 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-10-15 17:53:34,047 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-10-15 17:53:34,047 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-10-15 17:53:34,047 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-10-15 17:53:34,047 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-10-15 17:53:34,047 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-10-15 17:53:34,048 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-10-15 17:53:34,048 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-10-15 17:53:34,048 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-10-15 17:53:34,048 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-10-15 17:53:34,048 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-10-15 17:53:34,048 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-10-15 17:53:34,048 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-10-15 17:53:34,048 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-10-15 17:53:34,048 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-10-15 17:53:34,049 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-10-15 17:53:34,049 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-10-15 17:53:34,049 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-10-15 17:53:34,049 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-10-15 17:53:34,049 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-10-15 17:53:34,049 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-10-15 17:53:34,049 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-10-15 17:53:34,049 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-10-15 17:53:34,049 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-10-15 17:53:34,050 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-10-15 17:53:34,050 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-10-15 17:53:34,050 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-10-15 17:53:34,050 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-10-15 17:53:34,050 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-10-15 17:53:34,050 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-10-15 17:53:34,050 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-10-15 17:53:34,050 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-10-15 17:53:34,050 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-10-15 17:53:34,051 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-10-15 17:53:34,051 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-10-15 17:53:34,051 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-10-15 17:53:34,051 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-10-15 17:53:34,051 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-10-15 17:53:34,051 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-10-15 17:53:34,051 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-10-15 17:53:34,051 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-10-15 17:53:34,051 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-10-15 17:53:34,052 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-10-15 17:53:34,052 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-10-15 17:53:34,239 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.04027527179788877, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.05461630266023003, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.04027527179788877, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.17033333333333334, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.24116666666666667, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-10-15 17:53:34,239 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-10-15 17:53:34,239 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.17549857685877351, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.04027527179788877, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.05461630266023003, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.04027527179788877, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.17033333333333334, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.24116666666666667, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-10-15 17:53:34,526 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 443 ms to try 5000 different iterations.  Found a solution that moves 2646 regions; Going from a computed imbalance of 0.17549857685877351 to a new imbalance of 0.014857529496299765. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.02239272413143802); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.035916726233672196, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.294, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.02239272413143802); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.011416666666666667); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.04766666666666667, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-10-15 17:53:34,534 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1118628386:78 , srv1526775145:78 , srv1140967692:80 , srv1894175705:80 , srv231908221:80 , srv1242657262:81 , srv1187286726:82 , srv1260380829:82 , srv129427640:82 , srv1383285361:82 , srv2106919916:82 , srv2133598220:82 , srv1096656305:83 , srv1211136973:83 , srv1241473294:83 , srv1331412058:83 , srv1351448994:83 , srv1409526543:83 , srv1729656915:83 , srv195001017:83 , srv2016662109:83 , srv1192607252:84 , srv1224050964:84 , srv1261119382:84 , srv1456935157:84 , srv1600382163:84 , srv1629429342:84 , srv1987796236:84 , srv2042964732:84 , srv539715165:84 , srv553508938:84 , srv59679720:84 , srv951783653:84 , srv1156866766:85 , srv1247138403:85 , srv1387662481:85 , srv1563128942:85 , srv1758850861:85 , srv1941294590:85 , srv2133642873:85 , srv32446480:85 , srv417238138:85 , srv430396803:85 , srv597271407:85 , srv876211811:85 , srv976074429:85 , srv112196613:86 , srv1132715393:86 , srv1163395568:86 , srv1219278328:86 , srv1361409486:86 , srv1562505066:86 , srv1797912208:86 , srv191089956:86 , srv2003645522:86 , srv259321589:86 , srv334153850:86 , srv400206868:86 , srv487910106:86 , srv504405485:86 , srv799616027:86 , srv900750708:86 , srv1092603807:87 , srv1151280966:87 , srv1704186162:87 , srv1711025381:87 , srv1959705273:87 , srv2137761043:87 , srv484715566:87 , srv638097255:87 , srv112343788:88 , srv1155102866:88 , srv1178101037:88 , srv1184069212:88 , srv1207142480:88 , srv136478915:88 , srv1431610664:88 , srv1466041576:88 , srv1593816005:88 , srv162817656:88 , srv1703150257:88 , srv174731057:88 , srv1769157614:88 , srv1802695180:88 , srv2108046416:88 , srv742313657:88 , srv1281988215:89 , srv1641669872:89 , srv2027859583:89 , srv2084380979:89 , srv508855954:89 , srv728652853:89 , srv749248609:89 , srv1872514303:90 , srv1964893350:90 , srv2067121928:90 , srv519576785:91 , srv81200218:91 , srv863117908:91 , srv579937806:525 }
2023-10-15 17:53:34,538 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-10-15 17:53:34,538 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv112196613=3, srv1211136973=16, srv2137761043=71, srv2133598220=69, srv1600382163=40, srv1331412058=26, srv951783653=98, srv2003645522=61, srv2027859583=63, srv191089956=55, srv1456935157=34, srv1409526543=32, srv1351448994=27, srv553508938=85, srv1156866766=9, srv1941294590=56, srv1118628386=2, srv1247138403=21, srv508855954=82, srv1163395568=10, srv1155102866=8, srv579937806=86, srv728652853=90, srv484715566=79, srv638097255=89, srv1729656915=47, srv1563128942=38, srv81200218=94, srv1629429342=42, srv1802695180=52, srv2016662109=62, srv32446480=74, srv1261119382=23, srv1224050964=18, srv1704186162=45, srv1096656305=1, srv129427640=25, srv539715165=84, srv1219278328=17, srv1593816005=39, srv1281988215=24, srv259321589=73, srv597271407=88, srv1140967692=6, srv1466041576=35, srv1987796236=60, srv162817656=41, srv112343788=4, srv504405485=81, srv174731057=48, srv1260380829=22, srv799616027=93, srv1207142480=15, srv1151280966=7, srv742313657=91, srv1178101037=11, srv2067121928=65, srv1383285361=30, srv876211811=96, srv1431610664=33, srv231908221=72, srv400206868=76, srv1711025381=46, srv1132715393=5, srv1894175705=54, srv1562505066=37, srv487910106=80, srv2133642873=70, srv1387662481=31, srv417238138=77, srv863117908=95, srv1797912208=51, srv59679720=87, srv1964893350=59, srv2108046416=68, srv1241473294=19, srv1192607252=14, srv1872514303=53, srv2042964732=64, srv1758850861=49, srv1703150257=44, srv195001017=57, srv1959705273=58, srv900750708=97, srv1361409486=28, srv976074429=99, srv1526775145=36, srv334153850=75, srv1242657262=20, srv2084380979=66, srv136478915=29, srv1769157614=50, srv749248609=92, srv430396803=78, srv1092603807=0, srv1184069212=12, srv1187286726=13, srv1641669872=43, srv2106919916=67, srv519576785=83} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-10-15 17:53:34,550 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-10-15 17:53:34,550 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-10-15 17:53:34,550 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-10-15 17:53:34,550 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-10-15 17:53:34,550 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-10-15 17:53:34,550 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-10-15 17:53:34,551 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-10-15 17:53:34,551 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-10-15 17:53:34,551 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-10-15 17:53:34,551 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-10-15 17:53:34,551 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-10-15 17:53:34,551 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-10-15 17:53:34,551 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-10-15 17:53:34,551 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-10-15 17:53:34,551 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-10-15 17:53:34,551 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-10-15 17:53:34,551 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-10-15 17:53:34,551 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-10-15 17:53:34,551 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-10-15 17:53:34,551 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-10-15 17:53:34,551 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-10-15 17:53:34,551 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-10-15 17:53:34,552 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-10-15 17:53:34,552 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-10-15 17:53:34,552 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-10-15 17:53:34,552 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-10-15 17:53:34,552 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-10-15 17:53:34,552 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-10-15 17:53:34,552 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-10-15 17:53:34,552 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-10-15 17:53:34,552 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-10-15 17:53:34,552 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-10-15 17:53:34,552 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-10-15 17:53:34,552 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-10-15 17:53:34,552 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-10-15 17:53:34,552 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-10-15 17:53:34,552 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-10-15 17:53:34,553 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-10-15 17:53:34,553 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-10-15 17:53:34,553 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-10-15 17:53:34,553 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-10-15 17:53:34,553 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-10-15 17:53:34,553 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-10-15 17:53:34,553 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-10-15 17:53:34,553 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-10-15 17:53:34,553 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-10-15 17:53:34,553 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-10-15 17:53:34,553 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-10-15 17:53:34,553 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-10-15 17:53:34,553 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-10-15 17:53:34,553 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-10-15 17:53:34,554 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-10-15 17:53:34,554 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-10-15 17:53:34,554 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-10-15 17:53:34,554 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-10-15 17:53:34,554 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-10-15 17:53:34,554 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-10-15 17:53:34,554 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-10-15 17:53:34,554 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-10-15 17:53:34,554 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-10-15 17:53:34,554 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-10-15 17:53:34,554 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-10-15 17:53:34,554 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-10-15 17:53:34,554 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-10-15 17:53:34,554 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-10-15 17:53:34,554 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-10-15 17:53:34,554 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-10-15 17:53:34,554 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-10-15 17:53:34,555 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-10-15 17:53:34,555 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-10-15 17:53:34,555 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-10-15 17:53:34,555 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-10-15 17:53:34,555 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-10-15 17:53:34,555 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-10-15 17:53:34,555 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-10-15 17:53:34,555 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-10-15 17:53:34,555 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-10-15 17:53:34,555 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-10-15 17:53:34,555 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-10-15 17:53:34,555 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-10-15 17:53:34,555 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-10-15 17:53:34,555 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-10-15 17:53:34,555 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-10-15 17:53:34,555 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-10-15 17:53:34,556 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-10-15 17:53:34,556 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-10-15 17:53:34,556 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-10-15 17:53:34,556 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-10-15 17:53:34,556 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-10-15 17:53:34,556 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-10-15 17:53:34,556 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-10-15 17:53:34,556 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-10-15 17:53:34,556 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-10-15 17:53:34,556 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-10-15 17:53:34,556 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-10-15 17:53:34,556 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-10-15 17:53:34,556 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-10-15 17:53:34,556 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-10-15 17:53:34,556 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-10-15 17:53:34,556 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-10-15 17:53:34,557 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-10-15 17:53:34,672 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.02239272413143802); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.035916726233672196, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.02239272413143802); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.011416666666666667); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.04766666666666667, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-10-15 17:53:34,672 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-10-15 17:53:34,672 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.014839001808299548, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.02239272413143802); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.035916726233672196, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.02239272413143802); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.011416666666666667); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.04766666666666667, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-10-15 17:53:35,038 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 465 ms to try 5000 different iterations.  Found a solution that moves 997 regions; Going from a computed imbalance of 0.014839001808299548 to a new imbalance of 8.01696176973756E-4. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0072302036533169285); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.008812805701489793); MoveCostFunction : (multiplier=7.0, imbalance=0.11077777777777778, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0072302036533169285); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=3.333333333333333E-4); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.004666666666666667); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-10-15 17:53:35,040 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv112343788:80 , srv508855954:82 , srv519576785:82 , srv81200218:82 , srv1184069212:83 , srv1361409486:83 , srv1704186162:83 , srv1894175705:83 , srv2084380979:83 , srv400206868:83 , srv863117908:83 , srv112196613:84 , srv1155102866:84 , srv1178101037:84 , srv1187286726:84 , srv1211136973:84 , srv1281988215:84 , srv1431610664:84 , srv1563128942:84 , srv1593816005:84 , srv2133642873:84 , srv504405485:84 , srv1151280966:85 , srv1163395568:85 , srv1192607252:85 , srv1247138403:85 , srv1261119382:85 , srv1351448994:85 , srv1387662481:85 , srv1409526543:85 , srv1466041576:85 , srv1562505066:85 , srv162817656:85 , srv1711025381:85 , srv1729656915:85 , srv1802695180:85 , srv1872514303:85 , srv191089956:85 , srv1964893350:85 , srv2067121928:85 , srv259321589:85 , srv484715566:85 , srv553508938:85 , srv59679720:85 , srv597271407:85 , srv728652853:85 , srv749248609:85 , srv799616027:85 , srv1096656305:86 , srv1118628386:86 , srv1140967692:86 , srv1207142480:86 , srv1241473294:86 , srv1260380829:86 , srv129427640:86 , srv136478915:86 , srv1526775145:86 , srv1641669872:86 , srv1703150257:86 , srv174731057:86 , srv195001017:86 , srv1959705273:86 , srv1987796236:86 , srv2016662109:86 , srv2027859583:86 , srv2108046416:86 , srv2133598220:86 , srv2137761043:86 , srv32446480:86 , srv334153850:86 , srv417238138:86 , srv430396803:86 , srv539715165:86 , srv638097255:86 , srv742313657:86 , srv876211811:86 , srv951783653:86 , srv976074429:86 , srv1092603807:87 , srv1132715393:87 , srv1219278328:87 , srv1224050964:87 , srv1331412058:87 , srv1383285361:87 , srv1456935157:87 , srv1600382163:87 , srv1629429342:87 , srv1758850861:87 , srv1769157614:87 , srv1797912208:87 , srv1941294590:87 , srv2003645522:87 , srv2042964732:87 , srv2106919916:87 , srv231908221:87 , srv900750708:87 , srv1156866766:88 , srv1242657262:88 , srv487910106:88 , srv579937806:549 }
2023-10-15 17:53:35,047 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-10-15 17:53:35,048 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv112196613=3, srv1211136973=16, srv2137761043=71, srv2133598220=69, srv1600382163=40, srv1331412058=26, srv951783653=98, srv2003645522=61, srv2027859583=63, srv191089956=55, srv1456935157=34, srv1409526543=32, srv1351448994=27, srv553508938=85, srv1156866766=9, srv1941294590=56, srv1118628386=2, srv1247138403=21, srv508855954=82, srv1163395568=10, srv1155102866=8, srv579937806=86, srv728652853=90, srv484715566=79, srv638097255=89, srv1729656915=47, srv1563128942=38, srv81200218=94, srv1629429342=42, srv1802695180=52, srv2016662109=62, srv32446480=74, srv1261119382=23, srv1224050964=18, srv1704186162=45, srv1096656305=1, srv129427640=25, srv539715165=84, srv1219278328=17, srv1593816005=39, srv1281988215=24, srv259321589=73, srv597271407=88, srv1140967692=6, srv1466041576=35, srv1987796236=60, srv162817656=41, srv112343788=4, srv504405485=81, srv174731057=48, srv1260380829=22, srv799616027=93, srv1207142480=15, srv1151280966=7, srv742313657=91, srv1178101037=11, srv2067121928=65, srv1383285361=30, srv876211811=96, srv1431610664=33, srv231908221=72, srv400206868=76, srv1711025381=46, srv1132715393=5, srv1894175705=54, srv1562505066=37, srv487910106=80, srv2133642873=70, srv1387662481=31, srv417238138=77, srv863117908=95, srv1797912208=51, srv59679720=87, srv1964893350=59, srv2108046416=68, srv1241473294=19, srv1192607252=14, srv1872514303=53, srv2042964732=64, srv1758850861=49, srv1703150257=44, srv195001017=57, srv1959705273=58, srv900750708=97, srv1361409486=28, srv976074429=99, srv1526775145=36, srv334153850=75, srv1242657262=20, srv2084380979=66, srv136478915=29, srv1769157614=50, srv749248609=92, srv430396803=78, srv1092603807=0, srv1184069212=12, srv1187286726=13, srv1641669872=43, srv2106919916=67, srv519576785=83} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-10-15 17:53:35,063 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-10-15 17:53:35,063 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-10-15 17:53:35,064 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-10-15 17:53:35,064 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-10-15 17:53:35,064 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-10-15 17:53:35,064 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-10-15 17:53:35,064 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-10-15 17:53:35,064 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-10-15 17:53:35,064 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-10-15 17:53:35,064 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-10-15 17:53:35,064 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-10-15 17:53:35,064 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-10-15 17:53:35,064 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-10-15 17:53:35,064 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-10-15 17:53:35,064 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-10-15 17:53:35,064 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-10-15 17:53:35,064 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-10-15 17:53:35,064 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-10-15 17:53:35,064 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-10-15 17:53:35,065 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-10-15 17:53:35,065 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-10-15 17:53:35,065 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-10-15 17:53:35,065 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-10-15 17:53:35,065 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-10-15 17:53:35,065 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-10-15 17:53:35,065 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-10-15 17:53:35,065 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-10-15 17:53:35,065 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-10-15 17:53:35,065 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-10-15 17:53:35,065 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-10-15 17:53:35,065 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-10-15 17:53:35,065 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-10-15 17:53:35,065 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-10-15 17:53:35,065 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-10-15 17:53:35,065 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-10-15 17:53:35,066 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-10-15 17:53:35,066 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-10-15 17:53:35,066 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-10-15 17:53:35,066 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-10-15 17:53:35,066 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-10-15 17:53:35,066 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-10-15 17:53:35,066 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-10-15 17:53:35,066 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-10-15 17:53:35,066 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-10-15 17:53:35,066 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-10-15 17:53:35,066 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-10-15 17:53:35,066 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-10-15 17:53:35,067 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-10-15 17:53:35,067 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-10-15 17:53:35,067 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-10-15 17:53:35,067 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-10-15 17:53:35,067 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-10-15 17:53:35,067 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-10-15 17:53:35,067 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-10-15 17:53:35,067 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-10-15 17:53:35,067 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-10-15 17:53:35,068 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-10-15 17:53:35,068 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-10-15 17:53:35,068 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-10-15 17:53:35,068 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-10-15 17:53:35,068 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-10-15 17:53:35,068 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-10-15 17:53:35,068 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-10-15 17:53:35,068 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-10-15 17:53:35,068 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-10-15 17:53:35,068 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-10-15 17:53:35,069 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-10-15 17:53:35,069 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-10-15 17:53:35,069 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-10-15 17:53:35,069 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-10-15 17:53:35,069 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-10-15 17:53:35,069 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-10-15 17:53:35,069 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-10-15 17:53:35,069 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-10-15 17:53:35,069 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-10-15 17:53:35,069 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-10-15 17:53:35,070 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-10-15 17:53:35,070 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-10-15 17:53:35,070 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-10-15 17:53:35,070 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-10-15 17:53:35,070 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-10-15 17:53:35,070 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-10-15 17:53:35,070 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-10-15 17:53:35,070 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-10-15 17:53:35,070 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-10-15 17:53:35,070 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-10-15 17:53:35,071 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-10-15 17:53:35,071 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-10-15 17:53:35,071 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-10-15 17:53:35,071 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-10-15 17:53:35,071 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-10-15 17:53:35,071 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-10-15 17:53:35,071 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-10-15 17:53:35,071 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-10-15 17:53:35,072 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-10-15 17:53:35,072 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-10-15 17:53:35,072 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-10-15 17:53:35,072 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-10-15 17:53:35,072 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-10-15 17:53:35,072 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-10-15 17:53:35,072 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-10-15 17:53:35,193 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0072302036533169285); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.008812805701489793); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0072302036533169285); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=3.333333333333333E-4); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.004666666666666667); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-10-15 17:53:35,193 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-10-15 17:53:35,193 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=7.947150337627903E-4, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0072302036533169285); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.008812805701489793); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0072302036533169285); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=3.333333333333333E-4); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.004666666666666667); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-10-15 17:53:35,462 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 376 ms to try 5000 different iterations.  Found a solution that moves 307 regions; Going from a computed imbalance of 7.947150337627903E-4 to a new imbalance of 3.467929390894773E-5. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=5.470732932414788E-4); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0016412198797244363); MoveCostFunction : (multiplier=7.0, imbalance=0.03411111111111111, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=5.470732932414788E-4); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=2.5E-4); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-10-15 17:53:35,463 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1132715393:83 , srv1769157614:83 , srv430396803:83 , srv487910106:83 , srv799616027:83 , srv900750708:83 , srv1118628386:84 , srv1140967692:84 , srv1156866766:84 , srv1219278328:84 , srv1224050964:84 , srv1242657262:84 , srv1261119382:84 , srv1281988215:84 , srv1331412058:84 , srv136478915:84 , srv1383285361:84 , srv1593816005:84 , srv162817656:84 , srv1629429342:84 , srv1641669872:84 , srv1711025381:84 , srv174731057:84 , srv1872514303:84 , srv191089956:84 , srv1941294590:84 , srv195001017:84 , srv1964893350:84 , srv2016662109:84 , srv2042964732:84 , srv2084380979:84 , srv2106919916:84 , srv2108046416:84 , srv2133598220:84 , srv2133642873:84 , srv2137761043:84 , srv32446480:84 , srv508855954:84 , srv597271407:84 , srv749248609:84 , srv951783653:84 , srv976074429:84 , srv1092603807:85 , srv1155102866:85 , srv1163395568:85 , srv1178101037:85 , srv1184069212:85 , srv1187286726:85 , srv1192607252:85 , srv1207142480:85 , srv1211136973:85 , srv1241473294:85 , srv1260380829:85 , srv129427640:85 , srv1351448994:85 , srv1361409486:85 , srv1387662481:85 , srv1409526543:85 , srv1431610664:85 , srv1466041576:85 , srv1526775145:85 , srv1562505066:85 , srv1563128942:85 , srv1600382163:85 , srv1729656915:85 , srv1758850861:85 , srv1797912208:85 , srv1802695180:85 , srv1894175705:85 , srv1959705273:85 , srv2003645522:85 , srv2027859583:85 , srv2067121928:85 , srv231908221:85 , srv259321589:85 , srv334153850:85 , srv417238138:85 , srv484715566:85 , srv504405485:85 , srv539715165:85 , srv553508938:85 , srv59679720:85 , srv728652853:85 , srv742313657:85 , srv81200218:85 , srv863117908:85 , srv1096656305:86 , srv112196613:86 , srv112343788:86 , srv1151280966:86 , srv1247138403:86 , srv1456935157:86 , srv1703150257:86 , srv1704186162:86 , srv1987796236:86 , srv400206868:86 , srv519576785:86 , srv638097255:86 , srv876211811:86 , srv579937806:620 }
2023-10-15 17:53:35,467 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-10-15 17:53:35,467 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv112196613=3, srv1211136973=16, srv2137761043=71, srv2133598220=69, srv1600382163=40, srv1331412058=26, srv951783653=98, srv2003645522=61, srv2027859583=63, srv191089956=55, srv1456935157=34, srv1409526543=32, srv1351448994=27, srv553508938=85, srv1156866766=9, srv1941294590=56, srv1118628386=2, srv1247138403=21, srv508855954=82, srv1163395568=10, srv1155102866=8, srv579937806=86, srv728652853=90, srv484715566=79, srv638097255=89, srv1729656915=47, srv1563128942=38, srv81200218=94, srv1629429342=42, srv1802695180=52, srv2016662109=62, srv32446480=74, srv1261119382=23, srv1224050964=18, srv1704186162=45, srv1096656305=1, srv129427640=25, srv539715165=84, srv1219278328=17, srv1593816005=39, srv1281988215=24, srv259321589=73, srv597271407=88, srv1140967692=6, srv1466041576=35, srv1987796236=60, srv162817656=41, srv112343788=4, srv504405485=81, srv174731057=48, srv1260380829=22, srv799616027=93, srv1207142480=15, srv1151280966=7, srv742313657=91, srv1178101037=11, srv2067121928=65, srv1383285361=30, srv876211811=96, srv1431610664=33, srv231908221=72, srv400206868=76, srv1711025381=46, srv1132715393=5, srv1894175705=54, srv1562505066=37, srv487910106=80, srv2133642873=70, srv1387662481=31, srv417238138=77, srv863117908=95, srv1797912208=51, srv59679720=87, srv1964893350=59, srv2108046416=68, srv1241473294=19, srv1192607252=14, srv1872514303=53, srv2042964732=64, srv1758850861=49, srv1703150257=44, srv195001017=57, srv1959705273=58, srv900750708=97, srv1361409486=28, srv976074429=99, srv1526775145=36, srv334153850=75, srv1242657262=20, srv2084380979=66, srv136478915=29, srv1769157614=50, srv749248609=92, srv430396803=78, srv1092603807=0, srv1184069212=12, srv1187286726=13, srv1641669872=43, srv2106919916=67, srv519576785=83} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-10-15 17:53:35,478 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-10-15 17:53:35,478 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-10-15 17:53:35,478 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-10-15 17:53:35,478 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-10-15 17:53:35,478 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-10-15 17:53:35,478 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-10-15 17:53:35,478 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-10-15 17:53:35,479 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-10-15 17:53:35,479 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-10-15 17:53:35,479 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-10-15 17:53:35,479 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-10-15 17:53:35,479 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-10-15 17:53:35,479 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-10-15 17:53:35,479 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-10-15 17:53:35,479 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-10-15 17:53:35,479 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-10-15 17:53:35,479 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-10-15 17:53:35,479 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-10-15 17:53:35,479 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-10-15 17:53:35,479 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-10-15 17:53:35,479 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-10-15 17:53:35,479 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-10-15 17:53:35,479 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-10-15 17:53:35,479 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-10-15 17:53:35,479 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-10-15 17:53:35,479 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-10-15 17:53:35,479 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-10-15 17:53:35,479 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-10-15 17:53:35,480 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-10-15 17:53:35,480 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-10-15 17:53:35,480 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-10-15 17:53:35,480 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-10-15 17:53:35,480 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-10-15 17:53:35,480 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-10-15 17:53:35,480 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-10-15 17:53:35,480 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-10-15 17:53:35,480 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-10-15 17:53:35,480 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-10-15 17:53:35,480 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-10-15 17:53:35,480 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-10-15 17:53:35,480 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-10-15 17:53:35,480 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-10-15 17:53:35,480 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-10-15 17:53:35,480 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-10-15 17:53:35,480 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-10-15 17:53:35,480 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-10-15 17:53:35,480 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-10-15 17:53:35,480 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-10-15 17:53:35,481 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-10-15 17:53:35,481 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-10-15 17:53:35,481 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-10-15 17:53:35,481 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-10-15 17:53:35,481 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-10-15 17:53:35,481 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-10-15 17:53:35,481 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-10-15 17:53:35,481 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-10-15 17:53:35,481 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-10-15 17:53:35,481 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-10-15 17:53:35,481 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-10-15 17:53:35,481 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-10-15 17:53:35,481 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-10-15 17:53:35,481 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-10-15 17:53:35,481 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-10-15 17:53:35,481 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-10-15 17:53:35,481 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-10-15 17:53:35,481 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-10-15 17:53:35,481 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-10-15 17:53:35,482 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-10-15 17:53:35,482 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-10-15 17:53:35,482 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-10-15 17:53:35,482 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-10-15 17:53:35,482 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-10-15 17:53:35,482 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-10-15 17:53:35,482 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-10-15 17:53:35,482 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-10-15 17:53:35,482 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-10-15 17:53:35,482 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-10-15 17:53:35,482 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-10-15 17:53:35,482 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-10-15 17:53:35,482 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-10-15 17:53:35,482 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-10-15 17:53:35,482 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-10-15 17:53:35,482 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-10-15 17:53:35,483 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-10-15 17:53:35,483 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-10-15 17:53:35,483 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-10-15 17:53:35,483 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-10-15 17:53:35,483 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-10-15 17:53:35,483 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-10-15 17:53:35,483 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-10-15 17:53:35,483 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-10-15 17:53:35,483 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-10-15 17:53:35,483 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-10-15 17:53:35,483 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-10-15 17:53:35,483 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-10-15 17:53:35,483 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-10-15 17:53:35,483 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-10-15 17:53:35,483 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-10-15 17:53:35,483 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-10-15 17:53:35,483 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-10-15 17:53:35,483 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-10-15 17:53:35,590 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=5.470732932414788E-4); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0016412198797244363); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=5.470732932414788E-4); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=2.5E-4); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-10-15 17:53:35,590 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-10-15 17:53:35,590 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=3.252963396334443E-5, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=5.470732932414788E-4); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0016412198797244363); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=5.470732932414788E-4); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=2.5E-4); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-10-15 17:53:35,806 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 315 ms to try 5000 different iterations.  Found a solution that moves 28 regions; Going from a computed imbalance of 3.252963396334443E-5 to a new imbalance of 5.838553184005151E-6. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0012535023884839248); MoveCostFunction : (multiplier=7.0, imbalance=0.003111111111111111); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-10-15 17:53:35,807 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1096656305:83 , srv1151280966:83 , srv1184069212:83 , srv1187286726:83 , srv1247138403:83 , srv1987796236:83 , srv334153850:83 , srv400206868:83 , srv553508938:83 , srv728652853:83 , srv749248609:83 , srv900750708:83 , srv1092603807:84 , srv1118628386:84 , srv112196613:84 , srv112343788:84 , srv1132715393:84 , srv1155102866:84 , srv1156866766:84 , srv1163395568:84 , srv1178101037:84 , srv1192607252:84 , srv1207142480:84 , srv1211136973:84 , srv1219278328:84 , srv1241473294:84 , srv1242657262:84 , srv1260380829:84 , srv1281988215:84 , srv129427640:84 , srv1331412058:84 , srv1361409486:84 , srv136478915:84 , srv1387662481:84 , srv1409526543:84 , srv1431610664:84 , srv1456935157:84 , srv1466041576:84 , srv1526775145:84 , srv1562505066:84 , srv1563128942:84 , srv1593816005:84 , srv1600382163:84 , srv162817656:84 , srv1641669872:84 , srv1703150257:84 , srv1704186162:84 , srv1711025381:84 , srv1729656915:84 , srv174731057:84 , srv1758850861:84 , srv1797912208:84 , srv1802695180:84 , srv1872514303:84 , srv1894175705:84 , srv191089956:84 , srv1941294590:84 , srv195001017:84 , srv1959705273:84 , srv1964893350:84 , srv2003645522:84 , srv2027859583:84 , srv2042964732:84 , srv2067121928:84 , srv2084380979:84 , srv2106919916:84 , srv2108046416:84 , srv2133598220:84 , srv2133642873:84 , srv2137761043:84 , srv231908221:84 , srv259321589:84 , srv417238138:84 , srv484715566:84 , srv487910106:84 , srv504405485:84 , srv508855954:84 , srv519576785:84 , srv539715165:84 , srv59679720:84 , srv597271407:84 , srv638097255:84 , srv742313657:84 , srv799616027:84 , srv81200218:84 , srv863117908:84 , srv876211811:84 , srv1140967692:85 , srv1224050964:85 , srv1261119382:85 , srv1351448994:85 , srv1383285361:85 , srv1629429342:85 , srv1769157614:85 , srv2016662109:85 , srv32446480:85 , srv430396803:85 , srv951783653:85 , srv976074429:85 , srv579937806:684 }
2023-10-15 17:53:35,811 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-10-15 17:53:35,811 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv112196613=3, srv1211136973=16, srv2137761043=71, srv2133598220=69, srv1600382163=40, srv1331412058=26, srv951783653=98, srv2003645522=61, srv2027859583=63, srv191089956=55, srv1456935157=34, srv1409526543=32, srv1351448994=27, srv553508938=85, srv1156866766=9, srv1941294590=56, srv1118628386=2, srv1247138403=21, srv508855954=82, srv1163395568=10, srv1155102866=8, srv579937806=86, srv728652853=90, srv484715566=79, srv638097255=89, srv1729656915=47, srv1563128942=38, srv81200218=94, srv1629429342=42, srv1802695180=52, srv2016662109=62, srv32446480=74, srv1261119382=23, srv1224050964=18, srv1704186162=45, srv1096656305=1, srv129427640=25, srv539715165=84, srv1219278328=17, srv1593816005=39, srv1281988215=24, srv259321589=73, srv597271407=88, srv1140967692=6, srv1466041576=35, srv1987796236=60, srv162817656=41, srv112343788=4, srv504405485=81, srv174731057=48, srv1260380829=22, srv799616027=93, srv1207142480=15, srv1151280966=7, srv742313657=91, srv1178101037=11, srv2067121928=65, srv1383285361=30, srv876211811=96, srv1431610664=33, srv231908221=72, srv400206868=76, srv1711025381=46, srv1132715393=5, srv1894175705=54, srv1562505066=37, srv487910106=80, srv2133642873=70, srv1387662481=31, srv417238138=77, srv863117908=95, srv1797912208=51, srv59679720=87, srv1964893350=59, srv2108046416=68, srv1241473294=19, srv1192607252=14, srv1872514303=53, srv2042964732=64, srv1758850861=49, srv1703150257=44, srv195001017=57, srv1959705273=58, srv900750708=97, srv1361409486=28, srv976074429=99, srv1526775145=36, srv334153850=75, srv1242657262=20, srv2084380979=66, srv136478915=29, srv1769157614=50, srv749248609=92, srv430396803=78, srv1092603807=0, srv1184069212=12, srv1187286726=13, srv1641669872=43, srv2106919916=67, srv519576785=83} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-10-15 17:53:35,828 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-10-15 17:53:35,828 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-10-15 17:53:35,828 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-10-15 17:53:35,828 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-10-15 17:53:35,828 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-10-15 17:53:35,828 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-10-15 17:53:35,828 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-10-15 17:53:35,828 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-10-15 17:53:35,828 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-10-15 17:53:35,828 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-10-15 17:53:35,828 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-10-15 17:53:35,828 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-10-15 17:53:35,828 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-10-15 17:53:35,828 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-10-15 17:53:35,828 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-10-15 17:53:35,828 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-10-15 17:53:35,828 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-10-15 17:53:35,829 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-10-15 17:53:35,829 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-10-15 17:53:35,829 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-10-15 17:53:35,829 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-10-15 17:53:35,829 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-10-15 17:53:35,829 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-10-15 17:53:35,829 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-10-15 17:53:35,829 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-10-15 17:53:35,829 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-10-15 17:53:35,829 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-10-15 17:53:35,829 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-10-15 17:53:35,829 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-10-15 17:53:35,829 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-10-15 17:53:35,829 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-10-15 17:53:35,829 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-10-15 17:53:35,829 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-10-15 17:53:35,829 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-10-15 17:53:35,829 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-10-15 17:53:35,829 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-10-15 17:53:35,829 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-10-15 17:53:35,830 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-10-15 17:53:35,830 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-10-15 17:53:35,830 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-10-15 17:53:35,830 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-10-15 17:53:35,830 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-10-15 17:53:35,830 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-10-15 17:53:35,830 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-10-15 17:53:35,830 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-10-15 17:53:35,830 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-10-15 17:53:35,830 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-10-15 17:53:35,830 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-10-15 17:53:35,830 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-10-15 17:53:35,830 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-10-15 17:53:35,830 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-10-15 17:53:35,830 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-10-15 17:53:35,830 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-10-15 17:53:35,830 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-10-15 17:53:35,830 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-10-15 17:53:35,830 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-10-15 17:53:35,831 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-10-15 17:53:35,831 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-10-15 17:53:35,831 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-10-15 17:53:35,831 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-10-15 17:53:35,831 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-10-15 17:53:35,831 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-10-15 17:53:35,831 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-10-15 17:53:35,831 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-10-15 17:53:35,831 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-10-15 17:53:35,831 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-10-15 17:53:35,831 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-10-15 17:53:35,831 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-10-15 17:53:35,831 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-10-15 17:53:35,831 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-10-15 17:53:35,831 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-10-15 17:53:35,831 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-10-15 17:53:35,831 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-10-15 17:53:35,831 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-10-15 17:53:35,831 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-10-15 17:53:35,831 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-10-15 17:53:35,831 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-10-15 17:53:35,832 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-10-15 17:53:35,832 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-10-15 17:53:35,832 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-10-15 17:53:35,832 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-10-15 17:53:35,832 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-10-15 17:53:35,832 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-10-15 17:53:35,832 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-10-15 17:53:35,832 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-10-15 17:53:35,832 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-10-15 17:53:35,832 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-10-15 17:53:35,832 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-10-15 17:53:35,832 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-10-15 17:53:35,832 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-10-15 17:53:35,832 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-10-15 17:53:35,832 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-10-15 17:53:35,832 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-10-15 17:53:35,832 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-10-15 17:53:35,832 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-10-15 17:53:35,833 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-10-15 17:53:35,833 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-10-15 17:53:35,833 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-10-15 17:53:35,833 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-10-15 17:53:35,833 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-10-15 17:53:35,833 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-10-15 17:53:35,943 INFO  [Time-limited test] balancer.StochasticLoadBalancer(381): Cluster wide - skipping load balancing because weighted average imbalance=5.642492993526674E-6 <= threshold(0.025). If you want more aggressive balancing, either lower hbase.master.balancer.stochastic.minCostNeedBalance from 0.025 or increase the relative multiplier(s) of the specific cost function(s). functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0012535023884839248); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-10-15 17:53:35,944 INFO  [Time-limited test] balancer.BalancerTestBase(570): Mock Final balance: { srv1096656305:83 , srv1151280966:83 , srv1184069212:83 , srv1187286726:83 , srv1247138403:83 , srv1987796236:83 , srv334153850:83 , srv400206868:83 , srv553508938:83 , srv728652853:83 , srv749248609:83 , srv900750708:83 , srv1092603807:84 , srv1118628386:84 , srv112196613:84 , srv112343788:84 , srv1132715393:84 , srv1155102866:84 , srv1156866766:84 , srv1163395568:84 , srv1178101037:84 , srv1192607252:84 , srv1207142480:84 , srv1211136973:84 , srv1219278328:84 , srv1241473294:84 , srv1242657262:84 , srv1260380829:84 , srv1281988215:84 , srv129427640:84 , srv1331412058:84 , srv1361409486:84 , srv136478915:84 , srv1387662481:84 , srv1409526543:84 , srv1431610664:84 , srv1456935157:84 , srv1466041576:84 , srv1526775145:84 , srv1562505066:84 , srv1563128942:84 , srv1593816005:84 , srv1600382163:84 , srv162817656:84 , srv1641669872:84 , srv1703150257:84 , srv1704186162:84 , srv1711025381:84 , srv1729656915:84 , srv174731057:84 , srv1758850861:84 , srv1797912208:84 , srv1802695180:84 , srv1872514303:84 , srv1894175705:84 , srv191089956:84 , srv1941294590:84 , srv195001017:84 , srv1959705273:84 , srv1964893350:84 , srv2003645522:84 , srv2027859583:84 , srv2042964732:84 , srv2067121928:84 , srv2084380979:84 , srv2106919916:84 , srv2108046416:84 , srv2133598220:84 , srv2133642873:84 , srv2137761043:84 , srv231908221:84 , srv259321589:84 , srv417238138:84 , srv484715566:84 , srv487910106:84 , srv504405485:84 , srv508855954:84 , srv519576785:84 , srv539715165:84 , srv59679720:84 , srv597271407:84 , srv638097255:84 , srv742313657:84 , srv799616027:84 , srv81200218:84 , srv863117908:84 , srv876211811:84 , srv1140967692:85 , srv1224050964:85 , srv1261119382:85 , srv1351448994:85 , srv1383285361:85 , srv1629429342:85 , srv1769157614:85 , srv2016662109:85 , srv32446480:85 , srv430396803:85 , srv951783653:85 , srv976074429:85 , srv579937806:684 }
2023-10-15 17:53:35,978 INFO  [Time-limited test] hbase.ResourceChecker(175): after: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnLargeClusterWithRacks Thread=12 (was 12), OpenFileDescriptor=263 (was 263), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=258 (was 258), ProcessCount=173 (was 173), AvailableMemoryMB=5974 (was 6677)
2023-10-15 17:53:35,987 INFO  [Time-limited test] hbase.ResourceChecker(147): before: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnMidClusterWithRacks Thread=12, OpenFileDescriptor=263, MaxFileDescriptor=60000, SystemLoadAverage=258, ProcessCount=173, AvailableMemoryMB=5973
2023-10-15 17:53:35,988 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2023-10-15 17:53:35,988 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=5000, runMaxSteps=true, stepsPerRegion=800, maxRunningTime=120000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 111077.0 etc.
2023-10-15 17:53:36,001 INFO  [Time-limited test] balancer.BalancerTestBase(547): Mock Cluster : { srv1054436454:84 , srv1064542698:84 , srv1085407077:84 , srv1093789321:84 , srv120748599:84 , srv1321290141:84 , srv1346035410:84 , srv1392250008:84 , srv1409000378:84 , srv1511650570:84 , srv1564791:84 , srv1573270369:84 , srv1601847053:84 , srv1694969789:84 , srv183611009:84 , srv187353859:84 , srv1949822171:84 , srv203595765:84 , srv268597488:84 , srv35302171:84 , srv443241423:84 , srv500201893:84 , srv625774054:84 , srv640262383:84 , srv725867929:84 , srv792374285:84 , srv829599877:84 , srv969906463:84 , srv976724450:84 , srv772284988:264 } [srvr=30 rgns=2700 avg=90.0 max=90 min=90]
2023-10-15 17:53:36,003 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-10-15 17:53:36,003 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1564791=10, srv443241423=20, srv500201893=21, srv35302171=19, srv1573270369=11, srv772284988=25, srv625774054=22, srv976724450=29, srv1054436454=0, srv120748599=4, srv187353859=15, srv183611009=14, srv1949822171=16, srv640262383=23, srv1085407077=2, srv1346035410=6, srv792374285=26, srv1694969789=13, srv829599877=27, srv725867929=24, srv1409000378=8, srv1511650570=9, srv1321290141=5, srv969906463=28, srv1064542698=1, srv268597488=18, srv1093789321=3, srv1392250008=7, srv203595765=17, srv1601847053=12} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-10-15 17:53:36,023 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-10-15 17:53:36,023 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-10-15 17:53:36,023 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-10-15 17:53:36,023 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-10-15 17:53:36,024 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-10-15 17:53:36,024 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-10-15 17:53:36,024 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-10-15 17:53:36,024 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-10-15 17:53:36,024 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-10-15 17:53:36,024 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-10-15 17:53:36,024 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-10-15 17:53:36,024 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-10-15 17:53:36,024 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-10-15 17:53:36,024 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-10-15 17:53:36,024 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-10-15 17:53:36,024 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-10-15 17:53:36,024 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-10-15 17:53:36,024 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-10-15 17:53:36,024 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-10-15 17:53:36,024 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-10-15 17:53:36,024 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-10-15 17:53:36,024 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-10-15 17:53:36,024 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-10-15 17:53:36,024 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-10-15 17:53:36,024 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-10-15 17:53:36,025 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-10-15 17:53:36,025 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-10-15 17:53:36,025 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-10-15 17:53:36,025 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-10-15 17:53:36,025 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-10-15 17:53:36,025 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=10, number of hosts=30, number of racks=4
2023-10-15 17:53:36,041 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=1.119664969198419, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-10-15 17:53:36,042 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.9912570103674804, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=1.119664969198419, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=64800000
2023-10-15 17:55:36,029 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 120001 ms to try 6452696 different iterations.  Found a solution that moves 1848 regions; Going from a computed imbalance of 0.9912570103674804 to a new imbalance of 4.313324190526491E-5. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); MoveCostFunction : (multiplier=7.0, imbalance=0.6844444444444444, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-10-15 17:55:36,037 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1054436454:90 , srv1064542698:90 , srv1085407077:90 , srv1093789321:90 , srv120748599:90 , srv1321290141:90 , srv1346035410:90 , srv1392250008:90 , srv1409000378:90 , srv1511650570:90 , srv1564791:90 , srv1573270369:90 , srv1601847053:90 , srv1694969789:90 , srv183611009:90 , srv187353859:90 , srv1949822171:90 , srv203595765:90 , srv268597488:90 , srv35302171:90 , srv443241423:90 , srv500201893:90 , srv625774054:90 , srv640262383:90 , srv725867929:90 , srv772284988:90 , srv792374285:90 , srv829599877:90 , srv969906463:90 , srv976724450:90 }
2023-10-15 17:55:36,038 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-10-15 17:55:36,038 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1564791=10, srv443241423=20, srv500201893=21, srv35302171=19, srv1573270369=11, srv772284988=25, srv625774054=22, srv976724450=29, srv1054436454=0, srv120748599=4, srv187353859=15, srv183611009=14, srv1949822171=16, srv640262383=23, srv1085407077=2, srv1346035410=6, srv792374285=26, srv1694969789=13, srv829599877=27, srv725867929=24, srv1409000378=8, srv1511650570=9, srv1321290141=5, srv969906463=28, srv1064542698=1, srv268597488=18, srv1093789321=3, srv1392250008=7, srv203595765=17, srv1601847053=12} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-10-15 17:55:36,045 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-10-15 17:55:36,045 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-10-15 17:55:36,045 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-10-15 17:55:36,045 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-10-15 17:55:36,045 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-10-15 17:55:36,045 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-10-15 17:55:36,045 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-10-15 17:55:36,045 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-10-15 17:55:36,045 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-10-15 17:55:36,045 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-10-15 17:55:36,045 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-10-15 17:55:36,045 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-10-15 17:55:36,045 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-10-15 17:55:36,045 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-10-15 17:55:36,046 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-10-15 17:55:36,046 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-10-15 17:55:36,046 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-10-15 17:55:36,046 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-10-15 17:55:36,046 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-10-15 17:55:36,046 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-10-15 17:55:36,046 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-10-15 17:55:36,046 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-10-15 17:55:36,046 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-10-15 17:55:36,046 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-10-15 17:55:36,046 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-10-15 17:55:36,046 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-10-15 17:55:36,046 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-10-15 17:55:36,046 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-10-15 17:55:36,046 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-10-15 17:55:36,046 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-10-15 17:55:36,046 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=10, number of hosts=30, number of racks=4
2023-10-15 17:55:36,064 INFO  [Time-limited test] balancer.StochasticLoadBalancer(381): Cluster wide - skipping load balancing because weighted average imbalance=0.0 <= threshold(0.025). If you want more aggressive balancing, either lower hbase.master.balancer.stochastic.minCostNeedBalance from 0.025 or increase the relative multiplier(s) of the specific cost function(s). functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-10-15 17:55:36,064 INFO  [Time-limited test] balancer.BalancerTestBase(570): Mock Final balance: { srv1054436454:90 , srv1064542698:90 , srv1085407077:90 , srv1093789321:90 , srv120748599:90 , srv1321290141:90 , srv1346035410:90 , srv1392250008:90 , srv1409000378:90 , srv1511650570:90 , srv1564791:90 , srv1573270369:90 , srv1601847053:90 , srv1694969789:90 , srv183611009:90 , srv187353859:90 , srv1949822171:90 , srv203595765:90 , srv268597488:90 , srv35302171:90 , srv443241423:90 , srv500201893:90 , srv625774054:90 , srv640262383:90 , srv725867929:90 , srv772284988:90 , srv792374285:90 , srv829599877:90 , srv969906463:90 , srv976724450:90 }
2023-10-15 17:55:36,082 INFO  [Time-limited test] hbase.ResourceChecker(175): after: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnMidClusterWithRacks Thread=11 (was 12), OpenFileDescriptor=263 (was 263), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=247 (was 258), ProcessCount=168 (was 173), AvailableMemoryMB=6021 (was 5973) - AvailableMemoryMB LEAK? -