2023-10-28 15:55:24,597 INFO  [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks timeout: 13 mins
2023-10-28 15:55:24,880 WARN  [Time-limited test] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties
2023-10-28 15:55:24,988 INFO  [Time-limited test] metrics.MetricRegistriesLoader(60): Loaded MetricRegistries class org.apache.hadoop.hbase.metrics.impl.MetricRegistriesImpl
2023-10-28 15:55:25,054 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2023-10-28 15:55:25,064 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc.
2023-10-28 15:55:25,078 INFO  [Time-limited test] hbase.ResourceChecker(147): before: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnLargeClusterWithRacks Thread=12, OpenFileDescriptor=263, MaxFileDescriptor=60000, SystemLoadAverage=131, ProcessCount=167, AvailableMemoryMB=4334
2023-10-28 15:55:25,080 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2023-10-28 15:55:25,080 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=5000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=10000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc.
2023-10-28 15:55:25,210 INFO  [Time-limited test] balancer.BalancerTestBase(547): Mock Cluster : { srv1006777198:84 , srv1033100914:84 , srv111407466:84 , srv1119570793:84 , srv1137195556:84 , srv1138119558:84 , srv1140259670:84 , srv1166892295:84 , srv11773988:84 , srv1181928530:84 , srv1229713937:84 , srv1232245816:84 , srv1252357992:84 , srv1277107632:84 , srv1313044495:84 , srv1334624242:84 , srv1336220219:84 , srv1356955937:84 , srv1365640078:84 , srv1377252890:84 , srv1389917425:84 , srv1401860485:84 , srv1402197643:84 , srv1403326079:84 , srv1412499427:84 , srv1421599327:84 , srv142713155:84 , srv1459873411:84 , srv1468096056:84 , srv1503044115:84 , srv1515298070:84 , srv1518838527:84 , srv1526710579:84 , srv1544116819:84 , srv1582952926:84 , srv1589213285:84 , srv1598789337:84 , srv1615253703:84 , srv1616919292:84 , srv1655443820:84 , srv166377074:84 , srv1688697259:84 , srv1751696125:84 , srv1756817946:84 , srv1756941833:84 , srv1757051402:84 , srv1768587153:84 , srv1809819022:84 , srv1824129397:84 , srv1826249090:84 , srv1830918353:84 , srv1842554081:84 , srv1846100835:84 , srv1880642103:84 , srv1939963957:84 , srv1949692198:84 , srv1966645110:84 , srv1966791610:84 , srv1988238753:84 , srv20221253:84 , srv2039927551:84 , srv2040385129:84 , srv2085356770:84 , srv2092709209:84 , srv2111955701:84 , srv22091501:84 , srv231772801:84 , srv25570200:84 , srv285686969:84 , srv312867081:84 , srv323182843:84 , srv328877004:84 , srv427530200:84 , srv429238994:84 , srv436816869:84 , srv440613282:84 , srv485098524:84 , srv498268876:84 , srv512018401:84 , srv514032128:84 , srv635370933:84 , srv636120089:84 , srv700160659:84 , srv705692823:84 , srv718160476:84 , srv730972978:84 , srv774218162:84 , srv779803958:84 , srv806711318:84 , srv808271791:84 , srv817395139:84 , srv819372779:84 , srv832620957:84 , srv833028811:84 , srv884169407:84 , srv895375331:84 , srv916755028:84 , srv975377768:84 , srv979226286:84 , srv1308416175:684 } [srvr=100 rgns=9000 avg=90.0 max=90 min=90]
2023-10-28 15:55:25,222 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-10-28 15:55:25,231 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1412499427=25, srv1655443820=40, srv774218162=87, srv884169407=95, srv1949692198=56, srv1503044115=30, srv2040385129=62, srv1033100914=1, srv635370933=81, srv1308416175=14, srv1768587153=47, srv429238994=74, srv514032128=80, srv832620957=93, srv779803958=88, srv1365640078=19, srv2039927551=61, srv1232245816=11, srv1756941833=45, srv636120089=82, srv111407466=2, srv25570200=68, srv1229713937=10, srv1518838527=32, srv1756817946=44, srv1389917425=21, srv1006777198=0, srv20221253=60, srv1966645110=57, srv2092709209=64, srv323182843=71, srv1939963957=55, srv1751696125=43, srv1757051402=46, srv1616919292=39, srv440613282=76, srv1615253703=38, srv1277107632=13, srv498268876=78, srv1403326079=24, srv833028811=94, srv1468096056=29, srv1459873411=28, srv1252357992=12, srv231772801=67, srv166377074=41, srv817395139=91, srv1846100835=53, srv975377768=98, srv1830918353=51, srv819372779=92, srv1826249090=50, srv895375331=96, srv1880642103=54, srv1988238753=59, srv1313044495=15, srv142713155=27, srv1334624242=16, srv1140259670=6, srv512018401=79, srv1137195556=4, srv2111955701=65, srv436816869=75, srv485098524=77, srv1166892295=7, srv1401860485=22, srv1582952926=35, srv700160659=83, srv806711318=89, srv1598789337=37, srv1181928530=9, srv1688697259=42, srv916755028=97, srv1402197643=23, srv1589213285=36, srv1336220219=17, srv1421599327=26, srv808271791=90, srv1356955937=18, srv1966791610=58, srv328877004=72, srv1824129397=49, srv312867081=70, srv705692823=84, srv718160476=85, srv730972978=86, srv1842554081=52, srv1544116819=34, srv1377252890=20, srv2085356770=63, srv1526710579=33, srv427530200=73, srv22091501=66, srv979226286=99, srv1138119558=5, srv1809819022=48, srv1119570793=3, srv1515298070=31, srv11773988=8, srv285686969=69} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-10-28 15:55:25,300 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-10-28 15:55:25,300 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-10-28 15:55:25,300 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-10-28 15:55:25,300 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-10-28 15:55:25,300 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-10-28 15:55:25,301 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-10-28 15:55:25,301 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-10-28 15:55:25,301 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-10-28 15:55:25,301 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-10-28 15:55:25,301 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-10-28 15:55:25,301 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-10-28 15:55:25,301 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-10-28 15:55:25,301 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-10-28 15:55:25,301 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-10-28 15:55:25,301 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-10-28 15:55:25,302 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-10-28 15:55:25,302 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-10-28 15:55:25,302 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-10-28 15:55:25,302 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-10-28 15:55:25,302 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-10-28 15:55:25,302 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-10-28 15:55:25,302 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-10-28 15:55:25,302 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-10-28 15:55:25,302 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-10-28 15:55:25,302 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-10-28 15:55:25,302 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-10-28 15:55:25,303 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-10-28 15:55:25,303 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-10-28 15:55:25,303 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-10-28 15:55:25,303 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-10-28 15:55:25,303 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-10-28 15:55:25,303 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-10-28 15:55:25,303 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-10-28 15:55:25,303 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-10-28 15:55:25,303 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-10-28 15:55:25,303 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-10-28 15:55:25,303 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-10-28 15:55:25,304 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-10-28 15:55:25,304 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-10-28 15:55:25,304 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-10-28 15:55:25,304 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-10-28 15:55:25,304 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-10-28 15:55:25,304 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-10-28 15:55:25,304 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-10-28 15:55:25,304 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-10-28 15:55:25,304 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-10-28 15:55:25,304 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-10-28 15:55:25,304 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-10-28 15:55:25,305 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-10-28 15:55:25,305 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-10-28 15:55:25,305 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-10-28 15:55:25,305 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-10-28 15:55:25,305 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-10-28 15:55:25,305 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-10-28 15:55:25,305 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-10-28 15:55:25,305 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-10-28 15:55:25,305 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-10-28 15:55:25,305 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-10-28 15:55:25,305 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-10-28 15:55:25,306 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-10-28 15:55:25,306 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-10-28 15:55:25,306 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-10-28 15:55:25,306 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-10-28 15:55:25,306 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-10-28 15:55:25,306 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-10-28 15:55:25,306 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-10-28 15:55:25,306 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-10-28 15:55:25,306 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-10-28 15:55:25,306 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-10-28 15:55:25,306 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-10-28 15:55:25,306 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-10-28 15:55:25,307 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-10-28 15:55:25,307 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-10-28 15:55:25,307 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-10-28 15:55:25,307 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-10-28 15:55:25,307 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-10-28 15:55:25,307 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-10-28 15:55:25,307 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-10-28 15:55:25,307 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-10-28 15:55:25,307 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-10-28 15:55:25,307 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-10-28 15:55:25,307 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-10-28 15:55:25,308 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-10-28 15:55:25,308 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-10-28 15:55:25,308 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-10-28 15:55:25,308 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-10-28 15:55:25,308 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-10-28 15:55:25,308 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-10-28 15:55:25,308 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-10-28 15:55:25,308 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-10-28 15:55:25,308 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-10-28 15:55:25,308 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-10-28 15:55:25,308 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-10-28 15:55:25,308 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-10-28 15:55:25,309 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-10-28 15:55:25,309 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-10-28 15:55:25,309 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-10-28 15:55:25,309 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-10-28 15:55:25,309 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-10-28 15:55:25,309 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-10-28 15:55:25,309 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-10-28 15:55:25,470 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.06666666666666667, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-10-28 15:55:25,471 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-10-28 15:55:25,471 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.9909252140407105, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.06666666666666667, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-10-28 15:55:25,888 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 554 ms to try 5000 different iterations.  Found a solution that moves 4695 regions; Going from a computed imbalance of 0.9909252140407105 to a new imbalance of 0.1807644702840196. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.039170536937353735, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.056667656953121655, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.5216666666666666, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.039170536937353735, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.17575, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.24508333333333332, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-10-28 15:55:25,910 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv285686969:81 , srv884169407:81 , srv11773988:82 , srv1526710579:82 , srv429238994:82 , srv514032128:82 , srv779803958:82 , srv1336220219:83 , srv2085356770:83 , srv2111955701:83 , srv774218162:83 , srv1140259670:84 , srv1403326079:84 , srv1412499427:84 , srv1468096056:84 , srv1582952926:84 , srv1846100835:84 , srv2039927551:84 , srv25570200:84 , srv427530200:84 , srv485098524:84 , srv700160659:84 , srv718160476:84 , srv819372779:84 , srv1006777198:85 , srv1033100914:85 , srv1166892295:85 , srv1356955937:85 , srv1459873411:85 , srv1515298070:85 , srv1589213285:85 , srv1615253703:85 , srv1824129397:85 , srv1830918353:85 , srv1842554081:85 , srv20221253:85 , srv975377768:85 , srv1138119558:86 , srv1277107632:86 , srv1365640078:86 , srv1389917425:86 , srv142713155:86 , srv1756817946:86 , srv1756941833:86 , srv1768587153:86 , srv1988238753:86 , srv323182843:86 , srv328877004:86 , srv636120089:86 , srv705692823:86 , srv817395139:86 , srv833028811:86 , srv1137195556:87 , srv1252357992:87 , srv1313044495:87 , srv1334624242:87 , srv1377252890:87 , srv1809819022:87 , srv1880642103:87 , srv1966645110:87 , srv1966791610:87 , srv498268876:87 , srv806711318:87 , srv832620957:87 , srv1229713937:88 , srv1421599327:88 , srv1518838527:88 , srv1616919292:88 , srv1655443820:88 , srv1751696125:88 , srv1949692198:88 , srv2040385129:88 , srv2092709209:88 , srv440613282:88 , srv512018401:88 , srv635370933:88 , srv730972978:88 , srv979226286:88 , srv1119570793:89 , srv1232245816:89 , srv1401860485:89 , srv1402197643:89 , srv1598789337:89 , srv166377074:89 , srv1757051402:89 , srv1826249090:89 , srv1939963957:89 , srv312867081:89 , srv436816869:89 , srv1181928530:90 , srv22091501:90 , srv916755028:90 , srv111407466:91 , srv1503044115:91 , srv1688697259:91 , srv1544116819:92 , srv895375331:93 , srv231772801:94 , srv808271791:94 , srv1308416175:438 }
2023-10-28 15:55:25,914 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-10-28 15:55:25,914 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1412499427=25, srv1655443820=40, srv774218162=87, srv884169407=95, srv1949692198=56, srv1503044115=30, srv2040385129=62, srv1033100914=1, srv635370933=81, srv1308416175=14, srv1768587153=47, srv429238994=74, srv514032128=80, srv832620957=93, srv779803958=88, srv1365640078=19, srv2039927551=61, srv1232245816=11, srv1756941833=45, srv636120089=82, srv111407466=2, srv25570200=68, srv1229713937=10, srv1518838527=32, srv1756817946=44, srv1389917425=21, srv1006777198=0, srv20221253=60, srv1966645110=57, srv2092709209=64, srv323182843=71, srv1939963957=55, srv1751696125=43, srv1757051402=46, srv1616919292=39, srv440613282=76, srv1615253703=38, srv1277107632=13, srv498268876=78, srv1403326079=24, srv833028811=94, srv1468096056=29, srv1459873411=28, srv1252357992=12, srv231772801=67, srv166377074=41, srv817395139=91, srv1846100835=53, srv975377768=98, srv1830918353=51, srv819372779=92, srv1826249090=50, srv895375331=96, srv1880642103=54, srv1988238753=59, srv1313044495=15, srv142713155=27, srv1334624242=16, srv1140259670=6, srv512018401=79, srv1137195556=4, srv2111955701=65, srv436816869=75, srv485098524=77, srv1166892295=7, srv1401860485=22, srv1582952926=35, srv700160659=83, srv806711318=89, srv1598789337=37, srv1181928530=9, srv1688697259=42, srv916755028=97, srv1402197643=23, srv1589213285=36, srv1336220219=17, srv1421599327=26, srv808271791=90, srv1356955937=18, srv1966791610=58, srv328877004=72, srv1824129397=49, srv312867081=70, srv705692823=84, srv718160476=85, srv730972978=86, srv1842554081=52, srv1544116819=34, srv1377252890=20, srv2085356770=63, srv1526710579=33, srv427530200=73, srv22091501=66, srv979226286=99, srv1138119558=5, srv1809819022=48, srv1119570793=3, srv1515298070=31, srv11773988=8, srv285686969=69} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-10-28 15:55:25,928 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-10-28 15:55:25,928 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-10-28 15:55:25,928 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-10-28 15:55:25,928 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-10-28 15:55:25,928 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-10-28 15:55:25,928 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-10-28 15:55:25,928 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-10-28 15:55:25,928 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-10-28 15:55:25,928 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-10-28 15:55:25,928 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-10-28 15:55:25,928 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-10-28 15:55:25,928 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-10-28 15:55:25,929 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-10-28 15:55:25,929 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-10-28 15:55:25,929 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-10-28 15:55:25,929 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-10-28 15:55:25,929 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-10-28 15:55:25,929 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-10-28 15:55:25,929 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-10-28 15:55:25,929 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-10-28 15:55:25,929 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-10-28 15:55:25,929 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-10-28 15:55:25,929 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-10-28 15:55:25,929 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-10-28 15:55:25,929 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-10-28 15:55:25,930 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-10-28 15:55:25,930 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-10-28 15:55:25,930 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-10-28 15:55:25,930 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-10-28 15:55:25,930 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-10-28 15:55:25,930 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-10-28 15:55:25,930 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-10-28 15:55:25,930 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-10-28 15:55:25,930 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-10-28 15:55:25,930 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-10-28 15:55:25,930 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-10-28 15:55:25,930 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-10-28 15:55:25,930 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-10-28 15:55:25,930 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-10-28 15:55:25,931 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-10-28 15:55:25,931 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-10-28 15:55:25,931 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-10-28 15:55:25,931 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-10-28 15:55:25,931 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-10-28 15:55:25,931 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-10-28 15:55:25,931 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-10-28 15:55:25,931 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-10-28 15:55:25,931 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-10-28 15:55:25,931 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-10-28 15:55:25,931 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-10-28 15:55:25,931 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-10-28 15:55:25,931 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-10-28 15:55:25,931 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-10-28 15:55:25,932 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-10-28 15:55:25,932 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-10-28 15:55:25,932 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-10-28 15:55:25,932 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-10-28 15:55:25,932 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-10-28 15:55:25,932 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-10-28 15:55:25,932 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-10-28 15:55:25,932 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-10-28 15:55:25,932 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-10-28 15:55:25,932 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-10-28 15:55:25,932 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-10-28 15:55:25,932 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-10-28 15:55:25,933 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-10-28 15:55:25,933 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-10-28 15:55:25,933 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-10-28 15:55:25,933 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-10-28 15:55:25,933 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-10-28 15:55:25,933 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-10-28 15:55:25,933 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-10-28 15:55:25,933 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-10-28 15:55:25,933 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-10-28 15:55:25,933 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-10-28 15:55:25,933 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-10-28 15:55:25,933 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-10-28 15:55:25,933 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-10-28 15:55:25,934 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-10-28 15:55:25,934 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-10-28 15:55:25,934 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-10-28 15:55:25,934 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-10-28 15:55:25,934 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-10-28 15:55:25,934 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-10-28 15:55:25,934 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-10-28 15:55:25,934 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-10-28 15:55:25,934 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-10-28 15:55:25,934 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-10-28 15:55:25,934 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-10-28 15:55:25,934 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-10-28 15:55:25,934 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-10-28 15:55:25,934 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-10-28 15:55:25,934 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-10-28 15:55:25,935 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-10-28 15:55:25,935 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-10-28 15:55:25,935 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-10-28 15:55:25,935 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-10-28 15:55:25,935 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-10-28 15:55:25,935 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-10-28 15:55:25,935 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-10-28 15:55:25,935 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-10-28 15:55:26,054 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.039170536937353735, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.056667656953121655, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.039170536937353735, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.17575, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.24508333333333332, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-10-28 15:55:26,055 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-10-28 15:55:26,055 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.18073159519136614, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.039170536937353735, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.056667656953121655, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.039170536937353735, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.17575, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.24508333333333332, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-10-28 15:55:26,292 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 338 ms to try 5000 different iterations.  Found a solution that moves 2670 regions; Going from a computed imbalance of 0.18073159519136614 to a new imbalance of 0.015255014165366856. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.02417203586007291); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.03727833852263075, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.2966666666666667, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.02417203586007291); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.01175); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.04858333333333333, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-10-28 15:55:26,304 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv808271791:77 , srv895375331:79 , srv111407466:80 , srv1503044115:80 , srv231772801:80 , srv1181928530:81 , srv1826249090:81 , srv1119570793:82 , srv1232245816:82 , srv1402197643:82 , srv1421599327:82 , srv1544116819:82 , srv1688697259:82 , srv1939963957:82 , srv512018401:82 , srv916755028:82 , srv1334624242:83 , srv1401860485:83 , srv166377074:83 , srv1757051402:83 , srv1137195556:84 , srv1229713937:84 , srv1751696125:84 , srv2040385129:84 , srv2092709209:84 , srv312867081:84 , srv436816869:84 , srv498268876:84 , srv730972978:84 , srv806711318:84 , srv833028811:84 , srv1138119558:85 , srv1252357992:85 , srv1365640078:85 , srv1616919292:85 , srv1655443820:85 , srv1830918353:85 , srv1949692198:85 , srv1966645110:85 , srv1966791610:85 , srv1988238753:85 , srv22091501:85 , srv323182843:85 , srv328877004:85 , srv440613282:85 , srv635370933:85 , srv636120089:85 , srv817395139:85 , srv832620957:85 , srv979226286:85 , srv1166892295:86 , srv1356955937:86 , srv1377252890:86 , srv1412499427:86 , srv1459873411:86 , srv1589213285:86 , srv1598789337:86 , srv1615253703:86 , srv1756817946:86 , srv1809819022:86 , srv1880642103:86 , srv485098524:86 , srv700160659:86 , srv705692823:86 , srv718160476:86 , srv975377768:86 , srv1140259670:87 , srv1277107632:87 , srv1313044495:87 , srv1389917425:87 , srv1403326079:87 , srv142713155:87 , srv1468096056:87 , srv1515298070:87 , srv1518838527:87 , srv1768587153:87 , srv1824129397:87 , srv20221253:87 , srv2039927551:87 , srv514032128:87 , srv1006777198:88 , srv1033100914:88 , srv1336220219:88 , srv1756941833:88 , srv1842554081:88 , srv2085356770:88 , srv2111955701:88 , srv25570200:88 , srv427530200:88 , srv429238994:88 , srv774218162:88 , srv285686969:89 , srv819372779:89 , srv11773988:90 , srv1526710579:90 , srv1582952926:90 , srv779803958:90 , srv1846100835:91 , srv884169407:91 , srv1308416175:551 }
2023-10-28 15:55:26,309 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-10-28 15:55:26,310 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1412499427=25, srv1655443820=40, srv774218162=87, srv884169407=95, srv1949692198=56, srv1503044115=30, srv2040385129=62, srv1033100914=1, srv635370933=81, srv1308416175=14, srv1768587153=47, srv429238994=74, srv514032128=80, srv832620957=93, srv779803958=88, srv1365640078=19, srv2039927551=61, srv1232245816=11, srv1756941833=45, srv636120089=82, srv111407466=2, srv25570200=68, srv1229713937=10, srv1518838527=32, srv1756817946=44, srv1389917425=21, srv1006777198=0, srv20221253=60, srv1966645110=57, srv2092709209=64, srv323182843=71, srv1939963957=55, srv1751696125=43, srv1757051402=46, srv1616919292=39, srv440613282=76, srv1615253703=38, srv1277107632=13, srv498268876=78, srv1403326079=24, srv833028811=94, srv1468096056=29, srv1459873411=28, srv1252357992=12, srv231772801=67, srv166377074=41, srv817395139=91, srv1846100835=53, srv975377768=98, srv1830918353=51, srv819372779=92, srv1826249090=50, srv895375331=96, srv1880642103=54, srv1988238753=59, srv1313044495=15, srv142713155=27, srv1334624242=16, srv1140259670=6, srv512018401=79, srv1137195556=4, srv2111955701=65, srv436816869=75, srv485098524=77, srv1166892295=7, srv1401860485=22, srv1582952926=35, srv700160659=83, srv806711318=89, srv1598789337=37, srv1181928530=9, srv1688697259=42, srv916755028=97, srv1402197643=23, srv1589213285=36, srv1336220219=17, srv1421599327=26, srv808271791=90, srv1356955937=18, srv1966791610=58, srv328877004=72, srv1824129397=49, srv312867081=70, srv705692823=84, srv718160476=85, srv730972978=86, srv1842554081=52, srv1544116819=34, srv1377252890=20, srv2085356770=63, srv1526710579=33, srv427530200=73, srv22091501=66, srv979226286=99, srv1138119558=5, srv1809819022=48, srv1119570793=3, srv1515298070=31, srv11773988=8, srv285686969=69} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-10-28 15:55:26,365 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-10-28 15:55:26,365 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-10-28 15:55:26,365 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-10-28 15:55:26,365 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-10-28 15:55:26,365 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-10-28 15:55:26,365 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-10-28 15:55:26,366 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-10-28 15:55:26,366 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-10-28 15:55:26,366 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-10-28 15:55:26,366 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-10-28 15:55:26,366 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-10-28 15:55:26,366 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-10-28 15:55:26,366 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-10-28 15:55:26,366 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-10-28 15:55:26,366 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-10-28 15:55:26,367 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-10-28 15:55:26,367 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-10-28 15:55:26,367 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-10-28 15:55:26,367 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-10-28 15:55:26,367 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-10-28 15:55:26,367 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-10-28 15:55:26,367 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-10-28 15:55:26,367 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-10-28 15:55:26,367 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-10-28 15:55:26,368 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-10-28 15:55:26,368 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-10-28 15:55:26,368 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-10-28 15:55:26,368 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-10-28 15:55:26,368 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-10-28 15:55:26,368 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-10-28 15:55:26,368 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-10-28 15:55:26,368 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-10-28 15:55:26,369 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-10-28 15:55:26,369 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-10-28 15:55:26,369 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-10-28 15:55:26,369 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-10-28 15:55:26,369 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-10-28 15:55:26,369 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-10-28 15:55:26,369 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-10-28 15:55:26,369 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-10-28 15:55:26,369 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-10-28 15:55:26,370 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-10-28 15:55:26,370 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-10-28 15:55:26,370 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-10-28 15:55:26,370 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-10-28 15:55:26,370 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-10-28 15:55:26,370 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-10-28 15:55:26,370 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-10-28 15:55:26,370 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-10-28 15:55:26,370 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-10-28 15:55:26,371 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-10-28 15:55:26,371 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-10-28 15:55:26,371 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-10-28 15:55:26,371 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-10-28 15:55:26,371 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-10-28 15:55:26,371 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-10-28 15:55:26,371 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-10-28 15:55:26,371 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-10-28 15:55:26,371 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-10-28 15:55:26,372 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-10-28 15:55:26,372 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-10-28 15:55:26,372 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-10-28 15:55:26,372 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-10-28 15:55:26,372 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-10-28 15:55:26,372 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-10-28 15:55:26,372 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-10-28 15:55:26,372 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-10-28 15:55:26,372 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-10-28 15:55:26,373 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-10-28 15:55:26,373 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-10-28 15:55:26,373 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-10-28 15:55:26,373 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-10-28 15:55:26,373 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-10-28 15:55:26,373 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-10-28 15:55:26,373 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-10-28 15:55:26,373 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-10-28 15:55:26,374 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-10-28 15:55:26,374 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-10-28 15:55:26,374 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-10-28 15:55:26,374 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-10-28 15:55:26,374 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-10-28 15:55:26,374 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-10-28 15:55:26,374 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-10-28 15:55:26,374 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-10-28 15:55:26,374 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-10-28 15:55:26,374 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-10-28 15:55:26,375 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-10-28 15:55:26,375 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-10-28 15:55:26,375 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-10-28 15:55:26,375 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-10-28 15:55:26,375 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-10-28 15:55:26,375 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-10-28 15:55:26,375 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-10-28 15:55:26,375 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-10-28 15:55:26,376 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-10-28 15:55:26,376 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-10-28 15:55:26,376 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-10-28 15:55:26,376 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-10-28 15:55:26,376 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-10-28 15:55:26,376 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-10-28 15:55:26,376 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-10-28 15:55:26,531 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.02417203586007291); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.03727833852263075, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.02417203586007291); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.01175); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.04858333333333333, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-10-28 15:55:26,531 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-10-28 15:55:26,531 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.015236318425774801, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.02417203586007291); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.03727833852263075, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.02417203586007291); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.01175); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.04858333333333333, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-10-28 15:55:26,790 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 385 ms to try 5000 different iterations.  Found a solution that moves 1011 regions; Going from a computed imbalance of 0.015236318425774801 to a new imbalance of 6.839818625279021E-4. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.007680163464195452); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.008825531781334457); MoveCostFunction : (multiplier=7.0, imbalance=0.11233333333333333, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.007680163464195452); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=2.5E-4); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.004166666666666667); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-10-28 15:55:26,798 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1598789337:81 , srv22091501:82 , srv231772801:82 , srv142713155:83 , srv1518838527:83 , srv1544116819:83 , srv1756941833:83 , srv1846100835:83 , srv1006777198:84 , srv1277107632:84 , srv1313044495:84 , srv1377252890:84 , srv1389917425:84 , srv1582952926:84 , srv1616919292:84 , srv1688697259:84 , srv1880642103:84 , srv1966791610:84 , srv635370933:84 , srv1033100914:85 , srv111407466:85 , srv1119570793:85 , srv1140259670:85 , srv1166892295:85 , srv1229713937:85 , srv1252357992:85 , srv1401860485:85 , srv1526710579:85 , srv1615253703:85 , srv1655443820:85 , srv166377074:85 , srv1756817946:85 , srv1768587153:85 , srv1809819022:85 , srv1824129397:85 , srv1842554081:85 , srv1966645110:85 , srv312867081:85 , srv427530200:85 , srv436816869:85 , srv440613282:85 , srv636120089:85 , srv730972978:85 , srv817395139:85 , srv819372779:85 , srv895375331:85 , srv916755028:85 , srv979226286:85 , srv1138119558:86 , srv11773988:86 , srv1181928530:86 , srv1232245816:86 , srv1336220219:86 , srv1356955937:86 , srv1402197643:86 , srv1403326079:86 , srv1459873411:86 , srv1503044115:86 , srv1515298070:86 , srv1589213285:86 , srv1757051402:86 , srv1826249090:86 , srv1830918353:86 , srv1939963957:86 , srv20221253:86 , srv2040385129:86 , srv2092709209:86 , srv2111955701:86 , srv25570200:86 , srv323182843:86 , srv705692823:86 , srv774218162:86 , srv779803958:86 , srv806711318:86 , srv808271791:86 , srv832620957:86 , srv884169407:86 , srv975377768:86 , srv1137195556:87 , srv1334624242:87 , srv1365640078:87 , srv1421599327:87 , srv1468096056:87 , srv1751696125:87 , srv1949692198:87 , srv1988238753:87 , srv2039927551:87 , srv2085356770:87 , srv285686969:87 , srv429238994:87 , srv485098524:87 , srv498268876:87 , srv700160659:87 , srv718160476:87 , srv328877004:88 , srv512018401:88 , srv833028811:88 , srv1412499427:89 , srv514032128:89 , srv1308416175:537 }
2023-10-28 15:55:26,804 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-10-28 15:55:26,805 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1412499427=25, srv1655443820=40, srv774218162=87, srv884169407=95, srv1949692198=56, srv1503044115=30, srv2040385129=62, srv1033100914=1, srv635370933=81, srv1308416175=14, srv1768587153=47, srv429238994=74, srv514032128=80, srv832620957=93, srv779803958=88, srv1365640078=19, srv2039927551=61, srv1232245816=11, srv1756941833=45, srv636120089=82, srv111407466=2, srv25570200=68, srv1229713937=10, srv1518838527=32, srv1756817946=44, srv1389917425=21, srv1006777198=0, srv20221253=60, srv1966645110=57, srv2092709209=64, srv323182843=71, srv1939963957=55, srv1751696125=43, srv1757051402=46, srv1616919292=39, srv440613282=76, srv1615253703=38, srv1277107632=13, srv498268876=78, srv1403326079=24, srv833028811=94, srv1468096056=29, srv1459873411=28, srv1252357992=12, srv231772801=67, srv166377074=41, srv817395139=91, srv1846100835=53, srv975377768=98, srv1830918353=51, srv819372779=92, srv1826249090=50, srv895375331=96, srv1880642103=54, srv1988238753=59, srv1313044495=15, srv142713155=27, srv1334624242=16, srv1140259670=6, srv512018401=79, srv1137195556=4, srv2111955701=65, srv436816869=75, srv485098524=77, srv1166892295=7, srv1401860485=22, srv1582952926=35, srv700160659=83, srv806711318=89, srv1598789337=37, srv1181928530=9, srv1688697259=42, srv916755028=97, srv1402197643=23, srv1589213285=36, srv1336220219=17, srv1421599327=26, srv808271791=90, srv1356955937=18, srv1966791610=58, srv328877004=72, srv1824129397=49, srv312867081=70, srv705692823=84, srv718160476=85, srv730972978=86, srv1842554081=52, srv1544116819=34, srv1377252890=20, srv2085356770=63, srv1526710579=33, srv427530200=73, srv22091501=66, srv979226286=99, srv1138119558=5, srv1809819022=48, srv1119570793=3, srv1515298070=31, srv11773988=8, srv285686969=69} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-10-28 15:55:26,826 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-10-28 15:55:26,826 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-10-28 15:55:26,827 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-10-28 15:55:26,827 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-10-28 15:55:26,827 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-10-28 15:55:26,827 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-10-28 15:55:26,827 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-10-28 15:55:26,827 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-10-28 15:55:26,827 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-10-28 15:55:26,827 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-10-28 15:55:26,827 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-10-28 15:55:26,828 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-10-28 15:55:26,828 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-10-28 15:55:26,828 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-10-28 15:55:26,828 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-10-28 15:55:26,828 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-10-28 15:55:26,828 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-10-28 15:55:26,828 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-10-28 15:55:26,828 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-10-28 15:55:26,828 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-10-28 15:55:26,829 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-10-28 15:55:26,829 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-10-28 15:55:26,829 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-10-28 15:55:26,829 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-10-28 15:55:26,829 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-10-28 15:55:26,829 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-10-28 15:55:26,829 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-10-28 15:55:26,829 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-10-28 15:55:26,830 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-10-28 15:55:26,830 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-10-28 15:55:26,830 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-10-28 15:55:26,830 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-10-28 15:55:26,830 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-10-28 15:55:26,830 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-10-28 15:55:26,830 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-10-28 15:55:26,830 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-10-28 15:55:26,830 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-10-28 15:55:26,831 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-10-28 15:55:26,831 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-10-28 15:55:26,831 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-10-28 15:55:26,831 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-10-28 15:55:26,831 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-10-28 15:55:26,831 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-10-28 15:55:26,831 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-10-28 15:55:26,831 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-10-28 15:55:26,831 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-10-28 15:55:26,832 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-10-28 15:55:26,832 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-10-28 15:55:26,832 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-10-28 15:55:26,832 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-10-28 15:55:26,832 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-10-28 15:55:26,832 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-10-28 15:55:26,832 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-10-28 15:55:26,832 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-10-28 15:55:26,832 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-10-28 15:55:26,833 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-10-28 15:55:26,833 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-10-28 15:55:26,833 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-10-28 15:55:26,833 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-10-28 15:55:26,833 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-10-28 15:55:26,833 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-10-28 15:55:26,833 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-10-28 15:55:26,833 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-10-28 15:55:26,834 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-10-28 15:55:26,834 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-10-28 15:55:26,834 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-10-28 15:55:26,834 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-10-28 15:55:26,834 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-10-28 15:55:26,834 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-10-28 15:55:26,834 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-10-28 15:55:26,834 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-10-28 15:55:26,834 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-10-28 15:55:26,834 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-10-28 15:55:26,835 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-10-28 15:55:26,835 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-10-28 15:55:26,835 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-10-28 15:55:26,835 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-10-28 15:55:26,835 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-10-28 15:55:26,835 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-10-28 15:55:26,835 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-10-28 15:55:26,835 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-10-28 15:55:26,835 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-10-28 15:55:26,836 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-10-28 15:55:26,836 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-10-28 15:55:26,836 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-10-28 15:55:26,836 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-10-28 15:55:26,836 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-10-28 15:55:26,836 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-10-28 15:55:26,836 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-10-28 15:55:26,836 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-10-28 15:55:26,836 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-10-28 15:55:26,836 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-10-28 15:55:26,837 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-10-28 15:55:26,837 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-10-28 15:55:26,837 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-10-28 15:55:26,837 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-10-28 15:55:26,837 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-10-28 15:55:26,837 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-10-28 15:55:26,837 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-10-28 15:55:26,837 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-10-28 15:55:26,838 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-10-28 15:55:26,974 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.007680163464195452); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.008825531781334457); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.007680163464195452); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=2.5E-4); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.004166666666666667); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-10-28 15:55:26,974 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-10-28 15:55:26,975 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=6.769026892216972E-4, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.007680163464195452); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.008825531781334457); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.007680163464195452); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=2.5E-4); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.004166666666666667); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-10-28 15:55:27,313 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 456 ms to try 5000 different iterations.  Found a solution that moves 263 regions; Going from a computed imbalance of 6.769026892216972E-4 to a new imbalance of 4.2656457595913967E-5. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=4.178341294946416E-4); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0019534423844256277); MoveCostFunction : (multiplier=7.0, imbalance=0.029222222222222222, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=4.178341294946416E-4); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=3.333333333333333E-4); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-10-28 15:55:27,314 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1949692198:82 , srv1412499427:83 , srv1751696125:83 , srv25570200:83 , srv328877004:83 , srv1033100914:84 , srv1137195556:84 , srv11773988:84 , srv1229713937:84 , srv1313044495:84 , srv1336220219:84 , srv1365640078:84 , srv1403326079:84 , srv1421599327:84 , srv1515298070:84 , srv1518838527:84 , srv1582952926:84 , srv1655443820:84 , srv1688697259:84 , srv1757051402:84 , srv1768587153:84 , srv1809819022:84 , srv1842554081:84 , srv1846100835:84 , srv1988238753:84 , srv2039927551:84 , srv2040385129:84 , srv2085356770:84 , srv2092709209:84 , srv312867081:84 , srv440613282:84 , srv498268876:84 , srv512018401:84 , srv514032128:84 , srv779803958:84 , srv819372779:84 , srv832620957:84 , srv833028811:84 , srv884169407:84 , srv979226286:84 , srv1006777198:85 , srv1138119558:85 , srv1140259670:85 , srv1232245816:85 , srv1252357992:85 , srv1277107632:85 , srv1334624242:85 , srv1356955937:85 , srv1377252890:85 , srv1401860485:85 , srv1402197643:85 , srv1459873411:85 , srv1468096056:85 , srv1503044115:85 , srv1526710579:85 , srv1544116819:85 , srv1589213285:85 , srv1616919292:85 , srv166377074:85 , srv1756817946:85 , srv1756941833:85 , srv1824129397:85 , srv1880642103:85 , srv1939963957:85 , srv1966645110:85 , srv20221253:85 , srv2111955701:85 , srv22091501:85 , srv285686969:85 , srv323182843:85 , srv427530200:85 , srv429238994:85 , srv436816869:85 , srv485098524:85 , srv635370933:85 , srv700160659:85 , srv705692823:85 , srv718160476:85 , srv730972978:85 , srv806711318:85 , srv808271791:85 , srv895375331:85 , srv916755028:85 , srv975377768:85 , srv111407466:86 , srv1119570793:86 , srv1166892295:86 , srv1181928530:86 , srv1389917425:86 , srv142713155:86 , srv1598789337:86 , srv1615253703:86 , srv1826249090:86 , srv1830918353:86 , srv1966791610:86 , srv231772801:86 , srv636120089:86 , srv774218162:86 , srv817395139:86 , srv1308416175:616 }
2023-10-28 15:55:27,317 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-10-28 15:55:27,318 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1412499427=25, srv1655443820=40, srv774218162=87, srv884169407=95, srv1949692198=56, srv1503044115=30, srv2040385129=62, srv1033100914=1, srv635370933=81, srv1308416175=14, srv1768587153=47, srv429238994=74, srv514032128=80, srv832620957=93, srv779803958=88, srv1365640078=19, srv2039927551=61, srv1232245816=11, srv1756941833=45, srv636120089=82, srv111407466=2, srv25570200=68, srv1229713937=10, srv1518838527=32, srv1756817946=44, srv1389917425=21, srv1006777198=0, srv20221253=60, srv1966645110=57, srv2092709209=64, srv323182843=71, srv1939963957=55, srv1751696125=43, srv1757051402=46, srv1616919292=39, srv440613282=76, srv1615253703=38, srv1277107632=13, srv498268876=78, srv1403326079=24, srv833028811=94, srv1468096056=29, srv1459873411=28, srv1252357992=12, srv231772801=67, srv166377074=41, srv817395139=91, srv1846100835=53, srv975377768=98, srv1830918353=51, srv819372779=92, srv1826249090=50, srv895375331=96, srv1880642103=54, srv1988238753=59, srv1313044495=15, srv142713155=27, srv1334624242=16, srv1140259670=6, srv512018401=79, srv1137195556=4, srv2111955701=65, srv436816869=75, srv485098524=77, srv1166892295=7, srv1401860485=22, srv1582952926=35, srv700160659=83, srv806711318=89, srv1598789337=37, srv1181928530=9, srv1688697259=42, srv916755028=97, srv1402197643=23, srv1589213285=36, srv1336220219=17, srv1421599327=26, srv808271791=90, srv1356955937=18, srv1966791610=58, srv328877004=72, srv1824129397=49, srv312867081=70, srv705692823=84, srv718160476=85, srv730972978=86, srv1842554081=52, srv1544116819=34, srv1377252890=20, srv2085356770=63, srv1526710579=33, srv427530200=73, srv22091501=66, srv979226286=99, srv1138119558=5, srv1809819022=48, srv1119570793=3, srv1515298070=31, srv11773988=8, srv285686969=69} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-10-28 15:55:27,329 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-10-28 15:55:27,329 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-10-28 15:55:27,329 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-10-28 15:55:27,329 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-10-28 15:55:27,329 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-10-28 15:55:27,329 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-10-28 15:55:27,329 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-10-28 15:55:27,329 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-10-28 15:55:27,329 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-10-28 15:55:27,329 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-10-28 15:55:27,329 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-10-28 15:55:27,329 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-10-28 15:55:27,329 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-10-28 15:55:27,329 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-10-28 15:55:27,329 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-10-28 15:55:27,329 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-10-28 15:55:27,330 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-10-28 15:55:27,330 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-10-28 15:55:27,330 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-10-28 15:55:27,330 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-10-28 15:55:27,330 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-10-28 15:55:27,330 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-10-28 15:55:27,330 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-10-28 15:55:27,330 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-10-28 15:55:27,330 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-10-28 15:55:27,330 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-10-28 15:55:27,330 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-10-28 15:55:27,330 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-10-28 15:55:27,330 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-10-28 15:55:27,330 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-10-28 15:55:27,330 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-10-28 15:55:27,330 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-10-28 15:55:27,330 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-10-28 15:55:27,330 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-10-28 15:55:27,331 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-10-28 15:55:27,331 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-10-28 15:55:27,331 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-10-28 15:55:27,331 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-10-28 15:55:27,331 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-10-28 15:55:27,331 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-10-28 15:55:27,331 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-10-28 15:55:27,331 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-10-28 15:55:27,331 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-10-28 15:55:27,331 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-10-28 15:55:27,331 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-10-28 15:55:27,331 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-10-28 15:55:27,331 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-10-28 15:55:27,331 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-10-28 15:55:27,331 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-10-28 15:55:27,331 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-10-28 15:55:27,331 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-10-28 15:55:27,331 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-10-28 15:55:27,332 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-10-28 15:55:27,332 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-10-28 15:55:27,332 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-10-28 15:55:27,332 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-10-28 15:55:27,332 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-10-28 15:55:27,332 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-10-28 15:55:27,332 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-10-28 15:55:27,332 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-10-28 15:55:27,332 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-10-28 15:55:27,332 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-10-28 15:55:27,332 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-10-28 15:55:27,332 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-10-28 15:55:27,332 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-10-28 15:55:27,332 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-10-28 15:55:27,332 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-10-28 15:55:27,332 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-10-28 15:55:27,332 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-10-28 15:55:27,333 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-10-28 15:55:27,333 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-10-28 15:55:27,333 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-10-28 15:55:27,333 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-10-28 15:55:27,333 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-10-28 15:55:27,333 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-10-28 15:55:27,333 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-10-28 15:55:27,333 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-10-28 15:55:27,333 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-10-28 15:55:27,333 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-10-28 15:55:27,333 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-10-28 15:55:27,333 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-10-28 15:55:27,333 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-10-28 15:55:27,333 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-10-28 15:55:27,333 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-10-28 15:55:27,333 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-10-28 15:55:27,333 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-10-28 15:55:27,334 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-10-28 15:55:27,334 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-10-28 15:55:27,334 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-10-28 15:55:27,334 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-10-28 15:55:27,334 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-10-28 15:55:27,334 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-10-28 15:55:27,334 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-10-28 15:55:27,334 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-10-28 15:55:27,334 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-10-28 15:55:27,334 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-10-28 15:55:27,334 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-10-28 15:55:27,334 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-10-28 15:55:27,334 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-10-28 15:55:27,334 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-10-28 15:55:27,334 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-10-28 15:55:27,440 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=4.178341294946416E-4); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0019534423844256277); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=4.178341294946416E-4); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=3.333333333333333E-4); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-10-28 15:55:27,440 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-10-28 15:55:27,440 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=4.081489223534827E-5, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=4.178341294946416E-4); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0019534423844256277); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=4.178341294946416E-4); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=3.333333333333333E-4); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-10-28 15:55:27,682 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 338 ms to try 5000 different iterations.  Found a solution that moves 29 regions; Going from a computed imbalance of 4.081489223534827E-5 to a new imbalance of 6.947131393970371E-6. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0014982219165849825); MoveCostFunction : (multiplier=7.0, imbalance=0.0032222222222222222); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-10-28 15:55:27,682 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1181928530:83 , srv1389917425:83 , srv1468096056:83 , srv20221253:83 , srv436816869:83 , srv705692823:83 , srv774218162:83 , srv1006777198:84 , srv1033100914:84 , srv111407466:84 , srv1119570793:84 , srv1137195556:84 , srv1138119558:84 , srv1166892295:84 , srv11773988:84 , srv1232245816:84 , srv1252357992:84 , srv1277107632:84 , srv1313044495:84 , srv1334624242:84 , srv1356955937:84 , srv1365640078:84 , srv1377252890:84 , srv1401860485:84 , srv1402197643:84 , srv1412499427:84 , srv142713155:84 , srv1459873411:84 , srv1503044115:84 , srv1515298070:84 , srv1518838527:84 , srv1526710579:84 , srv1544116819:84 , srv1582952926:84 , srv1589213285:84 , srv1598789337:84 , srv1615253703:84 , srv1616919292:84 , srv1655443820:84 , srv166377074:84 , srv1751696125:84 , srv1756817946:84 , srv1756941833:84 , srv1757051402:84 , srv1768587153:84 , srv1809819022:84 , srv1824129397:84 , srv1826249090:84 , srv1830918353:84 , srv1842554081:84 , srv1846100835:84 , srv1880642103:84 , srv1939963957:84 , srv1949692198:84 , srv1966645110:84 , srv1966791610:84 , srv1988238753:84 , srv2039927551:84 , srv2040385129:84 , srv2085356770:84 , srv2092709209:84 , srv2111955701:84 , srv22091501:84 , srv231772801:84 , srv285686969:84 , srv312867081:84 , srv323182843:84 , srv328877004:84 , srv427530200:84 , srv429238994:84 , srv440613282:84 , srv485098524:84 , srv498268876:84 , srv512018401:84 , srv514032128:84 , srv635370933:84 , srv636120089:84 , srv700160659:84 , srv718160476:84 , srv730972978:84 , srv779803958:84 , srv806711318:84 , srv808271791:84 , srv817395139:84 , srv819372779:84 , srv832620957:84 , srv833028811:84 , srv884169407:84 , srv895375331:84 , srv916755028:84 , srv975377768:84 , srv979226286:84 , srv1140259670:85 , srv1229713937:85 , srv1336220219:85 , srv1403326079:85 , srv1421599327:85 , srv1688697259:85 , srv25570200:85 , srv1308416175:684 }
2023-10-28 15:55:27,686 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-10-28 15:55:27,686 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1412499427=25, srv1655443820=40, srv774218162=87, srv884169407=95, srv1949692198=56, srv1503044115=30, srv2040385129=62, srv1033100914=1, srv635370933=81, srv1308416175=14, srv1768587153=47, srv429238994=74, srv514032128=80, srv832620957=93, srv779803958=88, srv1365640078=19, srv2039927551=61, srv1232245816=11, srv1756941833=45, srv636120089=82, srv111407466=2, srv25570200=68, srv1229713937=10, srv1518838527=32, srv1756817946=44, srv1389917425=21, srv1006777198=0, srv20221253=60, srv1966645110=57, srv2092709209=64, srv323182843=71, srv1939963957=55, srv1751696125=43, srv1757051402=46, srv1616919292=39, srv440613282=76, srv1615253703=38, srv1277107632=13, srv498268876=78, srv1403326079=24, srv833028811=94, srv1468096056=29, srv1459873411=28, srv1252357992=12, srv231772801=67, srv166377074=41, srv817395139=91, srv1846100835=53, srv975377768=98, srv1830918353=51, srv819372779=92, srv1826249090=50, srv895375331=96, srv1880642103=54, srv1988238753=59, srv1313044495=15, srv142713155=27, srv1334624242=16, srv1140259670=6, srv512018401=79, srv1137195556=4, srv2111955701=65, srv436816869=75, srv485098524=77, srv1166892295=7, srv1401860485=22, srv1582952926=35, srv700160659=83, srv806711318=89, srv1598789337=37, srv1181928530=9, srv1688697259=42, srv916755028=97, srv1402197643=23, srv1589213285=36, srv1336220219=17, srv1421599327=26, srv808271791=90, srv1356955937=18, srv1966791610=58, srv328877004=72, srv1824129397=49, srv312867081=70, srv705692823=84, srv718160476=85, srv730972978=86, srv1842554081=52, srv1544116819=34, srv1377252890=20, srv2085356770=63, srv1526710579=33, srv427530200=73, srv22091501=66, srv979226286=99, srv1138119558=5, srv1809819022=48, srv1119570793=3, srv1515298070=31, srv11773988=8, srv285686969=69} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-10-28 15:55:27,703 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-10-28 15:55:27,703 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-10-28 15:55:27,703 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-10-28 15:55:27,703 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-10-28 15:55:27,703 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-10-28 15:55:27,703 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-10-28 15:55:27,703 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-10-28 15:55:27,703 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-10-28 15:55:27,703 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-10-28 15:55:27,703 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-10-28 15:55:27,703 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-10-28 15:55:27,703 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-10-28 15:55:27,703 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-10-28 15:55:27,703 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-10-28 15:55:27,703 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-10-28 15:55:27,703 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-10-28 15:55:27,703 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-10-28 15:55:27,704 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-10-28 15:55:27,704 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-10-28 15:55:27,704 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-10-28 15:55:27,704 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-10-28 15:55:27,704 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-10-28 15:55:27,704 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-10-28 15:55:27,704 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-10-28 15:55:27,704 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-10-28 15:55:27,704 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-10-28 15:55:27,704 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-10-28 15:55:27,704 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-10-28 15:55:27,704 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-10-28 15:55:27,704 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-10-28 15:55:27,704 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-10-28 15:55:27,704 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-10-28 15:55:27,704 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-10-28 15:55:27,704 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-10-28 15:55:27,704 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-10-28 15:55:27,704 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-10-28 15:55:27,704 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-10-28 15:55:27,704 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-10-28 15:55:27,705 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-10-28 15:55:27,705 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-10-28 15:55:27,705 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-10-28 15:55:27,705 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-10-28 15:55:27,705 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-10-28 15:55:27,705 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-10-28 15:55:27,705 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-10-28 15:55:27,705 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-10-28 15:55:27,705 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-10-28 15:55:27,705 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-10-28 15:55:27,705 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-10-28 15:55:27,705 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-10-28 15:55:27,705 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-10-28 15:55:27,705 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-10-28 15:55:27,705 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-10-28 15:55:27,705 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-10-28 15:55:27,705 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-10-28 15:55:27,705 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-10-28 15:55:27,705 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-10-28 15:55:27,705 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-10-28 15:55:27,706 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-10-28 15:55:27,706 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-10-28 15:55:27,706 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-10-28 15:55:27,706 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-10-28 15:55:27,706 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-10-28 15:55:27,706 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-10-28 15:55:27,706 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-10-28 15:55:27,706 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-10-28 15:55:27,706 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-10-28 15:55:27,706 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-10-28 15:55:27,706 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-10-28 15:55:27,706 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-10-28 15:55:27,706 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-10-28 15:55:27,706 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-10-28 15:55:27,706 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-10-28 15:55:27,706 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-10-28 15:55:27,706 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-10-28 15:55:27,706 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-10-28 15:55:27,706 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-10-28 15:55:27,706 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-10-28 15:55:27,706 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-10-28 15:55:27,707 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-10-28 15:55:27,707 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-10-28 15:55:27,707 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-10-28 15:55:27,707 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-10-28 15:55:27,707 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-10-28 15:55:27,707 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-10-28 15:55:27,707 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-10-28 15:55:27,707 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-10-28 15:55:27,707 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-10-28 15:55:27,707 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-10-28 15:55:27,707 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-10-28 15:55:27,707 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-10-28 15:55:27,707 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-10-28 15:55:27,707 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-10-28 15:55:27,707 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-10-28 15:55:27,707 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-10-28 15:55:27,707 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-10-28 15:55:27,707 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-10-28 15:55:27,707 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-10-28 15:55:27,707 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-10-28 15:55:27,708 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-10-28 15:55:27,708 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-10-28 15:55:27,813 INFO  [Time-limited test] balancer.StochasticLoadBalancer(381): Cluster wide - skipping load balancing because weighted average imbalance=6.744069053831948E-6 <= threshold(0.025). If you want more aggressive balancing, either lower hbase.master.balancer.stochastic.minCostNeedBalance from 0.025 or increase the relative multiplier(s) of the specific cost function(s). functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0014982219165849825); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-10-28 15:55:27,814 INFO  [Time-limited test] balancer.BalancerTestBase(570): Mock Final balance: { srv1181928530:83 , srv1389917425:83 , srv1468096056:83 , srv20221253:83 , srv436816869:83 , srv705692823:83 , srv774218162:83 , srv1006777198:84 , srv1033100914:84 , srv111407466:84 , srv1119570793:84 , srv1137195556:84 , srv1138119558:84 , srv1166892295:84 , srv11773988:84 , srv1232245816:84 , srv1252357992:84 , srv1277107632:84 , srv1313044495:84 , srv1334624242:84 , srv1356955937:84 , srv1365640078:84 , srv1377252890:84 , srv1401860485:84 , srv1402197643:84 , srv1412499427:84 , srv142713155:84 , srv1459873411:84 , srv1503044115:84 , srv1515298070:84 , srv1518838527:84 , srv1526710579:84 , srv1544116819:84 , srv1582952926:84 , srv1589213285:84 , srv1598789337:84 , srv1615253703:84 , srv1616919292:84 , srv1655443820:84 , srv166377074:84 , srv1751696125:84 , srv1756817946:84 , srv1756941833:84 , srv1757051402:84 , srv1768587153:84 , srv1809819022:84 , srv1824129397:84 , srv1826249090:84 , srv1830918353:84 , srv1842554081:84 , srv1846100835:84 , srv1880642103:84 , srv1939963957:84 , srv1949692198:84 , srv1966645110:84 , srv1966791610:84 , srv1988238753:84 , srv2039927551:84 , srv2040385129:84 , srv2085356770:84 , srv2092709209:84 , srv2111955701:84 , srv22091501:84 , srv231772801:84 , srv285686969:84 , srv312867081:84 , srv323182843:84 , srv328877004:84 , srv427530200:84 , srv429238994:84 , srv440613282:84 , srv485098524:84 , srv498268876:84 , srv512018401:84 , srv514032128:84 , srv635370933:84 , srv636120089:84 , srv700160659:84 , srv718160476:84 , srv730972978:84 , srv779803958:84 , srv806711318:84 , srv808271791:84 , srv817395139:84 , srv819372779:84 , srv832620957:84 , srv833028811:84 , srv884169407:84 , srv895375331:84 , srv916755028:84 , srv975377768:84 , srv979226286:84 , srv1140259670:85 , srv1229713937:85 , srv1336220219:85 , srv1403326079:85 , srv1421599327:85 , srv1688697259:85 , srv25570200:85 , srv1308416175:684 }
2023-10-28 15:55:27,838 INFO  [Time-limited test] hbase.ResourceChecker(175): after: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnLargeClusterWithRacks Thread=12 (was 12), OpenFileDescriptor=263 (was 263), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=131 (was 131), ProcessCount=167 (was 167), AvailableMemoryMB=3825 (was 4334)
2023-10-28 15:55:27,845 INFO  [Time-limited test] hbase.ResourceChecker(147): before: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnMidClusterWithRacks Thread=12, OpenFileDescriptor=263, MaxFileDescriptor=60000, SystemLoadAverage=131, ProcessCount=167, AvailableMemoryMB=3825
2023-10-28 15:55:27,845 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2023-10-28 15:55:27,846 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=5000, runMaxSteps=true, stepsPerRegion=800, maxRunningTime=120000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 111077.0 etc.
2023-10-28 15:55:27,856 INFO  [Time-limited test] balancer.BalancerTestBase(547): Mock Cluster : { srv1029277078:84 , srv1101440180:84 , srv1218576281:84 , srv1463898913:84 , srv1482505653:84 , srv1509161361:84 , srv1632983014:84 , srv1711422514:84 , srv1726912938:84 , srv1830275028:84 , srv1962575085:84 , srv1964396003:84 , srv2031856624:84 , srv2055947003:84 , srv2100779879:84 , srv2139768549:84 , srv278343062:84 , srv33830269:84 , srv395297259:84 , srv423605321:84 , srv424480563:84 , srv430633041:84 , srv46694239:84 , srv473499093:84 , srv617673099:84 , srv637391933:84 , srv67075385:84 , srv714330109:84 , srv811385343:84 , srv206651440:264 } [srvr=30 rgns=2700 avg=90.0 max=90 min=90]
2023-10-28 15:55:27,858 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-10-28 15:55:27,858 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1218576281=2, srv617673099=25, srv1711422514=7, srv1830275028=9, srv395297259=19, srv46694239=23, srv1482505653=4, srv714330109=28, srv1101440180=1, srv423605321=20, srv811385343=29, srv1726912938=8, srv2031856624=12, srv2139768549=16, srv2055947003=13, srv1962575085=10, srv278343062=17, srv67075385=27, srv1509161361=5, srv2100779879=15, srv424480563=21, srv430633041=22, srv1029277078=0, srv206651440=14, srv473499093=24, srv637391933=26, srv1964396003=11, srv1463898913=3, srv33830269=18, srv1632983014=6} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-10-28 15:55:27,866 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-10-28 15:55:27,866 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-10-28 15:55:27,866 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-10-28 15:55:27,866 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-10-28 15:55:27,866 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-10-28 15:55:27,866 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-10-28 15:55:27,866 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-10-28 15:55:27,866 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-10-28 15:55:27,866 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-10-28 15:55:27,866 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-10-28 15:55:27,866 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-10-28 15:55:27,866 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-10-28 15:55:27,867 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-10-28 15:55:27,867 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-10-28 15:55:27,867 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-10-28 15:55:27,867 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-10-28 15:55:27,867 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-10-28 15:55:27,867 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-10-28 15:55:27,867 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-10-28 15:55:27,867 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-10-28 15:55:27,867 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-10-28 15:55:27,867 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-10-28 15:55:27,867 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-10-28 15:55:27,867 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-10-28 15:55:27,867 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-10-28 15:55:27,867 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-10-28 15:55:27,867 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-10-28 15:55:27,867 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-10-28 15:55:27,867 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-10-28 15:55:27,867 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-10-28 15:55:27,867 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=10, number of hosts=30, number of racks=4
2023-10-28 15:55:27,883 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=1.146902178970052, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-10-28 15:55:27,883 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.9912655927233417, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=1.146902178970052, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=64800000
2023-10-28 15:57:27,871 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 120001 ms to try 5794506 different iterations.  Found a solution that moves 1860 regions; Going from a computed imbalance of 0.9912655927233417 to a new imbalance of 4.341332789166274E-5. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); MoveCostFunction : (multiplier=7.0, imbalance=0.6888888888888889, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-10-28 15:57:27,877 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1029277078:90 , srv1101440180:90 , srv1218576281:90 , srv1463898913:90 , srv1482505653:90 , srv1509161361:90 , srv1632983014:90 , srv1711422514:90 , srv1726912938:90 , srv1830275028:90 , srv1962575085:90 , srv1964396003:90 , srv2031856624:90 , srv2055947003:90 , srv206651440:90 , srv2100779879:90 , srv2139768549:90 , srv278343062:90 , srv33830269:90 , srv395297259:90 , srv423605321:90 , srv424480563:90 , srv430633041:90 , srv46694239:90 , srv473499093:90 , srv617673099:90 , srv637391933:90 , srv67075385:90 , srv714330109:90 , srv811385343:90 }
2023-10-28 15:57:27,878 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-10-28 15:57:27,878 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1218576281=2, srv617673099=25, srv1711422514=7, srv1830275028=9, srv395297259=19, srv46694239=23, srv1482505653=4, srv714330109=28, srv1101440180=1, srv423605321=20, srv811385343=29, srv1726912938=8, srv2031856624=12, srv2139768549=16, srv2055947003=13, srv1962575085=10, srv278343062=17, srv67075385=27, srv1509161361=5, srv2100779879=15, srv424480563=21, srv430633041=22, srv1029277078=0, srv206651440=14, srv473499093=24, srv637391933=26, srv1964396003=11, srv1463898913=3, srv33830269=18, srv1632983014=6} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-10-28 15:57:27,882 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-10-28 15:57:27,882 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-10-28 15:57:27,882 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-10-28 15:57:27,882 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-10-28 15:57:27,882 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-10-28 15:57:27,882 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-10-28 15:57:27,882 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-10-28 15:57:27,882 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-10-28 15:57:27,882 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-10-28 15:57:27,882 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-10-28 15:57:27,882 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-10-28 15:57:27,882 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-10-28 15:57:27,882 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-10-28 15:57:27,882 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-10-28 15:57:27,882 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-10-28 15:57:27,882 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-10-28 15:57:27,882 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-10-28 15:57:27,882 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-10-28 15:57:27,883 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-10-28 15:57:27,883 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-10-28 15:57:27,883 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-10-28 15:57:27,883 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-10-28 15:57:27,883 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-10-28 15:57:27,883 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-10-28 15:57:27,883 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-10-28 15:57:27,883 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-10-28 15:57:27,883 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-10-28 15:57:27,883 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-10-28 15:57:27,883 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-10-28 15:57:27,883 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-10-28 15:57:27,883 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=10, number of hosts=30, number of racks=4
2023-10-28 15:57:27,896 INFO  [Time-limited test] balancer.StochasticLoadBalancer(381): Cluster wide - skipping load balancing because weighted average imbalance=0.0 <= threshold(0.025). If you want more aggressive balancing, either lower hbase.master.balancer.stochastic.minCostNeedBalance from 0.025 or increase the relative multiplier(s) of the specific cost function(s). functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-10-28 15:57:27,896 INFO  [Time-limited test] balancer.BalancerTestBase(570): Mock Final balance: { srv1029277078:90 , srv1101440180:90 , srv1218576281:90 , srv1463898913:90 , srv1482505653:90 , srv1509161361:90 , srv1632983014:90 , srv1711422514:90 , srv1726912938:90 , srv1830275028:90 , srv1962575085:90 , srv1964396003:90 , srv2031856624:90 , srv2055947003:90 , srv206651440:90 , srv2100779879:90 , srv2139768549:90 , srv278343062:90 , srv33830269:90 , srv395297259:90 , srv423605321:90 , srv424480563:90 , srv430633041:90 , srv46694239:90 , srv473499093:90 , srv617673099:90 , srv637391933:90 , srv67075385:90 , srv714330109:90 , srv811385343:90 }
2023-10-28 15:57:27,908 INFO  [Time-limited test] hbase.ResourceChecker(175): after: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnMidClusterWithRacks Thread=11 (was 12), OpenFileDescriptor=263 (was 263), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=131 (was 131), ProcessCount=166 (was 167), AvailableMemoryMB=3815 (was 3825)