2023-11-19 10:55:16,728 INFO  [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks timeout: 13 mins
2023-11-19 10:55:17,013 WARN  [Time-limited test] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties
2023-11-19 10:55:17,114 INFO  [Time-limited test] metrics.MetricRegistriesLoader(60): Loaded MetricRegistries class org.apache.hadoop.hbase.metrics.impl.MetricRegistriesImpl
2023-11-19 10:55:17,180 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2023-11-19 10:55:17,190 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc.
2023-11-19 10:55:17,205 INFO  [Time-limited test] hbase.ResourceChecker(147): before: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnLargeClusterWithRacks Thread=12, OpenFileDescriptor=290, MaxFileDescriptor=60000, SystemLoadAverage=159, ProcessCount=171, AvailableMemoryMB=16385
2023-11-19 10:55:17,206 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2023-11-19 10:55:17,207 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=5000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=10000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc.
2023-11-19 10:55:17,333 INFO  [Time-limited test] balancer.BalancerTestBase(547): Mock Cluster : { srv1032221491:84 , srv103288457:84 , srv1042639084:84 , srv1081295875:84 , srv1108387825:84 , srv1118815027:84 , srv1133077433:84 , srv1134372898:84 , srv1219223480:84 , srv1229964641:84 , srv1237418507:84 , srv1250801672:84 , srv1269759308:84 , srv1293191511:84 , srv1316046333:84 , srv136516943:84 , srv1386197367:84 , srv1392531006:84 , srv1411141110:84 , srv145175811:84 , srv153025847:84 , srv1533666945:84 , srv1569149611:84 , srv1598700225:84 , srv1602245175:84 , srv1652584870:84 , srv1679632222:84 , srv1687427363:84 , srv1723379352:84 , srv1757069108:84 , srv1810943743:84 , srv1811874963:84 , srv1813569195:84 , srv1819519514:84 , srv1858093247:84 , srv1863185247:84 , srv1865787335:84 , srv1884261935:84 , srv188546070:84 , srv1897693771:84 , srv1940581351:84 , srv1942713782:84 , srv1950284923:84 , srv1959350135:84 , srv1973021341:84 , srv1976887828:84 , srv2029954237:84 , srv2043332152:84 , srv2063723129:84 , srv2086871724:84 , srv2114146119:84 , srv220273699:84 , srv249567975:84 , srv284834918:84 , srv321052950:84 , srv327112665:84 , srv346851963:84 , srv373801585:84 , srv385593605:84 , srv396136976:84 , srv398246628:84 , srv414096338:84 , srv424624931:84 , srv442622811:84 , srv458649722:84 , srv46189595:84 , srv465509763:84 , srv466539268:84 , srv469388240:84 , srv486161442:84 , srv488034609:84 , srv502907313:84 , srv503169443:84 , srv561112121:84 , srv567762681:84 , srv594434294:84 , srv629894000:84 , srv644116334:84 , srv666258590:84 , srv670475364:84 , srv71507353:84 , srv726268461:84 , srv751140353:84 , srv75635336:84 , srv762320177:84 , srv772543615:84 , srv798847433:84 , srv830340198:84 , srv833277736:84 , srv834382277:84 , srv844299686:84 , srv859117130:84 , srv882665726:84 , srv885219809:84 , srv924790038:84 , srv937594057:84 , srv941661453:84 , srv946956088:84 , srv993395388:84 , srv1321003366:684 } [srvr=100 rgns=9000 avg=90.0 max=90 min=90]
2023-11-19 10:55:17,344 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-11-19 10:55:17,351 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv75635336=84, srv414096338=62, srv1316046333=14, srv830340198=88, srv885219809=94, srv1134372898=7, srv1940581351=41, srv503169443=73, srv220273699=52, srv1229964641=9, srv136516943=16, srv1687427363=28, srv385593605=59, srv424624931=63, srv1897693771=40, srv1959350135=44, srv941661453=97, srv249567975=53, srv1386197367=17, srv666258590=79, srv469388240=69, srv594434294=76, srv2043332152=48, srv396136976=60, srv882665726=93, srv1269759308=12, srv946956088=98, srv833277736=89, srv1081295875=3, srv567762681=75, srv751140353=83, srv1392531006=18, srv327112665=56, srv670475364=80, srv644116334=78, srv1411141110=19, srv772543615=86, srv2086871724=50, srv2114146119=51, srv1723379352=29, srv1810943743=31, srv859117130=92, srv1819519514=34, srv458649722=65, srv2063723129=49, srv1950284923=43, srv1032221491=0, srv1533666945=22, srv1863185247=36, srv1133077433=6, srv153025847=21, srv71507353=81, srv726268461=82, srv1108387825=4, srv488034609=71, srv346851963=57, srv1250801672=11, srv1118815027=5, srv1219223480=8, srv834382277=90, srv1569149611=23, srv1757069108=30, srv1942713782=42, srv442622811=64, srv924790038=95, srv284834918=54, srv398246628=61, srv1652584870=26, srv465509763=67, srv1813569195=33, srv145175811=20, srv1976887828=46, srv1321003366=15, srv373801585=58, srv1811874963=32, srv993395388=99, srv798847433=87, srv486161442=70, srv844299686=91, srv1602245175=25, srv46189595=66, srv188546070=39, srv1237418507=10, srv629894000=77, srv762320177=85, srv561112121=74, srv466539268=68, srv321052950=55, srv1865787335=37, srv1598700225=24, srv502907313=72, srv1858093247=35, srv1042639084=2, srv2029954237=47, srv1973021341=45, srv103288457=1, srv937594057=96, srv1679632222=27, srv1293191511=13, srv1884261935=38} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-11-19 10:55:17,429 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-11-19 10:55:17,429 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-11-19 10:55:17,429 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-11-19 10:55:17,429 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-11-19 10:55:17,430 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-11-19 10:55:17,430 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-11-19 10:55:17,430 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-11-19 10:55:17,430 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-11-19 10:55:17,430 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-11-19 10:55:17,430 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-11-19 10:55:17,431 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-11-19 10:55:17,431 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-11-19 10:55:17,431 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-11-19 10:55:17,431 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-11-19 10:55:17,431 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-11-19 10:55:17,431 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-11-19 10:55:17,431 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-11-19 10:55:17,431 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-11-19 10:55:17,431 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-11-19 10:55:17,431 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-11-19 10:55:17,432 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-11-19 10:55:17,432 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-11-19 10:55:17,432 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-11-19 10:55:17,432 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-11-19 10:55:17,432 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-11-19 10:55:17,432 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-11-19 10:55:17,432 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-11-19 10:55:17,432 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-11-19 10:55:17,432 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-11-19 10:55:17,433 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-11-19 10:55:17,433 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-11-19 10:55:17,433 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-11-19 10:55:17,433 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-11-19 10:55:17,433 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-11-19 10:55:17,433 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-11-19 10:55:17,433 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-11-19 10:55:17,433 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-11-19 10:55:17,433 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-11-19 10:55:17,434 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-11-19 10:55:17,434 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-11-19 10:55:17,434 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-11-19 10:55:17,434 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-11-19 10:55:17,434 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-11-19 10:55:17,434 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-11-19 10:55:17,434 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-11-19 10:55:17,434 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-11-19 10:55:17,434 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-11-19 10:55:17,434 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-11-19 10:55:17,434 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-11-19 10:55:17,435 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-11-19 10:55:17,435 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-11-19 10:55:17,435 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-11-19 10:55:17,435 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-11-19 10:55:17,435 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-11-19 10:55:17,436 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-11-19 10:55:17,436 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-11-19 10:55:17,436 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-11-19 10:55:17,436 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-11-19 10:55:17,436 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-11-19 10:55:17,436 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-11-19 10:55:17,437 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-11-19 10:55:17,437 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-11-19 10:55:17,437 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-11-19 10:55:17,437 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-11-19 10:55:17,437 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-11-19 10:55:17,437 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-11-19 10:55:17,438 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-11-19 10:55:17,438 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-11-19 10:55:17,438 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-11-19 10:55:17,438 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-11-19 10:55:17,438 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-11-19 10:55:17,438 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-11-19 10:55:17,439 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-11-19 10:55:17,439 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-11-19 10:55:17,439 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-11-19 10:55:17,439 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-11-19 10:55:17,439 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-11-19 10:55:17,439 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-11-19 10:55:17,439 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-11-19 10:55:17,439 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-11-19 10:55:17,439 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-11-19 10:55:17,439 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-11-19 10:55:17,439 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-11-19 10:55:17,439 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-11-19 10:55:17,440 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-11-19 10:55:17,440 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-11-19 10:55:17,440 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-11-19 10:55:17,440 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-11-19 10:55:17,440 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-11-19 10:55:17,440 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-11-19 10:55:17,440 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-11-19 10:55:17,440 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-11-19 10:55:17,440 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-11-19 10:55:17,441 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-11-19 10:55:17,441 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-11-19 10:55:17,441 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-11-19 10:55:17,441 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-11-19 10:55:17,441 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-11-19 10:55:17,441 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-11-19 10:55:17,442 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-11-19 10:55:17,442 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-11-19 10:55:17,629 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.06666666666666667, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-11-19 10:55:17,630 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-11-19 10:55:17,630 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.9909252140407105, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.06666666666666667, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-11-19 10:55:18,360 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 892 ms to try 5000 different iterations.  Found a solution that moves 4686 regions; Going from a computed imbalance of 0.9909252140407105 to a new imbalance of 0.18034682535452015. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.04175534894754668, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.057801083100854384, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.5206666666666667, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.04175534894754668, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.17558333333333334, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.24191666666666667, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-11-19 10:55:18,382 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv670475364:81 , srv1118815027:82 , srv1976887828:82 , srv503169443:82 , srv946956088:82 , srv1133077433:83 , srv1316046333:83 , srv136516943:83 , srv1652584870:83 , srv1687427363:83 , srv1942713782:83 , srv2063723129:83 , srv442622811:83 , srv762320177:83 , srv859117130:83 , srv885219809:83 , srv1042639084:84 , srv1081295875:84 , srv1229964641:84 , srv1598700225:84 , srv1602245175:84 , srv1813569195:84 , srv1884261935:84 , srv2114146119:84 , srv396136976:84 , srv414096338:84 , srv488034609:84 , srv666258590:84 , srv830340198:84 , srv1269759308:85 , srv1386197367:85 , srv1679632222:85 , srv1723379352:85 , srv1819519514:85 , srv1858093247:85 , srv1863185247:85 , srv1959350135:85 , srv321052950:85 , srv398246628:85 , srv424624931:85 , srv469388240:85 , srv629894000:85 , srv71507353:85 , srv833277736:85 , srv834382277:85 , srv1032221491:86 , srv103288457:86 , srv1411141110:86 , srv1757069108:86 , srv1810943743:86 , srv1811874963:86 , srv1940581351:86 , srv2086871724:86 , srv327112665:86 , srv644116334:86 , srv726268461:86 , srv772543615:86 , srv844299686:86 , srv153025847:87 , srv1569149611:87 , srv1897693771:87 , srv346851963:87 , srv458649722:87 , srv46189595:87 , srv465509763:87 , srv486161442:87 , srv502907313:87 , srv594434294:87 , srv798847433:87 , srv1293191511:88 , srv1865787335:88 , srv1973021341:88 , srv2029954237:88 , srv249567975:88 , srv373801585:88 , srv385593605:88 , srv567762681:88 , srv75635336:88 , srv882665726:88 , srv924790038:88 , srv1219223480:89 , srv1237418507:89 , srv1950284923:89 , srv284834918:89 , srv466539268:89 , srv561112121:89 , srv751140353:89 , srv941661453:89 , srv993395388:89 , srv1533666945:90 , srv937594057:90 , srv1108387825:91 , srv145175811:91 , srv1134372898:92 , srv2043332152:92 , srv220273699:93 , srv1250801672:94 , srv1392531006:94 , srv188546070:94 , srv1321003366:461 }
2023-11-19 10:55:18,386 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-11-19 10:55:18,387 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv75635336=84, srv414096338=62, srv1316046333=14, srv830340198=88, srv885219809=94, srv1134372898=7, srv1940581351=41, srv503169443=73, srv220273699=52, srv1229964641=9, srv136516943=16, srv1687427363=28, srv385593605=59, srv424624931=63, srv1897693771=40, srv1959350135=44, srv941661453=97, srv249567975=53, srv1386197367=17, srv666258590=79, srv469388240=69, srv594434294=76, srv2043332152=48, srv396136976=60, srv882665726=93, srv1269759308=12, srv946956088=98, srv833277736=89, srv1081295875=3, srv567762681=75, srv751140353=83, srv1392531006=18, srv327112665=56, srv670475364=80, srv644116334=78, srv1411141110=19, srv772543615=86, srv2086871724=50, srv2114146119=51, srv1723379352=29, srv1810943743=31, srv859117130=92, srv1819519514=34, srv458649722=65, srv2063723129=49, srv1950284923=43, srv1032221491=0, srv1533666945=22, srv1863185247=36, srv1133077433=6, srv153025847=21, srv71507353=81, srv726268461=82, srv1108387825=4, srv488034609=71, srv346851963=57, srv1250801672=11, srv1118815027=5, srv1219223480=8, srv834382277=90, srv1569149611=23, srv1757069108=30, srv1942713782=42, srv442622811=64, srv924790038=95, srv284834918=54, srv398246628=61, srv1652584870=26, srv465509763=67, srv1813569195=33, srv145175811=20, srv1976887828=46, srv1321003366=15, srv373801585=58, srv1811874963=32, srv993395388=99, srv798847433=87, srv486161442=70, srv844299686=91, srv1602245175=25, srv46189595=66, srv188546070=39, srv1237418507=10, srv629894000=77, srv762320177=85, srv561112121=74, srv466539268=68, srv321052950=55, srv1865787335=37, srv1598700225=24, srv502907313=72, srv1858093247=35, srv1042639084=2, srv2029954237=47, srv1973021341=45, srv103288457=1, srv937594057=96, srv1679632222=27, srv1293191511=13, srv1884261935=38} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-11-19 10:55:18,400 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-11-19 10:55:18,400 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-11-19 10:55:18,400 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-11-19 10:55:18,400 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-11-19 10:55:18,400 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-11-19 10:55:18,400 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-11-19 10:55:18,401 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-11-19 10:55:18,401 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-11-19 10:55:18,401 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-11-19 10:55:18,401 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-11-19 10:55:18,401 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-11-19 10:55:18,401 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-11-19 10:55:18,401 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-11-19 10:55:18,401 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-11-19 10:55:18,401 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-11-19 10:55:18,401 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-11-19 10:55:18,401 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-11-19 10:55:18,401 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-11-19 10:55:18,401 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-11-19 10:55:18,402 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-11-19 10:55:18,402 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-11-19 10:55:18,402 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-11-19 10:55:18,402 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-11-19 10:55:18,402 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-11-19 10:55:18,402 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-11-19 10:55:18,402 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-11-19 10:55:18,402 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-11-19 10:55:18,402 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-11-19 10:55:18,402 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-11-19 10:55:18,402 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-11-19 10:55:18,402 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-11-19 10:55:18,402 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-11-19 10:55:18,402 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-11-19 10:55:18,403 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-11-19 10:55:18,403 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-11-19 10:55:18,403 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-11-19 10:55:18,403 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-11-19 10:55:18,403 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-11-19 10:55:18,403 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-11-19 10:55:18,403 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-11-19 10:55:18,403 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-11-19 10:55:18,403 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-11-19 10:55:18,403 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-11-19 10:55:18,403 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-11-19 10:55:18,403 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-11-19 10:55:18,403 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-11-19 10:55:18,403 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-11-19 10:55:18,404 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-11-19 10:55:18,404 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-11-19 10:55:18,404 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-11-19 10:55:18,404 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-11-19 10:55:18,404 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-11-19 10:55:18,404 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-11-19 10:55:18,404 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-11-19 10:55:18,404 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-11-19 10:55:18,404 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-11-19 10:55:18,404 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-11-19 10:55:18,404 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-11-19 10:55:18,404 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-11-19 10:55:18,404 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-11-19 10:55:18,404 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-11-19 10:55:18,405 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-11-19 10:55:18,405 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-11-19 10:55:18,405 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-11-19 10:55:18,405 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-11-19 10:55:18,405 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-11-19 10:55:18,405 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-11-19 10:55:18,405 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-11-19 10:55:18,405 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-11-19 10:55:18,405 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-11-19 10:55:18,405 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-11-19 10:55:18,405 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-11-19 10:55:18,405 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-11-19 10:55:18,405 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-11-19 10:55:18,405 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-11-19 10:55:18,405 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-11-19 10:55:18,406 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-11-19 10:55:18,406 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-11-19 10:55:18,406 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-11-19 10:55:18,406 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-11-19 10:55:18,406 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-11-19 10:55:18,406 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-11-19 10:55:18,406 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-11-19 10:55:18,406 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-11-19 10:55:18,406 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-11-19 10:55:18,406 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-11-19 10:55:18,406 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-11-19 10:55:18,406 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-11-19 10:55:18,406 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-11-19 10:55:18,406 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-11-19 10:55:18,406 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-11-19 10:55:18,407 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-11-19 10:55:18,407 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-11-19 10:55:18,407 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-11-19 10:55:18,407 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-11-19 10:55:18,407 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-11-19 10:55:18,407 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-11-19 10:55:18,407 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-11-19 10:55:18,407 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-11-19 10:55:18,407 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-11-19 10:55:18,407 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-11-19 10:55:18,527 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.04175534894754668, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.057801083100854384, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.04175534894754668, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.17558333333333334, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.24191666666666667, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-11-19 10:55:18,527 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-11-19 10:55:18,527 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.18031401328121363, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.04175534894754668, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.057801083100854384, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.04175534894754668, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.17558333333333334, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.24191666666666667, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-11-19 10:55:18,765 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 337 ms to try 5000 different iterations.  Found a solution that moves 2670 regions; Going from a computed imbalance of 0.18031401328121363 to a new imbalance of 0.01500542701995258. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.02250992215858341); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.035276684147527874, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.2966666666666667, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.02250992215858341); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.011833333333333333); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.04516666666666667, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-11-19 10:55:18,774 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1250801672:79 , srv188546070:79 , srv1108387825:80 , srv220273699:80 , srv937594057:80 , srv1134372898:81 , srv145175811:81 , srv1533666945:81 , srv2043332152:81 , srv1392531006:82 , srv153025847:82 , srv249567975:82 , srv1219223480:83 , srv1865787335:83 , srv1897693771:83 , srv1973021341:83 , srv46189595:83 , srv502907313:83 , srv561112121:83 , srv882665726:83 , srv924790038:83 , srv1237418507:84 , srv1293191511:84 , srv1950284923:84 , srv2029954237:84 , srv284834918:84 , srv466539268:84 , srv567762681:84 , srv644116334:84 , srv751140353:84 , srv772543615:84 , srv993395388:84 , srv1032221491:85 , srv1858093247:85 , srv321052950:85 , srv327112665:85 , srv373801585:85 , srv398246628:85 , srv465509763:85 , srv469388240:85 , srv594434294:85 , srv629894000:85 , srv726268461:85 , srv834382277:85 , srv1411141110:86 , srv1569149611:86 , srv1723379352:86 , srv1810943743:86 , srv1813569195:86 , srv1863185247:86 , srv1884261935:86 , srv1940581351:86 , srv346851963:86 , srv385593605:86 , srv71507353:86 , srv75635336:86 , srv830340198:86 , srv833277736:86 , srv1042639084:87 , srv1229964641:87 , srv1316046333:87 , srv1386197367:87 , srv1598700225:87 , srv1679632222:87 , srv1757069108:87 , srv1811874963:87 , srv1959350135:87 , srv2086871724:87 , srv414096338:87 , srv486161442:87 , srv844299686:87 , srv1118815027:88 , srv1269759308:88 , srv136516943:88 , srv1602245175:88 , srv1819519514:88 , srv1942713782:88 , srv2114146119:88 , srv424624931:88 , srv458649722:88 , srv666258590:88 , srv798847433:88 , srv941661453:88 , srv103288457:89 , srv1081295875:89 , srv1133077433:89 , srv1687427363:89 , srv396136976:89 , srv442622811:89 , srv488034609:89 , srv670475364:89 , srv859117130:89 , srv885219809:89 , srv1652584870:90 , srv503169443:91 , srv762320177:91 , srv946956088:91 , srv1976887828:92 , srv2063723129:92 , srv1321003366:513 }
2023-11-19 10:55:18,778 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-11-19 10:55:18,778 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv75635336=84, srv414096338=62, srv1316046333=14, srv830340198=88, srv885219809=94, srv1134372898=7, srv1940581351=41, srv503169443=73, srv220273699=52, srv1229964641=9, srv136516943=16, srv1687427363=28, srv385593605=59, srv424624931=63, srv1897693771=40, srv1959350135=44, srv941661453=97, srv249567975=53, srv1386197367=17, srv666258590=79, srv469388240=69, srv594434294=76, srv2043332152=48, srv396136976=60, srv882665726=93, srv1269759308=12, srv946956088=98, srv833277736=89, srv1081295875=3, srv567762681=75, srv751140353=83, srv1392531006=18, srv327112665=56, srv670475364=80, srv644116334=78, srv1411141110=19, srv772543615=86, srv2086871724=50, srv2114146119=51, srv1723379352=29, srv1810943743=31, srv859117130=92, srv1819519514=34, srv458649722=65, srv2063723129=49, srv1950284923=43, srv1032221491=0, srv1533666945=22, srv1863185247=36, srv1133077433=6, srv153025847=21, srv71507353=81, srv726268461=82, srv1108387825=4, srv488034609=71, srv346851963=57, srv1250801672=11, srv1118815027=5, srv1219223480=8, srv834382277=90, srv1569149611=23, srv1757069108=30, srv1942713782=42, srv442622811=64, srv924790038=95, srv284834918=54, srv398246628=61, srv1652584870=26, srv465509763=67, srv1813569195=33, srv145175811=20, srv1976887828=46, srv1321003366=15, srv373801585=58, srv1811874963=32, srv993395388=99, srv798847433=87, srv486161442=70, srv844299686=91, srv1602245175=25, srv46189595=66, srv188546070=39, srv1237418507=10, srv629894000=77, srv762320177=85, srv561112121=74, srv466539268=68, srv321052950=55, srv1865787335=37, srv1598700225=24, srv502907313=72, srv1858093247=35, srv1042639084=2, srv2029954237=47, srv1973021341=45, srv103288457=1, srv937594057=96, srv1679632222=27, srv1293191511=13, srv1884261935=38} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-11-19 10:55:18,799 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-11-19 10:55:18,799 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-11-19 10:55:18,800 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-11-19 10:55:18,800 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-11-19 10:55:18,800 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-11-19 10:55:18,800 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-11-19 10:55:18,800 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-11-19 10:55:18,800 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-11-19 10:55:18,800 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-11-19 10:55:18,800 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-11-19 10:55:18,800 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-11-19 10:55:18,800 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-11-19 10:55:18,800 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-11-19 10:55:18,800 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-11-19 10:55:18,800 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-11-19 10:55:18,800 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-11-19 10:55:18,800 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-11-19 10:55:18,801 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-11-19 10:55:18,801 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-11-19 10:55:18,801 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-11-19 10:55:18,801 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-11-19 10:55:18,801 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-11-19 10:55:18,801 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-11-19 10:55:18,801 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-11-19 10:55:18,801 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-11-19 10:55:18,801 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-11-19 10:55:18,801 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-11-19 10:55:18,801 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-11-19 10:55:18,801 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-11-19 10:55:18,801 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-11-19 10:55:18,801 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-11-19 10:55:18,801 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-11-19 10:55:18,802 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-11-19 10:55:18,802 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-11-19 10:55:18,802 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-11-19 10:55:18,802 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-11-19 10:55:18,802 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-11-19 10:55:18,802 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-11-19 10:55:18,802 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-11-19 10:55:18,802 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-11-19 10:55:18,802 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-11-19 10:55:18,802 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-11-19 10:55:18,802 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-11-19 10:55:18,802 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-11-19 10:55:18,802 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-11-19 10:55:18,802 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-11-19 10:55:18,802 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-11-19 10:55:18,803 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-11-19 10:55:18,803 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-11-19 10:55:18,803 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-11-19 10:55:18,803 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-11-19 10:55:18,803 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-11-19 10:55:18,803 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-11-19 10:55:18,803 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-11-19 10:55:18,803 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-11-19 10:55:18,803 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-11-19 10:55:18,803 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-11-19 10:55:18,803 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-11-19 10:55:18,803 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-11-19 10:55:18,803 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-11-19 10:55:18,803 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-11-19 10:55:18,803 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-11-19 10:55:18,803 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-11-19 10:55:18,803 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-11-19 10:55:18,804 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-11-19 10:55:18,804 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-11-19 10:55:18,804 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-11-19 10:55:18,804 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-11-19 10:55:18,804 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-11-19 10:55:18,804 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-11-19 10:55:18,804 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-11-19 10:55:18,804 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-11-19 10:55:18,804 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-11-19 10:55:18,804 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-11-19 10:55:18,804 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-11-19 10:55:18,804 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-11-19 10:55:18,804 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-11-19 10:55:18,804 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-11-19 10:55:18,804 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-11-19 10:55:18,804 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-11-19 10:55:18,805 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-11-19 10:55:18,805 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-11-19 10:55:18,805 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-11-19 10:55:18,805 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-11-19 10:55:18,805 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-11-19 10:55:18,805 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-11-19 10:55:18,805 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-11-19 10:55:18,805 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-11-19 10:55:18,805 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-11-19 10:55:18,805 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-11-19 10:55:18,805 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-11-19 10:55:18,805 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-11-19 10:55:18,805 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-11-19 10:55:18,805 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-11-19 10:55:18,805 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-11-19 10:55:18,805 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-11-19 10:55:18,805 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-11-19 10:55:18,806 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-11-19 10:55:18,806 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-11-19 10:55:18,806 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-11-19 10:55:18,806 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-11-19 10:55:18,921 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.02250992215858341); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.035276684147527874, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.02250992215858341); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.011833333333333333); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.04516666666666667, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-11-19 10:55:18,921 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-11-19 10:55:18,921 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.014986731280360526, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.02250992215858341); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.035276684147527874, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.02250992215858341); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.011833333333333333); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.04516666666666667, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-11-19 10:55:19,150 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 330 ms to try 5000 different iterations.  Found a solution that moves 965 regions; Going from a computed imbalance of 0.014986731280360526 to a new imbalance of 5.007697674365128E-4. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.008914105645620285); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.013542136096499574); MoveCostFunction : (multiplier=7.0, imbalance=0.10722222222222222, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.008914105645620285); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.004333333333333333); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-11-19 10:55:19,152 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv941661453:80 , srv798847433:81 , srv103288457:82 , srv1392531006:82 , srv2063723129:82 , srv458649722:82 , srv1081295875:83 , srv385593605:83 , srv762320177:83 , srv993395388:83 , srv1134372898:84 , srv1219223480:84 , srv1237418507:84 , srv1250801672:84 , srv1269759308:84 , srv1569149611:84 , srv1811874963:84 , srv188546070:84 , srv1950284923:84 , srv1976887828:84 , srv2086871724:84 , srv284834918:84 , srv346851963:84 , srv424624931:84 , srv442622811:84 , srv465509763:84 , srv488034609:84 , srv503169443:84 , srv751140353:84 , srv75635336:84 , srv844299686:84 , srv1133077433:85 , srv136516943:85 , srv1411141110:85 , srv1652584870:85 , srv1687427363:85 , srv1723379352:85 , srv1757069108:85 , srv1810943743:85 , srv1819519514:85 , srv1863185247:85 , srv1959350135:85 , srv2043332152:85 , srv2114146119:85 , srv466539268:85 , srv567762681:85 , srv594434294:85 , srv666258590:85 , srv859117130:85 , srv885219809:85 , srv946956088:85 , srv1032221491:86 , srv1042639084:86 , srv1118815027:86 , srv1229964641:86 , srv1293191511:86 , srv1386197367:86 , srv145175811:86 , srv1598700225:86 , srv1602245175:86 , srv1679632222:86 , srv1858093247:86 , srv1940581351:86 , srv1973021341:86 , srv2029954237:86 , srv220273699:86 , srv321052950:86 , srv327112665:86 , srv373801585:86 , srv396136976:86 , srv414096338:86 , srv46189595:86 , srv469388240:86 , srv486161442:86 , srv502907313:86 , srv644116334:86 , srv71507353:86 , srv726268461:86 , srv830340198:86 , srv833277736:86 , srv882665726:86 , srv924790038:86 , srv1108387825:87 , srv153025847:87 , srv1533666945:87 , srv1813569195:87 , srv1865787335:87 , srv1884261935:87 , srv1942713782:87 , srv398246628:87 , srv561112121:87 , srv629894000:87 , srv937594057:87 , srv1316046333:88 , srv1897693771:88 , srv249567975:88 , srv670475364:88 , srv834382277:88 , srv772543615:89 , srv1321003366:563 }
2023-11-19 10:55:19,156 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-11-19 10:55:19,157 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv75635336=84, srv414096338=62, srv1316046333=14, srv830340198=88, srv885219809=94, srv1134372898=7, srv1940581351=41, srv503169443=73, srv220273699=52, srv1229964641=9, srv136516943=16, srv1687427363=28, srv385593605=59, srv424624931=63, srv1897693771=40, srv1959350135=44, srv941661453=97, srv249567975=53, srv1386197367=17, srv666258590=79, srv469388240=69, srv594434294=76, srv2043332152=48, srv396136976=60, srv882665726=93, srv1269759308=12, srv946956088=98, srv833277736=89, srv1081295875=3, srv567762681=75, srv751140353=83, srv1392531006=18, srv327112665=56, srv670475364=80, srv644116334=78, srv1411141110=19, srv772543615=86, srv2086871724=50, srv2114146119=51, srv1723379352=29, srv1810943743=31, srv859117130=92, srv1819519514=34, srv458649722=65, srv2063723129=49, srv1950284923=43, srv1032221491=0, srv1533666945=22, srv1863185247=36, srv1133077433=6, srv153025847=21, srv71507353=81, srv726268461=82, srv1108387825=4, srv488034609=71, srv346851963=57, srv1250801672=11, srv1118815027=5, srv1219223480=8, srv834382277=90, srv1569149611=23, srv1757069108=30, srv1942713782=42, srv442622811=64, srv924790038=95, srv284834918=54, srv398246628=61, srv1652584870=26, srv465509763=67, srv1813569195=33, srv145175811=20, srv1976887828=46, srv1321003366=15, srv373801585=58, srv1811874963=32, srv993395388=99, srv798847433=87, srv486161442=70, srv844299686=91, srv1602245175=25, srv46189595=66, srv188546070=39, srv1237418507=10, srv629894000=77, srv762320177=85, srv561112121=74, srv466539268=68, srv321052950=55, srv1865787335=37, srv1598700225=24, srv502907313=72, srv1858093247=35, srv1042639084=2, srv2029954237=47, srv1973021341=45, srv103288457=1, srv937594057=96, srv1679632222=27, srv1293191511=13, srv1884261935=38} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-11-19 10:55:19,177 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-11-19 10:55:19,177 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-11-19 10:55:19,177 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-11-19 10:55:19,177 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-11-19 10:55:19,178 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-11-19 10:55:19,178 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-11-19 10:55:19,178 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-11-19 10:55:19,178 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-11-19 10:55:19,178 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-11-19 10:55:19,178 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-11-19 10:55:19,178 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-11-19 10:55:19,178 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-11-19 10:55:19,178 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-11-19 10:55:19,179 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-11-19 10:55:19,179 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-11-19 10:55:19,179 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-11-19 10:55:19,179 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-11-19 10:55:19,179 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-11-19 10:55:19,179 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-11-19 10:55:19,179 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-11-19 10:55:19,179 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-11-19 10:55:19,179 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-11-19 10:55:19,180 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-11-19 10:55:19,180 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-11-19 10:55:19,180 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-11-19 10:55:19,180 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-11-19 10:55:19,180 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-11-19 10:55:19,180 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-11-19 10:55:19,180 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-11-19 10:55:19,180 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-11-19 10:55:19,181 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-11-19 10:55:19,181 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-11-19 10:55:19,181 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-11-19 10:55:19,181 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-11-19 10:55:19,181 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-11-19 10:55:19,181 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-11-19 10:55:19,181 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-11-19 10:55:19,181 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-11-19 10:55:19,181 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-11-19 10:55:19,182 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-11-19 10:55:19,182 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-11-19 10:55:19,182 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-11-19 10:55:19,182 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-11-19 10:55:19,182 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-11-19 10:55:19,182 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-11-19 10:55:19,182 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-11-19 10:55:19,182 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-11-19 10:55:19,182 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-11-19 10:55:19,182 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-11-19 10:55:19,183 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-11-19 10:55:19,183 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-11-19 10:55:19,183 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-11-19 10:55:19,183 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-11-19 10:55:19,183 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-11-19 10:55:19,183 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-11-19 10:55:19,183 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-11-19 10:55:19,183 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-11-19 10:55:19,183 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-11-19 10:55:19,184 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-11-19 10:55:19,184 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-11-19 10:55:19,184 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-11-19 10:55:19,184 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-11-19 10:55:19,184 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-11-19 10:55:19,184 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-11-19 10:55:19,184 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-11-19 10:55:19,184 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-11-19 10:55:19,184 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-11-19 10:55:19,184 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-11-19 10:55:19,185 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-11-19 10:55:19,185 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-11-19 10:55:19,185 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-11-19 10:55:19,185 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-11-19 10:55:19,185 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-11-19 10:55:19,185 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-11-19 10:55:19,185 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-11-19 10:55:19,185 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-11-19 10:55:19,185 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-11-19 10:55:19,186 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-11-19 10:55:19,186 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-11-19 10:55:19,186 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-11-19 10:55:19,186 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-11-19 10:55:19,186 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-11-19 10:55:19,186 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-11-19 10:55:19,186 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-11-19 10:55:19,186 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-11-19 10:55:19,186 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-11-19 10:55:19,186 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-11-19 10:55:19,187 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-11-19 10:55:19,187 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-11-19 10:55:19,187 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-11-19 10:55:19,187 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-11-19 10:55:19,187 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-11-19 10:55:19,187 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-11-19 10:55:19,187 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-11-19 10:55:19,187 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-11-19 10:55:19,187 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-11-19 10:55:19,187 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-11-19 10:55:19,188 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-11-19 10:55:19,188 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-11-19 10:55:19,188 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-11-19 10:55:19,188 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-11-19 10:55:19,352 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.008914105645620285); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.013542136096499574); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.008914105645620285); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.004333333333333333); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-11-19 10:55:19,352 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-11-19 10:55:19,353 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=4.940126930146652E-4, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.008914105645620285); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.013542136096499574); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.008914105645620285); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.004333333333333333); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-11-19 10:55:19,706 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 506 ms to try 5000 different iterations.  Found a solution that moves 283 regions; Going from a computed imbalance of 4.940126930146652E-4 to a new imbalance of 3.6413043938327726E-5. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=4.4668347344853864E-4); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0021711298242630987); MoveCostFunction : (multiplier=7.0, imbalance=0.03144444444444444, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=4.4668347344853864E-4); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=2.5E-4); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-11-19 10:55:19,707 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1679632222:83 , srv220273699:83 , srv373801585:83 , srv396136976:83 , srv486161442:83 , srv561112121:83 , srv772543615:83 , srv1108387825:84 , srv1293191511:84 , srv1316046333:84 , srv1386197367:84 , srv1392531006:84 , srv145175811:84 , srv1533666945:84 , srv1602245175:84 , srv1652584870:84 , srv1757069108:84 , srv1865787335:84 , srv1884261935:84 , srv1940581351:84 , srv1942713782:84 , srv1950284923:84 , srv1976887828:84 , srv2029954237:84 , srv2043332152:84 , srv2114146119:84 , srv249567975:84 , srv424624931:84 , srv670475364:84 , srv75635336:84 , srv834382277:84 , srv946956088:84 , srv1032221491:85 , srv103288457:85 , srv1042639084:85 , srv1133077433:85 , srv1134372898:85 , srv1229964641:85 , srv1237418507:85 , srv1250801672:85 , srv1269759308:85 , srv1411141110:85 , srv1569149611:85 , srv1598700225:85 , srv1687427363:85 , srv1810943743:85 , srv1811874963:85 , srv1813569195:85 , srv1819519514:85 , srv1858093247:85 , srv188546070:85 , srv1897693771:85 , srv1959350135:85 , srv1973021341:85 , srv2063723129:85 , srv2086871724:85 , srv284834918:85 , srv321052950:85 , srv327112665:85 , srv385593605:85 , srv398246628:85 , srv414096338:85 , srv458649722:85 , srv466539268:85 , srv488034609:85 , srv503169443:85 , srv567762681:85 , srv594434294:85 , srv629894000:85 , srv666258590:85 , srv726268461:85 , srv751140353:85 , srv762320177:85 , srv833277736:85 , srv844299686:85 , srv882665726:85 , srv885219809:85 , srv924790038:85 , srv937594057:85 , srv941661453:85 , srv993395388:85 , srv1081295875:86 , srv1118815027:86 , srv1219223480:86 , srv136516943:86 , srv1723379352:86 , srv1863185247:86 , srv346851963:86 , srv442622811:86 , srv46189595:86 , srv465509763:86 , srv469388240:86 , srv502907313:86 , srv644116334:86 , srv71507353:86 , srv798847433:86 , srv830340198:86 , srv859117130:86 , srv153025847:87 , srv1321003366:605 }
2023-11-19 10:55:19,711 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-11-19 10:55:19,711 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv75635336=84, srv414096338=62, srv1316046333=14, srv830340198=88, srv885219809=94, srv1134372898=7, srv1940581351=41, srv503169443=73, srv220273699=52, srv1229964641=9, srv136516943=16, srv1687427363=28, srv385593605=59, srv424624931=63, srv1897693771=40, srv1959350135=44, srv941661453=97, srv249567975=53, srv1386197367=17, srv666258590=79, srv469388240=69, srv594434294=76, srv2043332152=48, srv396136976=60, srv882665726=93, srv1269759308=12, srv946956088=98, srv833277736=89, srv1081295875=3, srv567762681=75, srv751140353=83, srv1392531006=18, srv327112665=56, srv670475364=80, srv644116334=78, srv1411141110=19, srv772543615=86, srv2086871724=50, srv2114146119=51, srv1723379352=29, srv1810943743=31, srv859117130=92, srv1819519514=34, srv458649722=65, srv2063723129=49, srv1950284923=43, srv1032221491=0, srv1533666945=22, srv1863185247=36, srv1133077433=6, srv153025847=21, srv71507353=81, srv726268461=82, srv1108387825=4, srv488034609=71, srv346851963=57, srv1250801672=11, srv1118815027=5, srv1219223480=8, srv834382277=90, srv1569149611=23, srv1757069108=30, srv1942713782=42, srv442622811=64, srv924790038=95, srv284834918=54, srv398246628=61, srv1652584870=26, srv465509763=67, srv1813569195=33, srv145175811=20, srv1976887828=46, srv1321003366=15, srv373801585=58, srv1811874963=32, srv993395388=99, srv798847433=87, srv486161442=70, srv844299686=91, srv1602245175=25, srv46189595=66, srv188546070=39, srv1237418507=10, srv629894000=77, srv762320177=85, srv561112121=74, srv466539268=68, srv321052950=55, srv1865787335=37, srv1598700225=24, srv502907313=72, srv1858093247=35, srv1042639084=2, srv2029954237=47, srv1973021341=45, srv103288457=1, srv937594057=96, srv1679632222=27, srv1293191511=13, srv1884261935=38} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-11-19 10:55:19,722 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-11-19 10:55:19,722 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-11-19 10:55:19,722 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-11-19 10:55:19,722 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-11-19 10:55:19,722 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-11-19 10:55:19,722 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-11-19 10:55:19,722 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-11-19 10:55:19,722 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-11-19 10:55:19,722 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-11-19 10:55:19,722 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-11-19 10:55:19,722 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-11-19 10:55:19,722 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-11-19 10:55:19,722 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-11-19 10:55:19,722 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-11-19 10:55:19,722 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-11-19 10:55:19,722 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-11-19 10:55:19,722 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-11-19 10:55:19,722 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-11-19 10:55:19,723 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-11-19 10:55:19,723 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-11-19 10:55:19,723 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-11-19 10:55:19,723 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-11-19 10:55:19,723 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-11-19 10:55:19,723 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-11-19 10:55:19,723 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-11-19 10:55:19,723 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-11-19 10:55:19,723 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-11-19 10:55:19,723 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-11-19 10:55:19,723 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-11-19 10:55:19,723 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-11-19 10:55:19,723 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-11-19 10:55:19,723 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-11-19 10:55:19,723 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-11-19 10:55:19,723 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-11-19 10:55:19,723 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-11-19 10:55:19,723 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-11-19 10:55:19,723 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-11-19 10:55:19,723 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-11-19 10:55:19,723 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-11-19 10:55:19,724 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-11-19 10:55:19,724 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-11-19 10:55:19,724 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-11-19 10:55:19,724 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-11-19 10:55:19,724 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-11-19 10:55:19,724 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-11-19 10:55:19,724 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-11-19 10:55:19,724 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-11-19 10:55:19,724 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-11-19 10:55:19,724 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-11-19 10:55:19,724 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-11-19 10:55:19,724 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-11-19 10:55:19,724 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-11-19 10:55:19,724 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-11-19 10:55:19,724 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-11-19 10:55:19,724 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-11-19 10:55:19,724 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-11-19 10:55:19,724 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-11-19 10:55:19,724 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-11-19 10:55:19,724 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-11-19 10:55:19,724 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-11-19 10:55:19,724 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-11-19 10:55:19,725 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-11-19 10:55:19,725 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-11-19 10:55:19,725 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-11-19 10:55:19,725 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-11-19 10:55:19,725 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-11-19 10:55:19,725 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-11-19 10:55:19,725 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-11-19 10:55:19,725 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-11-19 10:55:19,725 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-11-19 10:55:19,725 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-11-19 10:55:19,725 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-11-19 10:55:19,725 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-11-19 10:55:19,725 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-11-19 10:55:19,725 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-11-19 10:55:19,725 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-11-19 10:55:19,726 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-11-19 10:55:19,726 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-11-19 10:55:19,726 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-11-19 10:55:19,726 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-11-19 10:55:19,726 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-11-19 10:55:19,726 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-11-19 10:55:19,726 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-11-19 10:55:19,726 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-11-19 10:55:19,726 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-11-19 10:55:19,726 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-11-19 10:55:19,726 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-11-19 10:55:19,726 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-11-19 10:55:19,726 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-11-19 10:55:19,726 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-11-19 10:55:19,726 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-11-19 10:55:19,726 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-11-19 10:55:19,726 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-11-19 10:55:19,726 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-11-19 10:55:19,726 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-11-19 10:55:19,726 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-11-19 10:55:19,726 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-11-19 10:55:19,726 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-11-19 10:55:19,727 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-11-19 10:55:19,727 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-11-19 10:55:19,727 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-11-19 10:55:19,835 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=4.4668347344853864E-4); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0021711298242630987); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=4.4668347344853864E-4); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=2.5E-4); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-11-19 10:55:19,835 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-11-19 10:55:19,836 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=3.443143558456312E-5, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=4.4668347344853864E-4); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0021711298242630987); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=4.4668347344853864E-4); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=2.5E-4); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-11-19 10:55:20,046 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 312 ms to try 5000 different iterations.  Found a solution that moves 39 regions; Going from a computed imbalance of 3.443143558456312E-5 to a new imbalance of 6.671069509007577E-6. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0014213381090374027); MoveCostFunction : (multiplier=7.0, imbalance=0.004333333333333333); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-11-19 10:55:20,047 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv153025847:83 , srv1819519514:83 , srv1897693771:83 , srv346851963:83 , srv466539268:83 , srv486161442:83 , srv71507353:83 , srv859117130:83 , srv1032221491:84 , srv103288457:84 , srv1042639084:84 , srv1081295875:84 , srv1108387825:84 , srv1118815027:84 , srv1133077433:84 , srv1134372898:84 , srv1219223480:84 , srv1229964641:84 , srv1237418507:84 , srv1250801672:84 , srv1269759308:84 , srv1293191511:84 , srv1316046333:84 , srv136516943:84 , srv1386197367:84 , srv1392531006:84 , srv1411141110:84 , srv145175811:84 , srv1533666945:84 , srv1569149611:84 , srv1598700225:84 , srv1602245175:84 , srv1652584870:84 , srv1687427363:84 , srv1723379352:84 , srv1757069108:84 , srv1810943743:84 , srv1811874963:84 , srv1813569195:84 , srv1863185247:84 , srv1865787335:84 , srv188546070:84 , srv1940581351:84 , srv1942713782:84 , srv1959350135:84 , srv1973021341:84 , srv1976887828:84 , srv2029954237:84 , srv2043332152:84 , srv2063723129:84 , srv2086871724:84 , srv220273699:84 , srv249567975:84 , srv284834918:84 , srv327112665:84 , srv373801585:84 , srv385593605:84 , srv396136976:84 , srv398246628:84 , srv414096338:84 , srv442622811:84 , srv458649722:84 , srv46189595:84 , srv465509763:84 , srv469388240:84 , srv488034609:84 , srv502907313:84 , srv503169443:84 , srv561112121:84 , srv567762681:84 , srv594434294:84 , srv629894000:84 , srv644116334:84 , srv666258590:84 , srv670475364:84 , srv726268461:84 , srv751140353:84 , srv75635336:84 , srv762320177:84 , srv772543615:84 , srv798847433:84 , srv830340198:84 , srv833277736:84 , srv834382277:84 , srv844299686:84 , srv882665726:84 , srv885219809:84 , srv924790038:84 , srv937594057:84 , srv941661453:84 , srv946956088:84 , srv1679632222:85 , srv1858093247:85 , srv1884261935:85 , srv1950284923:85 , srv2114146119:85 , srv321052950:85 , srv424624931:85 , srv993395388:85 , srv1321003366:684 }
2023-11-19 10:55:20,052 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-11-19 10:55:20,052 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv75635336=84, srv414096338=62, srv1316046333=14, srv830340198=88, srv885219809=94, srv1134372898=7, srv1940581351=41, srv503169443=73, srv220273699=52, srv1229964641=9, srv136516943=16, srv1687427363=28, srv385593605=59, srv424624931=63, srv1897693771=40, srv1959350135=44, srv941661453=97, srv249567975=53, srv1386197367=17, srv666258590=79, srv469388240=69, srv594434294=76, srv2043332152=48, srv396136976=60, srv882665726=93, srv1269759308=12, srv946956088=98, srv833277736=89, srv1081295875=3, srv567762681=75, srv751140353=83, srv1392531006=18, srv327112665=56, srv670475364=80, srv644116334=78, srv1411141110=19, srv772543615=86, srv2086871724=50, srv2114146119=51, srv1723379352=29, srv1810943743=31, srv859117130=92, srv1819519514=34, srv458649722=65, srv2063723129=49, srv1950284923=43, srv1032221491=0, srv1533666945=22, srv1863185247=36, srv1133077433=6, srv153025847=21, srv71507353=81, srv726268461=82, srv1108387825=4, srv488034609=71, srv346851963=57, srv1250801672=11, srv1118815027=5, srv1219223480=8, srv834382277=90, srv1569149611=23, srv1757069108=30, srv1942713782=42, srv442622811=64, srv924790038=95, srv284834918=54, srv398246628=61, srv1652584870=26, srv465509763=67, srv1813569195=33, srv145175811=20, srv1976887828=46, srv1321003366=15, srv373801585=58, srv1811874963=32, srv993395388=99, srv798847433=87, srv486161442=70, srv844299686=91, srv1602245175=25, srv46189595=66, srv188546070=39, srv1237418507=10, srv629894000=77, srv762320177=85, srv561112121=74, srv466539268=68, srv321052950=55, srv1865787335=37, srv1598700225=24, srv502907313=72, srv1858093247=35, srv1042639084=2, srv2029954237=47, srv1973021341=45, srv103288457=1, srv937594057=96, srv1679632222=27, srv1293191511=13, srv1884261935=38} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-11-19 10:55:20,068 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-11-19 10:55:20,068 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-11-19 10:55:20,068 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-11-19 10:55:20,068 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-11-19 10:55:20,069 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-11-19 10:55:20,069 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-11-19 10:55:20,069 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-11-19 10:55:20,069 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-11-19 10:55:20,069 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-11-19 10:55:20,069 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-11-19 10:55:20,069 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-11-19 10:55:20,069 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-11-19 10:55:20,069 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-11-19 10:55:20,069 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-11-19 10:55:20,069 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-11-19 10:55:20,069 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-11-19 10:55:20,070 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-11-19 10:55:20,070 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-11-19 10:55:20,070 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-11-19 10:55:20,070 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-11-19 10:55:20,070 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-11-19 10:55:20,070 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-11-19 10:55:20,070 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-11-19 10:55:20,070 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-11-19 10:55:20,070 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-11-19 10:55:20,070 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-11-19 10:55:20,070 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-11-19 10:55:20,070 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-11-19 10:55:20,070 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-11-19 10:55:20,071 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-11-19 10:55:20,071 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-11-19 10:55:20,071 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-11-19 10:55:20,071 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-11-19 10:55:20,071 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-11-19 10:55:20,071 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-11-19 10:55:20,071 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-11-19 10:55:20,071 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-11-19 10:55:20,071 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-11-19 10:55:20,071 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-11-19 10:55:20,071 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-11-19 10:55:20,071 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-11-19 10:55:20,071 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-11-19 10:55:20,071 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-11-19 10:55:20,071 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-11-19 10:55:20,072 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-11-19 10:55:20,072 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-11-19 10:55:20,072 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-11-19 10:55:20,072 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-11-19 10:55:20,072 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-11-19 10:55:20,072 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-11-19 10:55:20,072 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-11-19 10:55:20,072 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-11-19 10:55:20,072 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-11-19 10:55:20,072 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-11-19 10:55:20,072 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-11-19 10:55:20,072 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-11-19 10:55:20,072 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-11-19 10:55:20,072 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-11-19 10:55:20,072 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-11-19 10:55:20,072 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-11-19 10:55:20,072 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-11-19 10:55:20,072 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-11-19 10:55:20,072 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-11-19 10:55:20,072 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-11-19 10:55:20,072 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-11-19 10:55:20,072 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-11-19 10:55:20,072 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-11-19 10:55:20,072 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-11-19 10:55:20,073 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-11-19 10:55:20,073 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-11-19 10:55:20,073 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-11-19 10:55:20,073 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-11-19 10:55:20,073 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-11-19 10:55:20,073 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-11-19 10:55:20,073 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-11-19 10:55:20,073 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-11-19 10:55:20,073 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-11-19 10:55:20,073 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-11-19 10:55:20,073 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-11-19 10:55:20,073 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-11-19 10:55:20,073 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-11-19 10:55:20,073 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-11-19 10:55:20,073 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-11-19 10:55:20,073 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-11-19 10:55:20,073 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-11-19 10:55:20,073 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-11-19 10:55:20,073 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-11-19 10:55:20,073 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-11-19 10:55:20,073 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-11-19 10:55:20,074 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-11-19 10:55:20,074 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-11-19 10:55:20,074 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-11-19 10:55:20,074 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-11-19 10:55:20,074 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-11-19 10:55:20,074 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-11-19 10:55:20,074 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-11-19 10:55:20,074 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-11-19 10:55:20,074 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-11-19 10:55:20,074 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-11-19 10:55:20,074 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-11-19 10:55:20,074 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-11-19 10:55:20,179 INFO  [Time-limited test] balancer.StochasticLoadBalancer(381): Cluster wide - skipping load balancing because weighted average imbalance=6.397985672269699E-6 <= threshold(0.025). If you want more aggressive balancing, either lower hbase.master.balancer.stochastic.minCostNeedBalance from 0.025 or increase the relative multiplier(s) of the specific cost function(s). functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0014213381090374027); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-11-19 10:55:20,179 INFO  [Time-limited test] balancer.BalancerTestBase(570): Mock Final balance: { srv153025847:83 , srv1819519514:83 , srv1897693771:83 , srv346851963:83 , srv466539268:83 , srv486161442:83 , srv71507353:83 , srv859117130:83 , srv1032221491:84 , srv103288457:84 , srv1042639084:84 , srv1081295875:84 , srv1108387825:84 , srv1118815027:84 , srv1133077433:84 , srv1134372898:84 , srv1219223480:84 , srv1229964641:84 , srv1237418507:84 , srv1250801672:84 , srv1269759308:84 , srv1293191511:84 , srv1316046333:84 , srv136516943:84 , srv1386197367:84 , srv1392531006:84 , srv1411141110:84 , srv145175811:84 , srv1533666945:84 , srv1569149611:84 , srv1598700225:84 , srv1602245175:84 , srv1652584870:84 , srv1687427363:84 , srv1723379352:84 , srv1757069108:84 , srv1810943743:84 , srv1811874963:84 , srv1813569195:84 , srv1863185247:84 , srv1865787335:84 , srv188546070:84 , srv1940581351:84 , srv1942713782:84 , srv1959350135:84 , srv1973021341:84 , srv1976887828:84 , srv2029954237:84 , srv2043332152:84 , srv2063723129:84 , srv2086871724:84 , srv220273699:84 , srv249567975:84 , srv284834918:84 , srv327112665:84 , srv373801585:84 , srv385593605:84 , srv396136976:84 , srv398246628:84 , srv414096338:84 , srv442622811:84 , srv458649722:84 , srv46189595:84 , srv465509763:84 , srv469388240:84 , srv488034609:84 , srv502907313:84 , srv503169443:84 , srv561112121:84 , srv567762681:84 , srv594434294:84 , srv629894000:84 , srv644116334:84 , srv666258590:84 , srv670475364:84 , srv726268461:84 , srv751140353:84 , srv75635336:84 , srv762320177:84 , srv772543615:84 , srv798847433:84 , srv830340198:84 , srv833277736:84 , srv834382277:84 , srv844299686:84 , srv882665726:84 , srv885219809:84 , srv924790038:84 , srv937594057:84 , srv941661453:84 , srv946956088:84 , srv1679632222:85 , srv1858093247:85 , srv1884261935:85 , srv1950284923:85 , srv2114146119:85 , srv321052950:85 , srv424624931:85 , srv993395388:85 , srv1321003366:684 }
2023-11-19 10:55:20,215 INFO  [Time-limited test] hbase.ResourceChecker(175): after: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnLargeClusterWithRacks Thread=12 (was 12), OpenFileDescriptor=290 (was 290), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=179 (was 159) - SystemLoadAverage LEAK? -, ProcessCount=171 (was 171), AvailableMemoryMB=15880 (was 16385)
2023-11-19 10:55:20,224 INFO  [Time-limited test] hbase.ResourceChecker(147): before: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnMidClusterWithRacks Thread=12, OpenFileDescriptor=290, MaxFileDescriptor=60000, SystemLoadAverage=179, ProcessCount=171, AvailableMemoryMB=15879
2023-11-19 10:55:20,224 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2023-11-19 10:55:20,225 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=5000, runMaxSteps=true, stepsPerRegion=800, maxRunningTime=120000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 111077.0 etc.
2023-11-19 10:55:20,237 INFO  [Time-limited test] balancer.BalancerTestBase(547): Mock Cluster : { srv1026693460:84 , srv1302752930:84 , srv1304519560:84 , srv1430807793:84 , srv1444392236:84 , srv146575227:84 , srv1726131513:84 , srv1728224204:84 , srv1866376684:84 , srv2064713920:84 , srv2116183405:84 , srv2134803011:84 , srv248198940:84 , srv297929000:84 , srv305492168:84 , srv400660441:84 , srv420323592:84 , srv569445005:84 , srv572727893:84 , srv583894195:84 , srv604374390:84 , srv651594463:84 , srv67873926:84 , srv749736528:84 , srv786975880:84 , srv789889755:84 , srv838029081:84 , srv925184836:84 , srv996609321:84 , srv43109112:264 } [srvr=30 rgns=2700 avg=90.0 max=90 min=90]
2023-11-19 10:55:20,239 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-11-19 10:55:20,240 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv67873926=23, srv1302752930=1, srv1304519560=2, srv1430807793=3, srv1728224204=7, srv2064713920=9, srv996609321=29, srv1026693460=0, srv604374390=21, srv248198940=12, srv146575227=5, srv651594463=22, srv925184836=28, srv305492168=14, srv1866376684=8, srv420323592=16, srv569445005=18, srv400660441=15, srv583894195=20, srv789889755=26, srv838029081=27, srv2116183405=10, srv2134803011=11, srv749736528=24, srv572727893=19, srv1444392236=4, srv1726131513=6, srv297929000=13, srv43109112=17, srv786975880=25} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-11-19 10:55:20,253 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-11-19 10:55:20,253 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-11-19 10:55:20,254 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-11-19 10:55:20,254 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-11-19 10:55:20,254 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-11-19 10:55:20,254 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-11-19 10:55:20,254 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-11-19 10:55:20,254 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-11-19 10:55:20,254 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-11-19 10:55:20,254 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-11-19 10:55:20,254 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-11-19 10:55:20,255 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-11-19 10:55:20,255 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-11-19 10:55:20,255 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-11-19 10:55:20,255 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-11-19 10:55:20,255 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-11-19 10:55:20,255 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-11-19 10:55:20,255 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-11-19 10:55:20,255 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-11-19 10:55:20,255 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-11-19 10:55:20,255 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-11-19 10:55:20,255 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-11-19 10:55:20,255 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-11-19 10:55:20,255 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-11-19 10:55:20,256 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-11-19 10:55:20,256 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-11-19 10:55:20,256 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-11-19 10:55:20,256 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-11-19 10:55:20,256 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-11-19 10:55:20,256 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-11-19 10:55:20,256 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=10, number of hosts=30, number of racks=4
2023-11-19 10:55:20,272 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=1.1058847550436244, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-11-19 10:55:20,272 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.9912526682669968, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=1.1058847550436244, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=64800000
2023-11-19 10:57:20,260 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 120001 ms to try 6415925 different iterations.  Found a solution that moves 1855 regions; Going from a computed imbalance of 0.9912526682669968 to a new imbalance of 4.329662539733032E-5. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); MoveCostFunction : (multiplier=7.0, imbalance=0.687037037037037, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-11-19 10:57:20,268 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1026693460:90 , srv1302752930:90 , srv1304519560:90 , srv1430807793:90 , srv1444392236:90 , srv146575227:90 , srv1726131513:90 , srv1728224204:90 , srv1866376684:90 , srv2064713920:90 , srv2116183405:90 , srv2134803011:90 , srv248198940:90 , srv297929000:90 , srv305492168:90 , srv400660441:90 , srv420323592:90 , srv43109112:90 , srv569445005:90 , srv572727893:90 , srv583894195:90 , srv604374390:90 , srv651594463:90 , srv67873926:90 , srv749736528:90 , srv786975880:90 , srv789889755:90 , srv838029081:90 , srv925184836:90 , srv996609321:90 }
2023-11-19 10:57:20,270 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-11-19 10:57:20,270 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv67873926=23, srv1302752930=1, srv1304519560=2, srv1430807793=3, srv1728224204=7, srv2064713920=9, srv996609321=29, srv1026693460=0, srv604374390=21, srv248198940=12, srv146575227=5, srv651594463=22, srv925184836=28, srv305492168=14, srv1866376684=8, srv420323592=16, srv569445005=18, srv400660441=15, srv583894195=20, srv789889755=26, srv838029081=27, srv2116183405=10, srv2134803011=11, srv749736528=24, srv572727893=19, srv1444392236=4, srv1726131513=6, srv297929000=13, srv43109112=17, srv786975880=25} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-11-19 10:57:20,274 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-11-19 10:57:20,274 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-11-19 10:57:20,274 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-11-19 10:57:20,274 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-11-19 10:57:20,274 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-11-19 10:57:20,274 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-11-19 10:57:20,274 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-11-19 10:57:20,274 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-11-19 10:57:20,274 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-11-19 10:57:20,274 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-11-19 10:57:20,274 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-11-19 10:57:20,274 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-11-19 10:57:20,274 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-11-19 10:57:20,274 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-11-19 10:57:20,274 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-11-19 10:57:20,274 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-11-19 10:57:20,274 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-11-19 10:57:20,274 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-11-19 10:57:20,275 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-11-19 10:57:20,275 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-11-19 10:57:20,275 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-11-19 10:57:20,275 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-11-19 10:57:20,275 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-11-19 10:57:20,275 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-11-19 10:57:20,275 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-11-19 10:57:20,275 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-11-19 10:57:20,275 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-11-19 10:57:20,275 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-11-19 10:57:20,275 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-11-19 10:57:20,275 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-11-19 10:57:20,275 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=10, number of hosts=30, number of racks=4
2023-11-19 10:57:20,287 INFO  [Time-limited test] balancer.StochasticLoadBalancer(381): Cluster wide - skipping load balancing because weighted average imbalance=0.0 <= threshold(0.025). If you want more aggressive balancing, either lower hbase.master.balancer.stochastic.minCostNeedBalance from 0.025 or increase the relative multiplier(s) of the specific cost function(s). functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-11-19 10:57:20,288 INFO  [Time-limited test] balancer.BalancerTestBase(570): Mock Final balance: { srv1026693460:90 , srv1302752930:90 , srv1304519560:90 , srv1430807793:90 , srv1444392236:90 , srv146575227:90 , srv1726131513:90 , srv1728224204:90 , srv1866376684:90 , srv2064713920:90 , srv2116183405:90 , srv2134803011:90 , srv248198940:90 , srv297929000:90 , srv305492168:90 , srv400660441:90 , srv420323592:90 , srv43109112:90 , srv569445005:90 , srv572727893:90 , srv583894195:90 , srv604374390:90 , srv651594463:90 , srv67873926:90 , srv749736528:90 , srv786975880:90 , srv789889755:90 , srv838029081:90 , srv925184836:90 , srv996609321:90 }
2023-11-19 10:57:20,299 INFO  [Time-limited test] hbase.ResourceChecker(175): after: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnMidClusterWithRacks Thread=11 (was 12), OpenFileDescriptor=290 (was 290), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=227 (was 179) - SystemLoadAverage LEAK? -, ProcessCount=170 (was 171), AvailableMemoryMB=15981 (was 15879) - AvailableMemoryMB LEAK? -