2023-07-29 13:53:11,598 INFO  [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks timeout: 13 mins
2023-07-29 13:53:11,913 WARN  [Time-limited test] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties
2023-07-29 13:53:12,040 INFO  [Time-limited test] metrics.MetricRegistriesLoader(60): Loaded MetricRegistries class org.apache.hadoop.hbase.metrics.impl.MetricRegistriesImpl
2023-07-29 13:53:12,112 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2023-07-29 13:53:12,123 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc.
2023-07-29 13:53:12,138 INFO  [Time-limited test] hbase.ResourceChecker(147): before: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnLargeClusterWithRacks Thread=12, OpenFileDescriptor=263, MaxFileDescriptor=60000, SystemLoadAverage=283, ProcessCount=174, AvailableMemoryMB=2548
2023-07-29 13:53:12,140 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2023-07-29 13:53:12,140 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=5000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=10000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc.
2023-07-29 13:53:12,293 INFO  [Time-limited test] balancer.BalancerTestBase(547): Mock Cluster : { srv1001411492:84 , srv1021452976:84 , srv1058387076:84 , srv1066800959:84 , srv1069454615:84 , srv1075436015:84 , srv1107444931:84 , srv1115361186:84 , srv1144062073:84 , srv1154550365:84 , srv1155804297:84 , srv1162118463:84 , srv1163427723:84 , srv1181635048:84 , srv1196504604:84 , srv1197819044:84 , srv1216314771:84 , srv124644847:84 , srv1277556051:84 , srv1287142555:84 , srv1288384780:84 , srv1321184983:84 , srv1340811143:84 , srv1348497205:84 , srv1366823677:84 , srv1380713806:84 , srv1401091266:84 , srv1403666432:84 , srv1432840649:84 , srv1453797058:84 , srv1457995437:84 , srv1467376916:84 , srv148538457:84 , srv1490099306:84 , srv1490706217:84 , srv1538075708:84 , srv1568311623:84 , srv1595117031:84 , srv1615637441:84 , srv1630653720:84 , srv1647369129:84 , srv1680015206:84 , srv1694140492:84 , srv171998404:84 , srv1723320022:84 , srv1731481614:84 , srv1743269117:84 , srv1761443416:84 , srv181855693:84 , srv1826796451:84 , srv1877150020:84 , srv1910991847:84 , srv1944449256:84 , srv1966288623:84 , srv1976062490:84 , srv1998661512:84 , srv2007656436:84 , srv2010034297:84 , srv203197176:84 , srv2066570013:84 , srv2072299495:84 , srv2125246283:84 , srv221404404:84 , srv236731625:84 , srv276919931:84 , srv300703940:84 , srv338854637:84 , srv341370000:84 , srv368714698:84 , srv403969178:84 , srv445936766:84 , srv455517820:84 , srv467891810:84 , srv493635161:84 , srv508900542:84 , srv51714353:84 , srv536425414:84 , srv548603845:84 , srv629490421:84 , srv646998005:84 , srv659078629:84 , srv68829343:84 , srv693481840:84 , srv70678401:84 , srv708407872:84 , srv716606312:84 , srv745394155:84 , srv765150496:84 , srv798358691:84 , srv803965204:84 , srv813693834:84 , srv834863110:84 , srv844887058:84 , srv865966778:84 , srv866676369:84 , srv895968219:84 , srv900585448:84 , srv935427324:84 , srv943635438:84 , srv110447746:684 } [srvr=100 rgns=9000 avg=90.0 max=90 min=90]
2023-07-29 13:53:12,306 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-07-29 13:53:12,314 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv467891810=73, srv803965204=90, srv1001411492=0, srv1154550365=10, srv1401091266=27, srv834863110=92, srv68829343=82, srv1155804297=11, srv900585448=97, srv1115361186=8, srv1966288623=54, srv1366823677=25, srv716606312=86, srv171998404=44, srv765150496=88, srv1998661512=56, srv1723320022=45, srv1348497205=24, srv341370000=68, srv1432840649=29, srv1457995437=31, srv181855693=49, srv1680015206=42, srv1910991847=52, srv1944449256=53, srv493635161=74, srv2072299495=61, srv1743269117=47, srv1731481614=46, srv508900542=75, srv813693834=91, srv338854637=67, srv798358691=89, srv1976062490=55, srv236731625=64, srv629490421=79, srv2010034297=58, srv1490706217=35, srv110447746=6, srv1826796451=50, srv1288384780=21, srv1595117031=38, srv1058387076=2, srv708407872=85, srv1615637441=39, srv865966778=94, srv1568311623=37, srv536425414=77, srv844887058=93, srv1538075708=36, srv1380713806=26, srv1144062073=9, srv935427324=98, srv2007656436=57, srv221404404=63, srv1453797058=30, srv1877150020=51, srv70678401=84, srv943635438=99, srv646998005=80, srv1162118463=12, srv1163427723=13, srv276919931=65, srv1490099306=34, srv1467376916=32, srv51714353=76, srv1694140492=43, srv548603845=78, srv403969178=70, srv1107444931=7, srv866676369=95, srv2125246283=62, srv1021452976=1, srv1277556051=19, srv1196504604=15, srv1340811143=23, srv445936766=71, srv1197819044=16, srv1287142555=20, srv1181635048=14, srv1069454615=4, srv300703940=66, srv1647369129=41, srv124644847=18, srv455517820=72, srv2066570013=60, srv1630653720=40, srv1321184983=22, srv148538457=33, srv659078629=81, srv1403666432=28, srv1066800959=3, srv1075436015=5, srv895968219=96, srv1216314771=17, srv203197176=59, srv693481840=83, srv1761443416=48, srv745394155=87, srv368714698=69} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-07-29 13:53:12,402 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-07-29 13:53:12,402 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-07-29 13:53:12,402 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-07-29 13:53:12,402 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-07-29 13:53:12,403 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-07-29 13:53:12,403 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-07-29 13:53:12,403 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-07-29 13:53:12,403 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-07-29 13:53:12,403 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-07-29 13:53:12,403 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-07-29 13:53:12,404 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-07-29 13:53:12,404 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-07-29 13:53:12,404 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-07-29 13:53:12,404 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-07-29 13:53:12,404 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-07-29 13:53:12,404 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-07-29 13:53:12,404 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-07-29 13:53:12,405 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-07-29 13:53:12,405 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-07-29 13:53:12,405 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-07-29 13:53:12,405 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-07-29 13:53:12,405 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-07-29 13:53:12,405 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-07-29 13:53:12,406 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-07-29 13:53:12,406 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-07-29 13:53:12,406 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-07-29 13:53:12,406 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-07-29 13:53:12,406 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-07-29 13:53:12,406 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-07-29 13:53:12,407 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-07-29 13:53:12,407 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-07-29 13:53:12,407 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-07-29 13:53:12,407 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-07-29 13:53:12,407 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-07-29 13:53:12,407 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-07-29 13:53:12,407 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-07-29 13:53:12,408 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-07-29 13:53:12,408 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-07-29 13:53:12,408 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-07-29 13:53:12,408 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-07-29 13:53:12,408 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-07-29 13:53:12,408 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-07-29 13:53:12,409 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-07-29 13:53:12,409 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-07-29 13:53:12,409 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-07-29 13:53:12,409 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-07-29 13:53:12,409 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-07-29 13:53:12,409 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-07-29 13:53:12,409 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-07-29 13:53:12,410 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-07-29 13:53:12,410 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-07-29 13:53:12,410 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-07-29 13:53:12,410 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-07-29 13:53:12,410 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-07-29 13:53:12,410 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-07-29 13:53:12,411 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-07-29 13:53:12,411 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-07-29 13:53:12,411 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-07-29 13:53:12,411 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-07-29 13:53:12,411 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-07-29 13:53:12,411 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-07-29 13:53:12,411 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-07-29 13:53:12,412 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-07-29 13:53:12,412 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-07-29 13:53:12,412 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-07-29 13:53:12,412 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-07-29 13:53:12,412 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-07-29 13:53:12,412 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-07-29 13:53:12,412 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-07-29 13:53:12,413 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-07-29 13:53:12,413 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-07-29 13:53:12,413 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-07-29 13:53:12,413 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-07-29 13:53:12,413 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-07-29 13:53:12,413 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-07-29 13:53:12,413 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-07-29 13:53:12,414 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-07-29 13:53:12,414 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-07-29 13:53:12,414 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-07-29 13:53:12,414 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-07-29 13:53:12,414 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-07-29 13:53:12,414 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-07-29 13:53:12,414 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-07-29 13:53:12,415 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-07-29 13:53:12,415 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-07-29 13:53:12,415 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-07-29 13:53:12,415 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-07-29 13:53:12,415 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-07-29 13:53:12,415 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-07-29 13:53:12,415 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-07-29 13:53:12,416 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-07-29 13:53:12,416 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-07-29 13:53:12,416 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-07-29 13:53:12,416 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-07-29 13:53:12,416 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-07-29 13:53:12,417 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-07-29 13:53:12,417 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-07-29 13:53:12,417 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-07-29 13:53:12,417 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-07-29 13:53:12,417 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-07-29 13:53:12,417 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-07-29 13:53:12,697 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.06666666666666667, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-07-29 13:53:12,698 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-07-29 13:53:12,698 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.9909252140407105, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.06666666666666667, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-07-29 13:53:13,170 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 725 ms to try 5000 different iterations.  Found a solution that moves 4663 regions; Going from a computed imbalance of 0.9909252140407105 to a new imbalance of 0.18543946163963423. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.03869230415467789, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06079717342357534, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.5181111111111111, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.03869230415467789, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.18058333333333335, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.2485, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-07-29 13:53:13,192 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv2072299495:82 , srv1001411492:83 , srv1287142555:83 , srv1432840649:83 , srv181855693:83 , srv236731625:83 , srv338854637:83 , srv844887058:83 , srv1058387076:84 , srv1066800959:84 , srv1288384780:84 , srv1340811143:84 , srv1401091266:84 , srv1743269117:84 , srv2007656436:84 , srv493635161:84 , srv798358691:84 , srv895968219:84 , srv900585448:84 , srv1069454615:85 , srv1107444931:85 , srv1144062073:85 , srv1321184983:85 , srv1366823677:85 , srv1490099306:85 , srv1595117031:85 , srv1976062490:85 , srv2066570013:85 , srv445936766:85 , srv455517820:85 , srv548603845:85 , srv629490421:85 , srv693481840:85 , srv765150496:85 , srv866676369:85 , srv1162118463:86 , srv1163427723:86 , srv1181635048:86 , srv1196504604:86 , srv1490706217:86 , srv1615637441:86 , srv1630653720:86 , srv1647369129:86 , srv1694140492:86 , srv1723320022:86 , srv1761443416:86 , srv1826796451:86 , srv1944449256:86 , srv2125246283:86 , srv276919931:86 , srv467891810:86 , srv51714353:86 , srv865966778:86 , srv1115361186:87 , srv1155804297:87 , srv1197819044:87 , srv1568311623:87 , srv1877150020:87 , srv1910991847:87 , srv1966288623:87 , srv341370000:87 , srv508900542:87 , srv536425414:87 , srv646998005:87 , srv659078629:87 , srv745394155:87 , srv124644847:88 , srv1277556051:88 , srv1403666432:88 , srv1457995437:88 , srv148538457:88 , srv1680015206:88 , srv171998404:88 , srv1731481614:88 , srv1998661512:88 , srv2010034297:88 , srv221404404:88 , srv300703940:88 , srv813693834:88 , srv943635438:88 , srv1021452976:89 , srv1075436015:89 , srv1154550365:89 , srv1216314771:89 , srv1453797058:89 , srv1538075708:89 , srv203197176:89 , srv368714698:89 , srv708407872:89 , srv716606312:89 , srv803965204:89 , srv935427324:89 , srv68829343:90 , srv70678401:90 , srv1348497205:91 , srv1467376916:91 , srv403969178:91 , srv834863110:91 , srv1380713806:96 , srv110447746:434 }
2023-07-29 13:53:13,199 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-07-29 13:53:13,200 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv467891810=73, srv803965204=90, srv1001411492=0, srv1154550365=10, srv1401091266=27, srv834863110=92, srv68829343=82, srv1155804297=11, srv900585448=97, srv1115361186=8, srv1966288623=54, srv1366823677=25, srv716606312=86, srv171998404=44, srv765150496=88, srv1998661512=56, srv1723320022=45, srv1348497205=24, srv341370000=68, srv1432840649=29, srv1457995437=31, srv181855693=49, srv1680015206=42, srv1910991847=52, srv1944449256=53, srv493635161=74, srv2072299495=61, srv1743269117=47, srv1731481614=46, srv508900542=75, srv813693834=91, srv338854637=67, srv798358691=89, srv1976062490=55, srv236731625=64, srv629490421=79, srv2010034297=58, srv1490706217=35, srv110447746=6, srv1826796451=50, srv1288384780=21, srv1595117031=38, srv1058387076=2, srv708407872=85, srv1615637441=39, srv865966778=94, srv1568311623=37, srv536425414=77, srv844887058=93, srv1538075708=36, srv1380713806=26, srv1144062073=9, srv935427324=98, srv2007656436=57, srv221404404=63, srv1453797058=30, srv1877150020=51, srv70678401=84, srv943635438=99, srv646998005=80, srv1162118463=12, srv1163427723=13, srv276919931=65, srv1490099306=34, srv1467376916=32, srv51714353=76, srv1694140492=43, srv548603845=78, srv403969178=70, srv1107444931=7, srv866676369=95, srv2125246283=62, srv1021452976=1, srv1277556051=19, srv1196504604=15, srv1340811143=23, srv445936766=71, srv1197819044=16, srv1287142555=20, srv1181635048=14, srv1069454615=4, srv300703940=66, srv1647369129=41, srv124644847=18, srv455517820=72, srv2066570013=60, srv1630653720=40, srv1321184983=22, srv148538457=33, srv659078629=81, srv1403666432=28, srv1066800959=3, srv1075436015=5, srv895968219=96, srv1216314771=17, srv203197176=59, srv693481840=83, srv1761443416=48, srv745394155=87, srv368714698=69} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-07-29 13:53:13,226 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-07-29 13:53:13,226 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-07-29 13:53:13,227 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-07-29 13:53:13,227 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-07-29 13:53:13,227 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-07-29 13:53:13,227 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-07-29 13:53:13,227 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-07-29 13:53:13,227 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-07-29 13:53:13,227 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-07-29 13:53:13,228 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-07-29 13:53:13,228 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-07-29 13:53:13,228 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-07-29 13:53:13,228 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-07-29 13:53:13,228 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-07-29 13:53:13,228 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-07-29 13:53:13,228 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-07-29 13:53:13,228 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-07-29 13:53:13,229 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-07-29 13:53:13,229 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-07-29 13:53:13,229 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-07-29 13:53:13,229 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-07-29 13:53:13,229 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-07-29 13:53:13,229 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-07-29 13:53:13,229 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-07-29 13:53:13,229 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-07-29 13:53:13,230 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-07-29 13:53:13,230 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-07-29 13:53:13,230 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-07-29 13:53:13,230 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-07-29 13:53:13,230 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-07-29 13:53:13,230 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-07-29 13:53:13,230 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-07-29 13:53:13,230 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-07-29 13:53:13,230 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-07-29 13:53:13,231 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-07-29 13:53:13,231 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-07-29 13:53:13,231 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-07-29 13:53:13,231 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-07-29 13:53:13,231 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-07-29 13:53:13,231 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-07-29 13:53:13,231 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-07-29 13:53:13,231 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-07-29 13:53:13,231 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-07-29 13:53:13,232 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-07-29 13:53:13,232 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-07-29 13:53:13,232 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-07-29 13:53:13,232 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-07-29 13:53:13,232 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-07-29 13:53:13,232 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-07-29 13:53:13,232 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-07-29 13:53:13,232 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-07-29 13:53:13,233 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-07-29 13:53:13,233 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-07-29 13:53:13,233 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-07-29 13:53:13,233 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-07-29 13:53:13,233 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-07-29 13:53:13,233 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-07-29 13:53:13,233 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-07-29 13:53:13,233 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-07-29 13:53:13,233 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-07-29 13:53:13,234 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-07-29 13:53:13,234 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-07-29 13:53:13,234 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-07-29 13:53:13,234 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-07-29 13:53:13,234 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-07-29 13:53:13,234 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-07-29 13:53:13,234 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-07-29 13:53:13,234 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-07-29 13:53:13,235 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-07-29 13:53:13,235 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-07-29 13:53:13,235 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-07-29 13:53:13,235 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-07-29 13:53:13,235 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-07-29 13:53:13,235 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-07-29 13:53:13,235 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-07-29 13:53:13,235 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-07-29 13:53:13,235 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-07-29 13:53:13,236 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-07-29 13:53:13,236 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-07-29 13:53:13,236 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-07-29 13:53:13,236 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-07-29 13:53:13,236 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-07-29 13:53:13,236 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-07-29 13:53:13,236 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-07-29 13:53:13,236 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-07-29 13:53:13,236 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-07-29 13:53:13,237 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-07-29 13:53:13,237 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-07-29 13:53:13,237 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-07-29 13:53:13,237 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-07-29 13:53:13,237 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-07-29 13:53:13,237 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-07-29 13:53:13,237 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-07-29 13:53:13,237 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-07-29 13:53:13,237 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-07-29 13:53:13,238 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-07-29 13:53:13,238 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-07-29 13:53:13,238 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-07-29 13:53:13,238 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-07-29 13:53:13,238 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-07-29 13:53:13,238 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-07-29 13:53:13,428 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.03869230415467789, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06079717342357534, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.03869230415467789, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.18058333333333335, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.2485, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-07-29 13:53:13,428 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-07-29 13:53:13,428 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.18540681061576994, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.03869230415467789, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06079717342357534, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.03869230415467789, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.18058333333333335, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.2485, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-07-29 13:53:13,763 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 493 ms to try 5000 different iterations.  Found a solution that moves 2707 regions; Going from a computed imbalance of 0.18540681061576994 to a new imbalance of 0.015038356557354932. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.020594724110307914); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.03791715228904246, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.30077777777777776, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.020594724110307914); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.011916666666666667); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.04466666666666667, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-07-29 13:53:13,774 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1380713806:74 , srv68829343:79 , srv1348497205:81 , srv403969178:81 , srv935427324:81 , srv1216314771:82 , srv124644847:82 , srv1731481614:82 , srv708407872:82 , srv1021452976:83 , srv1115361186:83 , srv1154550365:83 , srv1277556051:83 , srv1403666432:83 , srv1467376916:83 , srv1538075708:83 , srv171998404:83 , srv1966288623:83 , srv203197176:83 , srv300703940:83 , srv368714698:83 , srv803965204:83 , srv813693834:83 , srv1075436015:84 , srv1453797058:84 , srv1568311623:84 , srv1680015206:84 , srv2010034297:84 , srv341370000:84 , srv70678401:84 , srv716606312:84 , srv765150496:84 , srv834863110:84 , srv1181635048:85 , srv1197819044:85 , srv1457995437:85 , srv1630653720:85 , srv1761443416:85 , srv1877150020:85 , srv445936766:85 , srv467891810:85 , srv536425414:85 , srv659078629:85 , srv895968219:85 , srv1155804297:86 , srv1162118463:86 , srv1163427723:86 , srv1196504604:86 , srv1366823677:86 , srv148538457:86 , srv1615637441:86 , srv1694140492:86 , srv1723320022:86 , srv1826796451:86 , srv1910991847:86 , srv1998661512:86 , srv2007656436:86 , srv508900542:86 , srv548603845:86 , srv629490421:86 , srv646998005:86 , srv943635438:86 , srv1069454615:87 , srv1340811143:87 , srv1490099306:87 , srv1595117031:87 , srv1647369129:87 , srv1944449256:87 , srv2066570013:87 , srv221404404:87 , srv276919931:87 , srv455517820:87 , srv745394155:87 , srv900585448:87 , srv1066800959:88 , srv1107444931:88 , srv1144062073:88 , srv1321184983:88 , srv1432840649:88 , srv1490706217:88 , srv1743269117:88 , srv1976062490:88 , srv2125246283:88 , srv865966778:88 , srv866676369:88 , srv1058387076:89 , srv1401091266:89 , srv236731625:89 , srv338854637:89 , srv693481840:89 , srv798358691:89 , srv1287142555:90 , srv1288384780:90 , srv181855693:90 , srv493635161:90 , srv51714353:90 , srv844887058:90 , srv1001411492:91 , srv2072299495:91 , srv110447746:523 }
2023-07-29 13:53:13,778 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-07-29 13:53:13,779 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv467891810=73, srv803965204=90, srv1001411492=0, srv1154550365=10, srv1401091266=27, srv834863110=92, srv68829343=82, srv1155804297=11, srv900585448=97, srv1115361186=8, srv1966288623=54, srv1366823677=25, srv716606312=86, srv171998404=44, srv765150496=88, srv1998661512=56, srv1723320022=45, srv1348497205=24, srv341370000=68, srv1432840649=29, srv1457995437=31, srv181855693=49, srv1680015206=42, srv1910991847=52, srv1944449256=53, srv493635161=74, srv2072299495=61, srv1743269117=47, srv1731481614=46, srv508900542=75, srv813693834=91, srv338854637=67, srv798358691=89, srv1976062490=55, srv236731625=64, srv629490421=79, srv2010034297=58, srv1490706217=35, srv110447746=6, srv1826796451=50, srv1288384780=21, srv1595117031=38, srv1058387076=2, srv708407872=85, srv1615637441=39, srv865966778=94, srv1568311623=37, srv536425414=77, srv844887058=93, srv1538075708=36, srv1380713806=26, srv1144062073=9, srv935427324=98, srv2007656436=57, srv221404404=63, srv1453797058=30, srv1877150020=51, srv70678401=84, srv943635438=99, srv646998005=80, srv1162118463=12, srv1163427723=13, srv276919931=65, srv1490099306=34, srv1467376916=32, srv51714353=76, srv1694140492=43, srv548603845=78, srv403969178=70, srv1107444931=7, srv866676369=95, srv2125246283=62, srv1021452976=1, srv1277556051=19, srv1196504604=15, srv1340811143=23, srv445936766=71, srv1197819044=16, srv1287142555=20, srv1181635048=14, srv1069454615=4, srv300703940=66, srv1647369129=41, srv124644847=18, srv455517820=72, srv2066570013=60, srv1630653720=40, srv1321184983=22, srv148538457=33, srv659078629=81, srv1403666432=28, srv1066800959=3, srv1075436015=5, srv895968219=96, srv1216314771=17, srv203197176=59, srv693481840=83, srv1761443416=48, srv745394155=87, srv368714698=69} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-07-29 13:53:13,808 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-07-29 13:53:13,808 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-07-29 13:53:13,808 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-07-29 13:53:13,808 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-07-29 13:53:13,808 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-07-29 13:53:13,808 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-07-29 13:53:13,808 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-07-29 13:53:13,809 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-07-29 13:53:13,809 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-07-29 13:53:13,809 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-07-29 13:53:13,809 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-07-29 13:53:13,809 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-07-29 13:53:13,809 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-07-29 13:53:13,809 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-07-29 13:53:13,809 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-07-29 13:53:13,810 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-07-29 13:53:13,810 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-07-29 13:53:13,810 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-07-29 13:53:13,810 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-07-29 13:53:13,810 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-07-29 13:53:13,810 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-07-29 13:53:13,810 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-07-29 13:53:13,810 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-07-29 13:53:13,811 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-07-29 13:53:13,811 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-07-29 13:53:13,811 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-07-29 13:53:13,811 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-07-29 13:53:13,811 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-07-29 13:53:13,811 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-07-29 13:53:13,811 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-07-29 13:53:13,811 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-07-29 13:53:13,811 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-07-29 13:53:13,812 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-07-29 13:53:13,812 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-07-29 13:53:13,812 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-07-29 13:53:13,812 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-07-29 13:53:13,812 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-07-29 13:53:13,812 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-07-29 13:53:13,812 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-07-29 13:53:13,813 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-07-29 13:53:13,813 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-07-29 13:53:13,813 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-07-29 13:53:13,813 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-07-29 13:53:13,813 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-07-29 13:53:13,813 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-07-29 13:53:13,813 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-07-29 13:53:13,813 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-07-29 13:53:13,814 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-07-29 13:53:13,814 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-07-29 13:53:13,814 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-07-29 13:53:13,814 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-07-29 13:53:13,814 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-07-29 13:53:13,814 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-07-29 13:53:13,814 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-07-29 13:53:13,814 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-07-29 13:53:13,815 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-07-29 13:53:13,815 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-07-29 13:53:13,815 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-07-29 13:53:13,815 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-07-29 13:53:13,815 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-07-29 13:53:13,815 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-07-29 13:53:13,815 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-07-29 13:53:13,815 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-07-29 13:53:13,815 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-07-29 13:53:13,816 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-07-29 13:53:13,816 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-07-29 13:53:13,816 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-07-29 13:53:13,816 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-07-29 13:53:13,816 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-07-29 13:53:13,816 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-07-29 13:53:13,816 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-07-29 13:53:13,816 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-07-29 13:53:13,816 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-07-29 13:53:13,817 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-07-29 13:53:13,817 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-07-29 13:53:13,817 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-07-29 13:53:13,817 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-07-29 13:53:13,817 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-07-29 13:53:13,817 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-07-29 13:53:13,817 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-07-29 13:53:13,817 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-07-29 13:53:13,817 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-07-29 13:53:13,818 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-07-29 13:53:13,818 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-07-29 13:53:13,818 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-07-29 13:53:13,818 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-07-29 13:53:13,818 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-07-29 13:53:13,818 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-07-29 13:53:13,818 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-07-29 13:53:13,818 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-07-29 13:53:13,818 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-07-29 13:53:13,819 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-07-29 13:53:13,819 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-07-29 13:53:13,819 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-07-29 13:53:13,819 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-07-29 13:53:13,819 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-07-29 13:53:13,819 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-07-29 13:53:13,819 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-07-29 13:53:13,819 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-07-29 13:53:13,819 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-07-29 13:53:13,820 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-07-29 13:53:13,960 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.020594724110307914); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.03791715228904246, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.020594724110307914); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.011916666666666667); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.04466666666666667, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-07-29 13:53:13,960 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-07-29 13:53:13,961 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.01501940173822546, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.020594724110307914); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.03791715228904246, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.020594724110307914); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.011916666666666667); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.04466666666666667, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-07-29 13:53:14,238 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 387 ms to try 5000 different iterations.  Found a solution that moves 1031 regions; Going from a computed imbalance of 0.01501940173822546 to a new imbalance of 6.765747405110889E-4. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.005211573066470477); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.008123623944599232); MoveCostFunction : (multiplier=7.0, imbalance=0.11455555555555555, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.005211573066470477); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=3.333333333333333E-4); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.003416666666666667); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-07-29 13:53:14,240 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv51714353:82 , srv1467376916:83 , srv1490706217:83 , srv221404404:83 , srv493635161:83 , srv693481840:83 , srv834863110:83 , srv865966778:83 , srv943635438:83 , srv1001411492:84 , srv1075436015:84 , srv1107444931:84 , srv1287142555:84 , srv1401091266:84 , srv1453797058:84 , srv148538457:84 , srv1910991847:84 , srv1976062490:84 , srv1998661512:84 , srv2125246283:84 , srv508900542:84 , srv646998005:84 , srv70678401:84 , srv716606312:84 , srv844887058:84 , srv866676369:84 , srv1021452976:85 , srv1058387076:85 , srv1066800959:85 , srv1144062073:85 , srv1154550365:85 , srv1155804297:85 , srv1163427723:85 , srv1196504604:85 , srv1197819044:85 , srv1288384780:85 , srv1321184983:85 , srv1348497205:85 , srv1457995437:85 , srv1595117031:85 , srv1647369129:85 , srv1743269117:85 , srv181855693:85 , srv1944449256:85 , srv2010034297:85 , srv2072299495:85 , srv236731625:85 , srv276919931:85 , srv300703940:85 , srv403969178:85 , srv455517820:85 , srv629490421:85 , srv659078629:85 , srv745394155:85 , srv798358691:85 , srv803965204:85 , srv1069454615:86 , srv1162118463:86 , srv1216314771:86 , srv1277556051:86 , srv1366823677:86 , srv1380713806:86 , srv1490099306:86 , srv1538075708:86 , srv1568311623:86 , srv1615637441:86 , srv1680015206:86 , srv1694140492:86 , srv1826796451:86 , srv1877150020:86 , srv203197176:86 , srv2066570013:86 , srv338854637:86 , srv341370000:86 , srv368714698:86 , srv536425414:86 , srv1115361186:87 , srv124644847:87 , srv1340811143:87 , srv1403666432:87 , srv1432840649:87 , srv1630653720:87 , srv171998404:87 , srv1723320022:87 , srv1731481614:87 , srv1761443416:87 , srv1966288623:87 , srv445936766:87 , srv548603845:87 , srv708407872:87 , srv813693834:87 , srv900585448:87 , srv935427324:87 , srv1181635048:88 , srv2007656436:88 , srv467891810:88 , srv68829343:88 , srv765150496:89 , srv895968219:89 , srv110447746:547 }
2023-07-29 13:53:14,244 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-07-29 13:53:14,244 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv467891810=73, srv803965204=90, srv1001411492=0, srv1154550365=10, srv1401091266=27, srv834863110=92, srv68829343=82, srv1155804297=11, srv900585448=97, srv1115361186=8, srv1966288623=54, srv1366823677=25, srv716606312=86, srv171998404=44, srv765150496=88, srv1998661512=56, srv1723320022=45, srv1348497205=24, srv341370000=68, srv1432840649=29, srv1457995437=31, srv181855693=49, srv1680015206=42, srv1910991847=52, srv1944449256=53, srv493635161=74, srv2072299495=61, srv1743269117=47, srv1731481614=46, srv508900542=75, srv813693834=91, srv338854637=67, srv798358691=89, srv1976062490=55, srv236731625=64, srv629490421=79, srv2010034297=58, srv1490706217=35, srv110447746=6, srv1826796451=50, srv1288384780=21, srv1595117031=38, srv1058387076=2, srv708407872=85, srv1615637441=39, srv865966778=94, srv1568311623=37, srv536425414=77, srv844887058=93, srv1538075708=36, srv1380713806=26, srv1144062073=9, srv935427324=98, srv2007656436=57, srv221404404=63, srv1453797058=30, srv1877150020=51, srv70678401=84, srv943635438=99, srv646998005=80, srv1162118463=12, srv1163427723=13, srv276919931=65, srv1490099306=34, srv1467376916=32, srv51714353=76, srv1694140492=43, srv548603845=78, srv403969178=70, srv1107444931=7, srv866676369=95, srv2125246283=62, srv1021452976=1, srv1277556051=19, srv1196504604=15, srv1340811143=23, srv445936766=71, srv1197819044=16, srv1287142555=20, srv1181635048=14, srv1069454615=4, srv300703940=66, srv1647369129=41, srv124644847=18, srv455517820=72, srv2066570013=60, srv1630653720=40, srv1321184983=22, srv148538457=33, srv659078629=81, srv1403666432=28, srv1066800959=3, srv1075436015=5, srv895968219=96, srv1216314771=17, srv203197176=59, srv693481840=83, srv1761443416=48, srv745394155=87, srv368714698=69} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-07-29 13:53:14,257 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-07-29 13:53:14,257 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-07-29 13:53:14,257 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-07-29 13:53:14,257 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-07-29 13:53:14,257 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-07-29 13:53:14,257 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-07-29 13:53:14,257 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-07-29 13:53:14,257 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-07-29 13:53:14,257 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-07-29 13:53:14,257 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-07-29 13:53:14,257 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-07-29 13:53:14,257 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-07-29 13:53:14,257 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-07-29 13:53:14,257 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-07-29 13:53:14,258 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-07-29 13:53:14,258 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-07-29 13:53:14,258 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-07-29 13:53:14,258 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-07-29 13:53:14,258 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-07-29 13:53:14,258 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-07-29 13:53:14,258 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-07-29 13:53:14,258 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-07-29 13:53:14,258 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-07-29 13:53:14,258 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-07-29 13:53:14,258 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-07-29 13:53:14,258 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-07-29 13:53:14,258 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-07-29 13:53:14,259 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-07-29 13:53:14,259 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-07-29 13:53:14,259 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-07-29 13:53:14,259 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-07-29 13:53:14,259 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-07-29 13:53:14,259 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-07-29 13:53:14,259 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-07-29 13:53:14,259 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-07-29 13:53:14,260 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-07-29 13:53:14,260 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-07-29 13:53:14,260 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-07-29 13:53:14,260 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-07-29 13:53:14,260 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-07-29 13:53:14,260 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-07-29 13:53:14,260 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-07-29 13:53:14,260 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-07-29 13:53:14,260 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-07-29 13:53:14,261 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-07-29 13:53:14,261 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-07-29 13:53:14,261 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-07-29 13:53:14,261 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-07-29 13:53:14,261 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-07-29 13:53:14,261 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-07-29 13:53:14,261 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-07-29 13:53:14,261 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-07-29 13:53:14,261 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-07-29 13:53:14,261 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-07-29 13:53:14,262 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-07-29 13:53:14,262 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-07-29 13:53:14,262 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-07-29 13:53:14,262 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-07-29 13:53:14,262 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-07-29 13:53:14,262 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-07-29 13:53:14,262 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-07-29 13:53:14,262 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-07-29 13:53:14,262 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-07-29 13:53:14,262 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-07-29 13:53:14,262 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-07-29 13:53:14,263 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-07-29 13:53:14,263 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-07-29 13:53:14,263 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-07-29 13:53:14,263 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-07-29 13:53:14,263 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-07-29 13:53:14,263 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-07-29 13:53:14,263 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-07-29 13:53:14,263 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-07-29 13:53:14,264 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-07-29 13:53:14,264 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-07-29 13:53:14,264 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-07-29 13:53:14,264 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-07-29 13:53:14,264 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-07-29 13:53:14,264 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-07-29 13:53:14,264 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-07-29 13:53:14,264 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-07-29 13:53:14,264 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-07-29 13:53:14,264 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-07-29 13:53:14,265 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-07-29 13:53:14,265 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-07-29 13:53:14,265 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-07-29 13:53:14,265 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-07-29 13:53:14,265 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-07-29 13:53:14,265 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-07-29 13:53:14,265 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-07-29 13:53:14,265 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-07-29 13:53:14,265 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-07-29 13:53:14,265 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-07-29 13:53:14,265 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-07-29 13:53:14,265 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-07-29 13:53:14,265 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-07-29 13:53:14,265 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-07-29 13:53:14,266 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-07-29 13:53:14,266 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-07-29 13:53:14,266 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-07-29 13:53:14,266 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-07-29 13:53:14,408 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.005211573066470477); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.008123623944599232); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.005211573066470477); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=3.333333333333333E-4); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.003416666666666667); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-07-29 13:53:14,408 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-07-29 13:53:14,408 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=6.69355524211685E-4, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.005211573066470477); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.008123623944599232); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.005211573066470477); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=3.333333333333333E-4); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.003416666666666667); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-07-29 13:53:14,829 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 554 ms to try 5000 different iterations.  Found a solution that moves 243 regions; Going from a computed imbalance of 6.69355524211685E-4 to a new imbalance of 1.92986320040022E-5. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=4.994073055283275E-4); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0017082358106351274); MoveCostFunction : (multiplier=7.0, imbalance=0.027, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=4.994073055283275E-4); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=8.333333333333333E-5); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-07-29 13:53:14,831 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1181635048:83 , srv1288384780:83 , srv1723320022:83 , srv2125246283:83 , srv467891810:83 , srv745394155:83 , srv765150496:83 , srv1058387076:84 , srv1069454615:84 , srv1107444931:84 , srv1144062073:84 , srv1154550365:84 , srv1155804297:84 , srv1162118463:84 , srv1277556051:84 , srv1321184983:84 , srv1340811143:84 , srv1403666432:84 , srv1432840649:84 , srv1457995437:84 , srv148538457:84 , srv1490099306:84 , srv1538075708:84 , srv1630653720:84 , srv1680015206:84 , srv1694140492:84 , srv171998404:84 , srv1731481614:84 , srv1761443416:84 , srv1826796451:84 , srv1877150020:84 , srv1944449256:84 , srv2007656436:84 , srv2066570013:84 , srv2072299495:84 , srv221404404:84 , srv276919931:84 , srv338854637:84 , srv368714698:84 , srv51714353:84 , srv536425414:84 , srv548603845:84 , srv70678401:84 , srv708407872:84 , srv834863110:84 , srv865966778:84 , srv895968219:84 , srv900585448:84 , srv935427324:84 , srv1001411492:85 , srv1021452976:85 , srv1066800959:85 , srv1075436015:85 , srv1115361186:85 , srv1163427723:85 , srv1196504604:85 , srv1197819044:85 , srv1216314771:85 , srv124644847:85 , srv1287142555:85 , srv1348497205:85 , srv1366823677:85 , srv1380713806:85 , srv1401091266:85 , srv1453797058:85 , srv1467376916:85 , srv1490706217:85 , srv1568311623:85 , srv1595117031:85 , srv1615637441:85 , srv1647369129:85 , srv1743269117:85 , srv181855693:85 , srv1910991847:85 , srv1966288623:85 , srv1976062490:85 , srv1998661512:85 , srv2010034297:85 , srv203197176:85 , srv300703940:85 , srv341370000:85 , srv403969178:85 , srv445936766:85 , srv455517820:85 , srv493635161:85 , srv508900542:85 , srv646998005:85 , srv659078629:85 , srv68829343:85 , srv693481840:85 , srv716606312:85 , srv798358691:85 , srv803965204:85 , srv813693834:85 , srv844887058:85 , srv866676369:85 , srv943635438:85 , srv236731625:86 , srv629490421:86 , srv110447746:639 }
2023-07-29 13:53:14,837 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-07-29 13:53:14,838 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv467891810=73, srv803965204=90, srv1001411492=0, srv1154550365=10, srv1401091266=27, srv834863110=92, srv68829343=82, srv1155804297=11, srv900585448=97, srv1115361186=8, srv1966288623=54, srv1366823677=25, srv716606312=86, srv171998404=44, srv765150496=88, srv1998661512=56, srv1723320022=45, srv1348497205=24, srv341370000=68, srv1432840649=29, srv1457995437=31, srv181855693=49, srv1680015206=42, srv1910991847=52, srv1944449256=53, srv493635161=74, srv2072299495=61, srv1743269117=47, srv1731481614=46, srv508900542=75, srv813693834=91, srv338854637=67, srv798358691=89, srv1976062490=55, srv236731625=64, srv629490421=79, srv2010034297=58, srv1490706217=35, srv110447746=6, srv1826796451=50, srv1288384780=21, srv1595117031=38, srv1058387076=2, srv708407872=85, srv1615637441=39, srv865966778=94, srv1568311623=37, srv536425414=77, srv844887058=93, srv1538075708=36, srv1380713806=26, srv1144062073=9, srv935427324=98, srv2007656436=57, srv221404404=63, srv1453797058=30, srv1877150020=51, srv70678401=84, srv943635438=99, srv646998005=80, srv1162118463=12, srv1163427723=13, srv276919931=65, srv1490099306=34, srv1467376916=32, srv51714353=76, srv1694140492=43, srv548603845=78, srv403969178=70, srv1107444931=7, srv866676369=95, srv2125246283=62, srv1021452976=1, srv1277556051=19, srv1196504604=15, srv1340811143=23, srv445936766=71, srv1197819044=16, srv1287142555=20, srv1181635048=14, srv1069454615=4, srv300703940=66, srv1647369129=41, srv124644847=18, srv455517820=72, srv2066570013=60, srv1630653720=40, srv1321184983=22, srv148538457=33, srv659078629=81, srv1403666432=28, srv1066800959=3, srv1075436015=5, srv895968219=96, srv1216314771=17, srv203197176=59, srv693481840=83, srv1761443416=48, srv745394155=87, srv368714698=69} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-07-29 13:53:14,855 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-07-29 13:53:14,855 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-07-29 13:53:14,855 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-07-29 13:53:14,855 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-07-29 13:53:14,855 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-07-29 13:53:14,855 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-07-29 13:53:14,855 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-07-29 13:53:14,855 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-07-29 13:53:14,855 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-07-29 13:53:14,855 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-07-29 13:53:14,856 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-07-29 13:53:14,856 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-07-29 13:53:14,856 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-07-29 13:53:14,856 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-07-29 13:53:14,856 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-07-29 13:53:14,856 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-07-29 13:53:14,856 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-07-29 13:53:14,856 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-07-29 13:53:14,856 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-07-29 13:53:14,856 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-07-29 13:53:14,856 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-07-29 13:53:14,856 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-07-29 13:53:14,856 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-07-29 13:53:14,856 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-07-29 13:53:14,857 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-07-29 13:53:14,857 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-07-29 13:53:14,857 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-07-29 13:53:14,857 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-07-29 13:53:14,857 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-07-29 13:53:14,857 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-07-29 13:53:14,857 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-07-29 13:53:14,857 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-07-29 13:53:14,857 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-07-29 13:53:14,857 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-07-29 13:53:14,857 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-07-29 13:53:14,857 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-07-29 13:53:14,857 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-07-29 13:53:14,858 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-07-29 13:53:14,858 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-07-29 13:53:14,858 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-07-29 13:53:14,858 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-07-29 13:53:14,858 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-07-29 13:53:14,858 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-07-29 13:53:14,858 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-07-29 13:53:14,858 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-07-29 13:53:14,858 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-07-29 13:53:14,858 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-07-29 13:53:14,858 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-07-29 13:53:14,858 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-07-29 13:53:14,858 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-07-29 13:53:14,859 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-07-29 13:53:14,859 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-07-29 13:53:14,859 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-07-29 13:53:14,859 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-07-29 13:53:14,859 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-07-29 13:53:14,859 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-07-29 13:53:14,859 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-07-29 13:53:14,859 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-07-29 13:53:14,859 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-07-29 13:53:14,859 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-07-29 13:53:14,859 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-07-29 13:53:14,859 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-07-29 13:53:14,859 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-07-29 13:53:14,860 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-07-29 13:53:14,860 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-07-29 13:53:14,860 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-07-29 13:53:14,860 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-07-29 13:53:14,860 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-07-29 13:53:14,860 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-07-29 13:53:14,860 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-07-29 13:53:14,861 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-07-29 13:53:14,861 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-07-29 13:53:14,861 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-07-29 13:53:14,861 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-07-29 13:53:14,861 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-07-29 13:53:14,861 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-07-29 13:53:14,861 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-07-29 13:53:14,861 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-07-29 13:53:14,861 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-07-29 13:53:14,861 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-07-29 13:53:14,861 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-07-29 13:53:14,861 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-07-29 13:53:14,862 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-07-29 13:53:14,862 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-07-29 13:53:14,862 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-07-29 13:53:14,862 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-07-29 13:53:14,862 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-07-29 13:53:14,862 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-07-29 13:53:14,862 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-07-29 13:53:14,862 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-07-29 13:53:14,862 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-07-29 13:53:14,862 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-07-29 13:53:14,862 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-07-29 13:53:14,862 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-07-29 13:53:14,862 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-07-29 13:53:14,863 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-07-29 13:53:14,863 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-07-29 13:53:14,863 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-07-29 13:53:14,863 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-07-29 13:53:14,863 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-07-29 13:53:14,863 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-07-29 13:53:15,022 INFO  [Time-limited test] balancer.StochasticLoadBalancer(381): Cluster wide - skipping load balancing because weighted average imbalance=1.7597109636635417E-5 <= threshold(0.025). If you want more aggressive balancing, either lower hbase.master.balancer.stochastic.minCostNeedBalance from 0.025 or increase the relative multiplier(s) of the specific cost function(s). functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=4.994073055283275E-4); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0017082358106351274); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=4.994073055283275E-4); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=8.333333333333333E-5); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-07-29 13:53:15,023 INFO  [Time-limited test] balancer.BalancerTestBase(570): Mock Final balance: { srv1181635048:83 , srv1288384780:83 , srv1723320022:83 , srv2125246283:83 , srv467891810:83 , srv745394155:83 , srv765150496:83 , srv1058387076:84 , srv1069454615:84 , srv1107444931:84 , srv1144062073:84 , srv1154550365:84 , srv1155804297:84 , srv1162118463:84 , srv1277556051:84 , srv1321184983:84 , srv1340811143:84 , srv1403666432:84 , srv1432840649:84 , srv1457995437:84 , srv148538457:84 , srv1490099306:84 , srv1538075708:84 , srv1630653720:84 , srv1680015206:84 , srv1694140492:84 , srv171998404:84 , srv1731481614:84 , srv1761443416:84 , srv1826796451:84 , srv1877150020:84 , srv1944449256:84 , srv2007656436:84 , srv2066570013:84 , srv2072299495:84 , srv221404404:84 , srv276919931:84 , srv338854637:84 , srv368714698:84 , srv51714353:84 , srv536425414:84 , srv548603845:84 , srv70678401:84 , srv708407872:84 , srv834863110:84 , srv865966778:84 , srv895968219:84 , srv900585448:84 , srv935427324:84 , srv1001411492:85 , srv1021452976:85 , srv1066800959:85 , srv1075436015:85 , srv1115361186:85 , srv1163427723:85 , srv1196504604:85 , srv1197819044:85 , srv1216314771:85 , srv124644847:85 , srv1287142555:85 , srv1348497205:85 , srv1366823677:85 , srv1380713806:85 , srv1401091266:85 , srv1453797058:85 , srv1467376916:85 , srv1490706217:85 , srv1568311623:85 , srv1595117031:85 , srv1615637441:85 , srv1647369129:85 , srv1743269117:85 , srv181855693:85 , srv1910991847:85 , srv1966288623:85 , srv1976062490:85 , srv1998661512:85 , srv2010034297:85 , srv203197176:85 , srv300703940:85 , srv341370000:85 , srv403969178:85 , srv445936766:85 , srv455517820:85 , srv493635161:85 , srv508900542:85 , srv646998005:85 , srv659078629:85 , srv68829343:85 , srv693481840:85 , srv716606312:85 , srv798358691:85 , srv803965204:85 , srv813693834:85 , srv844887058:85 , srv866676369:85 , srv943635438:85 , srv236731625:86 , srv629490421:86 , srv110447746:639 }
2023-07-29 13:53:15,061 INFO  [Time-limited test] hbase.ResourceChecker(175): after: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnLargeClusterWithRacks Thread=12 (was 12), OpenFileDescriptor=263 (was 263), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=283 (was 283), ProcessCount=174 (was 174), AvailableMemoryMB=1719 (was 2548)
2023-07-29 13:53:15,071 INFO  [Time-limited test] hbase.ResourceChecker(147): before: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnMidClusterWithRacks Thread=12, OpenFileDescriptor=263, MaxFileDescriptor=60000, SystemLoadAverage=283, ProcessCount=174, AvailableMemoryMB=1718
2023-07-29 13:53:15,073 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2023-07-29 13:53:15,073 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=5000, runMaxSteps=true, stepsPerRegion=800, maxRunningTime=120000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 111077.0 etc.
2023-07-29 13:53:15,085 INFO  [Time-limited test] balancer.BalancerTestBase(547): Mock Cluster : { srv1021300362:84 , srv1058248760:84 , srv1167066754:84 , srv1201208422:84 , srv1263844596:84 , srv12881201:84 , srv1429339281:84 , srv1453170529:84 , srv1481836698:84 , srv1539782629:84 , srv1608946205:84 , srv162929451:84 , srv1654601014:84 , srv1863107079:84 , srv1951976791:84 , srv1956149395:84 , srv1959911373:84 , srv2024192272:84 , srv2147330466:84 , srv221267649:84 , srv332641685:84 , srv558830455:84 , srv582184053:84 , srv603258159:84 , srv603608137:84 , srv624094454:84 , srv628631059:84 , srv675207039:84 , srv763302322:84 , srv801658950:264 } [srvr=30 rgns=2700 avg=90.0 max=90 min=90]
2023-07-29 13:53:15,087 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-07-29 13:53:15,087 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1167066754=2, srv1959911373=16, srv162929451=11, srv1481836698=8, srv221267649=19, srv603608137=24, srv1654601014=12, srv1863107079=13, srv332641685=20, srv1429339281=6, srv801658950=29, srv624094454=25, srv603258159=23, srv1263844596=4, srv2024192272=17, srv1021300362=0, srv1453170529=7, srv1956149395=15, srv763302322=28, srv1539782629=9, srv2147330466=18, srv1608946205=10, srv12881201=5, srv1951976791=14, srv675207039=27, srv628631059=26, srv582184053=22, srv558830455=21, srv1201208422=3, srv1058248760=1} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-07-29 13:53:15,100 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-07-29 13:53:15,100 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-07-29 13:53:15,100 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-07-29 13:53:15,100 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-07-29 13:53:15,100 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-07-29 13:53:15,100 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-07-29 13:53:15,100 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-07-29 13:53:15,101 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-07-29 13:53:15,101 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-07-29 13:53:15,101 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-07-29 13:53:15,101 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-07-29 13:53:15,101 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-07-29 13:53:15,101 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-07-29 13:53:15,101 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-07-29 13:53:15,101 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-07-29 13:53:15,101 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-07-29 13:53:15,101 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-07-29 13:53:15,101 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-07-29 13:53:15,101 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-07-29 13:53:15,101 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-07-29 13:53:15,102 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-07-29 13:53:15,102 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-07-29 13:53:15,102 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-07-29 13:53:15,102 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-07-29 13:53:15,102 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-07-29 13:53:15,102 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-07-29 13:53:15,102 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-07-29 13:53:15,102 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-07-29 13:53:15,102 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-07-29 13:53:15,102 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-07-29 13:53:15,102 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=10, number of hosts=30, number of racks=4
2023-07-29 13:53:15,126 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=1.1928816272557587, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-07-29 13:53:15,126 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.9912800806973597, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=1.1928816272557587, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=64800000
2023-07-29 13:55:15,106 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 120001 ms to try 5551215 different iterations.  Found a solution that moves 1876 regions; Going from a computed imbalance of 0.9912800806973597 to a new imbalance of 4.37867758735265E-5. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); MoveCostFunction : (multiplier=7.0, imbalance=0.6948148148148148, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-07-29 13:55:15,114 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1021300362:90 , srv1058248760:90 , srv1167066754:90 , srv1201208422:90 , srv1263844596:90 , srv12881201:90 , srv1429339281:90 , srv1453170529:90 , srv1481836698:90 , srv1539782629:90 , srv1608946205:90 , srv162929451:90 , srv1654601014:90 , srv1863107079:90 , srv1951976791:90 , srv1956149395:90 , srv1959911373:90 , srv2024192272:90 , srv2147330466:90 , srv221267649:90 , srv332641685:90 , srv558830455:90 , srv582184053:90 , srv603258159:90 , srv603608137:90 , srv624094454:90 , srv628631059:90 , srv675207039:90 , srv763302322:90 , srv801658950:90 }
2023-07-29 13:55:15,115 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-07-29 13:55:15,115 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1167066754=2, srv1959911373=16, srv162929451=11, srv1481836698=8, srv221267649=19, srv603608137=24, srv1654601014=12, srv1863107079=13, srv332641685=20, srv1429339281=6, srv801658950=29, srv624094454=25, srv603258159=23, srv1263844596=4, srv2024192272=17, srv1021300362=0, srv1453170529=7, srv1956149395=15, srv763302322=28, srv1539782629=9, srv2147330466=18, srv1608946205=10, srv12881201=5, srv1951976791=14, srv675207039=27, srv628631059=26, srv582184053=22, srv558830455=21, srv1201208422=3, srv1058248760=1} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-07-29 13:55:15,119 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-07-29 13:55:15,119 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-07-29 13:55:15,120 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-07-29 13:55:15,120 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-07-29 13:55:15,120 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-07-29 13:55:15,120 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-07-29 13:55:15,120 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-07-29 13:55:15,120 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-07-29 13:55:15,120 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-07-29 13:55:15,120 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-07-29 13:55:15,120 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-07-29 13:55:15,120 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-07-29 13:55:15,120 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-07-29 13:55:15,120 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-07-29 13:55:15,120 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-07-29 13:55:15,120 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-07-29 13:55:15,120 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-07-29 13:55:15,120 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-07-29 13:55:15,120 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-07-29 13:55:15,120 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-07-29 13:55:15,120 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-07-29 13:55:15,120 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-07-29 13:55:15,120 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-07-29 13:55:15,121 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-07-29 13:55:15,121 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-07-29 13:55:15,121 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-07-29 13:55:15,121 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-07-29 13:55:15,121 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-07-29 13:55:15,121 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-07-29 13:55:15,121 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-07-29 13:55:15,121 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=10, number of hosts=30, number of racks=4
2023-07-29 13:55:15,133 INFO  [Time-limited test] balancer.StochasticLoadBalancer(381): Cluster wide - skipping load balancing because weighted average imbalance=0.0 <= threshold(0.025). If you want more aggressive balancing, either lower hbase.master.balancer.stochastic.minCostNeedBalance from 0.025 or increase the relative multiplier(s) of the specific cost function(s). functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-07-29 13:55:15,133 INFO  [Time-limited test] balancer.BalancerTestBase(570): Mock Final balance: { srv1021300362:90 , srv1058248760:90 , srv1167066754:90 , srv1201208422:90 , srv1263844596:90 , srv12881201:90 , srv1429339281:90 , srv1453170529:90 , srv1481836698:90 , srv1539782629:90 , srv1608946205:90 , srv162929451:90 , srv1654601014:90 , srv1863107079:90 , srv1951976791:90 , srv1956149395:90 , srv1959911373:90 , srv2024192272:90 , srv2147330466:90 , srv221267649:90 , srv332641685:90 , srv558830455:90 , srv582184053:90 , srv603258159:90 , srv603608137:90 , srv624094454:90 , srv628631059:90 , srv675207039:90 , srv763302322:90 , srv801658950:90 }
2023-07-29 13:55:15,151 INFO  [Time-limited test] hbase.ResourceChecker(175): after: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnMidClusterWithRacks Thread=11 (was 12), OpenFileDescriptor=263 (was 263), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=196 (was 283), ProcessCount=174 (was 174), AvailableMemoryMB=1629 (was 1718)