2023-10-22 14:53:26,613 INFO  [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks timeout: 13 mins
2023-10-22 14:53:26,931 WARN  [Time-limited test] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties
2023-10-22 14:53:27,067 INFO  [Time-limited test] metrics.MetricRegistriesLoader(60): Loaded MetricRegistries class org.apache.hadoop.hbase.metrics.impl.MetricRegistriesImpl
2023-10-22 14:53:27,145 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2023-10-22 14:53:27,152 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc.
2023-10-22 14:53:27,168 INFO  [Time-limited test] hbase.ResourceChecker(147): before: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnLargeClusterWithRacks Thread=12, OpenFileDescriptor=263, MaxFileDescriptor=60000, SystemLoadAverage=364, ProcessCount=173, AvailableMemoryMB=8558
2023-10-22 14:53:27,171 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2023-10-22 14:53:27,171 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=5000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=10000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc.
2023-10-22 14:53:27,293 INFO  [Time-limited test] balancer.BalancerTestBase(547): Mock Cluster : { srv1009731817:84 , srv101661895:84 , srv103096586:84 , srv1058930715:84 , srv1063657066:84 , srv1115450090:84 , srv1164506511:84 , srv1171936795:84 , srv1178710152:84 , srv1199355664:84 , srv1261842137:84 , srv1265456178:84 , srv1282577976:84 , srv1321162558:84 , srv1360723330:84 , srv1360919974:84 , srv1377376959:84 , srv1382838700:84 , srv1416528715:84 , srv141963941:84 , srv1440129881:84 , srv1441496315:84 , srv1442964698:84 , srv1449535268:84 , srv1479034191:84 , srv1501903216:84 , srv1512442377:84 , srv1523663516:84 , srv1531243180:84 , srv1593686568:84 , srv1626465885:84 , srv1635171568:84 , srv1635537929:84 , srv1663652508:84 , srv1668551435:84 , srv167057005:84 , srv1679789896:84 , srv1691435979:84 , srv1696677270:84 , srv1696973582:84 , srv1700166303:84 , srv1705416210:84 , srv1709586844:84 , srv1731799296:84 , srv1763385674:84 , srv1773776253:84 , srv1839483069:84 , srv1841749645:84 , srv1862902377:84 , srv1884505226:84 , srv1894067517:84 , srv1913056326:84 , srv1919195927:84 , srv193129032:84 , srv1962430124:84 , srv1982238523:84 , srv202364810:84 , srv2050180173:84 , srv2056559966:84 , srv2073551813:84 , srv2124406884:84 , srv212470733:84 , srv2132264542:84 , srv2141662313:84 , srv240648254:84 , srv260605937:84 , srv2625216:84 , srv319918667:84 , srv338090430:84 , srv362450353:84 , srv382982137:84 , srv38704623:84 , srv415305245:84 , srv420677124:84 , srv421737515:84 , srv461367939:84 , srv47478160:84 , srv501973660:84 , srv535199952:84 , srv53760657:84 , srv540457022:84 , srv542106973:84 , srv544887906:84 , srv571317777:84 , srv574164723:84 , srv58916663:84 , srv606771690:84 , srv740837715:84 , srv762933018:84 , srv772816239:84 , srv779501869:84 , srv796739696:84 , srv804609928:84 , srv853752658:84 , srv901513397:84 , srv913051578:84 , srv973037962:84 , srv981616817:84 , srv990718346:84 , srv351451178:684 } [srvr=100 rgns=9000 avg=90.0 max=90 min=90]
2023-10-22 14:53:27,306 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-10-22 14:53:27,314 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1199355664=9, srv202364810=56, srv1523663516=27, srv1265456178=11, srv415305245=73, srv1501903216=25, srv1679789896=36, srv319918667=67, srv193129032=53, srv804609928=93, srv2625216=66, srv990718346=99, srv542106973=82, srv540457022=81, srv1063657066=4, srv1282577976=12, srv1668551435=34, srv1773776253=45, srv606771690=87, srv1164506511=6, srv1696677270=38, srv351451178=69, srv2050180173=57, srv1731799296=43, srv1635537929=32, srv2073551813=59, srv1626465885=30, srv901513397=95, srv1171936795=7, srv1512442377=26, srv167057005=35, srv1696973582=39, srv1663652508=33, srv1382838700=17, srv1691435979=37, srv421737515=75, srv1261842137=10, srv461367939=76, srv1058930715=3, srv973037962=97, srv1377376959=16, srv1178710152=8, srv1479034191=24, srv1360919974=15, srv420677124=74, srv1635171568=31, srv141963941=19, srv1862902377=48, srv1416528715=18, srv1449535268=23, srv1440129881=20, srv1442964698=22, srv571317777=84, srv1919195927=52, srv260605937=65, srv1593686568=29, srv1894067517=50, srv740837715=88, srv1009731817=0, srv101661895=1, srv1884505226=49, srv501973660=78, srv240648254=64, srv2132264542=62, srv1115450090=5, srv574164723=85, srv1531243180=28, srv1441496315=21, srv103096586=2, srv772816239=90, srv1709586844=42, srv1700166303=40, srv1982238523=55, srv47478160=77, srv2141662313=63, srv779501869=91, srv1763385674=44, srv382982137=71, srv913051578=96, srv853752658=94, srv1913056326=51, srv338090430=68, srv1962430124=54, srv1839483069=46, srv1360723330=14, srv1841749645=47, srv212470733=61, srv2056559966=58, srv58916663=86, srv535199952=79, srv762933018=89, srv1321162558=13, srv362450353=70, srv544887906=83, srv1705416210=41, srv38704623=72, srv2124406884=60, srv796739696=92, srv53760657=80, srv981616817=98} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-10-22 14:53:27,407 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-10-22 14:53:27,407 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-10-22 14:53:27,407 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-10-22 14:53:27,408 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-10-22 14:53:27,408 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-10-22 14:53:27,408 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-10-22 14:53:27,408 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-10-22 14:53:27,408 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-10-22 14:53:27,408 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-10-22 14:53:27,409 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-10-22 14:53:27,409 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-10-22 14:53:27,409 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-10-22 14:53:27,409 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-10-22 14:53:27,409 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-10-22 14:53:27,409 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-10-22 14:53:27,409 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-10-22 14:53:27,409 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-10-22 14:53:27,410 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-10-22 14:53:27,410 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-10-22 14:53:27,410 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-10-22 14:53:27,410 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-10-22 14:53:27,410 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-10-22 14:53:27,410 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-10-22 14:53:27,410 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-10-22 14:53:27,411 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-10-22 14:53:27,411 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-10-22 14:53:27,411 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-10-22 14:53:27,411 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-10-22 14:53:27,411 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-10-22 14:53:27,411 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-10-22 14:53:27,411 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-10-22 14:53:27,411 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-10-22 14:53:27,411 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-10-22 14:53:27,411 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-10-22 14:53:27,411 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-10-22 14:53:27,412 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-10-22 14:53:27,412 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-10-22 14:53:27,412 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-10-22 14:53:27,412 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-10-22 14:53:27,412 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-10-22 14:53:27,412 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-10-22 14:53:27,412 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-10-22 14:53:27,412 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-10-22 14:53:27,412 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-10-22 14:53:27,412 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-10-22 14:53:27,412 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-10-22 14:53:27,413 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-10-22 14:53:27,413 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-10-22 14:53:27,413 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-10-22 14:53:27,413 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-10-22 14:53:27,413 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-10-22 14:53:27,413 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-10-22 14:53:27,413 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-10-22 14:53:27,413 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-10-22 14:53:27,413 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-10-22 14:53:27,413 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-10-22 14:53:27,413 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-10-22 14:53:27,414 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-10-22 14:53:27,414 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-10-22 14:53:27,414 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-10-22 14:53:27,414 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-10-22 14:53:27,414 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-10-22 14:53:27,414 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-10-22 14:53:27,414 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-10-22 14:53:27,414 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-10-22 14:53:27,414 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-10-22 14:53:27,414 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-10-22 14:53:27,415 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-10-22 14:53:27,415 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-10-22 14:53:27,415 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-10-22 14:53:27,415 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-10-22 14:53:27,415 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-10-22 14:53:27,415 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-10-22 14:53:27,415 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-10-22 14:53:27,415 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-10-22 14:53:27,415 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-10-22 14:53:27,415 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-10-22 14:53:27,415 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-10-22 14:53:27,415 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-10-22 14:53:27,416 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-10-22 14:53:27,416 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-10-22 14:53:27,416 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-10-22 14:53:27,416 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-10-22 14:53:27,416 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-10-22 14:53:27,416 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-10-22 14:53:27,416 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-10-22 14:53:27,416 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-10-22 14:53:27,416 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-10-22 14:53:27,416 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-10-22 14:53:27,416 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-10-22 14:53:27,417 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-10-22 14:53:27,417 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-10-22 14:53:27,417 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-10-22 14:53:27,417 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-10-22 14:53:27,417 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-10-22 14:53:27,417 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-10-22 14:53:27,417 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-10-22 14:53:27,417 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-10-22 14:53:27,417 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-10-22 14:53:27,417 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-10-22 14:53:27,418 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-10-22 14:53:27,655 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.06666666666666667, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-10-22 14:53:27,656 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-10-22 14:53:27,656 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.9909252140407105, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.06666666666666667, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-10-22 14:53:28,030 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 583 ms to try 5000 different iterations.  Found a solution that moves 4720 regions; Going from a computed imbalance of 0.9909252140407105 to a new imbalance of 0.1780545874630704. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.04265125516649791, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06089309135390682, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.5244444444444445, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.04265125516649791, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.17308333333333334, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.24125, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-10-22 14:53:28,041 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1282577976:82 , srv1416528715:82 , srv1512442377:82 , srv1731799296:82 , srv1763385674:82 , srv1894067517:82 , srv542106973:82 , srv981616817:82 , srv1440129881:83 , srv1441496315:83 , srv1635171568:83 , srv1668551435:83 , srv1962430124:83 , srv2056559966:83 , srv240648254:83 , srv2625216:83 , srv461367939:83 , srv1261842137:84 , srv1265456178:84 , srv1377376959:84 , srv141963941:84 , srv1635537929:84 , srv1696973582:84 , srv1913056326:84 , srv2073551813:84 , srv2141662313:84 , srv38704623:84 , srv420677124:84 , srv540457022:84 , srv544887906:84 , srv58916663:84 , srv779501869:84 , srv853752658:84 , srv1531243180:85 , srv167057005:85 , srv1773776253:85 , srv1841749645:85 , srv1919195927:85 , srv1982238523:85 , srv212470733:85 , srv319918667:85 , srv421737515:85 , srv535199952:85 , srv740837715:85 , srv772816239:85 , srv796739696:85 , srv901513397:85 , srv1360919974:86 , srv1709586844:86 , srv2050180173:86 , srv382982137:86 , srv762933018:86 , srv103096586:87 , srv1063657066:87 , srv1164506511:87 , srv1178710152:87 , srv1382838700:87 , srv1442964698:87 , srv1523663516:87 , srv1626465885:87 , srv1663652508:87 , srv1691435979:87 , srv1696677270:87 , srv1884505226:87 , srv362450353:87 , srv415305245:87 , srv606771690:87 , srv1009731817:88 , srv101661895:88 , srv1058930715:88 , srv1115450090:88 , srv1199355664:88 , srv1449535268:88 , srv1700166303:88 , srv1705416210:88 , srv202364810:88 , srv2124406884:88 , srv260605937:88 , srv338090430:88 , srv574164723:88 , srv913051578:88 , srv990718346:88 , srv1360723330:89 , srv1839483069:89 , srv1862902377:89 , srv47478160:89 , srv501973660:89 , srv571317777:89 , srv973037962:89 , srv1479034191:90 , srv193129032:90 , srv1171936795:91 , srv1593686568:91 , srv1679789896:91 , srv2132264542:91 , srv53760657:91 , srv804609928:91 , srv1501903216:92 , srv1321162558:98 , srv351451178:469 }
2023-10-22 14:53:28,046 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-10-22 14:53:28,046 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1199355664=9, srv202364810=56, srv1523663516=27, srv1265456178=11, srv415305245=73, srv1501903216=25, srv1679789896=36, srv319918667=67, srv193129032=53, srv804609928=93, srv2625216=66, srv990718346=99, srv542106973=82, srv540457022=81, srv1063657066=4, srv1282577976=12, srv1668551435=34, srv1773776253=45, srv606771690=87, srv1164506511=6, srv1696677270=38, srv351451178=69, srv2050180173=57, srv1731799296=43, srv1635537929=32, srv2073551813=59, srv1626465885=30, srv901513397=95, srv1171936795=7, srv1512442377=26, srv167057005=35, srv1696973582=39, srv1663652508=33, srv1382838700=17, srv1691435979=37, srv421737515=75, srv1261842137=10, srv461367939=76, srv1058930715=3, srv973037962=97, srv1377376959=16, srv1178710152=8, srv1479034191=24, srv1360919974=15, srv420677124=74, srv1635171568=31, srv141963941=19, srv1862902377=48, srv1416528715=18, srv1449535268=23, srv1440129881=20, srv1442964698=22, srv571317777=84, srv1919195927=52, srv260605937=65, srv1593686568=29, srv1894067517=50, srv740837715=88, srv1009731817=0, srv101661895=1, srv1884505226=49, srv501973660=78, srv240648254=64, srv2132264542=62, srv1115450090=5, srv574164723=85, srv1531243180=28, srv1441496315=21, srv103096586=2, srv772816239=90, srv1709586844=42, srv1700166303=40, srv1982238523=55, srv47478160=77, srv2141662313=63, srv779501869=91, srv1763385674=44, srv382982137=71, srv913051578=96, srv853752658=94, srv1913056326=51, srv338090430=68, srv1962430124=54, srv1839483069=46, srv1360723330=14, srv1841749645=47, srv212470733=61, srv2056559966=58, srv58916663=86, srv535199952=79, srv762933018=89, srv1321162558=13, srv362450353=70, srv544887906=83, srv1705416210=41, srv38704623=72, srv2124406884=60, srv796739696=92, srv53760657=80, srv981616817=98} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-10-22 14:53:28,061 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-10-22 14:53:28,061 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-10-22 14:53:28,061 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-10-22 14:53:28,061 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-10-22 14:53:28,061 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-10-22 14:53:28,061 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-10-22 14:53:28,062 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-10-22 14:53:28,062 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-10-22 14:53:28,062 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-10-22 14:53:28,062 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-10-22 14:53:28,062 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-10-22 14:53:28,062 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-10-22 14:53:28,062 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-10-22 14:53:28,063 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-10-22 14:53:28,063 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-10-22 14:53:28,063 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-10-22 14:53:28,063 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-10-22 14:53:28,063 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-10-22 14:53:28,063 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-10-22 14:53:28,063 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-10-22 14:53:28,063 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-10-22 14:53:28,063 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-10-22 14:53:28,064 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-10-22 14:53:28,064 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-10-22 14:53:28,064 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-10-22 14:53:28,064 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-10-22 14:53:28,064 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-10-22 14:53:28,064 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-10-22 14:53:28,064 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-10-22 14:53:28,064 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-10-22 14:53:28,065 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-10-22 14:53:28,065 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-10-22 14:53:28,065 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-10-22 14:53:28,065 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-10-22 14:53:28,065 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-10-22 14:53:28,065 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-10-22 14:53:28,065 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-10-22 14:53:28,065 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-10-22 14:53:28,066 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-10-22 14:53:28,066 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-10-22 14:53:28,066 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-10-22 14:53:28,066 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-10-22 14:53:28,066 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-10-22 14:53:28,066 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-10-22 14:53:28,066 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-10-22 14:53:28,066 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-10-22 14:53:28,066 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-10-22 14:53:28,066 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-10-22 14:53:28,066 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-10-22 14:53:28,066 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-10-22 14:53:28,066 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-10-22 14:53:28,066 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-10-22 14:53:28,067 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-10-22 14:53:28,067 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-10-22 14:53:28,067 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-10-22 14:53:28,067 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-10-22 14:53:28,067 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-10-22 14:53:28,067 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-10-22 14:53:28,067 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-10-22 14:53:28,067 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-10-22 14:53:28,068 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-10-22 14:53:28,068 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-10-22 14:53:28,068 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-10-22 14:53:28,068 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-10-22 14:53:28,068 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-10-22 14:53:28,068 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-10-22 14:53:28,068 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-10-22 14:53:28,068 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-10-22 14:53:28,068 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-10-22 14:53:28,068 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-10-22 14:53:28,068 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-10-22 14:53:28,069 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-10-22 14:53:28,069 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-10-22 14:53:28,069 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-10-22 14:53:28,069 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-10-22 14:53:28,069 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-10-22 14:53:28,069 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-10-22 14:53:28,069 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-10-22 14:53:28,069 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-10-22 14:53:28,069 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-10-22 14:53:28,069 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-10-22 14:53:28,069 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-10-22 14:53:28,069 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-10-22 14:53:28,070 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-10-22 14:53:28,070 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-10-22 14:53:28,070 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-10-22 14:53:28,070 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-10-22 14:53:28,070 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-10-22 14:53:28,070 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-10-22 14:53:28,070 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-10-22 14:53:28,070 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-10-22 14:53:28,070 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-10-22 14:53:28,071 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-10-22 14:53:28,071 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-10-22 14:53:28,071 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-10-22 14:53:28,071 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-10-22 14:53:28,071 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-10-22 14:53:28,071 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-10-22 14:53:28,071 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-10-22 14:53:28,071 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-10-22 14:53:28,071 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-10-22 14:53:28,225 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.04265125516649791, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06089309135390682, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.04265125516649791, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.17308333333333334, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.24125, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-10-22 14:53:28,225 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-10-22 14:53:28,226 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.17802153731667547, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.04265125516649791, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06089309135390682, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.04265125516649791, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.17308333333333334, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.24125, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-10-22 14:53:28,521 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 419 ms to try 5000 different iterations.  Found a solution that moves 2598 regions; Going from a computed imbalance of 0.17802153731667547 to a new imbalance of 0.0157373438637505. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.024298616132987932); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.03940636944533146, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.2886666666666667, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.024298616132987932); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.012583333333333334); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0455, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-10-22 14:53:28,535 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1321162558:74 , srv1501903216:80 , srv53760657:80 , srv804609928:80 , srv1171936795:81 , srv1360723330:81 , srv1479034191:81 , srv1593686568:81 , srv47478160:81 , srv1058930715:82 , srv1199355664:82 , srv1691435979:82 , srv1839483069:82 , srv260605937:82 , srv571317777:82 , srv990718346:82 , srv103096586:83 , srv1115450090:83 , srv1679789896:83 , srv1862902377:83 , srv193129032:83 , srv2132264542:83 , srv574164723:83 , srv913051578:83 , srv973037962:83 , srv1009731817:84 , srv101661895:84 , srv1164506511:84 , srv1360919974:84 , srv1449535268:84 , srv1523663516:84 , srv1626465885:84 , srv1696677270:84 , srv1705416210:84 , srv1884505226:84 , srv2050180173:84 , srv415305245:84 , srv1063657066:85 , srv1178710152:85 , srv1265456178:85 , srv1663652508:85 , srv167057005:85 , srv1709586844:85 , srv1919195927:85 , srv382982137:85 , srv421737515:85 , srv501973660:85 , srv740837715:85 , srv1700166303:86 , srv1773776253:86 , srv1982238523:86 , srv212470733:86 , srv338090430:86 , srv38704623:86 , srv762933018:86 , srv772816239:86 , srv1382838700:87 , srv1416528715:87 , srv141963941:87 , srv1440129881:87 , srv1442964698:87 , srv202364810:87 , srv2073551813:87 , srv2124406884:87 , srv2141662313:87 , srv362450353:87 , srv535199952:87 , srv544887906:87 , srv58916663:87 , srv606771690:87 , srv853752658:87 , srv1261842137:88 , srv1377376959:88 , srv1531243180:88 , srv1841749645:88 , srv2056559966:88 , srv2625216:88 , srv540457022:88 , srv796739696:88 , srv1282577976:89 , srv1441496315:89 , srv1668551435:89 , srv1731799296:89 , srv1763385674:89 , srv319918667:89 , srv420677124:89 , srv779501869:89 , srv901513397:89 , srv1696973582:90 , srv1894067517:90 , srv1913056326:90 , srv461367939:90 , srv1512442377:91 , srv1635171568:91 , srv1635537929:91 , srv1962430124:91 , srv240648254:91 , srv542106973:91 , srv981616817:92 , srv351451178:521 }
2023-10-22 14:53:28,539 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-10-22 14:53:28,539 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1199355664=9, srv202364810=56, srv1523663516=27, srv1265456178=11, srv415305245=73, srv1501903216=25, srv1679789896=36, srv319918667=67, srv193129032=53, srv804609928=93, srv2625216=66, srv990718346=99, srv542106973=82, srv540457022=81, srv1063657066=4, srv1282577976=12, srv1668551435=34, srv1773776253=45, srv606771690=87, srv1164506511=6, srv1696677270=38, srv351451178=69, srv2050180173=57, srv1731799296=43, srv1635537929=32, srv2073551813=59, srv1626465885=30, srv901513397=95, srv1171936795=7, srv1512442377=26, srv167057005=35, srv1696973582=39, srv1663652508=33, srv1382838700=17, srv1691435979=37, srv421737515=75, srv1261842137=10, srv461367939=76, srv1058930715=3, srv973037962=97, srv1377376959=16, srv1178710152=8, srv1479034191=24, srv1360919974=15, srv420677124=74, srv1635171568=31, srv141963941=19, srv1862902377=48, srv1416528715=18, srv1449535268=23, srv1440129881=20, srv1442964698=22, srv571317777=84, srv1919195927=52, srv260605937=65, srv1593686568=29, srv1894067517=50, srv740837715=88, srv1009731817=0, srv101661895=1, srv1884505226=49, srv501973660=78, srv240648254=64, srv2132264542=62, srv1115450090=5, srv574164723=85, srv1531243180=28, srv1441496315=21, srv103096586=2, srv772816239=90, srv1709586844=42, srv1700166303=40, srv1982238523=55, srv47478160=77, srv2141662313=63, srv779501869=91, srv1763385674=44, srv382982137=71, srv913051578=96, srv853752658=94, srv1913056326=51, srv338090430=68, srv1962430124=54, srv1839483069=46, srv1360723330=14, srv1841749645=47, srv212470733=61, srv2056559966=58, srv58916663=86, srv535199952=79, srv762933018=89, srv1321162558=13, srv362450353=70, srv544887906=83, srv1705416210=41, srv38704623=72, srv2124406884=60, srv796739696=92, srv53760657=80, srv981616817=98} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-10-22 14:53:28,561 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-10-22 14:53:28,561 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-10-22 14:53:28,561 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-10-22 14:53:28,561 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-10-22 14:53:28,561 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-10-22 14:53:28,561 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-10-22 14:53:28,561 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-10-22 14:53:28,562 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-10-22 14:53:28,562 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-10-22 14:53:28,562 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-10-22 14:53:28,562 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-10-22 14:53:28,562 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-10-22 14:53:28,562 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-10-22 14:53:28,562 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-10-22 14:53:28,562 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-10-22 14:53:28,562 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-10-22 14:53:28,562 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-10-22 14:53:28,563 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-10-22 14:53:28,563 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-10-22 14:53:28,563 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-10-22 14:53:28,563 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-10-22 14:53:28,563 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-10-22 14:53:28,563 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-10-22 14:53:28,563 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-10-22 14:53:28,563 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-10-22 14:53:28,563 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-10-22 14:53:28,564 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-10-22 14:53:28,564 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-10-22 14:53:28,564 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-10-22 14:53:28,564 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-10-22 14:53:28,564 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-10-22 14:53:28,564 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-10-22 14:53:28,565 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-10-22 14:53:28,565 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-10-22 14:53:28,565 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-10-22 14:53:28,565 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-10-22 14:53:28,565 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-10-22 14:53:28,565 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-10-22 14:53:28,565 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-10-22 14:53:28,565 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-10-22 14:53:28,565 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-10-22 14:53:28,566 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-10-22 14:53:28,566 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-10-22 14:53:28,566 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-10-22 14:53:28,566 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-10-22 14:53:28,566 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-10-22 14:53:28,566 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-10-22 14:53:28,566 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-10-22 14:53:28,566 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-10-22 14:53:28,566 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-10-22 14:53:28,567 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-10-22 14:53:28,567 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-10-22 14:53:28,567 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-10-22 14:53:28,567 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-10-22 14:53:28,567 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-10-22 14:53:28,567 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-10-22 14:53:28,567 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-10-22 14:53:28,567 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-10-22 14:53:28,568 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-10-22 14:53:28,568 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-10-22 14:53:28,568 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-10-22 14:53:28,568 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-10-22 14:53:28,568 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-10-22 14:53:28,568 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-10-22 14:53:28,568 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-10-22 14:53:28,568 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-10-22 14:53:28,568 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-10-22 14:53:28,568 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-10-22 14:53:28,569 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-10-22 14:53:28,569 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-10-22 14:53:28,569 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-10-22 14:53:28,569 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-10-22 14:53:28,569 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-10-22 14:53:28,569 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-10-22 14:53:28,569 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-10-22 14:53:28,569 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-10-22 14:53:28,569 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-10-22 14:53:28,570 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-10-22 14:53:28,570 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-10-22 14:53:28,570 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-10-22 14:53:28,570 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-10-22 14:53:28,570 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-10-22 14:53:28,570 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-10-22 14:53:28,570 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-10-22 14:53:28,570 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-10-22 14:53:28,570 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-10-22 14:53:28,570 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-10-22 14:53:28,571 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-10-22 14:53:28,571 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-10-22 14:53:28,571 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-10-22 14:53:28,571 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-10-22 14:53:28,571 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-10-22 14:53:28,571 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-10-22 14:53:28,571 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-10-22 14:53:28,571 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-10-22 14:53:28,571 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-10-22 14:53:28,572 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-10-22 14:53:28,572 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-10-22 14:53:28,572 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-10-22 14:53:28,572 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-10-22 14:53:28,572 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-10-22 14:53:28,702 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.024298616132987932); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.03940636944533146, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.024298616132987932); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.012583333333333334); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0455, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-10-22 14:53:28,702 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-10-22 14:53:28,702 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.01571915227893396, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.024298616132987932); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.03940636944533146, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.024298616132987932); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.012583333333333334); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0455, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-10-22 14:53:28,958 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 361 ms to try 5000 different iterations.  Found a solution that moves 1030 regions; Going from a computed imbalance of 0.01571915227893396 to a new imbalance of 6.512044093287741E-4. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.00767691535093358); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.01151780936896998); MoveCostFunction : (multiplier=7.0, imbalance=0.11444444444444445, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.00767691535093358); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.6666666666666666E-4); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0045); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-10-22 14:53:28,960 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1962430124:82 , srv202364810:82 , srv1442964698:83 , srv1679789896:83 , srv1696973582:83 , srv1913056326:83 , srv2132264542:83 , srv240648254:83 , srv319918667:83 , srv362450353:83 , srv606771690:83 , srv901513397:83 , srv1382838700:84 , srv1512442377:84 , srv1531243180:84 , srv1635171568:84 , srv1635537929:84 , srv1668551435:84 , srv1700166303:84 , srv2124406884:84 , srv338090430:84 , srv420677124:84 , srv461367939:84 , srv501973660:84 , srv542106973:84 , srv779501869:84 , srv796739696:84 , srv981616817:84 , srv1009731817:85 , srv101661895:85 , srv1171936795:85 , srv1178710152:85 , srv1261842137:85 , srv1321162558:85 , srv1441496315:85 , srv1449535268:85 , srv1705416210:85 , srv1763385674:85 , srv1839483069:85 , srv1841749645:85 , srv1884505226:85 , srv1894067517:85 , srv193129032:85 , srv540457022:85 , srv772816239:85 , srv804609928:85 , srv103096586:86 , srv1063657066:86 , srv1115450090:86 , srv1164506511:86 , srv1282577976:86 , srv1360723330:86 , srv1377376959:86 , srv1479034191:86 , srv1501903216:86 , srv1523663516:86 , srv1593686568:86 , srv1663652508:86 , srv1709586844:86 , srv1731799296:86 , srv1773776253:86 , srv1862902377:86 , srv1982238523:86 , srv2056559966:86 , srv2141662313:86 , srv2625216:86 , srv38704623:86 , srv415305245:86 , srv544887906:86 , srv574164723:86 , srv762933018:86 , srv853752658:86 , srv913051578:86 , srv1058930715:87 , srv1440129881:87 , srv1626465885:87 , srv167057005:87 , srv1696677270:87 , srv1919195927:87 , srv2073551813:87 , srv212470733:87 , srv260605937:87 , srv382982137:87 , srv421737515:87 , srv47478160:87 , srv535199952:87 , srv53760657:87 , srv58916663:87 , srv973037962:87 , srv1199355664:88 , srv1360919974:88 , srv1416528715:88 , srv141963941:88 , srv1691435979:88 , srv2050180173:88 , srv571317777:88 , srv990718346:88 , srv1265456178:89 , srv740837715:89 , srv351451178:536 }
2023-10-22 14:53:28,965 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-10-22 14:53:28,966 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1199355664=9, srv202364810=56, srv1523663516=27, srv1265456178=11, srv415305245=73, srv1501903216=25, srv1679789896=36, srv319918667=67, srv193129032=53, srv804609928=93, srv2625216=66, srv990718346=99, srv542106973=82, srv540457022=81, srv1063657066=4, srv1282577976=12, srv1668551435=34, srv1773776253=45, srv606771690=87, srv1164506511=6, srv1696677270=38, srv351451178=69, srv2050180173=57, srv1731799296=43, srv1635537929=32, srv2073551813=59, srv1626465885=30, srv901513397=95, srv1171936795=7, srv1512442377=26, srv167057005=35, srv1696973582=39, srv1663652508=33, srv1382838700=17, srv1691435979=37, srv421737515=75, srv1261842137=10, srv461367939=76, srv1058930715=3, srv973037962=97, srv1377376959=16, srv1178710152=8, srv1479034191=24, srv1360919974=15, srv420677124=74, srv1635171568=31, srv141963941=19, srv1862902377=48, srv1416528715=18, srv1449535268=23, srv1440129881=20, srv1442964698=22, srv571317777=84, srv1919195927=52, srv260605937=65, srv1593686568=29, srv1894067517=50, srv740837715=88, srv1009731817=0, srv101661895=1, srv1884505226=49, srv501973660=78, srv240648254=64, srv2132264542=62, srv1115450090=5, srv574164723=85, srv1531243180=28, srv1441496315=21, srv103096586=2, srv772816239=90, srv1709586844=42, srv1700166303=40, srv1982238523=55, srv47478160=77, srv2141662313=63, srv779501869=91, srv1763385674=44, srv382982137=71, srv913051578=96, srv853752658=94, srv1913056326=51, srv338090430=68, srv1962430124=54, srv1839483069=46, srv1360723330=14, srv1841749645=47, srv212470733=61, srv2056559966=58, srv58916663=86, srv535199952=79, srv762933018=89, srv1321162558=13, srv362450353=70, srv544887906=83, srv1705416210=41, srv38704623=72, srv2124406884=60, srv796739696=92, srv53760657=80, srv981616817=98} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-10-22 14:53:28,983 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-10-22 14:53:28,984 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-10-22 14:53:28,984 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-10-22 14:53:28,984 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-10-22 14:53:28,984 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-10-22 14:53:28,984 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-10-22 14:53:28,984 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-10-22 14:53:28,984 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-10-22 14:53:28,984 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-10-22 14:53:28,984 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-10-22 14:53:28,984 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-10-22 14:53:28,985 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-10-22 14:53:28,985 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-10-22 14:53:28,985 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-10-22 14:53:28,985 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-10-22 14:53:28,985 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-10-22 14:53:28,985 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-10-22 14:53:28,985 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-10-22 14:53:28,985 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-10-22 14:53:28,985 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-10-22 14:53:28,986 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-10-22 14:53:28,986 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-10-22 14:53:28,986 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-10-22 14:53:28,986 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-10-22 14:53:28,986 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-10-22 14:53:28,986 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-10-22 14:53:28,986 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-10-22 14:53:28,986 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-10-22 14:53:28,987 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-10-22 14:53:28,987 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-10-22 14:53:28,987 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-10-22 14:53:28,987 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-10-22 14:53:28,987 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-10-22 14:53:28,987 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-10-22 14:53:28,987 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-10-22 14:53:28,987 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-10-22 14:53:28,988 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-10-22 14:53:28,988 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-10-22 14:53:28,988 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-10-22 14:53:28,988 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-10-22 14:53:28,988 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-10-22 14:53:28,988 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-10-22 14:53:28,988 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-10-22 14:53:28,988 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-10-22 14:53:28,988 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-10-22 14:53:28,988 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-10-22 14:53:28,989 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-10-22 14:53:28,989 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-10-22 14:53:28,989 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-10-22 14:53:28,989 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-10-22 14:53:28,989 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-10-22 14:53:28,989 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-10-22 14:53:28,989 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-10-22 14:53:28,989 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-10-22 14:53:28,989 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-10-22 14:53:28,990 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-10-22 14:53:28,990 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-10-22 14:53:28,990 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-10-22 14:53:28,990 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-10-22 14:53:28,990 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-10-22 14:53:28,990 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-10-22 14:53:28,990 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-10-22 14:53:28,990 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-10-22 14:53:28,990 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-10-22 14:53:28,991 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-10-22 14:53:28,991 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-10-22 14:53:28,991 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-10-22 14:53:28,991 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-10-22 14:53:28,991 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-10-22 14:53:28,991 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-10-22 14:53:28,991 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-10-22 14:53:28,991 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-10-22 14:53:28,991 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-10-22 14:53:28,991 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-10-22 14:53:28,992 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-10-22 14:53:28,992 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-10-22 14:53:28,992 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-10-22 14:53:28,992 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-10-22 14:53:28,992 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-10-22 14:53:28,992 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-10-22 14:53:28,992 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-10-22 14:53:28,992 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-10-22 14:53:28,992 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-10-22 14:53:28,993 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-10-22 14:53:28,993 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-10-22 14:53:28,993 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-10-22 14:53:28,993 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-10-22 14:53:28,993 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-10-22 14:53:28,993 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-10-22 14:53:28,993 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-10-22 14:53:28,993 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-10-22 14:53:28,993 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-10-22 14:53:28,993 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-10-22 14:53:28,994 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-10-22 14:53:28,994 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-10-22 14:53:28,994 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-10-22 14:53:28,994 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-10-22 14:53:28,994 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-10-22 14:53:28,994 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-10-22 14:53:28,994 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-10-22 14:53:28,994 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-10-22 14:53:29,116 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.00767691535093358); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.01151780936896998); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.00767691535093358); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.6666666666666666E-4); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0045); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-10-22 14:53:29,116 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-10-22 14:53:29,117 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=6.439921951790301E-4, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.00767691535093358); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.01151780936896998); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.00767691535093358); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.6666666666666666E-4); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0045); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-10-22 14:53:29,463 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 456 ms to try 5000 different iterations.  Found a solution that moves 271 regions; Going from a computed imbalance of 6.439921951790301E-4 to a new imbalance of 6.647404761130462E-5. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=5.23782800878924E-4); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.002118805753879094); MoveCostFunction : (multiplier=7.0, imbalance=0.030111111111111113, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=5.23782800878924E-4); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=5.833333333333334E-4); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-10-22 14:53:29,464 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1199355664:83 , srv141963941:83 , srv1635537929:83 , srv193129032:83 , srv212470733:83 , srv535199952:83 , srv571317777:83 , srv740837715:83 , srv762933018:83 , srv973037962:83 , srv1063657066:84 , srv1115450090:84 , srv1265456178:84 , srv1360919974:84 , srv1377376959:84 , srv1382838700:84 , srv1501903216:84 , srv1593686568:84 , srv1626465885:84 , srv1663652508:84 , srv1691435979:84 , srv1696677270:84 , srv1700166303:84 , srv1731799296:84 , srv1862902377:84 , srv2050180173:84 , srv2073551813:84 , srv2124406884:84 , srv338090430:84 , srv501973660:84 , srv53760657:84 , srv574164723:84 , srv58916663:84 , srv981616817:84 , srv990718346:84 , srv101661895:85 , srv1058930715:85 , srv1164506511:85 , srv1171936795:85 , srv1178710152:85 , srv1261842137:85 , srv1282577976:85 , srv1321162558:85 , srv1440129881:85 , srv1441496315:85 , srv1442964698:85 , srv1449535268:85 , srv1479034191:85 , srv1512442377:85 , srv1523663516:85 , srv1531243180:85 , srv1635171568:85 , srv1679789896:85 , srv1696973582:85 , srv1705416210:85 , srv1709586844:85 , srv1773776253:85 , srv1841749645:85 , srv1894067517:85 , srv1913056326:85 , srv1919195927:85 , srv1982238523:85 , srv202364810:85 , srv2056559966:85 , srv2132264542:85 , srv2141662313:85 , srv240648254:85 , srv260605937:85 , srv2625216:85 , srv319918667:85 , srv362450353:85 , srv382982137:85 , srv415305245:85 , srv420677124:85 , srv421737515:85 , srv461367939:85 , srv47478160:85 , srv540457022:85 , srv542106973:85 , srv544887906:85 , srv606771690:85 , srv772816239:85 , srv779501869:85 , srv796739696:85 , srv804609928:85 , srv853752658:85 , srv901513397:85 , srv103096586:86 , srv1360723330:86 , srv1416528715:86 , srv1668551435:86 , srv167057005:86 , srv1763385674:86 , srv1839483069:86 , srv1884505226:86 , srv38704623:86 , srv913051578:86 , srv1009731817:87 , srv1962430124:87 , srv351451178:616 }
2023-10-22 14:53:29,467 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-10-22 14:53:29,468 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1199355664=9, srv202364810=56, srv1523663516=27, srv1265456178=11, srv415305245=73, srv1501903216=25, srv1679789896=36, srv319918667=67, srv193129032=53, srv804609928=93, srv2625216=66, srv990718346=99, srv542106973=82, srv540457022=81, srv1063657066=4, srv1282577976=12, srv1668551435=34, srv1773776253=45, srv606771690=87, srv1164506511=6, srv1696677270=38, srv351451178=69, srv2050180173=57, srv1731799296=43, srv1635537929=32, srv2073551813=59, srv1626465885=30, srv901513397=95, srv1171936795=7, srv1512442377=26, srv167057005=35, srv1696973582=39, srv1663652508=33, srv1382838700=17, srv1691435979=37, srv421737515=75, srv1261842137=10, srv461367939=76, srv1058930715=3, srv973037962=97, srv1377376959=16, srv1178710152=8, srv1479034191=24, srv1360919974=15, srv420677124=74, srv1635171568=31, srv141963941=19, srv1862902377=48, srv1416528715=18, srv1449535268=23, srv1440129881=20, srv1442964698=22, srv571317777=84, srv1919195927=52, srv260605937=65, srv1593686568=29, srv1894067517=50, srv740837715=88, srv1009731817=0, srv101661895=1, srv1884505226=49, srv501973660=78, srv240648254=64, srv2132264542=62, srv1115450090=5, srv574164723=85, srv1531243180=28, srv1441496315=21, srv103096586=2, srv772816239=90, srv1709586844=42, srv1700166303=40, srv1982238523=55, srv47478160=77, srv2141662313=63, srv779501869=91, srv1763385674=44, srv382982137=71, srv913051578=96, srv853752658=94, srv1913056326=51, srv338090430=68, srv1962430124=54, srv1839483069=46, srv1360723330=14, srv1841749645=47, srv212470733=61, srv2056559966=58, srv58916663=86, srv535199952=79, srv762933018=89, srv1321162558=13, srv362450353=70, srv544887906=83, srv1705416210=41, srv38704623=72, srv2124406884=60, srv796739696=92, srv53760657=80, srv981616817=98} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-10-22 14:53:29,478 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-10-22 14:53:29,478 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-10-22 14:53:29,478 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-10-22 14:53:29,479 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-10-22 14:53:29,479 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-10-22 14:53:29,479 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-10-22 14:53:29,479 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-10-22 14:53:29,479 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-10-22 14:53:29,479 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-10-22 14:53:29,479 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-10-22 14:53:29,479 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-10-22 14:53:29,479 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-10-22 14:53:29,479 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-10-22 14:53:29,479 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-10-22 14:53:29,479 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-10-22 14:53:29,479 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-10-22 14:53:29,479 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-10-22 14:53:29,479 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-10-22 14:53:29,479 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-10-22 14:53:29,479 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-10-22 14:53:29,479 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-10-22 14:53:29,479 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-10-22 14:53:29,480 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-10-22 14:53:29,480 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-10-22 14:53:29,480 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-10-22 14:53:29,480 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-10-22 14:53:29,480 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-10-22 14:53:29,480 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-10-22 14:53:29,480 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-10-22 14:53:29,480 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-10-22 14:53:29,480 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-10-22 14:53:29,480 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-10-22 14:53:29,480 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-10-22 14:53:29,480 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-10-22 14:53:29,480 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-10-22 14:53:29,480 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-10-22 14:53:29,480 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-10-22 14:53:29,480 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-10-22 14:53:29,480 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-10-22 14:53:29,480 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-10-22 14:53:29,480 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-10-22 14:53:29,480 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-10-22 14:53:29,480 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-10-22 14:53:29,480 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-10-22 14:53:29,481 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-10-22 14:53:29,481 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-10-22 14:53:29,481 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-10-22 14:53:29,481 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-10-22 14:53:29,481 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-10-22 14:53:29,481 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-10-22 14:53:29,481 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-10-22 14:53:29,481 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-10-22 14:53:29,481 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-10-22 14:53:29,481 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-10-22 14:53:29,481 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-10-22 14:53:29,481 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-10-22 14:53:29,481 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-10-22 14:53:29,481 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-10-22 14:53:29,481 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-10-22 14:53:29,481 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-10-22 14:53:29,481 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-10-22 14:53:29,481 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-10-22 14:53:29,481 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-10-22 14:53:29,482 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-10-22 14:53:29,482 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-10-22 14:53:29,482 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-10-22 14:53:29,482 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-10-22 14:53:29,482 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-10-22 14:53:29,482 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-10-22 14:53:29,482 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-10-22 14:53:29,482 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-10-22 14:53:29,482 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-10-22 14:53:29,482 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-10-22 14:53:29,482 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-10-22 14:53:29,482 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-10-22 14:53:29,482 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-10-22 14:53:29,482 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-10-22 14:53:29,482 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-10-22 14:53:29,482 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-10-22 14:53:29,483 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-10-22 14:53:29,483 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-10-22 14:53:29,483 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-10-22 14:53:29,483 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-10-22 14:53:29,483 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-10-22 14:53:29,483 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-10-22 14:53:29,483 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-10-22 14:53:29,483 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-10-22 14:53:29,483 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-10-22 14:53:29,483 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-10-22 14:53:29,483 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-10-22 14:53:29,483 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-10-22 14:53:29,483 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-10-22 14:53:29,483 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-10-22 14:53:29,483 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-10-22 14:53:29,483 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-10-22 14:53:29,483 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-10-22 14:53:29,483 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-10-22 14:53:29,483 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-10-22 14:53:29,483 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-10-22 14:53:29,484 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-10-22 14:53:29,484 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-10-22 14:53:29,600 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=5.23782800878924E-4); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.002118805753879094); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=5.23782800878924E-4); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=5.833333333333334E-4); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-10-22 14:53:29,601 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-10-22 14:53:29,601 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=6.457646505345936E-5, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=5.23782800878924E-4); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.002118805753879094); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=5.23782800878924E-4); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=5.833333333333334E-4); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-10-22 14:53:29,825 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 334 ms to try 5000 different iterations.  Found a solution that moves 37 regions; Going from a computed imbalance of 6.457646505345936E-5 to a new imbalance of 8.518843523409391E-6. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0018349396085439343); MoveCostFunction : (multiplier=7.0, imbalance=0.004111111111111111); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-10-22 14:53:29,826 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1009731817:82 , srv1416528715:83 , srv1635171568:83 , srv167057005:83 , srv1841749645:83 , srv1962430124:83 , srv2124406884:83 , srv382982137:83 , srv913051578:83 , srv101661895:84 , srv103096586:84 , srv1058930715:84 , srv1063657066:84 , srv1164506511:84 , srv1171936795:84 , srv1178710152:84 , srv1261842137:84 , srv1265456178:84 , srv1282577976:84 , srv1321162558:84 , srv1360723330:84 , srv1360919974:84 , srv1377376959:84 , srv1382838700:84 , srv141963941:84 , srv1440129881:84 , srv1441496315:84 , srv1442964698:84 , srv1449535268:84 , srv1479034191:84 , srv1501903216:84 , srv1512442377:84 , srv1523663516:84 , srv1531243180:84 , srv1593686568:84 , srv1626465885:84 , srv1635537929:84 , srv1663652508:84 , srv1668551435:84 , srv1679789896:84 , srv1696677270:84 , srv1696973582:84 , srv1700166303:84 , srv1705416210:84 , srv1709586844:84 , srv1763385674:84 , srv1773776253:84 , srv1839483069:84 , srv1862902377:84 , srv1884505226:84 , srv1894067517:84 , srv1913056326:84 , srv1919195927:84 , srv1982238523:84 , srv202364810:84 , srv2050180173:84 , srv2056559966:84 , srv2073551813:84 , srv2132264542:84 , srv2141662313:84 , srv240648254:84 , srv260605937:84 , srv2625216:84 , srv319918667:84 , srv338090430:84 , srv362450353:84 , srv38704623:84 , srv415305245:84 , srv420677124:84 , srv421737515:84 , srv461367939:84 , srv47478160:84 , srv501973660:84 , srv535199952:84 , srv53760657:84 , srv540457022:84 , srv542106973:84 , srv544887906:84 , srv571317777:84 , srv58916663:84 , srv606771690:84 , srv740837715:84 , srv779501869:84 , srv796739696:84 , srv853752658:84 , srv901513397:84 , srv973037962:84 , srv981616817:84 , srv990718346:84 , srv1115450090:85 , srv1199355664:85 , srv1691435979:85 , srv1731799296:85 , srv193129032:85 , srv212470733:85 , srv574164723:85 , srv762933018:85 , srv772816239:85 , srv804609928:85 , srv351451178:684 }
2023-10-22 14:53:29,829 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-10-22 14:53:29,830 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1199355664=9, srv202364810=56, srv1523663516=27, srv1265456178=11, srv415305245=73, srv1501903216=25, srv1679789896=36, srv319918667=67, srv193129032=53, srv804609928=93, srv2625216=66, srv990718346=99, srv542106973=82, srv540457022=81, srv1063657066=4, srv1282577976=12, srv1668551435=34, srv1773776253=45, srv606771690=87, srv1164506511=6, srv1696677270=38, srv351451178=69, srv2050180173=57, srv1731799296=43, srv1635537929=32, srv2073551813=59, srv1626465885=30, srv901513397=95, srv1171936795=7, srv1512442377=26, srv167057005=35, srv1696973582=39, srv1663652508=33, srv1382838700=17, srv1691435979=37, srv421737515=75, srv1261842137=10, srv461367939=76, srv1058930715=3, srv973037962=97, srv1377376959=16, srv1178710152=8, srv1479034191=24, srv1360919974=15, srv420677124=74, srv1635171568=31, srv141963941=19, srv1862902377=48, srv1416528715=18, srv1449535268=23, srv1440129881=20, srv1442964698=22, srv571317777=84, srv1919195927=52, srv260605937=65, srv1593686568=29, srv1894067517=50, srv740837715=88, srv1009731817=0, srv101661895=1, srv1884505226=49, srv501973660=78, srv240648254=64, srv2132264542=62, srv1115450090=5, srv574164723=85, srv1531243180=28, srv1441496315=21, srv103096586=2, srv772816239=90, srv1709586844=42, srv1700166303=40, srv1982238523=55, srv47478160=77, srv2141662313=63, srv779501869=91, srv1763385674=44, srv382982137=71, srv913051578=96, srv853752658=94, srv1913056326=51, srv338090430=68, srv1962430124=54, srv1839483069=46, srv1360723330=14, srv1841749645=47, srv212470733=61, srv2056559966=58, srv58916663=86, srv535199952=79, srv762933018=89, srv1321162558=13, srv362450353=70, srv544887906=83, srv1705416210=41, srv38704623=72, srv2124406884=60, srv796739696=92, srv53760657=80, srv981616817=98} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-10-22 14:53:29,842 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-10-22 14:53:29,842 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-10-22 14:53:29,842 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-10-22 14:53:29,842 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-10-22 14:53:29,842 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-10-22 14:53:29,843 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-10-22 14:53:29,843 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-10-22 14:53:29,843 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-10-22 14:53:29,843 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-10-22 14:53:29,843 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-10-22 14:53:29,843 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-10-22 14:53:29,843 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-10-22 14:53:29,843 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-10-22 14:53:29,843 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-10-22 14:53:29,843 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-10-22 14:53:29,843 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-10-22 14:53:29,843 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-10-22 14:53:29,844 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-10-22 14:53:29,844 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-10-22 14:53:29,844 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-10-22 14:53:29,844 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-10-22 14:53:29,844 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-10-22 14:53:29,844 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-10-22 14:53:29,844 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-10-22 14:53:29,844 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-10-22 14:53:29,844 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-10-22 14:53:29,844 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-10-22 14:53:29,844 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-10-22 14:53:29,844 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-10-22 14:53:29,845 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-10-22 14:53:29,845 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-10-22 14:53:29,845 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-10-22 14:53:29,845 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-10-22 14:53:29,845 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-10-22 14:53:29,845 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-10-22 14:53:29,845 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-10-22 14:53:29,845 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-10-22 14:53:29,845 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-10-22 14:53:29,845 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-10-22 14:53:29,845 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-10-22 14:53:29,846 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-10-22 14:53:29,846 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-10-22 14:53:29,846 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-10-22 14:53:29,846 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-10-22 14:53:29,846 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-10-22 14:53:29,846 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-10-22 14:53:29,846 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-10-22 14:53:29,846 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-10-22 14:53:29,846 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-10-22 14:53:29,846 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-10-22 14:53:29,846 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-10-22 14:53:29,847 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-10-22 14:53:29,847 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-10-22 14:53:29,847 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-10-22 14:53:29,847 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-10-22 14:53:29,847 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-10-22 14:53:29,847 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-10-22 14:53:29,847 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-10-22 14:53:29,847 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-10-22 14:53:29,847 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-10-22 14:53:29,847 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-10-22 14:53:29,847 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-10-22 14:53:29,847 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-10-22 14:53:29,847 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-10-22 14:53:29,848 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-10-22 14:53:29,848 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-10-22 14:53:29,848 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-10-22 14:53:29,848 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-10-22 14:53:29,848 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-10-22 14:53:29,848 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-10-22 14:53:29,848 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-10-22 14:53:29,848 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-10-22 14:53:29,848 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-10-22 14:53:29,848 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-10-22 14:53:29,848 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-10-22 14:53:29,848 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-10-22 14:53:29,849 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-10-22 14:53:29,849 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-10-22 14:53:29,849 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-10-22 14:53:29,849 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-10-22 14:53:29,849 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-10-22 14:53:29,849 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-10-22 14:53:29,849 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-10-22 14:53:29,849 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-10-22 14:53:29,849 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-10-22 14:53:29,849 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-10-22 14:53:29,849 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-10-22 14:53:29,849 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-10-22 14:53:29,850 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-10-22 14:53:29,850 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-10-22 14:53:29,850 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-10-22 14:53:29,850 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-10-22 14:53:29,850 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-10-22 14:53:29,850 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-10-22 14:53:29,850 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-10-22 14:53:29,850 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-10-22 14:53:29,850 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-10-22 14:53:29,850 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-10-22 14:53:29,851 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-10-22 14:53:29,851 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-10-22 14:53:29,851 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-10-22 14:53:30,000 INFO  [Time-limited test] balancer.StochasticLoadBalancer(381): Cluster wide - skipping load balancing because weighted average imbalance=8.259763985991403E-6 <= threshold(0.025). If you want more aggressive balancing, either lower hbase.master.balancer.stochastic.minCostNeedBalance from 0.025 or increase the relative multiplier(s) of the specific cost function(s). functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0018349396085439343); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-10-22 14:53:30,000 INFO  [Time-limited test] balancer.BalancerTestBase(570): Mock Final balance: { srv1009731817:82 , srv1416528715:83 , srv1635171568:83 , srv167057005:83 , srv1841749645:83 , srv1962430124:83 , srv2124406884:83 , srv382982137:83 , srv913051578:83 , srv101661895:84 , srv103096586:84 , srv1058930715:84 , srv1063657066:84 , srv1164506511:84 , srv1171936795:84 , srv1178710152:84 , srv1261842137:84 , srv1265456178:84 , srv1282577976:84 , srv1321162558:84 , srv1360723330:84 , srv1360919974:84 , srv1377376959:84 , srv1382838700:84 , srv141963941:84 , srv1440129881:84 , srv1441496315:84 , srv1442964698:84 , srv1449535268:84 , srv1479034191:84 , srv1501903216:84 , srv1512442377:84 , srv1523663516:84 , srv1531243180:84 , srv1593686568:84 , srv1626465885:84 , srv1635537929:84 , srv1663652508:84 , srv1668551435:84 , srv1679789896:84 , srv1696677270:84 , srv1696973582:84 , srv1700166303:84 , srv1705416210:84 , srv1709586844:84 , srv1763385674:84 , srv1773776253:84 , srv1839483069:84 , srv1862902377:84 , srv1884505226:84 , srv1894067517:84 , srv1913056326:84 , srv1919195927:84 , srv1982238523:84 , srv202364810:84 , srv2050180173:84 , srv2056559966:84 , srv2073551813:84 , srv2132264542:84 , srv2141662313:84 , srv240648254:84 , srv260605937:84 , srv2625216:84 , srv319918667:84 , srv338090430:84 , srv362450353:84 , srv38704623:84 , srv415305245:84 , srv420677124:84 , srv421737515:84 , srv461367939:84 , srv47478160:84 , srv501973660:84 , srv535199952:84 , srv53760657:84 , srv540457022:84 , srv542106973:84 , srv544887906:84 , srv571317777:84 , srv58916663:84 , srv606771690:84 , srv740837715:84 , srv779501869:84 , srv796739696:84 , srv853752658:84 , srv901513397:84 , srv973037962:84 , srv981616817:84 , srv990718346:84 , srv1115450090:85 , srv1199355664:85 , srv1691435979:85 , srv1731799296:85 , srv193129032:85 , srv212470733:85 , srv574164723:85 , srv762933018:85 , srv772816239:85 , srv804609928:85 , srv351451178:684 }
2023-10-22 14:53:30,034 INFO  [Time-limited test] hbase.ResourceChecker(175): after: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnLargeClusterWithRacks Thread=12 (was 12), OpenFileDescriptor=263 (was 263), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=364 (was 364), ProcessCount=173 (was 173), AvailableMemoryMB=8049 (was 8558)
2023-10-22 14:53:30,045 INFO  [Time-limited test] hbase.ResourceChecker(147): before: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnMidClusterWithRacks Thread=12, OpenFileDescriptor=263, MaxFileDescriptor=60000, SystemLoadAverage=364, ProcessCount=173, AvailableMemoryMB=8047
2023-10-22 14:53:30,046 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2023-10-22 14:53:30,046 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=5000, runMaxSteps=true, stepsPerRegion=800, maxRunningTime=120000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 111077.0 etc.
2023-10-22 14:53:30,061 INFO  [Time-limited test] balancer.BalancerTestBase(547): Mock Cluster : { srv1018653604:84 , srv1041498354:84 , srv109522771:84 , srv1139085355:84 , srv1149627627:84 , srv1166837599:84 , srv1311718489:84 , srv1376468824:84 , srv1441392077:84 , srv1585724046:84 , srv1586742130:84 , srv1738271340:84 , srv1739672034:84 , srv1797928111:84 , srv1803156371:84 , srv1823229418:84 , srv1911339071:84 , srv198287066:84 , srv2032596025:84 , srv231097198:84 , srv255191776:84 , srv284071440:84 , srv342807291:84 , srv40148519:84 , srv406475608:84 , srv485960151:84 , srv627295916:84 , srv647350840:84 , srv815740014:84 , srv72492854:264 } [srvr=30 rgns=2700 avg=90.0 max=90 min=90]
2023-10-22 14:53:30,063 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-10-22 14:53:30,063 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1166837599=5, srv198287066=17, srv109522771=2, srv40148519=23, srv406475608=24, srv1018653604=0, srv1585724046=9, srv815740014=29, srv1823229418=15, srv231097198=19, srv284071440=21, srv255191776=20, srv1911339071=16, srv627295916=26, srv647350840=27, srv1739672034=12, srv342807291=22, srv1738271340=11, srv1586742130=10, srv1376468824=7, srv1797928111=13, srv485960151=25, srv1311718489=6, srv1149627627=4, srv72492854=28, srv2032596025=18, srv1139085355=3, srv1441392077=8, srv1803156371=14, srv1041498354=1} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-10-22 14:53:30,077 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-10-22 14:53:30,077 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-10-22 14:53:30,077 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-10-22 14:53:30,077 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-10-22 14:53:30,077 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-10-22 14:53:30,077 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-10-22 14:53:30,077 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-10-22 14:53:30,077 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-10-22 14:53:30,077 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-10-22 14:53:30,078 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-10-22 14:53:30,078 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-10-22 14:53:30,078 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-10-22 14:53:30,078 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-10-22 14:53:30,078 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-10-22 14:53:30,078 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-10-22 14:53:30,078 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-10-22 14:53:30,078 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-10-22 14:53:30,078 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-10-22 14:53:30,078 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-10-22 14:53:30,078 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-10-22 14:53:30,078 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-10-22 14:53:30,078 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-10-22 14:53:30,078 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-10-22 14:53:30,079 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-10-22 14:53:30,079 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-10-22 14:53:30,079 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-10-22 14:53:30,079 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-10-22 14:53:30,079 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-10-22 14:53:30,079 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-10-22 14:53:30,079 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-10-22 14:53:30,079 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=10, number of hosts=30, number of racks=4
2023-10-22 14:53:30,104 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=1.1077936994928448, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-10-22 14:53:30,104 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.9912532697691594, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=1.1077936994928448, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=64800000
2023-10-22 14:55:30,083 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 120001 ms to try 6238944 different iterations.  Found a solution that moves 1847 regions; Going from a computed imbalance of 0.9912532697691594 to a new imbalance of 4.3109901406398434E-5. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); MoveCostFunction : (multiplier=7.0, imbalance=0.6840740740740741, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-10-22 14:55:30,090 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1018653604:90 , srv1041498354:90 , srv109522771:90 , srv1139085355:90 , srv1149627627:90 , srv1166837599:90 , srv1311718489:90 , srv1376468824:90 , srv1441392077:90 , srv1585724046:90 , srv1586742130:90 , srv1738271340:90 , srv1739672034:90 , srv1797928111:90 , srv1803156371:90 , srv1823229418:90 , srv1911339071:90 , srv198287066:90 , srv2032596025:90 , srv231097198:90 , srv255191776:90 , srv284071440:90 , srv342807291:90 , srv40148519:90 , srv406475608:90 , srv485960151:90 , srv627295916:90 , srv647350840:90 , srv72492854:90 , srv815740014:90 }
2023-10-22 14:55:30,091 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-10-22 14:55:30,092 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1166837599=5, srv198287066=17, srv109522771=2, srv40148519=23, srv406475608=24, srv1018653604=0, srv1585724046=9, srv815740014=29, srv1823229418=15, srv231097198=19, srv284071440=21, srv255191776=20, srv1911339071=16, srv627295916=26, srv647350840=27, srv1739672034=12, srv342807291=22, srv1738271340=11, srv1586742130=10, srv1376468824=7, srv1797928111=13, srv485960151=25, srv1311718489=6, srv1149627627=4, srv72492854=28, srv2032596025=18, srv1139085355=3, srv1441392077=8, srv1803156371=14, srv1041498354=1} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-10-22 14:55:30,096 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-10-22 14:55:30,096 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-10-22 14:55:30,096 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-10-22 14:55:30,096 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-10-22 14:55:30,096 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-10-22 14:55:30,096 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-10-22 14:55:30,096 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-10-22 14:55:30,096 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-10-22 14:55:30,096 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-10-22 14:55:30,096 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-10-22 14:55:30,096 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-10-22 14:55:30,096 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-10-22 14:55:30,096 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-10-22 14:55:30,097 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-10-22 14:55:30,097 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-10-22 14:55:30,097 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-10-22 14:55:30,097 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-10-22 14:55:30,097 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-10-22 14:55:30,097 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-10-22 14:55:30,097 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-10-22 14:55:30,097 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-10-22 14:55:30,097 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-10-22 14:55:30,097 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-10-22 14:55:30,097 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-10-22 14:55:30,097 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-10-22 14:55:30,097 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-10-22 14:55:30,097 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-10-22 14:55:30,097 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-10-22 14:55:30,097 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-10-22 14:55:30,097 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-10-22 14:55:30,097 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=10, number of hosts=30, number of racks=4
2023-10-22 14:55:30,109 INFO  [Time-limited test] balancer.StochasticLoadBalancer(381): Cluster wide - skipping load balancing because weighted average imbalance=0.0 <= threshold(0.025). If you want more aggressive balancing, either lower hbase.master.balancer.stochastic.minCostNeedBalance from 0.025 or increase the relative multiplier(s) of the specific cost function(s). functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-10-22 14:55:30,109 INFO  [Time-limited test] balancer.BalancerTestBase(570): Mock Final balance: { srv1018653604:90 , srv1041498354:90 , srv109522771:90 , srv1139085355:90 , srv1149627627:90 , srv1166837599:90 , srv1311718489:90 , srv1376468824:90 , srv1441392077:90 , srv1585724046:90 , srv1586742130:90 , srv1738271340:90 , srv1739672034:90 , srv1797928111:90 , srv1803156371:90 , srv1823229418:90 , srv1911339071:90 , srv198287066:90 , srv2032596025:90 , srv231097198:90 , srv255191776:90 , srv284071440:90 , srv342807291:90 , srv40148519:90 , srv406475608:90 , srv485960151:90 , srv627295916:90 , srv647350840:90 , srv72492854:90 , srv815740014:90 }
2023-10-22 14:55:30,123 INFO  [Time-limited test] hbase.ResourceChecker(175): after: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnMidClusterWithRacks Thread=11 (was 12), OpenFileDescriptor=263 (was 263), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=248 (was 364), ProcessCount=168 (was 173), AvailableMemoryMB=8048 (was 8047) - AvailableMemoryMB LEAK? -