2024-04-01 07:53:13,452 INFO  [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks timeout: 13 mins
2024-04-01 07:53:13,796 WARN  [Time-limited test] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties
2024-04-01 07:53:13,910 INFO  [Time-limited test] metrics.MetricRegistriesLoader(60): Loaded MetricRegistries class org.apache.hadoop.hbase.metrics.impl.MetricRegistriesImpl
2024-04-01 07:53:13,979 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2024-04-01 07:53:13,986 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc.
2024-04-01 07:53:14,001 INFO  [Time-limited test] hbase.ResourceChecker(147): before: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnLargeClusterWithRacks Thread=12, OpenFileDescriptor=290, MaxFileDescriptor=60000, SystemLoadAverage=330, ProcessCount=169, AvailableMemoryMB=8259
2024-04-01 07:53:14,004 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2024-04-01 07:53:14,004 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=5000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=10000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc.
2024-04-01 07:53:14,132 INFO  [Time-limited test] balancer.BalancerTestBase(547): Mock Cluster : { srv1003160358:84 , srv1109243813:84 , srv1151885864:84 , srv115193847:84 , srv119461958:84 , srv1206933324:84 , srv1211867847:84 , srv1237066013:84 , srv124841836:84 , srv1268308985:84 , srv1284627830:84 , srv1330511257:84 , srv133445875:84 , srv1336147772:84 , srv1355801721:84 , srv1360680365:84 , srv1363307815:84 , srv1366210114:84 , srv1368928253:84 , srv1376208844:84 , srv1404716267:84 , srv1409566408:84 , srv1453762042:84 , srv147669629:84 , srv1508580954:84 , srv1521378582:84 , srv152538364:84 , srv1529494585:84 , srv157583311:84 , srv1585977924:84 , srv1599609863:84 , srv1643962068:84 , srv1644269060:84 , srv1663246995:84 , srv1682485681:84 , srv1697319172:84 , srv1731627487:84 , srv1756521510:84 , srv1778777639:84 , srv1788895972:84 , srv179501069:84 , srv180767481:84 , srv1840658200:84 , srv1848590691:84 , srv1891901729:84 , srv1937581465:84 , srv1959328345:84 , srv1990379430:84 , srv1990753164:84 , srv1996998963:84 , srv1997556087:84 , srv2006482772:84 , srv200732486:84 , srv2015411264:84 , srv2108157742:84 , srv2117505202:84 , srv221416269:84 , srv228950473:84 , srv266429354:84 , srv289188698:84 , srv295995613:84 , srv314276724:84 , srv317360873:84 , srv341647203:84 , srv351468988:84 , srv365062234:84 , srv372114066:84 , srv393657689:84 , srv42201616:84 , srv441076511:84 , srv451941268:84 , srv46550045:84 , srv524586888:84 , srv527823587:84 , srv527842559:84 , srv530027776:84 , srv605410659:84 , srv652681216:84 , srv661694786:84 , srv66465354:84 , srv703499381:84 , srv75135808:84 , srv759487540:84 , srv803136961:84 , srv809613817:84 , srv83938446:84 , srv860532336:84 , srv866122990:84 , srv874579110:84 , srv877324880:84 , srv880601744:84 , srv880895722:84 , srv884654194:84 , srv891272957:84 , srv894194359:84 , srv912036289:84 , srv913386536:84 , srv935908246:84 , srv97346310:84 , srv425990530:684 } [srvr=100 rgns=9000 avg=90.0 max=90 min=90]
2024-04-01 07:53:14,140 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2024-04-01 07:53:14,146 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1211867847=6, srv365062234=65, srv83938446=86, srv1237066013=7, srv1697319172=35, srv1756521510=37, srv2117505202=55, srv530027776=76, srv152538364=26, srv1848590691=43, srv2108157742=54, srv266429354=58, srv652681216=78, srv884654194=93, srv809613817=85, srv2006482772=51, srv1508580954=24, srv860532336=87, srv66465354=80, srv703499381=81, srv874579110=89, srv115193847=3, srv891272957=94, srv880601744=91, srv1778777639=38, srv1663246995=33, srv1330511257=11, srv317360873=62, srv1368928253=18, srv147669629=23, srv1268308985=9, srv1404716267=20, srv524586888=73, srv119461958=4, srv880895722=92, srv1206933324=5, srv1360680365=15, srv393657689=67, srv527842559=75, srv351468988=64, srv912036289=96, srv1409566408=21, srv1151885864=2, srv1109243813=1, srv1891901729=44, srv1990753164=48, srv1997556087=50, srv1355801721=14, srv877324880=90, srv1529494585=27, srv1990379430=47, srv1643962068=31, srv124841836=8, srv661694786=79, srv97346310=99, srv1366210114=17, srv1731627487=36, srv42201616=68, srv289188698=59, srv157583311=28, srv1937581465=45, srv46550045=72, srv1376208844=19, srv1521378582=25, srv228950473=57, srv1003160358=0, srv1453762042=22, srv894194359=95, srv1585977924=29, srv1599609863=30, srv1682485681=34, srv200732486=52, srv133445875=12, srv1996998963=49, srv451941268=71, srv441076511=70, srv341647203=63, srv1336147772=13, srv1363307815=16, srv179501069=40, srv1788895972=39, srv935908246=98, srv803136961=84, srv1284627830=10, srv866122990=88, srv605410659=77, srv759487540=83, srv913386536=97, srv221416269=56, srv1840658200=42, srv75135808=82, srv425990530=69, srv2015411264=53, srv1959328345=46, srv295995613=60, srv372114066=66, srv180767481=41, srv1644269060=32, srv314276724=61, srv527823587=74} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2024-04-01 07:53:14,236 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2024-04-01 07:53:14,236 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2024-04-01 07:53:14,237 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2024-04-01 07:53:14,237 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2024-04-01 07:53:14,237 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2024-04-01 07:53:14,237 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2024-04-01 07:53:14,237 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2024-04-01 07:53:14,237 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2024-04-01 07:53:14,238 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2024-04-01 07:53:14,238 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2024-04-01 07:53:14,238 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2024-04-01 07:53:14,238 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2024-04-01 07:53:14,238 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2024-04-01 07:53:14,238 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2024-04-01 07:53:14,239 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2024-04-01 07:53:14,239 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2024-04-01 07:53:14,239 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2024-04-01 07:53:14,239 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2024-04-01 07:53:14,239 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2024-04-01 07:53:14,239 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2024-04-01 07:53:14,240 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2024-04-01 07:53:14,240 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2024-04-01 07:53:14,240 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2024-04-01 07:53:14,240 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2024-04-01 07:53:14,240 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2024-04-01 07:53:14,240 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2024-04-01 07:53:14,240 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2024-04-01 07:53:14,241 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2024-04-01 07:53:14,241 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2024-04-01 07:53:14,241 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2024-04-01 07:53:14,241 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2024-04-01 07:53:14,241 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2024-04-01 07:53:14,241 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2024-04-01 07:53:14,242 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2024-04-01 07:53:14,242 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2024-04-01 07:53:14,242 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2024-04-01 07:53:14,242 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2024-04-01 07:53:14,242 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2024-04-01 07:53:14,242 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2024-04-01 07:53:14,243 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2024-04-01 07:53:14,243 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2024-04-01 07:53:14,243 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2024-04-01 07:53:14,243 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2024-04-01 07:53:14,243 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2024-04-01 07:53:14,243 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2024-04-01 07:53:14,243 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2024-04-01 07:53:14,244 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2024-04-01 07:53:14,244 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2024-04-01 07:53:14,244 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2024-04-01 07:53:14,244 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2024-04-01 07:53:14,244 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2024-04-01 07:53:14,244 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2024-04-01 07:53:14,245 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2024-04-01 07:53:14,245 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2024-04-01 07:53:14,245 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2024-04-01 07:53:14,245 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2024-04-01 07:53:14,245 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2024-04-01 07:53:14,245 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2024-04-01 07:53:14,246 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2024-04-01 07:53:14,246 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2024-04-01 07:53:14,246 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2024-04-01 07:53:14,246 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2024-04-01 07:53:14,246 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2024-04-01 07:53:14,246 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2024-04-01 07:53:14,246 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2024-04-01 07:53:14,247 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2024-04-01 07:53:14,247 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2024-04-01 07:53:14,247 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2024-04-01 07:53:14,247 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2024-04-01 07:53:14,247 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2024-04-01 07:53:14,247 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2024-04-01 07:53:14,247 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2024-04-01 07:53:14,248 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2024-04-01 07:53:14,248 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2024-04-01 07:53:14,248 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2024-04-01 07:53:14,248 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2024-04-01 07:53:14,248 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2024-04-01 07:53:14,248 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2024-04-01 07:53:14,248 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2024-04-01 07:53:14,249 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2024-04-01 07:53:14,249 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2024-04-01 07:53:14,249 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2024-04-01 07:53:14,249 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2024-04-01 07:53:14,249 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2024-04-01 07:53:14,249 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2024-04-01 07:53:14,249 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2024-04-01 07:53:14,250 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2024-04-01 07:53:14,250 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2024-04-01 07:53:14,250 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2024-04-01 07:53:14,250 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2024-04-01 07:53:14,250 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2024-04-01 07:53:14,250 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2024-04-01 07:53:14,250 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2024-04-01 07:53:14,250 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2024-04-01 07:53:14,251 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2024-04-01 07:53:14,251 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2024-04-01 07:53:14,251 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2024-04-01 07:53:14,251 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2024-04-01 07:53:14,251 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2024-04-01 07:53:14,251 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2024-04-01 07:53:14,252 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2024-04-01 07:53:14,624 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.06666666666666667, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2024-04-01 07:53:14,625 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2024-04-01 07:53:14,625 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.9909252140407105, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.06666666666666667, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2024-04-01 07:53:15,079 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 795 ms to try 5000 different iterations.  Found a solution that moves 4680 regions; Going from a computed imbalance of 0.9909252140407105 to a new imbalance of 0.1832304917735191. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.03938927711338647, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.055960142943029235, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.52, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.03938927711338647, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.17883333333333334, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.24166666666666667, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2024-04-01 07:53:15,095 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1644269060:81 , srv1643962068:82 , srv880601744:82 , srv1003160358:83 , srv1404716267:83 , srv891272957:83 , srv912036289:83 , srv1151885864:84 , srv1206933324:84 , srv1336147772:84 , srv1368928253:84 , srv1409566408:84 , srv152538364:84 , srv1529494585:84 , srv157583311:84 , srv1599609863:84 , srv1778777639:84 , srv1848590691:84 , srv1997556087:84 , srv393657689:84 , srv66465354:84 , srv75135808:84 , srv809613817:84 , srv1284627830:85 , srv1682485681:85 , srv1697319172:85 , srv1731627487:85 , srv1990753164:85 , srv1996998963:85 , srv295995613:85 , srv341647203:85 , srv351468988:85 , srv42201616:85 , srv441076511:85 , srv524586888:85 , srv605410659:85 , srv803136961:85 , srv877324880:85 , srv97346310:85 , srv119461958:86 , srv124841836:86 , srv133445875:86 , srv1360680365:86 , srv1363307815:86 , srv1521378582:86 , srv179501069:86 , srv1990379430:86 , srv200732486:86 , srv266429354:86 , srv317360873:86 , srv46550045:86 , srv530027776:86 , srv83938446:86 , srv880895722:86 , srv913386536:86 , srv935908246:86 , srv115193847:87 , srv1376208844:87 , srv1453762042:87 , srv1508580954:87 , srv1663246995:87 , srv1891901729:87 , srv2015411264:87 , srv2108157742:87 , srv221416269:87 , srv228950473:87 , srv289188698:87 , srv365062234:87 , srv652681216:87 , srv661694786:87 , srv703499381:87 , srv759487540:87 , srv1211867847:88 , srv1355801721:88 , srv147669629:88 , srv1585977924:88 , srv1840658200:88 , srv314276724:88 , srv372114066:88 , srv451941268:88 , srv860532336:88 , srv894194359:88 , srv1268308985:89 , srv180767481:89 , srv2006482772:89 , srv527842559:89 , srv1237066013:90 , srv1788895972:90 , srv1937581465:90 , srv1959328345:90 , srv2117505202:90 , srv874579110:90 , srv1109243813:91 , srv866122990:91 , srv1330511257:92 , srv1756521510:92 , srv527823587:92 , srv884654194:95 , srv1366210114:96 , srv425990530:440 }
2024-04-01 07:53:15,101 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2024-04-01 07:53:15,103 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1211867847=6, srv365062234=65, srv83938446=86, srv1237066013=7, srv1697319172=35, srv1756521510=37, srv2117505202=55, srv530027776=76, srv152538364=26, srv1848590691=43, srv2108157742=54, srv266429354=58, srv652681216=78, srv884654194=93, srv809613817=85, srv2006482772=51, srv1508580954=24, srv860532336=87, srv66465354=80, srv703499381=81, srv874579110=89, srv115193847=3, srv891272957=94, srv880601744=91, srv1778777639=38, srv1663246995=33, srv1330511257=11, srv317360873=62, srv1368928253=18, srv147669629=23, srv1268308985=9, srv1404716267=20, srv524586888=73, srv119461958=4, srv880895722=92, srv1206933324=5, srv1360680365=15, srv393657689=67, srv527842559=75, srv351468988=64, srv912036289=96, srv1409566408=21, srv1151885864=2, srv1109243813=1, srv1891901729=44, srv1990753164=48, srv1997556087=50, srv1355801721=14, srv877324880=90, srv1529494585=27, srv1990379430=47, srv1643962068=31, srv124841836=8, srv661694786=79, srv97346310=99, srv1366210114=17, srv1731627487=36, srv42201616=68, srv289188698=59, srv157583311=28, srv1937581465=45, srv46550045=72, srv1376208844=19, srv1521378582=25, srv228950473=57, srv1003160358=0, srv1453762042=22, srv894194359=95, srv1585977924=29, srv1599609863=30, srv1682485681=34, srv200732486=52, srv133445875=12, srv1996998963=49, srv451941268=71, srv441076511=70, srv341647203=63, srv1336147772=13, srv1363307815=16, srv179501069=40, srv1788895972=39, srv935908246=98, srv803136961=84, srv1284627830=10, srv866122990=88, srv605410659=77, srv759487540=83, srv913386536=97, srv221416269=56, srv1840658200=42, srv75135808=82, srv425990530=69, srv2015411264=53, srv1959328345=46, srv295995613=60, srv372114066=66, srv180767481=41, srv1644269060=32, srv314276724=61, srv527823587=74} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2024-04-01 07:53:15,123 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2024-04-01 07:53:15,124 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2024-04-01 07:53:15,124 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2024-04-01 07:53:15,124 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2024-04-01 07:53:15,124 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2024-04-01 07:53:15,124 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2024-04-01 07:53:15,125 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2024-04-01 07:53:15,125 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2024-04-01 07:53:15,125 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2024-04-01 07:53:15,125 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2024-04-01 07:53:15,125 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2024-04-01 07:53:15,125 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2024-04-01 07:53:15,125 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2024-04-01 07:53:15,126 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2024-04-01 07:53:15,126 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2024-04-01 07:53:15,126 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2024-04-01 07:53:15,126 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2024-04-01 07:53:15,126 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2024-04-01 07:53:15,126 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2024-04-01 07:53:15,126 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2024-04-01 07:53:15,126 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2024-04-01 07:53:15,126 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2024-04-01 07:53:15,127 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2024-04-01 07:53:15,127 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2024-04-01 07:53:15,127 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2024-04-01 07:53:15,127 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2024-04-01 07:53:15,127 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2024-04-01 07:53:15,127 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2024-04-01 07:53:15,127 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2024-04-01 07:53:15,127 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2024-04-01 07:53:15,128 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2024-04-01 07:53:15,128 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2024-04-01 07:53:15,128 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2024-04-01 07:53:15,128 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2024-04-01 07:53:15,128 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2024-04-01 07:53:15,128 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2024-04-01 07:53:15,128 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2024-04-01 07:53:15,128 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2024-04-01 07:53:15,128 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2024-04-01 07:53:15,129 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2024-04-01 07:53:15,129 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2024-04-01 07:53:15,129 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2024-04-01 07:53:15,129 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2024-04-01 07:53:15,129 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2024-04-01 07:53:15,129 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2024-04-01 07:53:15,129 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2024-04-01 07:53:15,129 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2024-04-01 07:53:15,129 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2024-04-01 07:53:15,130 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2024-04-01 07:53:15,130 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2024-04-01 07:53:15,130 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2024-04-01 07:53:15,130 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2024-04-01 07:53:15,130 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2024-04-01 07:53:15,130 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2024-04-01 07:53:15,130 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2024-04-01 07:53:15,131 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2024-04-01 07:53:15,131 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2024-04-01 07:53:15,131 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2024-04-01 07:53:15,131 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2024-04-01 07:53:15,131 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2024-04-01 07:53:15,131 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2024-04-01 07:53:15,131 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2024-04-01 07:53:15,131 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2024-04-01 07:53:15,132 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2024-04-01 07:53:15,132 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2024-04-01 07:53:15,132 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2024-04-01 07:53:15,132 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2024-04-01 07:53:15,132 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2024-04-01 07:53:15,132 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2024-04-01 07:53:15,132 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2024-04-01 07:53:15,132 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2024-04-01 07:53:15,132 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2024-04-01 07:53:15,133 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2024-04-01 07:53:15,133 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2024-04-01 07:53:15,133 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2024-04-01 07:53:15,133 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2024-04-01 07:53:15,133 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2024-04-01 07:53:15,133 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2024-04-01 07:53:15,133 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2024-04-01 07:53:15,133 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2024-04-01 07:53:15,134 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2024-04-01 07:53:15,134 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2024-04-01 07:53:15,134 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2024-04-01 07:53:15,134 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2024-04-01 07:53:15,134 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2024-04-01 07:53:15,134 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2024-04-01 07:53:15,134 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2024-04-01 07:53:15,134 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2024-04-01 07:53:15,134 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2024-04-01 07:53:15,134 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2024-04-01 07:53:15,135 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2024-04-01 07:53:15,135 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2024-04-01 07:53:15,135 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2024-04-01 07:53:15,135 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2024-04-01 07:53:15,135 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2024-04-01 07:53:15,135 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2024-04-01 07:53:15,135 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2024-04-01 07:53:15,135 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2024-04-01 07:53:15,135 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2024-04-01 07:53:15,136 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2024-04-01 07:53:15,136 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2024-04-01 07:53:15,314 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.03938927711338647, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.055960142943029235, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.03938927711338647, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.17883333333333334, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.24166666666666667, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2024-04-01 07:53:15,315 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2024-04-01 07:53:15,315 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.18319772171311055, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.03938927711338647, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.055960142943029235, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.03938927711338647, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.17883333333333334, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.24166666666666667, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2024-04-01 07:53:15,631 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 465 ms to try 5000 different iterations.  Found a solution that moves 2590 regions; Going from a computed imbalance of 0.18319772171311055 to a new imbalance of 0.015603640205322308. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.020141041527431045); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.032497949516598575, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.2877777777777778, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.020141041527431045); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.012833333333333334); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.042083333333333334, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2024-04-01 07:53:15,645 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1366210114:75 , srv527823587:78 , srv884654194:78 , srv1237066013:80 , srv1756521510:80 , srv1109243813:81 , srv1268308985:81 , srv1330511257:81 , srv866122990:81 , srv894194359:81 , srv1937581465:82 , srv2006482772:82 , srv2117505202:82 , srv451941268:82 , srv1788895972:83 , srv180767481:83 , srv372114066:83 , srv874579110:83 , srv1355801721:84 , srv1508580954:84 , srv1959328345:84 , srv221416269:84 , srv266429354:84 , srv527842559:84 , srv530027776:84 , srv661694786:84 , srv1211867847:85 , srv1363307815:85 , srv1453762042:85 , srv147669629:85 , srv1585977924:85 , srv1682485681:85 , srv1731627487:85 , srv179501069:85 , srv1840658200:85 , srv289188698:85 , srv314276724:85 , srv317360873:85 , srv365062234:85 , srv46550045:85 , srv703499381:85 , srv860532336:85 , srv880895722:85 , srv1151885864:86 , srv133445875:86 , srv1336147772:86 , srv1521378582:86 , srv1990753164:86 , srv1996998963:86 , srv200732486:86 , srv2015411264:86 , srv2108157742:86 , srv228950473:86 , srv42201616:86 , srv524586888:86 , srv605410659:86 , srv652681216:86 , srv759487540:86 , srv83938446:86 , srv115193847:87 , srv119461958:87 , srv1206933324:87 , srv124841836:87 , srv1284627830:87 , srv1663246995:87 , srv1891901729:87 , srv341647203:87 , srv877324880:87 , srv913386536:87 , srv1360680365:88 , srv1376208844:88 , srv1404716267:88 , srv1409566408:88 , srv152538364:88 , srv1529494585:88 , srv157583311:88 , srv1778777639:88 , srv1848590691:88 , srv351468988:88 , srv66465354:88 , srv803136961:88 , srv935908246:88 , srv97346310:88 , srv1599609863:89 , srv1990379430:89 , srv1997556087:89 , srv295995613:89 , srv393657689:89 , srv441076511:89 , srv809613817:89 , srv1003160358:90 , srv1368928253:90 , srv1643962068:90 , srv1697319172:90 , srv75135808:90 , srv880601744:90 , srv1644269060:91 , srv891272957:91 , srv912036289:91 , srv425990530:513 }
2024-04-01 07:53:15,649 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2024-04-01 07:53:15,650 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1211867847=6, srv365062234=65, srv83938446=86, srv1237066013=7, srv1697319172=35, srv1756521510=37, srv2117505202=55, srv530027776=76, srv152538364=26, srv1848590691=43, srv2108157742=54, srv266429354=58, srv652681216=78, srv884654194=93, srv809613817=85, srv2006482772=51, srv1508580954=24, srv860532336=87, srv66465354=80, srv703499381=81, srv874579110=89, srv115193847=3, srv891272957=94, srv880601744=91, srv1778777639=38, srv1663246995=33, srv1330511257=11, srv317360873=62, srv1368928253=18, srv147669629=23, srv1268308985=9, srv1404716267=20, srv524586888=73, srv119461958=4, srv880895722=92, srv1206933324=5, srv1360680365=15, srv393657689=67, srv527842559=75, srv351468988=64, srv912036289=96, srv1409566408=21, srv1151885864=2, srv1109243813=1, srv1891901729=44, srv1990753164=48, srv1997556087=50, srv1355801721=14, srv877324880=90, srv1529494585=27, srv1990379430=47, srv1643962068=31, srv124841836=8, srv661694786=79, srv97346310=99, srv1366210114=17, srv1731627487=36, srv42201616=68, srv289188698=59, srv157583311=28, srv1937581465=45, srv46550045=72, srv1376208844=19, srv1521378582=25, srv228950473=57, srv1003160358=0, srv1453762042=22, srv894194359=95, srv1585977924=29, srv1599609863=30, srv1682485681=34, srv200732486=52, srv133445875=12, srv1996998963=49, srv451941268=71, srv441076511=70, srv341647203=63, srv1336147772=13, srv1363307815=16, srv179501069=40, srv1788895972=39, srv935908246=98, srv803136961=84, srv1284627830=10, srv866122990=88, srv605410659=77, srv759487540=83, srv913386536=97, srv221416269=56, srv1840658200=42, srv75135808=82, srv425990530=69, srv2015411264=53, srv1959328345=46, srv295995613=60, srv372114066=66, srv180767481=41, srv1644269060=32, srv314276724=61, srv527823587=74} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2024-04-01 07:53:15,677 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2024-04-01 07:53:15,677 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2024-04-01 07:53:15,678 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2024-04-01 07:53:15,678 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2024-04-01 07:53:15,678 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2024-04-01 07:53:15,678 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2024-04-01 07:53:15,678 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2024-04-01 07:53:15,678 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2024-04-01 07:53:15,678 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2024-04-01 07:53:15,679 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2024-04-01 07:53:15,679 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2024-04-01 07:53:15,679 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2024-04-01 07:53:15,679 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2024-04-01 07:53:15,679 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2024-04-01 07:53:15,679 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2024-04-01 07:53:15,679 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2024-04-01 07:53:15,679 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2024-04-01 07:53:15,679 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2024-04-01 07:53:15,680 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2024-04-01 07:53:15,680 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2024-04-01 07:53:15,680 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2024-04-01 07:53:15,680 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2024-04-01 07:53:15,680 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2024-04-01 07:53:15,680 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2024-04-01 07:53:15,680 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2024-04-01 07:53:15,680 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2024-04-01 07:53:15,681 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2024-04-01 07:53:15,681 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2024-04-01 07:53:15,681 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2024-04-01 07:53:15,681 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2024-04-01 07:53:15,681 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2024-04-01 07:53:15,681 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2024-04-01 07:53:15,681 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2024-04-01 07:53:15,681 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2024-04-01 07:53:15,682 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2024-04-01 07:53:15,682 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2024-04-01 07:53:15,682 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2024-04-01 07:53:15,682 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2024-04-01 07:53:15,682 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2024-04-01 07:53:15,682 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2024-04-01 07:53:15,682 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2024-04-01 07:53:15,682 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2024-04-01 07:53:15,682 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2024-04-01 07:53:15,683 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2024-04-01 07:53:15,683 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2024-04-01 07:53:15,683 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2024-04-01 07:53:15,683 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2024-04-01 07:53:15,683 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2024-04-01 07:53:15,683 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2024-04-01 07:53:15,683 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2024-04-01 07:53:15,683 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2024-04-01 07:53:15,684 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2024-04-01 07:53:15,684 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2024-04-01 07:53:15,684 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2024-04-01 07:53:15,684 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2024-04-01 07:53:15,684 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2024-04-01 07:53:15,684 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2024-04-01 07:53:15,684 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2024-04-01 07:53:15,685 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2024-04-01 07:53:15,685 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2024-04-01 07:53:15,685 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2024-04-01 07:53:15,685 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2024-04-01 07:53:15,685 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2024-04-01 07:53:15,685 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2024-04-01 07:53:15,685 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2024-04-01 07:53:15,685 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2024-04-01 07:53:15,685 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2024-04-01 07:53:15,686 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2024-04-01 07:53:15,686 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2024-04-01 07:53:15,686 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2024-04-01 07:53:15,686 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2024-04-01 07:53:15,686 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2024-04-01 07:53:15,686 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2024-04-01 07:53:15,686 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2024-04-01 07:53:15,686 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2024-04-01 07:53:15,686 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2024-04-01 07:53:15,686 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2024-04-01 07:53:15,687 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2024-04-01 07:53:15,687 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2024-04-01 07:53:15,687 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2024-04-01 07:53:15,687 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2024-04-01 07:53:15,687 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2024-04-01 07:53:15,687 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2024-04-01 07:53:15,687 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2024-04-01 07:53:15,687 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2024-04-01 07:53:15,687 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2024-04-01 07:53:15,687 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2024-04-01 07:53:15,688 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2024-04-01 07:53:15,688 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2024-04-01 07:53:15,688 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2024-04-01 07:53:15,688 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2024-04-01 07:53:15,688 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2024-04-01 07:53:15,688 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2024-04-01 07:53:15,688 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2024-04-01 07:53:15,688 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2024-04-01 07:53:15,688 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2024-04-01 07:53:15,688 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2024-04-01 07:53:15,689 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2024-04-01 07:53:15,689 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2024-04-01 07:53:15,689 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2024-04-01 07:53:15,689 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2024-04-01 07:53:15,851 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.020141041527431045); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.032497949516598575, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.020141041527431045); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.012833333333333334); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.042083333333333334, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2024-04-01 07:53:15,851 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2024-04-01 07:53:15,851 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.01558550463770305, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.020141041527431045); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.032497949516598575, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.020141041527431045); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.012833333333333334); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.042083333333333334, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2024-04-01 07:53:16,147 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 431 ms to try 5000 different iterations.  Found a solution that moves 947 regions; Going from a computed imbalance of 0.01558550463770305 to a new imbalance of 9.560361387868938E-4. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0054318436834303405); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.00843540185701534); MoveCostFunction : (multiplier=7.0, imbalance=0.10522222222222222, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0054318436834303405); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=5.833333333333334E-4); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.004); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2024-04-01 07:53:16,151 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1990379430:82 , srv115193847:83 , srv1376208844:83 , srv1663246995:83 , srv1697319172:83 , srv1891901729:83 , srv295995613:83 , srv441076511:83 , srv75135808:83 , srv860532336:83 , srv124841836:84 , srv1360680365:84 , srv1368928253:84 , srv1409566408:84 , srv1585977924:84 , srv1788895972:84 , srv1840658200:84 , srv1959328345:84 , srv1997556087:84 , srv2015411264:84 , srv2108157742:84 , srv351468988:84 , srv527842559:84 , srv759487540:84 , srv803136961:84 , srv809613817:84 , srv874579110:84 , srv912036289:84 , srv935908246:84 , srv97346310:84 , srv1003160358:85 , srv1109243813:85 , srv119461958:85 , srv1211867847:85 , srv1284627830:85 , srv1330511257:85 , srv133445875:85 , srv147669629:85 , srv1521378582:85 , srv152538364:85 , srv1529494585:85 , srv1599609863:85 , srv1643962068:85 , srv180767481:85 , srv2117505202:85 , srv228950473:85 , srv314276724:85 , srv341647203:85 , srv365062234:85 , srv393657689:85 , srv652681216:85 , srv66465354:85 , srv703499381:85 , srv83938446:85 , srv880601744:85 , srv884654194:85 , srv891272957:85 , srv913386536:85 , srv1206933324:86 , srv1363307815:86 , srv1366210114:86 , srv1404716267:86 , srv1453762042:86 , srv157583311:86 , srv1756521510:86 , srv1778777639:86 , srv1848590691:86 , srv1937581465:86 , srv1996998963:86 , srv289188698:86 , srv317360873:86 , srv46550045:86 , srv524586888:86 , srv605410659:86 , srv866122990:86 , srv877324880:86 , srv1151885864:87 , srv1336147772:87 , srv1355801721:87 , srv1508580954:87 , srv1644269060:87 , srv1731627487:87 , srv179501069:87 , srv1990753164:87 , srv2006482772:87 , srv200732486:87 , srv221416269:87 , srv372114066:87 , srv42201616:87 , srv527823587:87 , srv661694786:87 , srv880895722:87 , srv1237066013:88 , srv1268308985:88 , srv1682485681:88 , srv451941268:88 , srv530027776:88 , srv266429354:89 , srv894194359:89 , srv425990530:553 }
2024-04-01 07:53:16,156 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2024-04-01 07:53:16,158 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1211867847=6, srv365062234=65, srv83938446=86, srv1237066013=7, srv1697319172=35, srv1756521510=37, srv2117505202=55, srv530027776=76, srv152538364=26, srv1848590691=43, srv2108157742=54, srv266429354=58, srv652681216=78, srv884654194=93, srv809613817=85, srv2006482772=51, srv1508580954=24, srv860532336=87, srv66465354=80, srv703499381=81, srv874579110=89, srv115193847=3, srv891272957=94, srv880601744=91, srv1778777639=38, srv1663246995=33, srv1330511257=11, srv317360873=62, srv1368928253=18, srv147669629=23, srv1268308985=9, srv1404716267=20, srv524586888=73, srv119461958=4, srv880895722=92, srv1206933324=5, srv1360680365=15, srv393657689=67, srv527842559=75, srv351468988=64, srv912036289=96, srv1409566408=21, srv1151885864=2, srv1109243813=1, srv1891901729=44, srv1990753164=48, srv1997556087=50, srv1355801721=14, srv877324880=90, srv1529494585=27, srv1990379430=47, srv1643962068=31, srv124841836=8, srv661694786=79, srv97346310=99, srv1366210114=17, srv1731627487=36, srv42201616=68, srv289188698=59, srv157583311=28, srv1937581465=45, srv46550045=72, srv1376208844=19, srv1521378582=25, srv228950473=57, srv1003160358=0, srv1453762042=22, srv894194359=95, srv1585977924=29, srv1599609863=30, srv1682485681=34, srv200732486=52, srv133445875=12, srv1996998963=49, srv451941268=71, srv441076511=70, srv341647203=63, srv1336147772=13, srv1363307815=16, srv179501069=40, srv1788895972=39, srv935908246=98, srv803136961=84, srv1284627830=10, srv866122990=88, srv605410659=77, srv759487540=83, srv913386536=97, srv221416269=56, srv1840658200=42, srv75135808=82, srv425990530=69, srv2015411264=53, srv1959328345=46, srv295995613=60, srv372114066=66, srv180767481=41, srv1644269060=32, srv314276724=61, srv527823587=74} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2024-04-01 07:53:16,175 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2024-04-01 07:53:16,175 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2024-04-01 07:53:16,176 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2024-04-01 07:53:16,176 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2024-04-01 07:53:16,176 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2024-04-01 07:53:16,176 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2024-04-01 07:53:16,176 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2024-04-01 07:53:16,176 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2024-04-01 07:53:16,176 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2024-04-01 07:53:16,176 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2024-04-01 07:53:16,176 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2024-04-01 07:53:16,176 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2024-04-01 07:53:16,176 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2024-04-01 07:53:16,176 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2024-04-01 07:53:16,176 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2024-04-01 07:53:16,177 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2024-04-01 07:53:16,177 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2024-04-01 07:53:16,177 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2024-04-01 07:53:16,177 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2024-04-01 07:53:16,177 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2024-04-01 07:53:16,177 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2024-04-01 07:53:16,177 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2024-04-01 07:53:16,177 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2024-04-01 07:53:16,177 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2024-04-01 07:53:16,177 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2024-04-01 07:53:16,177 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2024-04-01 07:53:16,177 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2024-04-01 07:53:16,178 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2024-04-01 07:53:16,178 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2024-04-01 07:53:16,178 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2024-04-01 07:53:16,178 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2024-04-01 07:53:16,178 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2024-04-01 07:53:16,178 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2024-04-01 07:53:16,178 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2024-04-01 07:53:16,178 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2024-04-01 07:53:16,178 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2024-04-01 07:53:16,178 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2024-04-01 07:53:16,178 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2024-04-01 07:53:16,178 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2024-04-01 07:53:16,179 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2024-04-01 07:53:16,179 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2024-04-01 07:53:16,179 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2024-04-01 07:53:16,179 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2024-04-01 07:53:16,179 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2024-04-01 07:53:16,179 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2024-04-01 07:53:16,179 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2024-04-01 07:53:16,179 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2024-04-01 07:53:16,179 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2024-04-01 07:53:16,179 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2024-04-01 07:53:16,179 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2024-04-01 07:53:16,179 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2024-04-01 07:53:16,179 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2024-04-01 07:53:16,180 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2024-04-01 07:53:16,180 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2024-04-01 07:53:16,180 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2024-04-01 07:53:16,180 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2024-04-01 07:53:16,180 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2024-04-01 07:53:16,180 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2024-04-01 07:53:16,180 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2024-04-01 07:53:16,180 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2024-04-01 07:53:16,180 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2024-04-01 07:53:16,180 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2024-04-01 07:53:16,180 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2024-04-01 07:53:16,180 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2024-04-01 07:53:16,180 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2024-04-01 07:53:16,181 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2024-04-01 07:53:16,181 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2024-04-01 07:53:16,181 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2024-04-01 07:53:16,181 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2024-04-01 07:53:16,181 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2024-04-01 07:53:16,181 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2024-04-01 07:53:16,181 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2024-04-01 07:53:16,181 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2024-04-01 07:53:16,181 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2024-04-01 07:53:16,181 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2024-04-01 07:53:16,181 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2024-04-01 07:53:16,182 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2024-04-01 07:53:16,182 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2024-04-01 07:53:16,182 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2024-04-01 07:53:16,182 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2024-04-01 07:53:16,182 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2024-04-01 07:53:16,182 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2024-04-01 07:53:16,182 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2024-04-01 07:53:16,182 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2024-04-01 07:53:16,182 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2024-04-01 07:53:16,182 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2024-04-01 07:53:16,182 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2024-04-01 07:53:16,182 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2024-04-01 07:53:16,182 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2024-04-01 07:53:16,182 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2024-04-01 07:53:16,183 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2024-04-01 07:53:16,183 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2024-04-01 07:53:16,183 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2024-04-01 07:53:16,183 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2024-04-01 07:53:16,183 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2024-04-01 07:53:16,183 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2024-04-01 07:53:16,183 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2024-04-01 07:53:16,183 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2024-04-01 07:53:16,183 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2024-04-01 07:53:16,183 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2024-04-01 07:53:16,183 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2024-04-01 07:53:16,336 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0054318436834303405); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.00843540185701534); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0054318436834303405); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=5.833333333333334E-4); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.004); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2024-04-01 07:53:16,336 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2024-04-01 07:53:16,336 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=9.494051030589252E-4, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0054318436834303405); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.00843540185701534); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0054318436834303405); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=5.833333333333334E-4); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.004); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2024-04-01 07:53:16,733 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 531 ms to try 5000 different iterations.  Found a solution that moves 243 regions; Going from a computed imbalance of 9.494051030589252E-4 to a new imbalance of 4.110102077872511E-5. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=3.5313429231318235E-4); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0017082358106351274); MoveCostFunction : (multiplier=7.0, imbalance=0.027, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=3.5313429231318235E-4); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=3.333333333333333E-4); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2024-04-01 07:53:16,734 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1355801721:83 , srv1644269060:83 , srv200732486:83 , srv266429354:83 , srv866122990:83 , srv891272957:83 , srv1003160358:84 , srv1109243813:84 , srv119461958:84 , srv1211867847:84 , srv1237066013:84 , srv124841836:84 , srv1268308985:84 , srv1330511257:84 , srv1360680365:84 , srv1376208844:84 , srv1453762042:84 , srv147669629:84 , srv1508580954:84 , srv157583311:84 , srv1599609863:84 , srv1682485681:84 , srv1697319172:84 , srv1731627487:84 , srv1756521510:84 , srv1778777639:84 , srv179501069:84 , srv1848590691:84 , srv1937581465:84 , srv1959328345:84 , srv1990753164:84 , srv2006482772:84 , srv221416269:84 , srv228950473:84 , srv289188698:84 , srv314276724:84 , srv372114066:84 , srv393657689:84 , srv42201616:84 , srv451941268:84 , srv46550045:84 , srv530027776:84 , srv652681216:84 , srv661694786:84 , srv877324880:84 , srv880895722:84 , srv894194359:84 , srv912036289:84 , srv913386536:84 , srv935908246:84 , srv1151885864:85 , srv115193847:85 , srv1206933324:85 , srv1284627830:85 , srv133445875:85 , srv1336147772:85 , srv1366210114:85 , srv1368928253:85 , srv1404716267:85 , srv1521378582:85 , srv152538364:85 , srv1529494585:85 , srv1585977924:85 , srv1643962068:85 , srv1663246995:85 , srv1788895972:85 , srv180767481:85 , srv1840658200:85 , srv1891901729:85 , srv1990379430:85 , srv1996998963:85 , srv2015411264:85 , srv2117505202:85 , srv295995613:85 , srv317360873:85 , srv341647203:85 , srv351468988:85 , srv365062234:85 , srv441076511:85 , srv524586888:85 , srv527823587:85 , srv527842559:85 , srv605410659:85 , srv66465354:85 , srv703499381:85 , srv75135808:85 , srv759487540:85 , srv803136961:85 , srv809613817:85 , srv83938446:85 , srv874579110:85 , srv880601744:85 , srv884654194:85 , srv97346310:85 , srv1363307815:86 , srv1409566408:86 , srv1997556087:86 , srv2108157742:86 , srv860532336:86 , srv425990530:636 }
2024-04-01 07:53:16,738 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2024-04-01 07:53:16,738 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1211867847=6, srv365062234=65, srv83938446=86, srv1237066013=7, srv1697319172=35, srv1756521510=37, srv2117505202=55, srv530027776=76, srv152538364=26, srv1848590691=43, srv2108157742=54, srv266429354=58, srv652681216=78, srv884654194=93, srv809613817=85, srv2006482772=51, srv1508580954=24, srv860532336=87, srv66465354=80, srv703499381=81, srv874579110=89, srv115193847=3, srv891272957=94, srv880601744=91, srv1778777639=38, srv1663246995=33, srv1330511257=11, srv317360873=62, srv1368928253=18, srv147669629=23, srv1268308985=9, srv1404716267=20, srv524586888=73, srv119461958=4, srv880895722=92, srv1206933324=5, srv1360680365=15, srv393657689=67, srv527842559=75, srv351468988=64, srv912036289=96, srv1409566408=21, srv1151885864=2, srv1109243813=1, srv1891901729=44, srv1990753164=48, srv1997556087=50, srv1355801721=14, srv877324880=90, srv1529494585=27, srv1990379430=47, srv1643962068=31, srv124841836=8, srv661694786=79, srv97346310=99, srv1366210114=17, srv1731627487=36, srv42201616=68, srv289188698=59, srv157583311=28, srv1937581465=45, srv46550045=72, srv1376208844=19, srv1521378582=25, srv228950473=57, srv1003160358=0, srv1453762042=22, srv894194359=95, srv1585977924=29, srv1599609863=30, srv1682485681=34, srv200732486=52, srv133445875=12, srv1996998963=49, srv451941268=71, srv441076511=70, srv341647203=63, srv1336147772=13, srv1363307815=16, srv179501069=40, srv1788895972=39, srv935908246=98, srv803136961=84, srv1284627830=10, srv866122990=88, srv605410659=77, srv759487540=83, srv913386536=97, srv221416269=56, srv1840658200=42, srv75135808=82, srv425990530=69, srv2015411264=53, srv1959328345=46, srv295995613=60, srv372114066=66, srv180767481=41, srv1644269060=32, srv314276724=61, srv527823587=74} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2024-04-01 07:53:16,748 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2024-04-01 07:53:16,748 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2024-04-01 07:53:16,748 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2024-04-01 07:53:16,748 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2024-04-01 07:53:16,748 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2024-04-01 07:53:16,748 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2024-04-01 07:53:16,748 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2024-04-01 07:53:16,749 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2024-04-01 07:53:16,749 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2024-04-01 07:53:16,749 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2024-04-01 07:53:16,749 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2024-04-01 07:53:16,749 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2024-04-01 07:53:16,749 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2024-04-01 07:53:16,749 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2024-04-01 07:53:16,749 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2024-04-01 07:53:16,749 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2024-04-01 07:53:16,749 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2024-04-01 07:53:16,749 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2024-04-01 07:53:16,749 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2024-04-01 07:53:16,749 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2024-04-01 07:53:16,749 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2024-04-01 07:53:16,749 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2024-04-01 07:53:16,749 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2024-04-01 07:53:16,749 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2024-04-01 07:53:16,749 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2024-04-01 07:53:16,749 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2024-04-01 07:53:16,749 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2024-04-01 07:53:16,750 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2024-04-01 07:53:16,750 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2024-04-01 07:53:16,750 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2024-04-01 07:53:16,750 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2024-04-01 07:53:16,750 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2024-04-01 07:53:16,750 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2024-04-01 07:53:16,750 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2024-04-01 07:53:16,750 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2024-04-01 07:53:16,750 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2024-04-01 07:53:16,750 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2024-04-01 07:53:16,750 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2024-04-01 07:53:16,750 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2024-04-01 07:53:16,750 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2024-04-01 07:53:16,750 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2024-04-01 07:53:16,750 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2024-04-01 07:53:16,750 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2024-04-01 07:53:16,750 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2024-04-01 07:53:16,750 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2024-04-01 07:53:16,750 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2024-04-01 07:53:16,750 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2024-04-01 07:53:16,750 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2024-04-01 07:53:16,750 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2024-04-01 07:53:16,751 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2024-04-01 07:53:16,751 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2024-04-01 07:53:16,751 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2024-04-01 07:53:16,751 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2024-04-01 07:53:16,751 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2024-04-01 07:53:16,751 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2024-04-01 07:53:16,751 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2024-04-01 07:53:16,751 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2024-04-01 07:53:16,751 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2024-04-01 07:53:16,751 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2024-04-01 07:53:16,751 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2024-04-01 07:53:16,751 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2024-04-01 07:53:16,751 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2024-04-01 07:53:16,751 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2024-04-01 07:53:16,751 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2024-04-01 07:53:16,751 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2024-04-01 07:53:16,751 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2024-04-01 07:53:16,751 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2024-04-01 07:53:16,751 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2024-04-01 07:53:16,752 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2024-04-01 07:53:16,752 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2024-04-01 07:53:16,752 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2024-04-01 07:53:16,752 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2024-04-01 07:53:16,752 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2024-04-01 07:53:16,752 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2024-04-01 07:53:16,752 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2024-04-01 07:53:16,752 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2024-04-01 07:53:16,752 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2024-04-01 07:53:16,752 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2024-04-01 07:53:16,752 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2024-04-01 07:53:16,752 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2024-04-01 07:53:16,752 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2024-04-01 07:53:16,752 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2024-04-01 07:53:16,752 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2024-04-01 07:53:16,752 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2024-04-01 07:53:16,752 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2024-04-01 07:53:16,753 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2024-04-01 07:53:16,753 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2024-04-01 07:53:16,753 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2024-04-01 07:53:16,753 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2024-04-01 07:53:16,753 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2024-04-01 07:53:16,753 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2024-04-01 07:53:16,753 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2024-04-01 07:53:16,753 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2024-04-01 07:53:16,753 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2024-04-01 07:53:16,753 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2024-04-01 07:53:16,753 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2024-04-01 07:53:16,753 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2024-04-01 07:53:16,753 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2024-04-01 07:53:16,753 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2024-04-01 07:53:16,753 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2024-04-01 07:53:16,753 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2024-04-01 07:53:16,854 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=3.5313429231318235E-4); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0017082358106351274); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=3.5313429231318235E-4); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=3.333333333333333E-4); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2024-04-01 07:53:16,854 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2024-04-01 07:53:16,854 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=3.939949841135833E-5, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=3.5313429231318235E-4); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0017082358106351274); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=3.5313429231318235E-4); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=3.333333333333333E-4); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2024-04-01 07:53:17,062 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 301 ms to try 5000 different iterations.  Found a solution that moves 27 regions; Going from a computed imbalance of 3.939949841135833E-5 to a new imbalance of 6.2211367805469E-6. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0013400504203456161); MoveCostFunction : (multiplier=7.0, imbalance=0.003); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2024-04-01 07:53:17,063 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1363307815:83 , srv1368928253:83 , srv1997556087:83 , srv2108157742:83 , srv884654194:83 , srv1003160358:84 , srv1151885864:84 , srv115193847:84 , srv119461958:84 , srv1206933324:84 , srv1211867847:84 , srv1237066013:84 , srv1268308985:84 , srv1284627830:84 , srv1330511257:84 , srv133445875:84 , srv1336147772:84 , srv1355801721:84 , srv1360680365:84 , srv1366210114:84 , srv1376208844:84 , srv1404716267:84 , srv1409566408:84 , srv1453762042:84 , srv147669629:84 , srv1508580954:84 , srv1521378582:84 , srv152538364:84 , srv1529494585:84 , srv157583311:84 , srv1585977924:84 , srv1599609863:84 , srv1643962068:84 , srv1644269060:84 , srv1663246995:84 , srv1682485681:84 , srv1697319172:84 , srv1756521510:84 , srv1778777639:84 , srv1788895972:84 , srv179501069:84 , srv180767481:84 , srv1840658200:84 , srv1848590691:84 , srv1891901729:84 , srv1937581465:84 , srv1959328345:84 , srv1990379430:84 , srv1990753164:84 , srv1996998963:84 , srv2006482772:84 , srv200732486:84 , srv2015411264:84 , srv2117505202:84 , srv221416269:84 , srv228950473:84 , srv266429354:84 , srv289188698:84 , srv295995613:84 , srv314276724:84 , srv317360873:84 , srv341647203:84 , srv351468988:84 , srv365062234:84 , srv372114066:84 , srv393657689:84 , srv42201616:84 , srv441076511:84 , srv451941268:84 , srv524586888:84 , srv527823587:84 , srv527842559:84 , srv530027776:84 , srv605410659:84 , srv652681216:84 , srv661694786:84 , srv66465354:84 , srv703499381:84 , srv75135808:84 , srv759487540:84 , srv803136961:84 , srv809613817:84 , srv83938446:84 , srv860532336:84 , srv874579110:84 , srv877324880:84 , srv880601744:84 , srv880895722:84 , srv891272957:84 , srv894194359:84 , srv912036289:84 , srv913386536:84 , srv935908246:84 , srv97346310:84 , srv1109243813:85 , srv124841836:85 , srv1731627487:85 , srv46550045:85 , srv866122990:85 , srv425990530:684 }
2024-04-01 07:53:17,066 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2024-04-01 07:53:17,067 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1211867847=6, srv365062234=65, srv83938446=86, srv1237066013=7, srv1697319172=35, srv1756521510=37, srv2117505202=55, srv530027776=76, srv152538364=26, srv1848590691=43, srv2108157742=54, srv266429354=58, srv652681216=78, srv884654194=93, srv809613817=85, srv2006482772=51, srv1508580954=24, srv860532336=87, srv66465354=80, srv703499381=81, srv874579110=89, srv115193847=3, srv891272957=94, srv880601744=91, srv1778777639=38, srv1663246995=33, srv1330511257=11, srv317360873=62, srv1368928253=18, srv147669629=23, srv1268308985=9, srv1404716267=20, srv524586888=73, srv119461958=4, srv880895722=92, srv1206933324=5, srv1360680365=15, srv393657689=67, srv527842559=75, srv351468988=64, srv912036289=96, srv1409566408=21, srv1151885864=2, srv1109243813=1, srv1891901729=44, srv1990753164=48, srv1997556087=50, srv1355801721=14, srv877324880=90, srv1529494585=27, srv1990379430=47, srv1643962068=31, srv124841836=8, srv661694786=79, srv97346310=99, srv1366210114=17, srv1731627487=36, srv42201616=68, srv289188698=59, srv157583311=28, srv1937581465=45, srv46550045=72, srv1376208844=19, srv1521378582=25, srv228950473=57, srv1003160358=0, srv1453762042=22, srv894194359=95, srv1585977924=29, srv1599609863=30, srv1682485681=34, srv200732486=52, srv133445875=12, srv1996998963=49, srv451941268=71, srv441076511=70, srv341647203=63, srv1336147772=13, srv1363307815=16, srv179501069=40, srv1788895972=39, srv935908246=98, srv803136961=84, srv1284627830=10, srv866122990=88, srv605410659=77, srv759487540=83, srv913386536=97, srv221416269=56, srv1840658200=42, srv75135808=82, srv425990530=69, srv2015411264=53, srv1959328345=46, srv295995613=60, srv372114066=66, srv180767481=41, srv1644269060=32, srv314276724=61, srv527823587=74} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2024-04-01 07:53:17,084 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2024-04-01 07:53:17,084 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2024-04-01 07:53:17,084 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2024-04-01 07:53:17,084 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2024-04-01 07:53:17,084 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2024-04-01 07:53:17,084 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2024-04-01 07:53:17,084 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2024-04-01 07:53:17,084 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2024-04-01 07:53:17,084 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2024-04-01 07:53:17,084 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2024-04-01 07:53:17,084 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2024-04-01 07:53:17,084 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2024-04-01 07:53:17,084 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2024-04-01 07:53:17,084 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2024-04-01 07:53:17,084 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2024-04-01 07:53:17,084 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2024-04-01 07:53:17,084 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2024-04-01 07:53:17,084 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2024-04-01 07:53:17,084 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2024-04-01 07:53:17,085 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2024-04-01 07:53:17,085 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2024-04-01 07:53:17,085 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2024-04-01 07:53:17,085 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2024-04-01 07:53:17,085 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2024-04-01 07:53:17,085 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2024-04-01 07:53:17,085 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2024-04-01 07:53:17,085 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2024-04-01 07:53:17,085 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2024-04-01 07:53:17,085 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2024-04-01 07:53:17,085 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2024-04-01 07:53:17,085 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2024-04-01 07:53:17,085 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2024-04-01 07:53:17,085 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2024-04-01 07:53:17,085 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2024-04-01 07:53:17,085 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2024-04-01 07:53:17,085 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2024-04-01 07:53:17,085 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2024-04-01 07:53:17,085 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2024-04-01 07:53:17,085 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2024-04-01 07:53:17,085 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2024-04-01 07:53:17,085 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2024-04-01 07:53:17,085 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2024-04-01 07:53:17,086 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2024-04-01 07:53:17,086 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2024-04-01 07:53:17,086 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2024-04-01 07:53:17,086 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2024-04-01 07:53:17,086 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2024-04-01 07:53:17,086 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2024-04-01 07:53:17,086 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2024-04-01 07:53:17,086 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2024-04-01 07:53:17,086 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2024-04-01 07:53:17,086 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2024-04-01 07:53:17,086 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2024-04-01 07:53:17,086 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2024-04-01 07:53:17,086 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2024-04-01 07:53:17,086 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2024-04-01 07:53:17,086 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2024-04-01 07:53:17,086 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2024-04-01 07:53:17,086 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2024-04-01 07:53:17,086 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2024-04-01 07:53:17,086 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2024-04-01 07:53:17,086 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2024-04-01 07:53:17,086 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2024-04-01 07:53:17,086 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2024-04-01 07:53:17,086 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2024-04-01 07:53:17,087 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2024-04-01 07:53:17,087 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2024-04-01 07:53:17,087 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2024-04-01 07:53:17,087 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2024-04-01 07:53:17,087 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2024-04-01 07:53:17,087 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2024-04-01 07:53:17,087 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2024-04-01 07:53:17,087 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2024-04-01 07:53:17,087 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2024-04-01 07:53:17,087 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2024-04-01 07:53:17,087 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2024-04-01 07:53:17,087 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2024-04-01 07:53:17,087 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2024-04-01 07:53:17,087 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2024-04-01 07:53:17,087 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2024-04-01 07:53:17,087 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2024-04-01 07:53:17,087 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2024-04-01 07:53:17,087 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2024-04-01 07:53:17,087 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2024-04-01 07:53:17,087 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2024-04-01 07:53:17,087 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2024-04-01 07:53:17,087 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2024-04-01 07:53:17,087 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2024-04-01 07:53:17,088 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2024-04-01 07:53:17,088 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2024-04-01 07:53:17,088 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2024-04-01 07:53:17,088 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2024-04-01 07:53:17,088 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2024-04-01 07:53:17,088 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2024-04-01 07:53:17,088 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2024-04-01 07:53:17,088 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2024-04-01 07:53:17,088 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2024-04-01 07:53:17,088 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2024-04-01 07:53:17,088 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2024-04-01 07:53:17,088 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2024-04-01 07:53:17,088 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2024-04-01 07:53:17,187 INFO  [Time-limited test] balancer.StochasticLoadBalancer(381): Cluster wide - skipping load balancing because weighted average imbalance=6.032078739728369E-6 <= threshold(0.025). If you want more aggressive balancing, either lower hbase.master.balancer.stochastic.minCostNeedBalance from 0.025 or increase the relative multiplier(s) of the specific cost function(s). functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0013400504203456161); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2024-04-01 07:53:17,188 INFO  [Time-limited test] balancer.BalancerTestBase(570): Mock Final balance: { srv1363307815:83 , srv1368928253:83 , srv1997556087:83 , srv2108157742:83 , srv884654194:83 , srv1003160358:84 , srv1151885864:84 , srv115193847:84 , srv119461958:84 , srv1206933324:84 , srv1211867847:84 , srv1237066013:84 , srv1268308985:84 , srv1284627830:84 , srv1330511257:84 , srv133445875:84 , srv1336147772:84 , srv1355801721:84 , srv1360680365:84 , srv1366210114:84 , srv1376208844:84 , srv1404716267:84 , srv1409566408:84 , srv1453762042:84 , srv147669629:84 , srv1508580954:84 , srv1521378582:84 , srv152538364:84 , srv1529494585:84 , srv157583311:84 , srv1585977924:84 , srv1599609863:84 , srv1643962068:84 , srv1644269060:84 , srv1663246995:84 , srv1682485681:84 , srv1697319172:84 , srv1756521510:84 , srv1778777639:84 , srv1788895972:84 , srv179501069:84 , srv180767481:84 , srv1840658200:84 , srv1848590691:84 , srv1891901729:84 , srv1937581465:84 , srv1959328345:84 , srv1990379430:84 , srv1990753164:84 , srv1996998963:84 , srv2006482772:84 , srv200732486:84 , srv2015411264:84 , srv2117505202:84 , srv221416269:84 , srv228950473:84 , srv266429354:84 , srv289188698:84 , srv295995613:84 , srv314276724:84 , srv317360873:84 , srv341647203:84 , srv351468988:84 , srv365062234:84 , srv372114066:84 , srv393657689:84 , srv42201616:84 , srv441076511:84 , srv451941268:84 , srv524586888:84 , srv527823587:84 , srv527842559:84 , srv530027776:84 , srv605410659:84 , srv652681216:84 , srv661694786:84 , srv66465354:84 , srv703499381:84 , srv75135808:84 , srv759487540:84 , srv803136961:84 , srv809613817:84 , srv83938446:84 , srv860532336:84 , srv874579110:84 , srv877324880:84 , srv880601744:84 , srv880895722:84 , srv891272957:84 , srv894194359:84 , srv912036289:84 , srv913386536:84 , srv935908246:84 , srv97346310:84 , srv1109243813:85 , srv124841836:85 , srv1731627487:85 , srv46550045:85 , srv866122990:85 , srv425990530:684 }
2024-04-01 07:53:17,212 INFO  [Time-limited test] hbase.ResourceChecker(175): after: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnLargeClusterWithRacks Thread=12 (was 12), OpenFileDescriptor=290 (was 290), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=330 (was 330), ProcessCount=169 (was 169), AvailableMemoryMB=7517 (was 8259)
2024-04-01 07:53:17,220 INFO  [Time-limited test] hbase.ResourceChecker(147): before: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnMidClusterWithRacks Thread=12, OpenFileDescriptor=290, MaxFileDescriptor=60000, SystemLoadAverage=330, ProcessCount=169, AvailableMemoryMB=7517
2024-04-01 07:53:17,221 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2024-04-01 07:53:17,221 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=5000, runMaxSteps=true, stepsPerRegion=800, maxRunningTime=120000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 111077.0 etc.
2024-04-01 07:53:17,228 INFO  [Time-limited test] balancer.BalancerTestBase(547): Mock Cluster : { srv1026582286:84 , srv1085237633:84 , srv1145140067:84 , srv1286126271:84 , srv1340712490:84 , srv1364615879:84 , srv1405444117:84 , srv1790769364:84 , srv1820816494:84 , srv1826295681:84 , srv1864562434:84 , srv1882272314:84 , srv1902361945:84 , srv1956879350:84 , srv1995078841:84 , srv283580844:84 , srv295441673:84 , srv363003620:84 , srv385077711:84 , srv444265487:84 , srv471936896:84 , srv623537052:84 , srv630952627:84 , srv663451127:84 , srv676905405:84 , srv706827951:84 , srv731415407:84 , srv763681529:84 , srv959848230:84 , srv694519594:264 } [srvr=30 rgns=2700 avg=90.0 max=90 min=90]
2024-04-01 07:53:17,229 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2024-04-01 07:53:17,229 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1826295681=9, srv731415407=27, srv1820816494=8, srv1790769364=7, srv663451127=23, srv1864562434=10, srv1364615879=5, srv1882272314=11, srv623537052=21, srv1026582286=0, srv1340712490=4, srv676905405=24, srv1902361945=12, srv283580844=15, srv363003620=17, srv1286126271=3, srv630952627=22, srv694519594=25, srv295441673=16, srv1405444117=6, srv763681529=28, srv471936896=20, srv444265487=19, srv385077711=18, srv1956879350=13, srv959848230=29, srv1995078841=14, srv706827951=26, srv1145140067=2, srv1085237633=1} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2024-04-01 07:53:17,238 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2024-04-01 07:53:17,238 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2024-04-01 07:53:17,238 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2024-04-01 07:53:17,238 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2024-04-01 07:53:17,238 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2024-04-01 07:53:17,238 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2024-04-01 07:53:17,238 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2024-04-01 07:53:17,238 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2024-04-01 07:53:17,238 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2024-04-01 07:53:17,238 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2024-04-01 07:53:17,238 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2024-04-01 07:53:17,238 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2024-04-01 07:53:17,238 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2024-04-01 07:53:17,238 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2024-04-01 07:53:17,238 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2024-04-01 07:53:17,238 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2024-04-01 07:53:17,239 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2024-04-01 07:53:17,239 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2024-04-01 07:53:17,239 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2024-04-01 07:53:17,239 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2024-04-01 07:53:17,239 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2024-04-01 07:53:17,239 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2024-04-01 07:53:17,239 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2024-04-01 07:53:17,239 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2024-04-01 07:53:17,239 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2024-04-01 07:53:17,239 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2024-04-01 07:53:17,239 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2024-04-01 07:53:17,239 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2024-04-01 07:53:17,239 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2024-04-01 07:53:17,239 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2024-04-01 07:53:17,239 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=10, number of hosts=30, number of racks=4
2024-04-01 07:53:17,254 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=1.1614251177455912, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2024-04-01 07:53:17,254 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.991270168853928, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=1.1614251177455912, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=64800000
2024-04-01 07:55:17,242 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 120001 ms to try 6044243 different iterations.  Found a solution that moves 1860 regions; Going from a computed imbalance of 0.991270168853928 to a new imbalance of 4.341332789166274E-5. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); MoveCostFunction : (multiplier=7.0, imbalance=0.6888888888888889, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2024-04-01 07:55:17,251 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1026582286:90 , srv1085237633:90 , srv1145140067:90 , srv1286126271:90 , srv1340712490:90 , srv1364615879:90 , srv1405444117:90 , srv1790769364:90 , srv1820816494:90 , srv1826295681:90 , srv1864562434:90 , srv1882272314:90 , srv1902361945:90 , srv1956879350:90 , srv1995078841:90 , srv283580844:90 , srv295441673:90 , srv363003620:90 , srv385077711:90 , srv444265487:90 , srv471936896:90 , srv623537052:90 , srv630952627:90 , srv663451127:90 , srv676905405:90 , srv694519594:90 , srv706827951:90 , srv731415407:90 , srv763681529:90 , srv959848230:90 }
2024-04-01 07:55:17,252 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2024-04-01 07:55:17,253 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1826295681=9, srv731415407=27, srv1820816494=8, srv1790769364=7, srv663451127=23, srv1864562434=10, srv1364615879=5, srv1882272314=11, srv623537052=21, srv1026582286=0, srv1340712490=4, srv676905405=24, srv1902361945=12, srv283580844=15, srv363003620=17, srv1286126271=3, srv630952627=22, srv694519594=25, srv295441673=16, srv1405444117=6, srv763681529=28, srv471936896=20, srv444265487=19, srv385077711=18, srv1956879350=13, srv959848230=29, srv1995078841=14, srv706827951=26, srv1145140067=2, srv1085237633=1} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2024-04-01 07:55:17,258 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2024-04-01 07:55:17,258 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2024-04-01 07:55:17,258 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2024-04-01 07:55:17,258 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2024-04-01 07:55:17,258 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2024-04-01 07:55:17,258 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2024-04-01 07:55:17,258 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2024-04-01 07:55:17,258 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2024-04-01 07:55:17,258 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2024-04-01 07:55:17,258 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2024-04-01 07:55:17,258 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2024-04-01 07:55:17,258 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2024-04-01 07:55:17,258 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2024-04-01 07:55:17,259 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2024-04-01 07:55:17,259 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2024-04-01 07:55:17,259 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2024-04-01 07:55:17,259 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2024-04-01 07:55:17,259 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2024-04-01 07:55:17,259 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2024-04-01 07:55:17,259 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2024-04-01 07:55:17,259 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2024-04-01 07:55:17,259 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2024-04-01 07:55:17,259 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2024-04-01 07:55:17,259 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2024-04-01 07:55:17,259 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2024-04-01 07:55:17,259 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2024-04-01 07:55:17,259 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2024-04-01 07:55:17,259 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2024-04-01 07:55:17,259 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2024-04-01 07:55:17,259 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2024-04-01 07:55:17,259 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=10, number of hosts=30, number of racks=4
2024-04-01 07:55:17,271 INFO  [Time-limited test] balancer.StochasticLoadBalancer(381): Cluster wide - skipping load balancing because weighted average imbalance=0.0 <= threshold(0.025). If you want more aggressive balancing, either lower hbase.master.balancer.stochastic.minCostNeedBalance from 0.025 or increase the relative multiplier(s) of the specific cost function(s). functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2024-04-01 07:55:17,271 INFO  [Time-limited test] balancer.BalancerTestBase(570): Mock Final balance: { srv1026582286:90 , srv1085237633:90 , srv1145140067:90 , srv1286126271:90 , srv1340712490:90 , srv1364615879:90 , srv1405444117:90 , srv1790769364:90 , srv1820816494:90 , srv1826295681:90 , srv1864562434:90 , srv1882272314:90 , srv1902361945:90 , srv1956879350:90 , srv1995078841:90 , srv283580844:90 , srv295441673:90 , srv363003620:90 , srv385077711:90 , srv444265487:90 , srv471936896:90 , srv623537052:90 , srv630952627:90 , srv663451127:90 , srv676905405:90 , srv694519594:90 , srv706827951:90 , srv731415407:90 , srv763681529:90 , srv959848230:90 }
2024-04-01 07:55:17,285 INFO  [Time-limited test] hbase.ResourceChecker(175): after: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnMidClusterWithRacks Thread=11 (was 12), OpenFileDescriptor=290 (was 290), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=327 (was 330), ProcessCount=167 (was 169), AvailableMemoryMB=6490 (was 7517)