2023-08-07 08:53:09,674 INFO  [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks timeout: 13 mins
2023-08-07 08:53:09,993 WARN  [Time-limited test] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties
2023-08-07 08:53:10,121 INFO  [Time-limited test] metrics.MetricRegistriesLoader(60): Loaded MetricRegistries class org.apache.hadoop.hbase.metrics.impl.MetricRegistriesImpl
2023-08-07 08:53:10,202 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2023-08-07 08:53:10,212 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc.
2023-08-07 08:53:10,227 INFO  [Time-limited test] hbase.ResourceChecker(147): before: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnLargeClusterWithRacks Thread=12, OpenFileDescriptor=263, MaxFileDescriptor=60000, SystemLoadAverage=317, ProcessCount=174, AvailableMemoryMB=3371
2023-08-07 08:53:10,229 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2023-08-07 08:53:10,229 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=5000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=10000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc.
2023-08-07 08:53:10,382 INFO  [Time-limited test] balancer.BalancerTestBase(547): Mock Cluster : { srv1008716543:84 , srv1036983923:84 , srv1051388443:84 , srv1079923798:84 , srv1086284578:84 , srv1100701341:84 , srv1110290940:84 , srv1134421258:84 , srv1148136189:84 , srv1163905264:84 , srv1165908775:84 , srv1179892319:84 , srv1194723956:84 , srv1200793452:84 , srv1214126972:84 , srv121501798:84 , srv122935209:84 , srv1238885417:84 , srv1249637944:84 , srv1251920990:84 , srv1257105158:84 , srv1285600739:84 , srv1290559910:84 , srv1295603988:84 , srv1295966808:84 , srv1307449797:84 , srv1329394123:84 , srv1331349466:84 , srv1343446742:84 , srv1345732641:84 , srv1347496736:84 , srv1354050760:84 , srv1375862509:84 , srv1378279897:84 , srv137852873:84 , srv1381664692:84 , srv1393094022:84 , srv1400450021:84 , srv1436337525:84 , srv1441216198:84 , srv1484653170:84 , srv149957919:84 , srv1525530271:84 , srv1594841988:84 , srv1655665684:84 , srv1668489958:84 , srv171272260:84 , srv1721924095:84 , srv1736078515:84 , srv1792194979:84 , srv1835652860:84 , srv1852554333:84 , srv1904962896:84 , srv1906483162:84 , srv1931779822:84 , srv1935704728:84 , srv195445168:84 , srv1970994876:84 , srv1994449501:84 , srv201108749:84 , srv2029171670:84 , srv2067636886:84 , srv248229479:84 , srv24937161:84 , srv249390066:84 , srv301095715:84 , srv338242171:84 , srv340037058:84 , srv343335784:84 , srv430585279:84 , srv433722767:84 , srv434684986:84 , srv484664786:84 , srv509788867:84 , srv518953314:84 , srv570510756:84 , srv607824497:84 , srv615075403:84 , srv655564951:84 , srv672295174:84 , srv679293317:84 , srv740370036:84 , srv761074200:84 , srv764818504:84 , srv795070345:84 , srv828887660:84 , srv844517512:84 , srv85599469:84 , srv879719684:84 , srv880162854:84 , srv893725815:84 , srv904360993:84 , srv907353323:84 , srv939365972:84 , srv947155764:84 , srv949101051:84 , srv961832556:84 , srv961857972:84 , srv964597372:84 , srv1243814406:684 } [srvr=100 rgns=9000 avg=90.0 max=90 min=90]
2023-08-07 08:53:10,391 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-08-07 08:53:10,399 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv195445168=57, srv1393094022=37, srv24937161=64, srv615075403=78, srv964597372=99, srv430585279=70, srv1110290940=6, srv249390066=65, srv1036983923=1, srv1792194979=50, srv1904962896=53, srv904360993=92, srv121501798=15, srv1307449797=26, srv1931779822=55, srv672295174=80, srv1194723956=12, srv893725815=91, srv1008716543=0, srv248229479=63, srv484664786=73, srv1165908775=10, srv201108749=60, srv1970994876=58, srv1134421258=7, srv1343446742=29, srv171272260=47, srv764818504=84, srv1100701341=5, srv433722767=71, srv1668489958=46, srv828887660=86, srv1243814406=18, srv1906483162=54, srv740370036=82, srv1594841988=44, srv85599469=88, srv1354050760=32, srv2067636886=62, srv149957919=42, srv1257105158=21, srv1285600739=22, srv1295603988=24, srv1935704728=56, srv122935209=16, srv1736078515=49, srv343335784=69, srv655564951=79, srv1051388443=2, srv1655665684=45, srv607824497=77, srv795070345=85, srv1852554333=52, srv844517512=87, srv1345732641=30, srv340037058=68, srv1994449501=59, srv1179892319=11, srv949101051=96, srv907353323=93, srv1214126972=14, srv939365972=94, srv434684986=72, srv1290559910=23, srv301095715=66, srv509788867=74, srv1295966808=25, srv1086284578=4, srv880162854=90, srv1441216198=40, srv961857972=98, srv1347496736=31, srv1200793452=13, srv1721924095=48, srv518953314=75, srv1238885417=17, srv1484653170=41, srv1331349466=28, srv1436337525=39, srv1525530271=43, srv1148136189=8, srv679293317=81, srv1079923798=3, srv570510756=76, srv1329394123=27, srv1249637944=19, srv137852873=35, srv1400450021=38, srv1835652860=51, srv2029171670=61, srv761074200=83, srv1163905264=9, srv1381664692=36, srv1251920990=20, srv879719684=89, srv1378279897=34, srv947155764=95, srv1375862509=33, srv338242171=67, srv961832556=97} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-08-07 08:53:10,475 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-08-07 08:53:10,475 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-08-07 08:53:10,475 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-08-07 08:53:10,475 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-08-07 08:53:10,475 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-08-07 08:53:10,475 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-08-07 08:53:10,476 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-08-07 08:53:10,476 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-08-07 08:53:10,476 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-08-07 08:53:10,476 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-08-07 08:53:10,476 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-08-07 08:53:10,476 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-08-07 08:53:10,476 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-08-07 08:53:10,476 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-08-07 08:53:10,477 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-08-07 08:53:10,477 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-08-07 08:53:10,477 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-08-07 08:53:10,477 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-08-07 08:53:10,477 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-08-07 08:53:10,477 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-08-07 08:53:10,477 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-08-07 08:53:10,477 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-08-07 08:53:10,477 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-08-07 08:53:10,477 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-08-07 08:53:10,478 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-08-07 08:53:10,478 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-08-07 08:53:10,478 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-08-07 08:53:10,478 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-08-07 08:53:10,478 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-08-07 08:53:10,478 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-08-07 08:53:10,478 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-08-07 08:53:10,478 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-08-07 08:53:10,478 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-08-07 08:53:10,478 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-08-07 08:53:10,478 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-08-07 08:53:10,479 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-08-07 08:53:10,479 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-08-07 08:53:10,479 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-08-07 08:53:10,479 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-08-07 08:53:10,479 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-08-07 08:53:10,479 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-08-07 08:53:10,479 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-08-07 08:53:10,480 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-08-07 08:53:10,480 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-08-07 08:53:10,480 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-08-07 08:53:10,480 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-08-07 08:53:10,480 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-08-07 08:53:10,480 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-08-07 08:53:10,480 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-08-07 08:53:10,481 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-08-07 08:53:10,481 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-08-07 08:53:10,481 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-08-07 08:53:10,481 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-08-07 08:53:10,481 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-08-07 08:53:10,481 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-08-07 08:53:10,482 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-08-07 08:53:10,482 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-08-07 08:53:10,482 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-08-07 08:53:10,482 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-08-07 08:53:10,482 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-08-07 08:53:10,482 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-08-07 08:53:10,483 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-08-07 08:53:10,483 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-08-07 08:53:10,483 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-08-07 08:53:10,483 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-08-07 08:53:10,483 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-08-07 08:53:10,483 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-08-07 08:53:10,483 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-08-07 08:53:10,484 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-08-07 08:53:10,484 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-08-07 08:53:10,484 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-08-07 08:53:10,484 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-08-07 08:53:10,484 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-08-07 08:53:10,484 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-08-07 08:53:10,485 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-08-07 08:53:10,485 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-08-07 08:53:10,485 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-08-07 08:53:10,485 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-08-07 08:53:10,485 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-08-07 08:53:10,485 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-08-07 08:53:10,485 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-08-07 08:53:10,486 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-08-07 08:53:10,486 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-08-07 08:53:10,486 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-08-07 08:53:10,486 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-08-07 08:53:10,486 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-08-07 08:53:10,486 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-08-07 08:53:10,486 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-08-07 08:53:10,487 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-08-07 08:53:10,487 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-08-07 08:53:10,487 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-08-07 08:53:10,487 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-08-07 08:53:10,487 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-08-07 08:53:10,487 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-08-07 08:53:10,487 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-08-07 08:53:10,488 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-08-07 08:53:10,488 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-08-07 08:53:10,488 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-08-07 08:53:10,488 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-08-07 08:53:10,488 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-08-07 08:53:10,488 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-08-07 08:53:10,764 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.06666666666666667, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-08-07 08:53:10,765 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-08-07 08:53:10,765 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.9909252140407105, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.06666666666666667, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-08-07 08:53:11,163 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 644 ms to try 5000 different iterations.  Found a solution that moves 4692 regions; Going from a computed imbalance of 0.9909252140407105 to a new imbalance of 0.1838882510830494. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.040054209432075695, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.056353860344767644, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.5213333333333333, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.040054209432075695, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.179, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.24725, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-08-07 08:53:11,179 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv947155764:81 , srv1036983923:82 , srv1194723956:82 , srv1655665684:82 , srv1163905264:83 , srv1381664692:83 , srv1721924095:83 , srv1994449501:83 , srv1008716543:84 , srv1285600739:84 , srv1295966808:84 , srv1378279897:84 , srv1441216198:84 , srv1736078515:84 , srv1835652860:84 , srv1852554333:84 , srv1931779822:84 , srv249390066:84 , srv338242171:84 , srv430585279:84 , srv509788867:84 , srv740370036:84 , srv764818504:84 , srv949101051:84 , srv1100701341:85 , srv1179892319:85 , srv122935209:85 , srv1375862509:85 , srv137852873:85 , srv1436337525:85 , srv1904962896:85 , srv2067636886:85 , srv301095715:85 , srv518953314:85 , srv655564951:85 , srv679293317:85 , srv795070345:85 , srv85599469:85 , srv880162854:85 , srv1079923798:86 , srv1165908775:86 , srv1200793452:86 , srv1307449797:86 , srv1343446742:86 , srv1354050760:86 , srv1525530271:86 , srv171272260:86 , srv1970994876:86 , srv24937161:86 , srv607824497:86 , srv828887660:86 , srv844517512:86 , srv879719684:86 , srv907353323:86 , srv1148136189:87 , srv121501798:87 , srv1238885417:87 , srv1257105158:87 , srv1329394123:87 , srv1331349466:87 , srv1347496736:87 , srv1484653170:87 , srv149957919:87 , srv1906483162:87 , srv1935704728:87 , srv195445168:87 , srv340037058:87 , srv484664786:87 , srv570510756:87 , srv672295174:87 , srv1086284578:88 , srv1249637944:88 , srv1251920990:88 , srv1295603988:88 , srv1393094022:88 , srv1594841988:88 , srv201108749:88 , srv434684986:88 , srv615075403:88 , srv761074200:88 , srv893725815:88 , srv904360993:88 , srv961832556:88 , srv961857972:88 , srv1051388443:89 , srv1110290940:89 , srv1214126972:89 , srv1400450021:89 , srv343335784:89 , srv1792194979:90 , srv2029171670:90 , srv964597372:90 , srv1290559910:91 , srv1668489958:91 , srv248229479:92 , srv433722767:92 , srv939365972:93 , srv1134421258:94 , srv1345732641:94 , srv1243814406:446 }
2023-08-07 08:53:11,184 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-08-07 08:53:11,185 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv195445168=57, srv1393094022=37, srv24937161=64, srv615075403=78, srv964597372=99, srv430585279=70, srv1110290940=6, srv249390066=65, srv1036983923=1, srv1792194979=50, srv1904962896=53, srv904360993=92, srv121501798=15, srv1307449797=26, srv1931779822=55, srv672295174=80, srv1194723956=12, srv893725815=91, srv1008716543=0, srv248229479=63, srv484664786=73, srv1165908775=10, srv201108749=60, srv1970994876=58, srv1134421258=7, srv1343446742=29, srv171272260=47, srv764818504=84, srv1100701341=5, srv433722767=71, srv1668489958=46, srv828887660=86, srv1243814406=18, srv1906483162=54, srv740370036=82, srv1594841988=44, srv85599469=88, srv1354050760=32, srv2067636886=62, srv149957919=42, srv1257105158=21, srv1285600739=22, srv1295603988=24, srv1935704728=56, srv122935209=16, srv1736078515=49, srv343335784=69, srv655564951=79, srv1051388443=2, srv1655665684=45, srv607824497=77, srv795070345=85, srv1852554333=52, srv844517512=87, srv1345732641=30, srv340037058=68, srv1994449501=59, srv1179892319=11, srv949101051=96, srv907353323=93, srv1214126972=14, srv939365972=94, srv434684986=72, srv1290559910=23, srv301095715=66, srv509788867=74, srv1295966808=25, srv1086284578=4, srv880162854=90, srv1441216198=40, srv961857972=98, srv1347496736=31, srv1200793452=13, srv1721924095=48, srv518953314=75, srv1238885417=17, srv1484653170=41, srv1331349466=28, srv1436337525=39, srv1525530271=43, srv1148136189=8, srv679293317=81, srv1079923798=3, srv570510756=76, srv1329394123=27, srv1249637944=19, srv137852873=35, srv1400450021=38, srv1835652860=51, srv2029171670=61, srv761074200=83, srv1163905264=9, srv1381664692=36, srv1251920990=20, srv879719684=89, srv1378279897=34, srv947155764=95, srv1375862509=33, srv338242171=67, srv961832556=97} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-08-07 08:53:11,208 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-08-07 08:53:11,208 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-08-07 08:53:11,209 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-08-07 08:53:11,209 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-08-07 08:53:11,209 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-08-07 08:53:11,209 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-08-07 08:53:11,209 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-08-07 08:53:11,209 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-08-07 08:53:11,209 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-08-07 08:53:11,209 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-08-07 08:53:11,209 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-08-07 08:53:11,210 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-08-07 08:53:11,210 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-08-07 08:53:11,210 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-08-07 08:53:11,210 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-08-07 08:53:11,210 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-08-07 08:53:11,210 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-08-07 08:53:11,210 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-08-07 08:53:11,210 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-08-07 08:53:11,210 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-08-07 08:53:11,211 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-08-07 08:53:11,211 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-08-07 08:53:11,211 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-08-07 08:53:11,211 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-08-07 08:53:11,211 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-08-07 08:53:11,211 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-08-07 08:53:11,211 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-08-07 08:53:11,211 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-08-07 08:53:11,211 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-08-07 08:53:11,212 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-08-07 08:53:11,212 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-08-07 08:53:11,212 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-08-07 08:53:11,212 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-08-07 08:53:11,212 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-08-07 08:53:11,212 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-08-07 08:53:11,212 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-08-07 08:53:11,212 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-08-07 08:53:11,212 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-08-07 08:53:11,212 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-08-07 08:53:11,213 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-08-07 08:53:11,213 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-08-07 08:53:11,213 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-08-07 08:53:11,213 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-08-07 08:53:11,213 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-08-07 08:53:11,213 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-08-07 08:53:11,213 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-08-07 08:53:11,213 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-08-07 08:53:11,213 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-08-07 08:53:11,213 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-08-07 08:53:11,213 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-08-07 08:53:11,214 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-08-07 08:53:11,214 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-08-07 08:53:11,214 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-08-07 08:53:11,214 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-08-07 08:53:11,214 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-08-07 08:53:11,214 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-08-07 08:53:11,214 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-08-07 08:53:11,214 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-08-07 08:53:11,214 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-08-07 08:53:11,215 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-08-07 08:53:11,215 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-08-07 08:53:11,215 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-08-07 08:53:11,215 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-08-07 08:53:11,215 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-08-07 08:53:11,215 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-08-07 08:53:11,215 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-08-07 08:53:11,215 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-08-07 08:53:11,215 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-08-07 08:53:11,215 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-08-07 08:53:11,216 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-08-07 08:53:11,216 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-08-07 08:53:11,216 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-08-07 08:53:11,216 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-08-07 08:53:11,216 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-08-07 08:53:11,216 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-08-07 08:53:11,216 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-08-07 08:53:11,216 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-08-07 08:53:11,216 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-08-07 08:53:11,217 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-08-07 08:53:11,217 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-08-07 08:53:11,217 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-08-07 08:53:11,217 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-08-07 08:53:11,217 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-08-07 08:53:11,217 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-08-07 08:53:11,217 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-08-07 08:53:11,217 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-08-07 08:53:11,217 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-08-07 08:53:11,217 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-08-07 08:53:11,218 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-08-07 08:53:11,218 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-08-07 08:53:11,218 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-08-07 08:53:11,218 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-08-07 08:53:11,218 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-08-07 08:53:11,218 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-08-07 08:53:11,218 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-08-07 08:53:11,218 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-08-07 08:53:11,218 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-08-07 08:53:11,218 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-08-07 08:53:11,218 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-08-07 08:53:11,219 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-08-07 08:53:11,219 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-08-07 08:53:11,389 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.040054209432075695, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.056353860344767644, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.040054209432075695, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.179, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.24725, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-08-07 08:53:11,389 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-08-07 08:53:11,390 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.18385539699684492, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.040054209432075695, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.056353860344767644, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.040054209432075695, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.179, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.24725, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-08-07 08:53:11,758 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 520 ms to try 5000 different iterations.  Found a solution that moves 2667 regions; Going from a computed imbalance of 0.18385539699684492 to a new imbalance of 0.015862065424068917. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.02338751658815269); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.03298130613594952, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.29633333333333334, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.02338751658815269); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.012666666666666666); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.04641666666666667, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-08-07 08:53:11,777 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1345732641:78 , srv1134421258:79 , srv1290559910:79 , srv1668489958:79 , srv248229479:80 , srv433722767:80 , srv939365972:80 , srv1110290940:82 , srv1214126972:82 , srv2029171670:82 , srv964597372:82 , srv1051388443:83 , srv121501798:83 , srv1393094022:83 , srv1594841988:83 , srv434684986:83 , srv615075403:83 , srv904360993:83 , srv1148136189:84 , srv1165908775:84 , srv1238885417:84 , srv1257105158:84 , srv1295603988:84 , srv1331349466:84 , srv24937161:84 , srv343335784:84 , srv570510756:84 , srv672295174:84 , srv85599469:84 , srv961832556:84 , srv961857972:84 , srv1079923798:85 , srv1086284578:85 , srv1179892319:85 , srv1200793452:85 , srv1249637944:85 , srv1285600739:85 , srv1347496736:85 , srv1354050760:85 , srv1400450021:85 , srv171272260:85 , srv301095715:85 , srv340037058:85 , srv828887660:85 , srv879719684:85 , srv907353323:85 , srv1251920990:86 , srv1307449797:86 , srv137852873:86 , srv1484653170:86 , srv149957919:86 , srv1525530271:86 , srv1792194979:86 , srv1935704728:86 , srv195445168:86 , srv1970994876:86 , srv201108749:86 , srv484664786:86 , srv655564951:86 , srv761074200:86 , srv844517512:86 , srv893725815:86 , srv1295966808:87 , srv1343446742:87 , srv1375862509:87 , srv1381664692:87 , srv1436337525:87 , srv1736078515:87 , srv1835652860:87 , srv1906483162:87 , srv1931779822:87 , srv2067636886:87 , srv249390066:87 , srv607824497:87 , srv679293317:87 , srv795070345:87 , srv880162854:87 , srv1008716543:88 , srv1100701341:88 , srv1194723956:88 , srv122935209:88 , srv1329394123:88 , srv1378279897:88 , srv1721924095:88 , srv1852554333:88 , srv1904962896:88 , srv338242171:88 , srv430585279:88 , srv509788867:88 , srv764818504:88 , srv1441216198:89 , srv1655665684:89 , srv518953314:89 , srv949101051:89 , srv1036983923:90 , srv1163905264:90 , srv740370036:90 , srv1994449501:91 , srv947155764:91 , srv1243814406:536 }
2023-08-07 08:53:11,783 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-08-07 08:53:11,785 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv195445168=57, srv1393094022=37, srv24937161=64, srv615075403=78, srv964597372=99, srv430585279=70, srv1110290940=6, srv249390066=65, srv1036983923=1, srv1792194979=50, srv1904962896=53, srv904360993=92, srv121501798=15, srv1307449797=26, srv1931779822=55, srv672295174=80, srv1194723956=12, srv893725815=91, srv1008716543=0, srv248229479=63, srv484664786=73, srv1165908775=10, srv201108749=60, srv1970994876=58, srv1134421258=7, srv1343446742=29, srv171272260=47, srv764818504=84, srv1100701341=5, srv433722767=71, srv1668489958=46, srv828887660=86, srv1243814406=18, srv1906483162=54, srv740370036=82, srv1594841988=44, srv85599469=88, srv1354050760=32, srv2067636886=62, srv149957919=42, srv1257105158=21, srv1285600739=22, srv1295603988=24, srv1935704728=56, srv122935209=16, srv1736078515=49, srv343335784=69, srv655564951=79, srv1051388443=2, srv1655665684=45, srv607824497=77, srv795070345=85, srv1852554333=52, srv844517512=87, srv1345732641=30, srv340037058=68, srv1994449501=59, srv1179892319=11, srv949101051=96, srv907353323=93, srv1214126972=14, srv939365972=94, srv434684986=72, srv1290559910=23, srv301095715=66, srv509788867=74, srv1295966808=25, srv1086284578=4, srv880162854=90, srv1441216198=40, srv961857972=98, srv1347496736=31, srv1200793452=13, srv1721924095=48, srv518953314=75, srv1238885417=17, srv1484653170=41, srv1331349466=28, srv1436337525=39, srv1525530271=43, srv1148136189=8, srv679293317=81, srv1079923798=3, srv570510756=76, srv1329394123=27, srv1249637944=19, srv137852873=35, srv1400450021=38, srv1835652860=51, srv2029171670=61, srv761074200=83, srv1163905264=9, srv1381664692=36, srv1251920990=20, srv879719684=89, srv1378279897=34, srv947155764=95, srv1375862509=33, srv338242171=67, srv961832556=97} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-08-07 08:53:11,815 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-08-07 08:53:11,816 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-08-07 08:53:11,816 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-08-07 08:53:11,816 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-08-07 08:53:11,816 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-08-07 08:53:11,816 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-08-07 08:53:11,816 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-08-07 08:53:11,816 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-08-07 08:53:11,817 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-08-07 08:53:11,817 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-08-07 08:53:11,817 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-08-07 08:53:11,817 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-08-07 08:53:11,817 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-08-07 08:53:11,817 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-08-07 08:53:11,817 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-08-07 08:53:11,817 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-08-07 08:53:11,817 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-08-07 08:53:11,818 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-08-07 08:53:11,818 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-08-07 08:53:11,818 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-08-07 08:53:11,818 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-08-07 08:53:11,818 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-08-07 08:53:11,818 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-08-07 08:53:11,818 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-08-07 08:53:11,818 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-08-07 08:53:11,819 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-08-07 08:53:11,819 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-08-07 08:53:11,819 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-08-07 08:53:11,819 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-08-07 08:53:11,819 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-08-07 08:53:11,819 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-08-07 08:53:11,819 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-08-07 08:53:11,819 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-08-07 08:53:11,820 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-08-07 08:53:11,820 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-08-07 08:53:11,820 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-08-07 08:53:11,820 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-08-07 08:53:11,820 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-08-07 08:53:11,820 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-08-07 08:53:11,820 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-08-07 08:53:11,820 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-08-07 08:53:11,821 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-08-07 08:53:11,821 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-08-07 08:53:11,821 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-08-07 08:53:11,821 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-08-07 08:53:11,821 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-08-07 08:53:11,821 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-08-07 08:53:11,821 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-08-07 08:53:11,821 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-08-07 08:53:11,821 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-08-07 08:53:11,822 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-08-07 08:53:11,822 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-08-07 08:53:11,822 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-08-07 08:53:11,822 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-08-07 08:53:11,822 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-08-07 08:53:11,822 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-08-07 08:53:11,822 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-08-07 08:53:11,822 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-08-07 08:53:11,822 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-08-07 08:53:11,823 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-08-07 08:53:11,823 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-08-07 08:53:11,823 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-08-07 08:53:11,823 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-08-07 08:53:11,823 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-08-07 08:53:11,823 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-08-07 08:53:11,823 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-08-07 08:53:11,823 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-08-07 08:53:11,823 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-08-07 08:53:11,824 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-08-07 08:53:11,824 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-08-07 08:53:11,824 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-08-07 08:53:11,824 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-08-07 08:53:11,824 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-08-07 08:53:11,824 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-08-07 08:53:11,824 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-08-07 08:53:11,824 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-08-07 08:53:11,824 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-08-07 08:53:11,825 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-08-07 08:53:11,825 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-08-07 08:53:11,825 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-08-07 08:53:11,825 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-08-07 08:53:11,825 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-08-07 08:53:11,825 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-08-07 08:53:11,825 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-08-07 08:53:11,825 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-08-07 08:53:11,825 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-08-07 08:53:11,825 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-08-07 08:53:11,826 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-08-07 08:53:11,826 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-08-07 08:53:11,826 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-08-07 08:53:11,826 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-08-07 08:53:11,826 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-08-07 08:53:11,826 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-08-07 08:53:11,826 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-08-07 08:53:11,826 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-08-07 08:53:11,826 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-08-07 08:53:11,827 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-08-07 08:53:11,827 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-08-07 08:53:11,827 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-08-07 08:53:11,827 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-08-07 08:53:11,827 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-08-07 08:53:11,989 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.02338751658815269); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.03298130613594952, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.02338751658815269); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.012666666666666666); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.04641666666666667, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-08-07 08:53:11,989 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-08-07 08:53:11,990 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.015843390690925843, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.02338751658815269); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.03298130613594952, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.02338751658815269); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.012666666666666666); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.04641666666666667, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-08-07 08:53:12,289 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 439 ms to try 5000 different iterations.  Found a solution that moves 962 regions; Going from a computed imbalance of 0.015843390690925843 to a new imbalance of 0.0011230973699183021. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.006794509347735742); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.007400670336975435); MoveCostFunction : (multiplier=7.0, imbalance=0.1068888888888889, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.006794509347735742); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=6.666666666666666E-4); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.005); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-08-07 08:53:12,291 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1792194979:81 , srv1251920990:83 , srv740370036:83 , srv761074200:83 , srv893725815:83 , srv1086284578:84 , srv1163905264:84 , srv1307449797:84 , srv1329394123:84 , srv1400450021:84 , srv1441216198:84 , srv1904962896:84 , srv1906483162:84 , srv195445168:84 , srv1994449501:84 , srv201108749:84 , srv430585279:84 , srv484664786:84 , srv518953314:84 , srv939365972:84 , srv949101051:84 , srv964597372:84 , srv1051388443:85 , srv1134421258:85 , srv122935209:85 , srv1249637944:85 , srv1257105158:85 , srv1331349466:85 , srv1343446742:85 , srv1345732641:85 , srv1378279897:85 , srv1436337525:85 , srv1484653170:85 , srv149957919:85 , srv1525530271:85 , srv1594841988:85 , srv1736078515:85 , srv1852554333:85 , srv1935704728:85 , srv1970994876:85 , srv2067636886:85 , srv343335784:85 , srv509788867:85 , srv607824497:85 , srv764818504:85 , srv795070345:85 , srv880162854:85 , srv904360993:85 , srv907353323:85 , srv947155764:85 , srv961832556:85 , srv961857972:85 , srv1008716543:86 , srv1036983923:86 , srv1079923798:86 , srv1110290940:86 , srv1148136189:86 , srv1200793452:86 , srv1290559910:86 , srv1295603988:86 , srv1295966808:86 , srv1347496736:86 , srv1375862509:86 , srv1393094022:86 , srv1655665684:86 , srv1721924095:86 , srv2029171670:86 , srv248229479:86 , srv301095715:86 , srv338242171:86 , srv340037058:86 , srv433722767:86 , srv570510756:86 , srv615075403:86 , srv679293317:86 , srv828887660:86 , srv844517512:86 , srv1100701341:87 , srv1165908775:87 , srv1179892319:87 , srv1194723956:87 , srv1214126972:87 , srv1238885417:87 , srv137852873:87 , srv1668489958:87 , srv171272260:87 , srv1835652860:87 , srv1931779822:87 , srv24937161:87 , srv434684986:87 , srv672295174:87 , srv85599469:87 , srv879719684:87 , srv1354050760:88 , srv1381664692:88 , srv249390066:88 , srv655564951:88 , srv121501798:89 , srv1285600739:90 , srv1243814406:536 }
2023-08-07 08:53:12,294 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-08-07 08:53:12,295 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv195445168=57, srv1393094022=37, srv24937161=64, srv615075403=78, srv964597372=99, srv430585279=70, srv1110290940=6, srv249390066=65, srv1036983923=1, srv1792194979=50, srv1904962896=53, srv904360993=92, srv121501798=15, srv1307449797=26, srv1931779822=55, srv672295174=80, srv1194723956=12, srv893725815=91, srv1008716543=0, srv248229479=63, srv484664786=73, srv1165908775=10, srv201108749=60, srv1970994876=58, srv1134421258=7, srv1343446742=29, srv171272260=47, srv764818504=84, srv1100701341=5, srv433722767=71, srv1668489958=46, srv828887660=86, srv1243814406=18, srv1906483162=54, srv740370036=82, srv1594841988=44, srv85599469=88, srv1354050760=32, srv2067636886=62, srv149957919=42, srv1257105158=21, srv1285600739=22, srv1295603988=24, srv1935704728=56, srv122935209=16, srv1736078515=49, srv343335784=69, srv655564951=79, srv1051388443=2, srv1655665684=45, srv607824497=77, srv795070345=85, srv1852554333=52, srv844517512=87, srv1345732641=30, srv340037058=68, srv1994449501=59, srv1179892319=11, srv949101051=96, srv907353323=93, srv1214126972=14, srv939365972=94, srv434684986=72, srv1290559910=23, srv301095715=66, srv509788867=74, srv1295966808=25, srv1086284578=4, srv880162854=90, srv1441216198=40, srv961857972=98, srv1347496736=31, srv1200793452=13, srv1721924095=48, srv518953314=75, srv1238885417=17, srv1484653170=41, srv1331349466=28, srv1436337525=39, srv1525530271=43, srv1148136189=8, srv679293317=81, srv1079923798=3, srv570510756=76, srv1329394123=27, srv1249637944=19, srv137852873=35, srv1400450021=38, srv1835652860=51, srv2029171670=61, srv761074200=83, srv1163905264=9, srv1381664692=36, srv1251920990=20, srv879719684=89, srv1378279897=34, srv947155764=95, srv1375862509=33, srv338242171=67, srv961832556=97} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-08-07 08:53:12,308 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-08-07 08:53:12,308 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-08-07 08:53:12,308 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-08-07 08:53:12,308 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-08-07 08:53:12,308 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-08-07 08:53:12,308 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-08-07 08:53:12,309 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-08-07 08:53:12,309 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-08-07 08:53:12,309 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-08-07 08:53:12,309 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-08-07 08:53:12,309 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-08-07 08:53:12,309 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-08-07 08:53:12,309 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-08-07 08:53:12,309 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-08-07 08:53:12,309 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-08-07 08:53:12,309 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-08-07 08:53:12,310 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-08-07 08:53:12,310 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-08-07 08:53:12,310 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-08-07 08:53:12,310 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-08-07 08:53:12,310 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-08-07 08:53:12,310 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-08-07 08:53:12,310 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-08-07 08:53:12,310 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-08-07 08:53:12,311 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-08-07 08:53:12,311 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-08-07 08:53:12,311 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-08-07 08:53:12,311 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-08-07 08:53:12,311 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-08-07 08:53:12,311 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-08-07 08:53:12,311 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-08-07 08:53:12,311 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-08-07 08:53:12,312 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-08-07 08:53:12,312 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-08-07 08:53:12,312 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-08-07 08:53:12,312 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-08-07 08:53:12,312 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-08-07 08:53:12,312 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-08-07 08:53:12,312 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-08-07 08:53:12,312 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-08-07 08:53:12,312 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-08-07 08:53:12,313 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-08-07 08:53:12,313 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-08-07 08:53:12,313 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-08-07 08:53:12,313 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-08-07 08:53:12,313 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-08-07 08:53:12,313 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-08-07 08:53:12,313 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-08-07 08:53:12,313 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-08-07 08:53:12,314 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-08-07 08:53:12,314 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-08-07 08:53:12,314 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-08-07 08:53:12,314 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-08-07 08:53:12,314 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-08-07 08:53:12,314 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-08-07 08:53:12,314 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-08-07 08:53:12,314 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-08-07 08:53:12,315 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-08-07 08:53:12,315 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-08-07 08:53:12,315 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-08-07 08:53:12,315 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-08-07 08:53:12,315 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-08-07 08:53:12,315 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-08-07 08:53:12,315 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-08-07 08:53:12,315 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-08-07 08:53:12,315 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-08-07 08:53:12,316 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-08-07 08:53:12,316 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-08-07 08:53:12,316 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-08-07 08:53:12,316 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-08-07 08:53:12,316 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-08-07 08:53:12,316 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-08-07 08:53:12,316 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-08-07 08:53:12,316 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-08-07 08:53:12,316 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-08-07 08:53:12,316 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-08-07 08:53:12,317 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-08-07 08:53:12,317 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-08-07 08:53:12,317 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-08-07 08:53:12,317 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-08-07 08:53:12,317 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-08-07 08:53:12,317 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-08-07 08:53:12,317 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-08-07 08:53:12,317 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-08-07 08:53:12,317 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-08-07 08:53:12,317 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-08-07 08:53:12,318 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-08-07 08:53:12,318 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-08-07 08:53:12,318 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-08-07 08:53:12,318 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-08-07 08:53:12,318 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-08-07 08:53:12,318 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-08-07 08:53:12,318 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-08-07 08:53:12,318 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-08-07 08:53:12,318 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-08-07 08:53:12,319 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-08-07 08:53:12,319 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-08-07 08:53:12,319 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-08-07 08:53:12,319 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-08-07 08:53:12,319 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-08-07 08:53:12,319 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-08-07 08:53:12,473 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.006794509347735742); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.007400670336975435); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.006794509347735742); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=6.666666666666666E-4); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.005); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-08-07 08:53:12,473 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-08-07 08:53:12,473 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.0011163613019454343, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.006794509347735742); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.007400670336975435); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.006794509347735742); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=6.666666666666666E-4); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.005); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-08-07 08:53:12,943 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 609 ms to try 5000 different iterations.  Found a solution that moves 253 regions; Going from a computed imbalance of 0.0011163613019454343 to a new imbalance of 4.2593352478440326E-5. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=4.737793696791342E-4); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0018951174787165373); MoveCostFunction : (multiplier=7.0, imbalance=0.02811111111111111, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=4.737793696791342E-4); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=3.333333333333333E-4); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-08-07 08:53:12,944 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1100701341:82 , srv1036983923:83 , srv121501798:83 , srv1285600739:83 , srv1329394123:83 , srv1354050760:83 , srv1400450021:83 , srv249390066:83 , srv1008716543:84 , srv1051388443:84 , srv1134421258:84 , srv1165908775:84 , srv1179892319:84 , srv1214126972:84 , srv122935209:84 , srv1238885417:84 , srv1295603988:84 , srv1345732641:84 , srv1347496736:84 , srv1375862509:84 , srv137852873:84 , srv1381664692:84 , srv149957919:84 , srv1668489958:84 , srv171272260:84 , srv1906483162:84 , srv1931779822:84 , srv1935704728:84 , srv1994449501:84 , srv201108749:84 , srv2029171670:84 , srv248229479:84 , srv338242171:84 , srv340037058:84 , srv343335784:84 , srv433722767:84 , srv434684986:84 , srv518953314:84 , srv607824497:84 , srv655564951:84 , srv672295174:84 , srv679293317:84 , srv740370036:84 , srv844517512:84 , srv879719684:84 , srv1079923798:85 , srv1086284578:85 , srv1110290940:85 , srv1148136189:85 , srv1163905264:85 , srv1194723956:85 , srv1200793452:85 , srv1249637944:85 , srv1251920990:85 , srv1295966808:85 , srv1343446742:85 , srv1378279897:85 , srv1436337525:85 , srv1441216198:85 , srv1484653170:85 , srv1525530271:85 , srv1655665684:85 , srv1721924095:85 , srv1792194979:85 , srv1835652860:85 , srv1852554333:85 , srv1904962896:85 , srv195445168:85 , srv1970994876:85 , srv2067636886:85 , srv24937161:85 , srv484664786:85 , srv509788867:85 , srv570510756:85 , srv615075403:85 , srv761074200:85 , srv764818504:85 , srv795070345:85 , srv828887660:85 , srv880162854:85 , srv939365972:85 , srv947155764:85 , srv949101051:85 , srv961832556:85 , srv961857972:85 , srv1257105158:86 , srv1290559910:86 , srv1307449797:86 , srv1331349466:86 , srv1393094022:86 , srv1594841988:86 , srv1736078515:86 , srv301095715:86 , srv430585279:86 , srv85599469:86 , srv904360993:86 , srv907353323:86 , srv964597372:86 , srv893725815:87 , srv1243814406:624 }
2023-08-07 08:53:12,948 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-08-07 08:53:12,948 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv195445168=57, srv1393094022=37, srv24937161=64, srv615075403=78, srv964597372=99, srv430585279=70, srv1110290940=6, srv249390066=65, srv1036983923=1, srv1792194979=50, srv1904962896=53, srv904360993=92, srv121501798=15, srv1307449797=26, srv1931779822=55, srv672295174=80, srv1194723956=12, srv893725815=91, srv1008716543=0, srv248229479=63, srv484664786=73, srv1165908775=10, srv201108749=60, srv1970994876=58, srv1134421258=7, srv1343446742=29, srv171272260=47, srv764818504=84, srv1100701341=5, srv433722767=71, srv1668489958=46, srv828887660=86, srv1243814406=18, srv1906483162=54, srv740370036=82, srv1594841988=44, srv85599469=88, srv1354050760=32, srv2067636886=62, srv149957919=42, srv1257105158=21, srv1285600739=22, srv1295603988=24, srv1935704728=56, srv122935209=16, srv1736078515=49, srv343335784=69, srv655564951=79, srv1051388443=2, srv1655665684=45, srv607824497=77, srv795070345=85, srv1852554333=52, srv844517512=87, srv1345732641=30, srv340037058=68, srv1994449501=59, srv1179892319=11, srv949101051=96, srv907353323=93, srv1214126972=14, srv939365972=94, srv434684986=72, srv1290559910=23, srv301095715=66, srv509788867=74, srv1295966808=25, srv1086284578=4, srv880162854=90, srv1441216198=40, srv961857972=98, srv1347496736=31, srv1200793452=13, srv1721924095=48, srv518953314=75, srv1238885417=17, srv1484653170=41, srv1331349466=28, srv1436337525=39, srv1525530271=43, srv1148136189=8, srv679293317=81, srv1079923798=3, srv570510756=76, srv1329394123=27, srv1249637944=19, srv137852873=35, srv1400450021=38, srv1835652860=51, srv2029171670=61, srv761074200=83, srv1163905264=9, srv1381664692=36, srv1251920990=20, srv879719684=89, srv1378279897=34, srv947155764=95, srv1375862509=33, srv338242171=67, srv961832556=97} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-08-07 08:53:12,960 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-08-07 08:53:12,961 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-08-07 08:53:12,961 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-08-07 08:53:12,961 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-08-07 08:53:12,961 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-08-07 08:53:12,961 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-08-07 08:53:12,961 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-08-07 08:53:12,961 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-08-07 08:53:12,961 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-08-07 08:53:12,961 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-08-07 08:53:12,961 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-08-07 08:53:12,961 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-08-07 08:53:12,961 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-08-07 08:53:12,962 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-08-07 08:53:12,962 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-08-07 08:53:12,962 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-08-07 08:53:12,962 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-08-07 08:53:12,962 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-08-07 08:53:12,962 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-08-07 08:53:12,962 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-08-07 08:53:12,962 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-08-07 08:53:12,962 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-08-07 08:53:12,962 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-08-07 08:53:12,962 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-08-07 08:53:12,962 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-08-07 08:53:12,962 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-08-07 08:53:12,962 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-08-07 08:53:12,962 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-08-07 08:53:12,962 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-08-07 08:53:12,962 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-08-07 08:53:12,962 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-08-07 08:53:12,962 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-08-07 08:53:12,963 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-08-07 08:53:12,963 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-08-07 08:53:12,963 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-08-07 08:53:12,963 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-08-07 08:53:12,963 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-08-07 08:53:12,963 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-08-07 08:53:12,963 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-08-07 08:53:12,963 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-08-07 08:53:12,963 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-08-07 08:53:12,963 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-08-07 08:53:12,963 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-08-07 08:53:12,963 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-08-07 08:53:12,963 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-08-07 08:53:12,963 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-08-07 08:53:12,963 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-08-07 08:53:12,963 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-08-07 08:53:12,963 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-08-07 08:53:12,963 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-08-07 08:53:12,963 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-08-07 08:53:12,963 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-08-07 08:53:12,964 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-08-07 08:53:12,964 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-08-07 08:53:12,964 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-08-07 08:53:12,964 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-08-07 08:53:12,964 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-08-07 08:53:12,964 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-08-07 08:53:12,964 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-08-07 08:53:12,964 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-08-07 08:53:12,964 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-08-07 08:53:12,964 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-08-07 08:53:12,964 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-08-07 08:53:12,964 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-08-07 08:53:12,964 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-08-07 08:53:12,964 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-08-07 08:53:12,965 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-08-07 08:53:12,965 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-08-07 08:53:12,965 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-08-07 08:53:12,965 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-08-07 08:53:12,965 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-08-07 08:53:12,965 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-08-07 08:53:12,966 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-08-07 08:53:12,966 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-08-07 08:53:12,966 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-08-07 08:53:12,966 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-08-07 08:53:12,966 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-08-07 08:53:12,966 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-08-07 08:53:12,966 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-08-07 08:53:12,966 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-08-07 08:53:12,966 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-08-07 08:53:12,966 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-08-07 08:53:12,967 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-08-07 08:53:12,967 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-08-07 08:53:12,967 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-08-07 08:53:12,967 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-08-07 08:53:12,967 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-08-07 08:53:12,967 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-08-07 08:53:12,967 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-08-07 08:53:12,967 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-08-07 08:53:12,967 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-08-07 08:53:12,967 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-08-07 08:53:12,967 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-08-07 08:53:12,968 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-08-07 08:53:12,968 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-08-07 08:53:12,968 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-08-07 08:53:12,968 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-08-07 08:53:12,968 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-08-07 08:53:12,968 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-08-07 08:53:12,968 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-08-07 08:53:12,968 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-08-07 08:53:13,104 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=4.737793696791342E-4); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0018951174787165373); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=4.737793696791342E-4); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=3.333333333333333E-4); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-08-07 08:53:13,104 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-08-07 08:53:13,105 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=4.0821808614474086E-5, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=4.737793696791342E-4); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0018951174787165373); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=4.737793696791342E-4); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=3.333333333333333E-4); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-08-07 08:53:13,460 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 482 ms to try 5000 different iterations.  Found a solution that moves 26 regions; Going from a computed imbalance of 4.0821808614474086E-5 to a new imbalance of 7.2552951874880335E-6. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0015713484026367722); MoveCostFunction : (multiplier=7.0, imbalance=0.0028888888888888888); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-08-07 08:53:13,461 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv893725815:82 , srv1249637944:83 , srv1343446742:83 , srv1393094022:83 , srv1484653170:83 , srv1835652860:83 , srv655564951:83 , srv1008716543:84 , srv1079923798:84 , srv1086284578:84 , srv1100701341:84 , srv1110290940:84 , srv1134421258:84 , srv1148136189:84 , srv1163905264:84 , srv1194723956:84 , srv1200793452:84 , srv1214126972:84 , srv121501798:84 , srv122935209:84 , srv1238885417:84 , srv1251920990:84 , srv1257105158:84 , srv1285600739:84 , srv1290559910:84 , srv1295603988:84 , srv1295966808:84 , srv1307449797:84 , srv1329394123:84 , srv1331349466:84 , srv1347496736:84 , srv1354050760:84 , srv1375862509:84 , srv1378279897:84 , srv137852873:84 , srv1381664692:84 , srv1436337525:84 , srv1441216198:84 , srv149957919:84 , srv1525530271:84 , srv1594841988:84 , srv1655665684:84 , srv171272260:84 , srv1721924095:84 , srv1736078515:84 , srv1792194979:84 , srv1852554333:84 , srv1904962896:84 , srv1906483162:84 , srv1931779822:84 , srv1935704728:84 , srv195445168:84 , srv1970994876:84 , srv1994449501:84 , srv201108749:84 , srv2029171670:84 , srv2067636886:84 , srv248229479:84 , srv24937161:84 , srv249390066:84 , srv301095715:84 , srv338242171:84 , srv340037058:84 , srv343335784:84 , srv430585279:84 , srv433722767:84 , srv434684986:84 , srv484664786:84 , srv509788867:84 , srv518953314:84 , srv570510756:84 , srv607824497:84 , srv615075403:84 , srv672295174:84 , srv679293317:84 , srv761074200:84 , srv764818504:84 , srv795070345:84 , srv828887660:84 , srv844517512:84 , srv85599469:84 , srv879719684:84 , srv880162854:84 , srv904360993:84 , srv907353323:84 , srv939365972:84 , srv947155764:84 , srv949101051:84 , srv961832556:84 , srv961857972:84 , srv964597372:84 , srv1036983923:85 , srv1051388443:85 , srv1165908775:85 , srv1179892319:85 , srv1345732641:85 , srv1400450021:85 , srv1668489958:85 , srv740370036:85 , srv1243814406:684 }
2023-08-07 08:53:13,467 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-08-07 08:53:13,468 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv195445168=57, srv1393094022=37, srv24937161=64, srv615075403=78, srv964597372=99, srv430585279=70, srv1110290940=6, srv249390066=65, srv1036983923=1, srv1792194979=50, srv1904962896=53, srv904360993=92, srv121501798=15, srv1307449797=26, srv1931779822=55, srv672295174=80, srv1194723956=12, srv893725815=91, srv1008716543=0, srv248229479=63, srv484664786=73, srv1165908775=10, srv201108749=60, srv1970994876=58, srv1134421258=7, srv1343446742=29, srv171272260=47, srv764818504=84, srv1100701341=5, srv433722767=71, srv1668489958=46, srv828887660=86, srv1243814406=18, srv1906483162=54, srv740370036=82, srv1594841988=44, srv85599469=88, srv1354050760=32, srv2067636886=62, srv149957919=42, srv1257105158=21, srv1285600739=22, srv1295603988=24, srv1935704728=56, srv122935209=16, srv1736078515=49, srv343335784=69, srv655564951=79, srv1051388443=2, srv1655665684=45, srv607824497=77, srv795070345=85, srv1852554333=52, srv844517512=87, srv1345732641=30, srv340037058=68, srv1994449501=59, srv1179892319=11, srv949101051=96, srv907353323=93, srv1214126972=14, srv939365972=94, srv434684986=72, srv1290559910=23, srv301095715=66, srv509788867=74, srv1295966808=25, srv1086284578=4, srv880162854=90, srv1441216198=40, srv961857972=98, srv1347496736=31, srv1200793452=13, srv1721924095=48, srv518953314=75, srv1238885417=17, srv1484653170=41, srv1331349466=28, srv1436337525=39, srv1525530271=43, srv1148136189=8, srv679293317=81, srv1079923798=3, srv570510756=76, srv1329394123=27, srv1249637944=19, srv137852873=35, srv1400450021=38, srv1835652860=51, srv2029171670=61, srv761074200=83, srv1163905264=9, srv1381664692=36, srv1251920990=20, srv879719684=89, srv1378279897=34, srv947155764=95, srv1375862509=33, srv338242171=67, srv961832556=97} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-08-07 08:53:13,488 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-08-07 08:53:13,488 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-08-07 08:53:13,488 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-08-07 08:53:13,488 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-08-07 08:53:13,488 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-08-07 08:53:13,488 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-08-07 08:53:13,488 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-08-07 08:53:13,489 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-08-07 08:53:13,489 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-08-07 08:53:13,489 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-08-07 08:53:13,489 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-08-07 08:53:13,489 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-08-07 08:53:13,489 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-08-07 08:53:13,489 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-08-07 08:53:13,489 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-08-07 08:53:13,489 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-08-07 08:53:13,489 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-08-07 08:53:13,489 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-08-07 08:53:13,489 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-08-07 08:53:13,489 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-08-07 08:53:13,489 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-08-07 08:53:13,489 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-08-07 08:53:13,490 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-08-07 08:53:13,490 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-08-07 08:53:13,490 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-08-07 08:53:13,490 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-08-07 08:53:13,490 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-08-07 08:53:13,490 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-08-07 08:53:13,490 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-08-07 08:53:13,490 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-08-07 08:53:13,490 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-08-07 08:53:13,490 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-08-07 08:53:13,490 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-08-07 08:53:13,490 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-08-07 08:53:13,490 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-08-07 08:53:13,490 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-08-07 08:53:13,491 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-08-07 08:53:13,491 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-08-07 08:53:13,491 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-08-07 08:53:13,491 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-08-07 08:53:13,491 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-08-07 08:53:13,491 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-08-07 08:53:13,491 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-08-07 08:53:13,491 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-08-07 08:53:13,491 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-08-07 08:53:13,491 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-08-07 08:53:13,491 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-08-07 08:53:13,491 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-08-07 08:53:13,491 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-08-07 08:53:13,491 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-08-07 08:53:13,491 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-08-07 08:53:13,492 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-08-07 08:53:13,492 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-08-07 08:53:13,492 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-08-07 08:53:13,492 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-08-07 08:53:13,492 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-08-07 08:53:13,492 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-08-07 08:53:13,492 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-08-07 08:53:13,492 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-08-07 08:53:13,492 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-08-07 08:53:13,492 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-08-07 08:53:13,492 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-08-07 08:53:13,492 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-08-07 08:53:13,492 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-08-07 08:53:13,492 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-08-07 08:53:13,493 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-08-07 08:53:13,493 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-08-07 08:53:13,493 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-08-07 08:53:13,493 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-08-07 08:53:13,493 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-08-07 08:53:13,493 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-08-07 08:53:13,493 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-08-07 08:53:13,493 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-08-07 08:53:13,493 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-08-07 08:53:13,493 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-08-07 08:53:13,493 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-08-07 08:53:13,493 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-08-07 08:53:13,493 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-08-07 08:53:13,493 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-08-07 08:53:13,493 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-08-07 08:53:13,494 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-08-07 08:53:13,494 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-08-07 08:53:13,494 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-08-07 08:53:13,494 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-08-07 08:53:13,494 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-08-07 08:53:13,494 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-08-07 08:53:13,494 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-08-07 08:53:13,494 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-08-07 08:53:13,494 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-08-07 08:53:13,494 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-08-07 08:53:13,494 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-08-07 08:53:13,494 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-08-07 08:53:13,495 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-08-07 08:53:13,495 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-08-07 08:53:13,495 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-08-07 08:53:13,495 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-08-07 08:53:13,495 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-08-07 08:53:13,495 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-08-07 08:53:13,495 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-08-07 08:53:13,495 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-08-07 08:53:13,495 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-08-07 08:53:13,658 INFO  [Time-limited test] balancer.StochasticLoadBalancer(381): Cluster wide - skipping load balancing because weighted average imbalance=7.073239296329447E-6 <= threshold(0.025). If you want more aggressive balancing, either lower hbase.master.balancer.stochastic.minCostNeedBalance from 0.025 or increase the relative multiplier(s) of the specific cost function(s). functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0015713484026367722); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-08-07 08:53:13,658 INFO  [Time-limited test] balancer.BalancerTestBase(570): Mock Final balance: { srv893725815:82 , srv1249637944:83 , srv1343446742:83 , srv1393094022:83 , srv1484653170:83 , srv1835652860:83 , srv655564951:83 , srv1008716543:84 , srv1079923798:84 , srv1086284578:84 , srv1100701341:84 , srv1110290940:84 , srv1134421258:84 , srv1148136189:84 , srv1163905264:84 , srv1194723956:84 , srv1200793452:84 , srv1214126972:84 , srv121501798:84 , srv122935209:84 , srv1238885417:84 , srv1251920990:84 , srv1257105158:84 , srv1285600739:84 , srv1290559910:84 , srv1295603988:84 , srv1295966808:84 , srv1307449797:84 , srv1329394123:84 , srv1331349466:84 , srv1347496736:84 , srv1354050760:84 , srv1375862509:84 , srv1378279897:84 , srv137852873:84 , srv1381664692:84 , srv1436337525:84 , srv1441216198:84 , srv149957919:84 , srv1525530271:84 , srv1594841988:84 , srv1655665684:84 , srv171272260:84 , srv1721924095:84 , srv1736078515:84 , srv1792194979:84 , srv1852554333:84 , srv1904962896:84 , srv1906483162:84 , srv1931779822:84 , srv1935704728:84 , srv195445168:84 , srv1970994876:84 , srv1994449501:84 , srv201108749:84 , srv2029171670:84 , srv2067636886:84 , srv248229479:84 , srv24937161:84 , srv249390066:84 , srv301095715:84 , srv338242171:84 , srv340037058:84 , srv343335784:84 , srv430585279:84 , srv433722767:84 , srv434684986:84 , srv484664786:84 , srv509788867:84 , srv518953314:84 , srv570510756:84 , srv607824497:84 , srv615075403:84 , srv672295174:84 , srv679293317:84 , srv761074200:84 , srv764818504:84 , srv795070345:84 , srv828887660:84 , srv844517512:84 , srv85599469:84 , srv879719684:84 , srv880162854:84 , srv904360993:84 , srv907353323:84 , srv939365972:84 , srv947155764:84 , srv949101051:84 , srv961832556:84 , srv961857972:84 , srv964597372:84 , srv1036983923:85 , srv1051388443:85 , srv1165908775:85 , srv1179892319:85 , srv1345732641:85 , srv1400450021:85 , srv1668489958:85 , srv740370036:85 , srv1243814406:684 }
2023-08-07 08:53:13,694 INFO  [Time-limited test] hbase.ResourceChecker(175): after: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnLargeClusterWithRacks Thread=12 (was 12), OpenFileDescriptor=263 (was 263), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=340 (was 317) - SystemLoadAverage LEAK? -, ProcessCount=174 (was 174), AvailableMemoryMB=2510 (was 3371)
2023-08-07 08:53:13,703 INFO  [Time-limited test] hbase.ResourceChecker(147): before: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnMidClusterWithRacks Thread=12, OpenFileDescriptor=263, MaxFileDescriptor=60000, SystemLoadAverage=340, ProcessCount=178, AvailableMemoryMB=2508
2023-08-07 08:53:13,704 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2023-08-07 08:53:13,704 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=5000, runMaxSteps=true, stepsPerRegion=800, maxRunningTime=120000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 111077.0 etc.
2023-08-07 08:53:13,716 INFO  [Time-limited test] balancer.BalancerTestBase(547): Mock Cluster : { srv1151755676:84 , srv1207289238:84 , srv1231572026:84 , srv1246376017:84 , srv127489886:84 , srv1388248322:84 , srv1443377389:84 , srv1478038283:84 , srv2062433634:84 , srv2132454959:84 , srv21448359:84 , srv228728784:84 , srv307569591:84 , srv316719331:84 , srv360328501:84 , srv373756761:84 , srv389734846:84 , srv416939497:84 , srv467613456:84 , srv487769916:84 , srv511735519:84 , srv515268731:84 , srv770523559:84 , srv779105049:84 , srv803424528:84 , srv836588014:84 , srv840421635:84 , srv887101266:84 , srv937461822:84 , srv1748024450:264 } [srvr=30 rgns=2700 avg=90.0 max=90 min=90]
2023-08-07 08:53:13,717 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-08-07 08:53:13,718 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1443377389=6, srv836588014=26, srv1151755676=0, srv803424528=25, srv487769916=20, srv1231572026=2, srv467613456=19, srv840421635=27, srv770523559=23, srv1478038283=7, srv389734846=17, srv2132454959=10, srv1207289238=1, srv2062433634=9, srv1246376017=3, srv228728784=12, srv360328501=15, srv316719331=14, srv416939497=18, srv887101266=28, srv1388248322=5, srv307569591=13, srv373756761=16, srv21448359=11, srv515268731=22, srv779105049=24, srv127489886=4, srv511735519=21, srv937461822=29, srv1748024450=8} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-08-07 08:53:13,728 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-08-07 08:53:13,728 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-08-07 08:53:13,728 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-08-07 08:53:13,728 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-08-07 08:53:13,728 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-08-07 08:53:13,728 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-08-07 08:53:13,728 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-08-07 08:53:13,728 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-08-07 08:53:13,728 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-08-07 08:53:13,728 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-08-07 08:53:13,728 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-08-07 08:53:13,728 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-08-07 08:53:13,728 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-08-07 08:53:13,729 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-08-07 08:53:13,729 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-08-07 08:53:13,729 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-08-07 08:53:13,729 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-08-07 08:53:13,729 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-08-07 08:53:13,729 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-08-07 08:53:13,729 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-08-07 08:53:13,729 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-08-07 08:53:13,729 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-08-07 08:53:13,729 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-08-07 08:53:13,729 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-08-07 08:53:13,729 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-08-07 08:53:13,729 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-08-07 08:53:13,729 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-08-07 08:53:13,729 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-08-07 08:53:13,729 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-08-07 08:53:13,729 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-08-07 08:53:13,729 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=10, number of hosts=30, number of racks=4
2023-08-07 08:53:13,750 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=1.0903277698935003, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-08-07 08:53:13,750 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.9912477663117741, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=1.0903277698935003, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=64800000
2023-08-07 08:55:13,733 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 120001 ms to try 5668174 different iterations.  Found a solution that moves 1853 regions; Going from a computed imbalance of 0.9912477663117741 to a new imbalance of 4.324994439959734E-5. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); MoveCostFunction : (multiplier=7.0, imbalance=0.6862962962962963, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-08-07 08:55:13,743 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1151755676:90 , srv1207289238:90 , srv1231572026:90 , srv1246376017:90 , srv127489886:90 , srv1388248322:90 , srv1443377389:90 , srv1478038283:90 , srv1748024450:90 , srv2062433634:90 , srv2132454959:90 , srv21448359:90 , srv228728784:90 , srv307569591:90 , srv316719331:90 , srv360328501:90 , srv373756761:90 , srv389734846:90 , srv416939497:90 , srv467613456:90 , srv487769916:90 , srv511735519:90 , srv515268731:90 , srv770523559:90 , srv779105049:90 , srv803424528:90 , srv836588014:90 , srv840421635:90 , srv887101266:90 , srv937461822:90 }
2023-08-07 08:55:13,744 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-08-07 08:55:13,745 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1443377389=6, srv836588014=26, srv1151755676=0, srv803424528=25, srv487769916=20, srv1231572026=2, srv467613456=19, srv840421635=27, srv770523559=23, srv1478038283=7, srv389734846=17, srv2132454959=10, srv1207289238=1, srv2062433634=9, srv1246376017=3, srv228728784=12, srv360328501=15, srv316719331=14, srv416939497=18, srv887101266=28, srv1388248322=5, srv307569591=13, srv373756761=16, srv21448359=11, srv515268731=22, srv779105049=24, srv127489886=4, srv511735519=21, srv937461822=29, srv1748024450=8} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-08-07 08:55:13,750 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-08-07 08:55:13,750 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-08-07 08:55:13,750 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-08-07 08:55:13,750 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-08-07 08:55:13,750 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-08-07 08:55:13,750 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-08-07 08:55:13,751 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-08-07 08:55:13,751 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-08-07 08:55:13,751 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-08-07 08:55:13,751 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-08-07 08:55:13,751 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-08-07 08:55:13,751 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-08-07 08:55:13,751 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-08-07 08:55:13,751 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-08-07 08:55:13,751 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-08-07 08:55:13,751 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-08-07 08:55:13,751 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-08-07 08:55:13,751 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-08-07 08:55:13,751 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-08-07 08:55:13,751 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-08-07 08:55:13,752 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-08-07 08:55:13,752 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-08-07 08:55:13,752 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-08-07 08:55:13,752 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-08-07 08:55:13,752 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-08-07 08:55:13,752 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-08-07 08:55:13,752 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-08-07 08:55:13,752 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-08-07 08:55:13,752 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-08-07 08:55:13,752 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-08-07 08:55:13,752 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=10, number of hosts=30, number of racks=4
2023-08-07 08:55:13,770 INFO  [Time-limited test] balancer.StochasticLoadBalancer(381): Cluster wide - skipping load balancing because weighted average imbalance=0.0 <= threshold(0.025). If you want more aggressive balancing, either lower hbase.master.balancer.stochastic.minCostNeedBalance from 0.025 or increase the relative multiplier(s) of the specific cost function(s). functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-08-07 08:55:13,770 INFO  [Time-limited test] balancer.BalancerTestBase(570): Mock Final balance: { srv1151755676:90 , srv1207289238:90 , srv1231572026:90 , srv1246376017:90 , srv127489886:90 , srv1388248322:90 , srv1443377389:90 , srv1478038283:90 , srv1748024450:90 , srv2062433634:90 , srv2132454959:90 , srv21448359:90 , srv228728784:90 , srv307569591:90 , srv316719331:90 , srv360328501:90 , srv373756761:90 , srv389734846:90 , srv416939497:90 , srv467613456:90 , srv487769916:90 , srv511735519:90 , srv515268731:90 , srv770523559:90 , srv779105049:90 , srv803424528:90 , srv836588014:90 , srv840421635:90 , srv887101266:90 , srv937461822:90 }
2023-08-07 08:55:13,803 INFO  [Time-limited test] hbase.ResourceChecker(175): after: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnMidClusterWithRacks Thread=11 (was 12), OpenFileDescriptor=263 (was 263), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=224 (was 340), ProcessCount=175 (was 178), AvailableMemoryMB=2441 (was 2508)