2023-04-17 18:55:37,837 INFO  [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks timeout: 13 mins
2023-04-17 18:55:38,133 WARN  [Time-limited test] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties
2023-04-17 18:55:38,235 INFO  [Time-limited test] metrics.MetricRegistriesLoader(60): Loaded MetricRegistries class org.apache.hadoop.hbase.metrics.impl.MetricRegistriesImpl
2023-04-17 18:55:38,295 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2023-04-17 18:55:38,303 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc.
2023-04-17 18:55:38,318 INFO  [Time-limited test] hbase.ResourceChecker(147): before: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnLargeClusterWithRacks Thread=10, OpenFileDescriptor=260, MaxFileDescriptor=60000, SystemLoadAverage=369, ProcessCount=169, AvailableMemoryMB=1315
2023-04-17 18:55:38,320 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2023-04-17 18:55:38,320 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=5000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=10000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc.
2023-04-17 18:55:38,459 INFO  [Time-limited test] balancer.BalancerTestBase(547): Mock Cluster : { srv1007129899:84 , srv1023883066:84 , srv1029661196:84 , srv103610012:84 , srv1074068497:84 , srv108383402:84 , srv1084598616:84 , srv1089735978:84 , srv1128300103:84 , srv1151659576:84 , srv1233034965:84 , srv1263747023:84 , srv1318224262:84 , srv1354862679:84 , srv1360706874:84 , srv137412657:84 , srv1384672262:84 , srv1396631718:84 , srv1402958941:84 , srv1404670674:84 , srv1421745426:84 , srv1463527153:84 , srv1501610719:84 , srv1529638201:84 , srv155557537:84 , srv1570568937:84 , srv1622004378:84 , srv1627347917:84 , srv162851546:84 , srv1632148918:84 , srv1652630379:84 , srv167603893:84 , srv1711862020:84 , srv1714202601:84 , srv1763475530:84 , srv1766565182:84 , srv1835192093:84 , srv187227097:84 , srv1872292163:84 , srv1881850740:84 , srv190847600:84 , srv1915031551:84 , srv1930233430:84 , srv1980272457:84 , srv1995448859:84 , srv2001061210:84 , srv2016660964:84 , srv2029706344:84 , srv2048406842:84 , srv2063803998:84 , srv225711138:84 , srv245393046:84 , srv295765928:84 , srv338601663:84 , srv3443083:84 , srv354736721:84 , srv364848204:84 , srv378124858:84 , srv430772205:84 , srv452456740:84 , srv47708389:84 , srv4841866:84 , srv498748505:84 , srv508134837:84 , srv509450626:84 , srv50995882:84 , srv515632703:84 , srv522212471:84 , srv532138381:84 , srv589225066:84 , srv589983458:84 , srv613503967:84 , srv613627539:84 , srv614138434:84 , srv629908343:84 , srv683501760:84 , srv738505753:84 , srv753761459:84 , srv754638286:84 , srv772039604:84 , srv77408441:84 , srv789409490:84 , srv802126452:84 , srv807163915:84 , srv897232149:84 , srv897296986:84 , srv905528623:84 , srv909434650:84 , srv910350179:84 , srv917898797:84 , srv926777992:84 , srv946651926:84 , srv961729567:84 , srv976530426:84 , srv981879350:84 , srv989050276:84 , srv98927113:84 , srv995372004:84 , srv997867787:84 , srv15140642:684 } [srvr=100 rgns=9000 avg=90.0 max=90 min=90]
2023-04-17 18:55:38,466 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-04-17 18:55:38,473 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv522212471=68, srv802126452=83, srv1627347917=28, srv1763475530=35, srv47708389=61, srv4841866=62, srv50995882=66, srv1980272457=44, srv910350179=89, srv137412657=15, srv1396631718=17, srv1570568937=26, srv295765928=53, srv2048406842=49, srv897296986=86, srv1652630379=31, srv1128300103=8, srv338601663=54, srv738505753=77, srv753761459=78, srv364848204=57, srv772039604=80, srv452456740=60, srv807163915=84, srv1151659576=9, srv155557537=25, srv108383402=5, srv1622004378=27, srv1632148918=30, srv2016660964=47, srv1007129899=0, srv378124858=58, srv354736721=56, srv2063803998=50, srv225711138=51, srv629908343=75, srv162851546=29, srv1360706874=14, srv1084598616=6, srv190847600=41, srv589225066=70, srv589983458=71, srv1766565182=36, srv989050276=96, srv167603893=32, srv3443083=55, srv245393046=52, srv1233034965=10, srv997867787=99, srv2001061210=46, srv1023883066=1, srv683501760=76, srv1263747023=11, srv98927113=97, srv1089735978=7, srv789409490=82, srv77408441=81, srv926777992=91, srv1835192093=37, srv1318224262=12, srv532138381=69, srv613503967=72, srv1501610719=22, srv15140642=23, srv1463527153=21, srv1404670674=19, srv754638286=79, srv1711862020=33, srv1881850740=40, srv103610012=3, srv613627539=73, srv976530426=94, srv905528623=87, srv498748505=63, srv187227097=38, srv1872292163=39, srv1995448859=45, srv2029706344=48, srv430772205=59, srv917898797=90, srv1354862679=13, srv995372004=98, srv897232149=85, srv1384672262=16, srv981879350=95, srv509450626=65, srv1714202601=34, srv614138434=74, srv1930233430=43, srv961729567=93, srv909434650=88, srv1029661196=2, srv1402958941=18, srv1421745426=20, srv1529638201=24, srv508134837=64, srv1074068497=4, srv1915031551=42, srv515632703=67, srv946651926=92} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-04-17 18:55:38,551 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-04-17 18:55:38,551 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-04-17 18:55:38,552 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-04-17 18:55:38,552 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-04-17 18:55:38,552 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-04-17 18:55:38,552 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-04-17 18:55:38,552 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-04-17 18:55:38,552 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-04-17 18:55:38,552 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-04-17 18:55:38,552 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-04-17 18:55:38,552 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-04-17 18:55:38,552 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-04-17 18:55:38,553 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-04-17 18:55:38,553 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-04-17 18:55:38,553 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-04-17 18:55:38,553 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-04-17 18:55:38,553 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-04-17 18:55:38,553 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-04-17 18:55:38,553 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-04-17 18:55:38,553 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-04-17 18:55:38,553 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-04-17 18:55:38,553 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-04-17 18:55:38,553 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-04-17 18:55:38,553 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-04-17 18:55:38,554 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-04-17 18:55:38,554 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-04-17 18:55:38,554 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-04-17 18:55:38,554 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-04-17 18:55:38,554 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-04-17 18:55:38,554 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-04-17 18:55:38,554 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-04-17 18:55:38,554 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-04-17 18:55:38,554 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-04-17 18:55:38,554 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-04-17 18:55:38,554 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-04-17 18:55:38,554 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-04-17 18:55:38,555 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-04-17 18:55:38,555 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-04-17 18:55:38,555 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-04-17 18:55:38,555 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-04-17 18:55:38,555 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-04-17 18:55:38,555 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-04-17 18:55:38,555 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-04-17 18:55:38,555 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-04-17 18:55:38,555 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-04-17 18:55:38,555 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-04-17 18:55:38,555 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-04-17 18:55:38,556 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-04-17 18:55:38,556 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-04-17 18:55:38,556 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-04-17 18:55:38,556 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-04-17 18:55:38,556 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-04-17 18:55:38,556 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-04-17 18:55:38,556 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-04-17 18:55:38,556 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-04-17 18:55:38,556 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-04-17 18:55:38,556 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-04-17 18:55:38,556 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-04-17 18:55:38,556 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-04-17 18:55:38,557 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-04-17 18:55:38,557 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-04-17 18:55:38,557 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-04-17 18:55:38,557 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-04-17 18:55:38,557 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-04-17 18:55:38,557 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-04-17 18:55:38,557 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-04-17 18:55:38,557 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-04-17 18:55:38,557 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-04-17 18:55:38,557 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-04-17 18:55:38,557 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-04-17 18:55:38,557 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-04-17 18:55:38,558 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-04-17 18:55:38,558 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-04-17 18:55:38,558 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-04-17 18:55:38,558 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-04-17 18:55:38,558 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-04-17 18:55:38,558 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-04-17 18:55:38,558 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-04-17 18:55:38,558 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-04-17 18:55:38,558 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-04-17 18:55:38,558 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-04-17 18:55:38,558 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-04-17 18:55:38,558 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-04-17 18:55:38,559 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-04-17 18:55:38,559 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-04-17 18:55:38,559 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-04-17 18:55:38,559 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-04-17 18:55:38,559 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-04-17 18:55:38,559 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-04-17 18:55:38,559 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-04-17 18:55:38,559 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-04-17 18:55:38,559 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-04-17 18:55:38,559 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-04-17 18:55:38,559 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-04-17 18:55:38,559 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-04-17 18:55:38,559 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-04-17 18:55:38,560 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-04-17 18:55:38,560 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-04-17 18:55:38,560 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-04-17 18:55:38,560 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-04-17 18:55:38,560 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-04-17 18:55:38,837 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.06666666666666667, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-04-17 18:55:38,838 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-04-17 18:55:38,838 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.9909252140407105, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.06666666666666667, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-04-17 18:55:39,452 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 868 ms to try 5000 different iterations.  Found a solution that moves 4720 regions; Going from a computed imbalance of 0.9909252140407105 to a new imbalance of 0.1831026694945468. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.04010368156381583, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.05507061072936725, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.5244444444444445, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.04010368156381583, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.17791666666666667, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.24941666666666668, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-04-17 18:55:39,468 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv378124858:81 , srv1074068497:82 , srv1711862020:82 , srv1881850740:82 , srv2029706344:82 , srv245393046:82 , srv1151659576:83 , srv1714202601:83 , srv1995448859:83 , srv4841866:83 , srv509450626:83 , srv589225066:83 , srv772039604:83 , srv98927113:83 , srv108383402:84 , srv1233034965:84 , srv1360706874:84 , srv1627347917:84 , srv1835192093:84 , srv187227097:84 , srv190847600:84 , srv1980272457:84 , srv2016660964:84 , srv295765928:84 , srv338601663:84 , srv364848204:84 , srv738505753:84 , srv789409490:84 , srv946651926:84 , srv976530426:84 , srv995372004:84 , srv1007129899:85 , srv1084598616:85 , srv1089735978:85 , srv1396631718:85 , srv1402958941:85 , srv1570568937:85 , srv1632148918:85 , srv1766565182:85 , srv1915031551:85 , srv452456740:85 , srv522212471:85 , srv1354862679:86 , srv1529638201:86 , srv155557537:86 , srv2048406842:86 , srv50995882:86 , srv629908343:86 , srv754638286:86 , srv77408441:86 , srv909434650:86 , srv910350179:86 , srv917898797:86 , srv926777992:86 , srv997867787:86 , srv1023883066:87 , srv1029661196:87 , srv1128300103:87 , srv1318224262:87 , srv1463527153:87 , srv167603893:87 , srv1763475530:87 , srv1872292163:87 , srv354736721:87 , srv589983458:87 , srv613627539:87 , srv614138434:87 , srv683501760:87 , srv807163915:87 , srv897296986:87 , srv103610012:88 , srv1384672262:88 , srv162851546:88 , srv3443083:88 , srv1263747023:89 , srv1421745426:89 , srv1501610719:89 , srv1652630379:89 , srv1930233430:89 , srv2063803998:89 , srv225711138:89 , srv430772205:89 , srv47708389:89 , srv498748505:89 , srv515632703:89 , srv532138381:89 , srv802126452:89 , srv905528623:89 , srv989050276:89 , srv1404670674:90 , srv1622004378:90 , srv897232149:90 , srv508134837:91 , srv753761459:91 , srv961729567:91 , srv981879350:92 , srv2001061210:93 , srv613503967:98 , srv137412657:100 , srv15140642:446 }
2023-04-17 18:55:39,474 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-04-17 18:55:39,475 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv522212471=68, srv802126452=83, srv1627347917=28, srv1763475530=35, srv47708389=61, srv4841866=62, srv50995882=66, srv1980272457=44, srv910350179=89, srv137412657=15, srv1396631718=17, srv1570568937=26, srv295765928=53, srv2048406842=49, srv897296986=86, srv1652630379=31, srv1128300103=8, srv338601663=54, srv738505753=77, srv753761459=78, srv364848204=57, srv772039604=80, srv452456740=60, srv807163915=84, srv1151659576=9, srv155557537=25, srv108383402=5, srv1622004378=27, srv1632148918=30, srv2016660964=47, srv1007129899=0, srv378124858=58, srv354736721=56, srv2063803998=50, srv225711138=51, srv629908343=75, srv162851546=29, srv1360706874=14, srv1084598616=6, srv190847600=41, srv589225066=70, srv589983458=71, srv1766565182=36, srv989050276=96, srv167603893=32, srv3443083=55, srv245393046=52, srv1233034965=10, srv997867787=99, srv2001061210=46, srv1023883066=1, srv683501760=76, srv1263747023=11, srv98927113=97, srv1089735978=7, srv789409490=82, srv77408441=81, srv926777992=91, srv1835192093=37, srv1318224262=12, srv532138381=69, srv613503967=72, srv1501610719=22, srv15140642=23, srv1463527153=21, srv1404670674=19, srv754638286=79, srv1711862020=33, srv1881850740=40, srv103610012=3, srv613627539=73, srv976530426=94, srv905528623=87, srv498748505=63, srv187227097=38, srv1872292163=39, srv1995448859=45, srv2029706344=48, srv430772205=59, srv917898797=90, srv1354862679=13, srv995372004=98, srv897232149=85, srv1384672262=16, srv981879350=95, srv509450626=65, srv1714202601=34, srv614138434=74, srv1930233430=43, srv961729567=93, srv909434650=88, srv1029661196=2, srv1402958941=18, srv1421745426=20, srv1529638201=24, srv508134837=64, srv1074068497=4, srv1915031551=42, srv515632703=67, srv946651926=92} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-04-17 18:55:39,505 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-04-17 18:55:39,506 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-04-17 18:55:39,506 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-04-17 18:55:39,506 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-04-17 18:55:39,506 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-04-17 18:55:39,506 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-04-17 18:55:39,506 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-04-17 18:55:39,506 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-04-17 18:55:39,506 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-04-17 18:55:39,506 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-04-17 18:55:39,506 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-04-17 18:55:39,506 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-04-17 18:55:39,507 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-04-17 18:55:39,507 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-04-17 18:55:39,507 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-04-17 18:55:39,507 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-04-17 18:55:39,507 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-04-17 18:55:39,507 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-04-17 18:55:39,507 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-04-17 18:55:39,507 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-04-17 18:55:39,507 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-04-17 18:55:39,507 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-04-17 18:55:39,507 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-04-17 18:55:39,507 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-04-17 18:55:39,507 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-04-17 18:55:39,507 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-04-17 18:55:39,508 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-04-17 18:55:39,508 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-04-17 18:55:39,508 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-04-17 18:55:39,508 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-04-17 18:55:39,508 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-04-17 18:55:39,508 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-04-17 18:55:39,508 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-04-17 18:55:39,508 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-04-17 18:55:39,508 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-04-17 18:55:39,508 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-04-17 18:55:39,508 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-04-17 18:55:39,508 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-04-17 18:55:39,508 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-04-17 18:55:39,508 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-04-17 18:55:39,509 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-04-17 18:55:39,509 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-04-17 18:55:39,509 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-04-17 18:55:39,509 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-04-17 18:55:39,509 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-04-17 18:55:39,509 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-04-17 18:55:39,509 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-04-17 18:55:39,509 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-04-17 18:55:39,509 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-04-17 18:55:39,509 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-04-17 18:55:39,509 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-04-17 18:55:39,509 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-04-17 18:55:39,509 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-04-17 18:55:39,509 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-04-17 18:55:39,509 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-04-17 18:55:39,510 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-04-17 18:55:39,510 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-04-17 18:55:39,510 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-04-17 18:55:39,510 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-04-17 18:55:39,510 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-04-17 18:55:39,510 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-04-17 18:55:39,510 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-04-17 18:55:39,510 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-04-17 18:55:39,510 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-04-17 18:55:39,510 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-04-17 18:55:39,510 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-04-17 18:55:39,510 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-04-17 18:55:39,510 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-04-17 18:55:39,510 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-04-17 18:55:39,510 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-04-17 18:55:39,511 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-04-17 18:55:39,511 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-04-17 18:55:39,511 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-04-17 18:55:39,511 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-04-17 18:55:39,511 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-04-17 18:55:39,511 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-04-17 18:55:39,511 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-04-17 18:55:39,511 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-04-17 18:55:39,511 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-04-17 18:55:39,511 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-04-17 18:55:39,511 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-04-17 18:55:39,511 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-04-17 18:55:39,511 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-04-17 18:55:39,511 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-04-17 18:55:39,512 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-04-17 18:55:39,512 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-04-17 18:55:39,512 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-04-17 18:55:39,512 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-04-17 18:55:39,512 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-04-17 18:55:39,512 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-04-17 18:55:39,512 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-04-17 18:55:39,512 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-04-17 18:55:39,512 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-04-17 18:55:39,512 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-04-17 18:55:39,512 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-04-17 18:55:39,512 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-04-17 18:55:39,512 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-04-17 18:55:39,512 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-04-17 18:55:39,513 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-04-17 18:55:39,513 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-04-17 18:55:39,513 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-04-17 18:55:39,661 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.04010368156381583, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.05507061072936725, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.04010368156381583, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.17791666666666667, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.24941666666666668, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-04-17 18:55:39,661 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-04-17 18:55:39,661 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.18306961934815183, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.04010368156381583, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.05507061072936725, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.04010368156381583, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.17791666666666667, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.24941666666666668, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-04-17 18:55:39,954 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 420 ms to try 5000 different iterations.  Found a solution that moves 2638 regions; Going from a computed imbalance of 0.18306961934815183 to a new imbalance of 0.016836085003637966. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.023518319678896445); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.03593547028621384, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.2931111111111111, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.023518319678896445); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.013833333333333333); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.04541666666666667, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-04-17 18:55:39,962 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv613503967:73 , srv137412657:75 , srv2001061210:77 , srv225711138:80 , srv961729567:80 , srv1404670674:81 , srv1421745426:81 , srv1501610719:81 , srv2063803998:81 , srv508134837:81 , srv515632703:81 , srv981879350:81 , srv753761459:82 , srv802126452:82 , srv1463527153:83 , srv1622004378:83 , srv1930233430:83 , srv3443083:83 , srv430772205:83 , srv47708389:83 , srv532138381:83 , srv589983458:83 , srv897232149:83 , srv1128300103:84 , srv1263747023:84 , srv1384672262:84 , srv1652630379:84 , srv1915031551:84 , srv498748505:84 , srv614138434:84 , srv683501760:84 , srv905528623:84 , srv1007129899:85 , srv103610012:85 , srv1084598616:85 , srv1089735978:85 , srv1318224262:85 , srv1402958941:85 , srv1570568937:85 , srv1632148918:85 , srv1763475530:85 , srv354736721:85 , srv613627539:85 , srv77408441:85 , srv789409490:85 , srv807163915:85 , srv910350179:85 , srv926777992:85 , srv989050276:85 , srv997867787:85 , srv1029661196:86 , srv1354862679:86 , srv155557537:86 , srv167603893:86 , srv1714202601:86 , srv1766565182:86 , srv1872292163:86 , srv452456740:86 , srv50995882:86 , srv629908343:86 , srv897296986:86 , srv1023883066:87 , srv1233034965:87 , srv1360706874:87 , srv1396631718:87 , srv1627347917:87 , srv2016660964:87 , srv2048406842:87 , srv295765928:87 , srv338601663:87 , srv364848204:87 , srv754638286:87 , srv909434650:87 , srv1151659576:88 , srv1529638201:88 , srv162851546:88 , srv1881850740:88 , srv509450626:88 , srv772039604:88 , srv917898797:88 , srv98927113:88 , srv995372004:88 , srv108383402:89 , srv1711862020:89 , srv187227097:89 , srv190847600:89 , srv1980272457:89 , srv1995448859:89 , srv4841866:89 , srv522212471:89 , srv738505753:89 , srv1074068497:91 , srv1835192093:91 , srv2029706344:91 , srv378124858:91 , srv589225066:91 , srv946651926:91 , srv976530426:91 , srv245393046:94 , srv15140642:537 }
2023-04-17 18:55:39,966 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-04-17 18:55:39,966 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv522212471=68, srv802126452=83, srv1627347917=28, srv1763475530=35, srv47708389=61, srv4841866=62, srv50995882=66, srv1980272457=44, srv910350179=89, srv137412657=15, srv1396631718=17, srv1570568937=26, srv295765928=53, srv2048406842=49, srv897296986=86, srv1652630379=31, srv1128300103=8, srv338601663=54, srv738505753=77, srv753761459=78, srv364848204=57, srv772039604=80, srv452456740=60, srv807163915=84, srv1151659576=9, srv155557537=25, srv108383402=5, srv1622004378=27, srv1632148918=30, srv2016660964=47, srv1007129899=0, srv378124858=58, srv354736721=56, srv2063803998=50, srv225711138=51, srv629908343=75, srv162851546=29, srv1360706874=14, srv1084598616=6, srv190847600=41, srv589225066=70, srv589983458=71, srv1766565182=36, srv989050276=96, srv167603893=32, srv3443083=55, srv245393046=52, srv1233034965=10, srv997867787=99, srv2001061210=46, srv1023883066=1, srv683501760=76, srv1263747023=11, srv98927113=97, srv1089735978=7, srv789409490=82, srv77408441=81, srv926777992=91, srv1835192093=37, srv1318224262=12, srv532138381=69, srv613503967=72, srv1501610719=22, srv15140642=23, srv1463527153=21, srv1404670674=19, srv754638286=79, srv1711862020=33, srv1881850740=40, srv103610012=3, srv613627539=73, srv976530426=94, srv905528623=87, srv498748505=63, srv187227097=38, srv1872292163=39, srv1995448859=45, srv2029706344=48, srv430772205=59, srv917898797=90, srv1354862679=13, srv995372004=98, srv897232149=85, srv1384672262=16, srv981879350=95, srv509450626=65, srv1714202601=34, srv614138434=74, srv1930233430=43, srv961729567=93, srv909434650=88, srv1029661196=2, srv1402958941=18, srv1421745426=20, srv1529638201=24, srv508134837=64, srv1074068497=4, srv1915031551=42, srv515632703=67, srv946651926=92} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-04-17 18:55:39,977 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-04-17 18:55:39,977 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-04-17 18:55:39,978 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-04-17 18:55:39,978 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-04-17 18:55:39,978 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-04-17 18:55:39,978 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-04-17 18:55:39,978 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-04-17 18:55:39,978 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-04-17 18:55:39,978 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-04-17 18:55:39,978 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-04-17 18:55:39,978 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-04-17 18:55:39,978 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-04-17 18:55:39,978 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-04-17 18:55:39,979 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-04-17 18:55:39,979 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-04-17 18:55:39,979 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-04-17 18:55:39,979 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-04-17 18:55:39,979 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-04-17 18:55:39,979 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-04-17 18:55:39,979 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-04-17 18:55:39,979 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-04-17 18:55:39,979 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-04-17 18:55:39,979 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-04-17 18:55:39,979 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-04-17 18:55:39,979 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-04-17 18:55:39,979 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-04-17 18:55:39,979 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-04-17 18:55:39,980 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-04-17 18:55:39,980 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-04-17 18:55:39,980 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-04-17 18:55:39,980 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-04-17 18:55:39,980 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-04-17 18:55:39,980 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-04-17 18:55:39,980 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-04-17 18:55:39,980 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-04-17 18:55:39,980 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-04-17 18:55:39,980 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-04-17 18:55:39,980 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-04-17 18:55:39,980 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-04-17 18:55:39,980 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-04-17 18:55:39,981 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-04-17 18:55:39,981 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-04-17 18:55:39,981 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-04-17 18:55:39,981 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-04-17 18:55:39,981 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-04-17 18:55:39,981 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-04-17 18:55:39,981 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-04-17 18:55:39,981 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-04-17 18:55:39,981 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-04-17 18:55:39,981 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-04-17 18:55:39,981 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-04-17 18:55:39,981 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-04-17 18:55:39,981 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-04-17 18:55:39,981 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-04-17 18:55:39,981 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-04-17 18:55:39,981 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-04-17 18:55:39,982 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-04-17 18:55:39,982 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-04-17 18:55:39,982 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-04-17 18:55:39,982 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-04-17 18:55:39,982 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-04-17 18:55:39,982 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-04-17 18:55:39,982 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-04-17 18:55:39,982 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-04-17 18:55:39,982 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-04-17 18:55:39,982 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-04-17 18:55:39,982 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-04-17 18:55:39,982 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-04-17 18:55:39,982 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-04-17 18:55:39,982 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-04-17 18:55:39,982 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-04-17 18:55:39,982 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-04-17 18:55:39,982 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-04-17 18:55:39,983 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-04-17 18:55:39,983 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-04-17 18:55:39,983 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-04-17 18:55:39,983 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-04-17 18:55:39,983 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-04-17 18:55:39,983 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-04-17 18:55:39,983 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-04-17 18:55:39,983 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-04-17 18:55:39,983 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-04-17 18:55:39,983 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-04-17 18:55:39,983 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-04-17 18:55:39,983 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-04-17 18:55:39,983 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-04-17 18:55:39,983 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-04-17 18:55:39,983 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-04-17 18:55:39,983 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-04-17 18:55:39,984 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-04-17 18:55:39,984 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-04-17 18:55:39,984 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-04-17 18:55:39,984 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-04-17 18:55:39,984 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-04-17 18:55:39,984 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-04-17 18:55:39,984 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-04-17 18:55:39,984 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-04-17 18:55:39,984 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-04-17 18:55:39,984 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-04-17 18:55:39,984 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-04-17 18:55:39,984 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-04-17 18:55:40,093 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.023518319678896445); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.03593547028621384, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.023518319678896445); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.013833333333333333); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.04541666666666667, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-04-17 18:55:40,093 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-04-17 18:55:40,093 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.01681761333283503, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.023518319678896445); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.03593547028621384, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.023518319678896445); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.013833333333333333); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.04541666666666667, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-04-17 18:55:40,347 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 347 ms to try 5000 different iterations.  Found a solution that moves 1032 regions; Going from a computed imbalance of 0.01681761333283503 to a new imbalance of 9.811410791235329E-4. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0072267533053975526); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.01029312258816727); MoveCostFunction : (multiplier=7.0, imbalance=0.11466666666666667, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0072267533053975526); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=5.0E-4); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.004916666666666666); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-04-17 18:55:40,349 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv137412657:82 , srv1529638201:82 , srv1835192093:82 , srv245393046:82 , srv946651926:82 , srv1023883066:83 , srv1872292163:83 , srv190847600:83 , srv2048406842:83 , srv917898797:83 , srv976530426:83 , srv989050276:83 , srv1029661196:84 , srv1074068497:84 , srv108383402:84 , srv1263747023:84 , srv162851546:84 , srv187227097:84 , srv2029706344:84 , srv498748505:84 , srv508134837:84 , srv532138381:84 , srv589225066:84 , srv753761459:84 , srv905528623:84 , srv909434650:84 , srv103610012:85 , srv1318224262:85 , srv1360706874:85 , srv1396631718:85 , srv155557537:85 , srv1622004378:85 , srv1652630379:85 , srv167603893:85 , srv1980272457:85 , srv1995448859:85 , srv378124858:85 , srv430772205:85 , srv4841866:85 , srv522212471:85 , srv738505753:85 , srv754638286:85 , srv77408441:85 , srv897296986:85 , srv981879350:85 , srv995372004:85 , srv1128300103:86 , srv1151659576:86 , srv1354862679:86 , srv1384672262:86 , srv1627347917:86 , srv1711862020:86 , srv1763475530:86 , srv1766565182:86 , srv1930233430:86 , srv2016660964:86 , srv295765928:86 , srv3443083:86 , srv354736721:86 , srv364848204:86 , srv452456740:86 , srv47708389:86 , srv509450626:86 , srv50995882:86 , srv613503967:86 , srv613627539:86 , srv629908343:86 , srv683501760:86 , srv772039604:86 , srv802126452:86 , srv807163915:86 , srv897232149:86 , srv926777992:86 , srv997867787:86 , srv1007129899:87 , srv1089735978:87 , srv1233034965:87 , srv1404670674:87 , srv1421745426:87 , srv1463527153:87 , srv1501610719:87 , srv1570568937:87 , srv1632148918:87 , srv338601663:87 , srv515632703:87 , srv614138434:87 , srv910350179:87 , srv98927113:87 , srv1084598616:88 , srv1402958941:88 , srv1714202601:88 , srv1881850740:88 , srv1915031551:88 , srv2001061210:88 , srv2063803998:88 , srv225711138:88 , srv589983458:88 , srv789409490:88 , srv961729567:88 , srv15140642:539 }
2023-04-17 18:55:40,353 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-04-17 18:55:40,354 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv522212471=68, srv802126452=83, srv1627347917=28, srv1763475530=35, srv47708389=61, srv4841866=62, srv50995882=66, srv1980272457=44, srv910350179=89, srv137412657=15, srv1396631718=17, srv1570568937=26, srv295765928=53, srv2048406842=49, srv897296986=86, srv1652630379=31, srv1128300103=8, srv338601663=54, srv738505753=77, srv753761459=78, srv364848204=57, srv772039604=80, srv452456740=60, srv807163915=84, srv1151659576=9, srv155557537=25, srv108383402=5, srv1622004378=27, srv1632148918=30, srv2016660964=47, srv1007129899=0, srv378124858=58, srv354736721=56, srv2063803998=50, srv225711138=51, srv629908343=75, srv162851546=29, srv1360706874=14, srv1084598616=6, srv190847600=41, srv589225066=70, srv589983458=71, srv1766565182=36, srv989050276=96, srv167603893=32, srv3443083=55, srv245393046=52, srv1233034965=10, srv997867787=99, srv2001061210=46, srv1023883066=1, srv683501760=76, srv1263747023=11, srv98927113=97, srv1089735978=7, srv789409490=82, srv77408441=81, srv926777992=91, srv1835192093=37, srv1318224262=12, srv532138381=69, srv613503967=72, srv1501610719=22, srv15140642=23, srv1463527153=21, srv1404670674=19, srv754638286=79, srv1711862020=33, srv1881850740=40, srv103610012=3, srv613627539=73, srv976530426=94, srv905528623=87, srv498748505=63, srv187227097=38, srv1872292163=39, srv1995448859=45, srv2029706344=48, srv430772205=59, srv917898797=90, srv1354862679=13, srv995372004=98, srv897232149=85, srv1384672262=16, srv981879350=95, srv509450626=65, srv1714202601=34, srv614138434=74, srv1930233430=43, srv961729567=93, srv909434650=88, srv1029661196=2, srv1402958941=18, srv1421745426=20, srv1529638201=24, srv508134837=64, srv1074068497=4, srv1915031551=42, srv515632703=67, srv946651926=92} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-04-17 18:55:40,368 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-04-17 18:55:40,368 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-04-17 18:55:40,369 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-04-17 18:55:40,369 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-04-17 18:55:40,369 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-04-17 18:55:40,369 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-04-17 18:55:40,369 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-04-17 18:55:40,369 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-04-17 18:55:40,369 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-04-17 18:55:40,369 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-04-17 18:55:40,369 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-04-17 18:55:40,369 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-04-17 18:55:40,370 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-04-17 18:55:40,370 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-04-17 18:55:40,370 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-04-17 18:55:40,370 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-04-17 18:55:40,370 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-04-17 18:55:40,370 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-04-17 18:55:40,370 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-04-17 18:55:40,370 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-04-17 18:55:40,370 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-04-17 18:55:40,370 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-04-17 18:55:40,370 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-04-17 18:55:40,371 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-04-17 18:55:40,371 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-04-17 18:55:40,371 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-04-17 18:55:40,371 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-04-17 18:55:40,371 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-04-17 18:55:40,371 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-04-17 18:55:40,371 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-04-17 18:55:40,371 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-04-17 18:55:40,371 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-04-17 18:55:40,372 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-04-17 18:55:40,372 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-04-17 18:55:40,372 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-04-17 18:55:40,372 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-04-17 18:55:40,372 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-04-17 18:55:40,372 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-04-17 18:55:40,372 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-04-17 18:55:40,372 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-04-17 18:55:40,372 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-04-17 18:55:40,372 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-04-17 18:55:40,373 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-04-17 18:55:40,373 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-04-17 18:55:40,373 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-04-17 18:55:40,373 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-04-17 18:55:40,373 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-04-17 18:55:40,373 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-04-17 18:55:40,373 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-04-17 18:55:40,373 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-04-17 18:55:40,373 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-04-17 18:55:40,373 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-04-17 18:55:40,374 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-04-17 18:55:40,374 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-04-17 18:55:40,374 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-04-17 18:55:40,374 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-04-17 18:55:40,374 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-04-17 18:55:40,374 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-04-17 18:55:40,374 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-04-17 18:55:40,374 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-04-17 18:55:40,374 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-04-17 18:55:40,374 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-04-17 18:55:40,374 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-04-17 18:55:40,374 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-04-17 18:55:40,374 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-04-17 18:55:40,375 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-04-17 18:55:40,375 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-04-17 18:55:40,375 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-04-17 18:55:40,375 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-04-17 18:55:40,375 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-04-17 18:55:40,375 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-04-17 18:55:40,375 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-04-17 18:55:40,375 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-04-17 18:55:40,375 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-04-17 18:55:40,375 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-04-17 18:55:40,375 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-04-17 18:55:40,375 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-04-17 18:55:40,376 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-04-17 18:55:40,376 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-04-17 18:55:40,376 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-04-17 18:55:40,376 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-04-17 18:55:40,376 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-04-17 18:55:40,376 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-04-17 18:55:40,376 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-04-17 18:55:40,376 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-04-17 18:55:40,376 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-04-17 18:55:40,376 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-04-17 18:55:40,377 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-04-17 18:55:40,377 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-04-17 18:55:40,377 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-04-17 18:55:40,377 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-04-17 18:55:40,377 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-04-17 18:55:40,377 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-04-17 18:55:40,377 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-04-17 18:55:40,377 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-04-17 18:55:40,377 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-04-17 18:55:40,377 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-04-17 18:55:40,377 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-04-17 18:55:40,378 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-04-17 18:55:40,378 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-04-17 18:55:40,378 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-04-17 18:55:40,508 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0072267533053975526); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.01029312258816727); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0072267533053975526); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=5.0E-4); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.004916666666666666); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-04-17 18:55:40,508 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-04-17 18:55:40,508 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=9.739148606744689E-4, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0072267533053975526); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.01029312258816727); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0072267533053975526); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=5.0E-4); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.004916666666666666); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-04-17 18:55:40,903 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 514 ms to try 5000 different iterations.  Found a solution that moves 258 regions; Going from a computed imbalance of 9.739148606744689E-4 to a new imbalance of 4.2710498268373816E-5. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=5.470732932414788E-4); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0018349396085439343); MoveCostFunction : (multiplier=7.0, imbalance=0.028666666666666667, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=5.470732932414788E-4); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=3.333333333333333E-4); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-04-17 18:55:40,905 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv162851546:82 , srv1930233430:83 , srv522212471:83 , srv961729567:83 , srv103610012:84 , srv1084598616:84 , srv1233034965:84 , srv1263747023:84 , srv137412657:84 , srv1384672262:84 , srv1402958941:84 , srv1404670674:84 , srv1570568937:84 , srv1622004378:84 , srv1652630379:84 , srv1714202601:84 , srv1763475530:84 , srv1881850740:84 , srv1980272457:84 , srv2001061210:84 , srv2063803998:84 , srv225711138:84 , srv245393046:84 , srv338601663:84 , srv354736721:84 , srv378124858:84 , srv47708389:84 , srv498748505:84 , srv50995882:84 , srv515632703:84 , srv589983458:84 , srv613627539:84 , srv629908343:84 , srv738505753:84 , srv754638286:84 , srv897232149:84 , srv897296986:84 , srv910350179:84 , srv981879350:84 , srv98927113:84 , srv997867787:84 , srv1007129899:85 , srv1029661196:85 , srv1074068497:85 , srv108383402:85 , srv1089735978:85 , srv1128300103:85 , srv1151659576:85 , srv1318224262:85 , srv1360706874:85 , srv1396631718:85 , srv1421745426:85 , srv1463527153:85 , srv1501610719:85 , srv155557537:85 , srv1627347917:85 , srv1632148918:85 , srv167603893:85 , srv1711862020:85 , srv1835192093:85 , srv187227097:85 , srv1915031551:85 , srv1995448859:85 , srv2016660964:85 , srv2029706344:85 , srv295765928:85 , srv3443083:85 , srv364848204:85 , srv430772205:85 , srv452456740:85 , srv4841866:85 , srv509450626:85 , srv589225066:85 , srv613503967:85 , srv614138434:85 , srv683501760:85 , srv753761459:85 , srv772039604:85 , srv789409490:85 , srv802126452:85 , srv807163915:85 , srv905528623:85 , srv909434650:85 , srv917898797:85 , srv926777992:85 , srv946651926:85 , srv976530426:85 , srv989050276:85 , srv1023883066:86 , srv1354862679:86 , srv1529638201:86 , srv1766565182:86 , srv1872292163:86 , srv190847600:86 , srv2048406842:86 , srv508134837:86 , srv532138381:86 , srv77408441:86 , srv995372004:86 , srv15140642:620 }
2023-04-17 18:55:40,909 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-04-17 18:55:40,910 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv522212471=68, srv802126452=83, srv1627347917=28, srv1763475530=35, srv47708389=61, srv4841866=62, srv50995882=66, srv1980272457=44, srv910350179=89, srv137412657=15, srv1396631718=17, srv1570568937=26, srv295765928=53, srv2048406842=49, srv897296986=86, srv1652630379=31, srv1128300103=8, srv338601663=54, srv738505753=77, srv753761459=78, srv364848204=57, srv772039604=80, srv452456740=60, srv807163915=84, srv1151659576=9, srv155557537=25, srv108383402=5, srv1622004378=27, srv1632148918=30, srv2016660964=47, srv1007129899=0, srv378124858=58, srv354736721=56, srv2063803998=50, srv225711138=51, srv629908343=75, srv162851546=29, srv1360706874=14, srv1084598616=6, srv190847600=41, srv589225066=70, srv589983458=71, srv1766565182=36, srv989050276=96, srv167603893=32, srv3443083=55, srv245393046=52, srv1233034965=10, srv997867787=99, srv2001061210=46, srv1023883066=1, srv683501760=76, srv1263747023=11, srv98927113=97, srv1089735978=7, srv789409490=82, srv77408441=81, srv926777992=91, srv1835192093=37, srv1318224262=12, srv532138381=69, srv613503967=72, srv1501610719=22, srv15140642=23, srv1463527153=21, srv1404670674=19, srv754638286=79, srv1711862020=33, srv1881850740=40, srv103610012=3, srv613627539=73, srv976530426=94, srv905528623=87, srv498748505=63, srv187227097=38, srv1872292163=39, srv1995448859=45, srv2029706344=48, srv430772205=59, srv917898797=90, srv1354862679=13, srv995372004=98, srv897232149=85, srv1384672262=16, srv981879350=95, srv509450626=65, srv1714202601=34, srv614138434=74, srv1930233430=43, srv961729567=93, srv909434650=88, srv1029661196=2, srv1402958941=18, srv1421745426=20, srv1529638201=24, srv508134837=64, srv1074068497=4, srv1915031551=42, srv515632703=67, srv946651926=92} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-04-17 18:55:40,933 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-04-17 18:55:40,933 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-04-17 18:55:40,933 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-04-17 18:55:40,934 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-04-17 18:55:40,934 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-04-17 18:55:40,934 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-04-17 18:55:40,934 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-04-17 18:55:40,934 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-04-17 18:55:40,934 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-04-17 18:55:40,934 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-04-17 18:55:40,934 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-04-17 18:55:40,934 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-04-17 18:55:40,934 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-04-17 18:55:40,934 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-04-17 18:55:40,935 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-04-17 18:55:40,935 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-04-17 18:55:40,935 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-04-17 18:55:40,935 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-04-17 18:55:40,935 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-04-17 18:55:40,935 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-04-17 18:55:40,935 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-04-17 18:55:40,935 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-04-17 18:55:40,935 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-04-17 18:55:40,935 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-04-17 18:55:40,935 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-04-17 18:55:40,936 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-04-17 18:55:40,936 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-04-17 18:55:40,936 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-04-17 18:55:40,936 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-04-17 18:55:40,936 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-04-17 18:55:40,936 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-04-17 18:55:40,936 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-04-17 18:55:40,936 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-04-17 18:55:40,936 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-04-17 18:55:40,936 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-04-17 18:55:40,937 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-04-17 18:55:40,937 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-04-17 18:55:40,937 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-04-17 18:55:40,937 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-04-17 18:55:40,937 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-04-17 18:55:40,937 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-04-17 18:55:40,937 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-04-17 18:55:40,937 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-04-17 18:55:40,937 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-04-17 18:55:40,937 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-04-17 18:55:40,937 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-04-17 18:55:40,937 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-04-17 18:55:40,937 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-04-17 18:55:40,937 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-04-17 18:55:40,937 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-04-17 18:55:40,938 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-04-17 18:55:40,938 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-04-17 18:55:40,938 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-04-17 18:55:40,938 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-04-17 18:55:40,938 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-04-17 18:55:40,938 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-04-17 18:55:40,938 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-04-17 18:55:40,938 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-04-17 18:55:40,938 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-04-17 18:55:40,938 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-04-17 18:55:40,938 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-04-17 18:55:40,938 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-04-17 18:55:40,939 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-04-17 18:55:40,939 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-04-17 18:55:40,939 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-04-17 18:55:40,939 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-04-17 18:55:40,939 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-04-17 18:55:40,939 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-04-17 18:55:40,939 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-04-17 18:55:40,940 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-04-17 18:55:40,940 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-04-17 18:55:40,941 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-04-17 18:55:40,941 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-04-17 18:55:40,941 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-04-17 18:55:40,941 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-04-17 18:55:40,941 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-04-17 18:55:40,941 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-04-17 18:55:40,941 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-04-17 18:55:40,941 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-04-17 18:55:40,942 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-04-17 18:55:40,942 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-04-17 18:55:40,942 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-04-17 18:55:40,942 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-04-17 18:55:40,942 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-04-17 18:55:40,942 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-04-17 18:55:40,942 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-04-17 18:55:40,942 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-04-17 18:55:40,942 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-04-17 18:55:40,942 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-04-17 18:55:40,943 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-04-17 18:55:40,943 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-04-17 18:55:40,943 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-04-17 18:55:40,943 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-04-17 18:55:40,943 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-04-17 18:55:40,943 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-04-17 18:55:40,943 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-04-17 18:55:40,943 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-04-17 18:55:40,943 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-04-17 18:55:40,943 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-04-17 18:55:40,943 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-04-17 18:55:40,943 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-04-17 18:55:41,098 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=5.470732932414788E-4); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0018349396085439343); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=5.470732932414788E-4); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=3.333333333333333E-4); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-04-17 18:55:41,099 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-04-17 18:55:41,099 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=4.090394365610785E-5, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=5.470732932414788E-4); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0018349396085439343); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=5.470732932414788E-4); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=3.333333333333333E-4); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-04-17 18:55:41,412 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 452 ms to try 5000 different iterations.  Found a solution that moves 31 regions; Going from a computed imbalance of 4.090394365610785E-5 to a new imbalance of 6.249145379186682E-6. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0013400504203456161); MoveCostFunction : (multiplier=7.0, imbalance=0.0034444444444444444); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-04-17 18:55:41,413 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1354862679:82 , srv1023883066:83 , srv167603893:83 , srv1766565182:83 , srv589225066:83 , srv614138434:83 , srv807163915:83 , srv897232149:83 , srv976530426:83 , srv995372004:83 , srv1007129899:84 , srv1029661196:84 , srv103610012:84 , srv1074068497:84 , srv108383402:84 , srv1084598616:84 , srv1089735978:84 , srv1128300103:84 , srv1151659576:84 , srv1233034965:84 , srv1318224262:84 , srv1384672262:84 , srv1396631718:84 , srv1402958941:84 , srv1404670674:84 , srv1421745426:84 , srv1463527153:84 , srv1501610719:84 , srv1529638201:84 , srv155557537:84 , srv1622004378:84 , srv1627347917:84 , srv162851546:84 , srv1632148918:84 , srv1652630379:84 , srv1711862020:84 , srv1763475530:84 , srv1835192093:84 , srv187227097:84 , srv1872292163:84 , srv1881850740:84 , srv190847600:84 , srv1915031551:84 , srv1980272457:84 , srv1995448859:84 , srv2001061210:84 , srv2016660964:84 , srv2029706344:84 , srv2048406842:84 , srv2063803998:84 , srv245393046:84 , srv295765928:84 , srv338601663:84 , srv3443083:84 , srv354736721:84 , srv364848204:84 , srv430772205:84 , srv452456740:84 , srv47708389:84 , srv4841866:84 , srv508134837:84 , srv509450626:84 , srv50995882:84 , srv522212471:84 , srv532138381:84 , srv589983458:84 , srv613503967:84 , srv613627539:84 , srv629908343:84 , srv683501760:84 , srv738505753:84 , srv753761459:84 , srv754638286:84 , srv772039604:84 , srv77408441:84 , srv789409490:84 , srv802126452:84 , srv897296986:84 , srv905528623:84 , srv909434650:84 , srv910350179:84 , srv917898797:84 , srv926777992:84 , srv946651926:84 , srv961729567:84 , srv981879350:84 , srv989050276:84 , srv98927113:84 , srv1263747023:85 , srv1360706874:85 , srv137412657:85 , srv1570568937:85 , srv1714202601:85 , srv1930233430:85 , srv225711138:85 , srv378124858:85 , srv498748505:85 , srv515632703:85 , srv997867787:85 , srv15140642:684 }
2023-04-17 18:55:41,418 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-04-17 18:55:41,419 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv522212471=68, srv802126452=83, srv1627347917=28, srv1763475530=35, srv47708389=61, srv4841866=62, srv50995882=66, srv1980272457=44, srv910350179=89, srv137412657=15, srv1396631718=17, srv1570568937=26, srv295765928=53, srv2048406842=49, srv897296986=86, srv1652630379=31, srv1128300103=8, srv338601663=54, srv738505753=77, srv753761459=78, srv364848204=57, srv772039604=80, srv452456740=60, srv807163915=84, srv1151659576=9, srv155557537=25, srv108383402=5, srv1622004378=27, srv1632148918=30, srv2016660964=47, srv1007129899=0, srv378124858=58, srv354736721=56, srv2063803998=50, srv225711138=51, srv629908343=75, srv162851546=29, srv1360706874=14, srv1084598616=6, srv190847600=41, srv589225066=70, srv589983458=71, srv1766565182=36, srv989050276=96, srv167603893=32, srv3443083=55, srv245393046=52, srv1233034965=10, srv997867787=99, srv2001061210=46, srv1023883066=1, srv683501760=76, srv1263747023=11, srv98927113=97, srv1089735978=7, srv789409490=82, srv77408441=81, srv926777992=91, srv1835192093=37, srv1318224262=12, srv532138381=69, srv613503967=72, srv1501610719=22, srv15140642=23, srv1463527153=21, srv1404670674=19, srv754638286=79, srv1711862020=33, srv1881850740=40, srv103610012=3, srv613627539=73, srv976530426=94, srv905528623=87, srv498748505=63, srv187227097=38, srv1872292163=39, srv1995448859=45, srv2029706344=48, srv430772205=59, srv917898797=90, srv1354862679=13, srv995372004=98, srv897232149=85, srv1384672262=16, srv981879350=95, srv509450626=65, srv1714202601=34, srv614138434=74, srv1930233430=43, srv961729567=93, srv909434650=88, srv1029661196=2, srv1402958941=18, srv1421745426=20, srv1529638201=24, srv508134837=64, srv1074068497=4, srv1915031551=42, srv515632703=67, srv946651926=92} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-04-17 18:55:41,434 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-04-17 18:55:41,435 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-04-17 18:55:41,435 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-04-17 18:55:41,435 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-04-17 18:55:41,435 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-04-17 18:55:41,435 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-04-17 18:55:41,435 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-04-17 18:55:41,435 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-04-17 18:55:41,435 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-04-17 18:55:41,435 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-04-17 18:55:41,435 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-04-17 18:55:41,435 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-04-17 18:55:41,435 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-04-17 18:55:41,436 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-04-17 18:55:41,436 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-04-17 18:55:41,436 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-04-17 18:55:41,436 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-04-17 18:55:41,436 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-04-17 18:55:41,436 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-04-17 18:55:41,436 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-04-17 18:55:41,436 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-04-17 18:55:41,436 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-04-17 18:55:41,436 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-04-17 18:55:41,436 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-04-17 18:55:41,436 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-04-17 18:55:41,437 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-04-17 18:55:41,437 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-04-17 18:55:41,437 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-04-17 18:55:41,437 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-04-17 18:55:41,437 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-04-17 18:55:41,437 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-04-17 18:55:41,437 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-04-17 18:55:41,437 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-04-17 18:55:41,437 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-04-17 18:55:41,437 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-04-17 18:55:41,437 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-04-17 18:55:41,437 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-04-17 18:55:41,437 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-04-17 18:55:41,437 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-04-17 18:55:41,438 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-04-17 18:55:41,438 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-04-17 18:55:41,438 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-04-17 18:55:41,438 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-04-17 18:55:41,438 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-04-17 18:55:41,438 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-04-17 18:55:41,438 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-04-17 18:55:41,438 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-04-17 18:55:41,438 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-04-17 18:55:41,438 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-04-17 18:55:41,438 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-04-17 18:55:41,438 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-04-17 18:55:41,438 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-04-17 18:55:41,439 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-04-17 18:55:41,439 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-04-17 18:55:41,439 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-04-17 18:55:41,439 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-04-17 18:55:41,439 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-04-17 18:55:41,439 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-04-17 18:55:41,439 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-04-17 18:55:41,439 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-04-17 18:55:41,439 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-04-17 18:55:41,439 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-04-17 18:55:41,439 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-04-17 18:55:41,439 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-04-17 18:55:41,440 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-04-17 18:55:41,440 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-04-17 18:55:41,440 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-04-17 18:55:41,440 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-04-17 18:55:41,440 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-04-17 18:55:41,440 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-04-17 18:55:41,440 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-04-17 18:55:41,440 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-04-17 18:55:41,440 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-04-17 18:55:41,440 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-04-17 18:55:41,440 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-04-17 18:55:41,440 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-04-17 18:55:41,440 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-04-17 18:55:41,441 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-04-17 18:55:41,441 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-04-17 18:55:41,441 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-04-17 18:55:41,441 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-04-17 18:55:41,441 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-04-17 18:55:41,441 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-04-17 18:55:41,441 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-04-17 18:55:41,441 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-04-17 18:55:41,441 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-04-17 18:55:41,441 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-04-17 18:55:41,441 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-04-17 18:55:41,441 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-04-17 18:55:41,441 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-04-17 18:55:41,442 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-04-17 18:55:41,442 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-04-17 18:55:41,442 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-04-17 18:55:41,442 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-04-17 18:55:41,442 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-04-17 18:55:41,442 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-04-17 18:55:41,442 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-04-17 18:55:41,442 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-04-17 18:55:41,442 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-04-17 18:55:41,442 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-04-17 18:55:41,442 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-04-17 18:55:41,589 INFO  [Time-limited test] balancer.StochasticLoadBalancer(381): Cluster wide - skipping load balancing because weighted average imbalance=6.032078739728369E-6 <= threshold(0.025). If you want more aggressive balancing, either lower hbase.master.balancer.stochastic.minCostNeedBalance from 0.025 or increase the relative multiplier(s) of the specific cost function(s). functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0013400504203456161); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-04-17 18:55:41,589 INFO  [Time-limited test] balancer.BalancerTestBase(570): Mock Final balance: { srv1354862679:82 , srv1023883066:83 , srv167603893:83 , srv1766565182:83 , srv589225066:83 , srv614138434:83 , srv807163915:83 , srv897232149:83 , srv976530426:83 , srv995372004:83 , srv1007129899:84 , srv1029661196:84 , srv103610012:84 , srv1074068497:84 , srv108383402:84 , srv1084598616:84 , srv1089735978:84 , srv1128300103:84 , srv1151659576:84 , srv1233034965:84 , srv1318224262:84 , srv1384672262:84 , srv1396631718:84 , srv1402958941:84 , srv1404670674:84 , srv1421745426:84 , srv1463527153:84 , srv1501610719:84 , srv1529638201:84 , srv155557537:84 , srv1622004378:84 , srv1627347917:84 , srv162851546:84 , srv1632148918:84 , srv1652630379:84 , srv1711862020:84 , srv1763475530:84 , srv1835192093:84 , srv187227097:84 , srv1872292163:84 , srv1881850740:84 , srv190847600:84 , srv1915031551:84 , srv1980272457:84 , srv1995448859:84 , srv2001061210:84 , srv2016660964:84 , srv2029706344:84 , srv2048406842:84 , srv2063803998:84 , srv245393046:84 , srv295765928:84 , srv338601663:84 , srv3443083:84 , srv354736721:84 , srv364848204:84 , srv430772205:84 , srv452456740:84 , srv47708389:84 , srv4841866:84 , srv508134837:84 , srv509450626:84 , srv50995882:84 , srv522212471:84 , srv532138381:84 , srv589983458:84 , srv613503967:84 , srv613627539:84 , srv629908343:84 , srv683501760:84 , srv738505753:84 , srv753761459:84 , srv754638286:84 , srv772039604:84 , srv77408441:84 , srv789409490:84 , srv802126452:84 , srv897296986:84 , srv905528623:84 , srv909434650:84 , srv910350179:84 , srv917898797:84 , srv926777992:84 , srv946651926:84 , srv961729567:84 , srv981879350:84 , srv989050276:84 , srv98927113:84 , srv1263747023:85 , srv1360706874:85 , srv137412657:85 , srv1570568937:85 , srv1714202601:85 , srv1930233430:85 , srv225711138:85 , srv378124858:85 , srv498748505:85 , srv515632703:85 , srv997867787:85 , srv15140642:684 }
2023-04-17 18:55:41,626 INFO  [Time-limited test] hbase.ResourceChecker(175): after: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnLargeClusterWithRacks Thread=10 (was 10), OpenFileDescriptor=260 (was 260), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=372 (was 369) - SystemLoadAverage LEAK? -, ProcessCount=169 (was 169), AvailableMemoryMB=827 (was 1315)
2023-04-17 18:55:41,636 INFO  [Time-limited test] hbase.ResourceChecker(147): before: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnMidClusterWithRacks Thread=10, OpenFileDescriptor=262, MaxFileDescriptor=60000, SystemLoadAverage=372, ProcessCount=169, AvailableMemoryMB=827
2023-04-17 18:55:41,641 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2023-04-17 18:55:41,641 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=5000, runMaxSteps=true, stepsPerRegion=800, maxRunningTime=120000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 111077.0 etc.
2023-04-17 18:55:41,655 INFO  [Time-limited test] balancer.BalancerTestBase(547): Mock Cluster : { srv1021451417:84 , srv1022592522:84 , srv1025075630:84 , srv1058425459:84 , srv1188942135:84 , srv1337167134:84 , srv1420200080:84 , srv1487437118:84 , srv1511908617:84 , srv156398246:84 , srv1776656675:84 , srv1802161491:84 , srv1852272651:84 , srv1864055306:84 , srv1866474154:84 , srv1893272504:84 , srv1896774115:84 , srv1940644042:84 , srv1950821797:84 , srv1977772553:84 , srv2011867389:84 , srv223262140:84 , srv24776807:84 , srv297598551:84 , srv340546161:84 , srv653808288:84 , srv79588889:84 , srv810608988:84 , srv95161132:84 , srv536776985:264 } [srvr=30 rgns=2700 avg=90.0 max=90 min=90]
2023-04-17 18:55:41,657 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-04-17 18:55:41,658 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv95161132=29, srv79588889=27, srv223262140=21, srv1420200080=6, srv1802161491=11, srv1337167134=5, srv1852272651=12, srv1021451417=0, srv297598551=23, srv156398246=9, srv24776807=22, srv653808288=26, srv810608988=28, srv1864055306=13, srv340546161=24, srv1022592522=1, srv1893272504=15, srv1940644042=17, srv1950821797=18, srv1776656675=10, srv1866474154=14, srv1896774115=16, srv2011867389=20, srv1058425459=3, srv1025075630=2, srv1487437118=7, srv536776985=25, srv1188942135=4, srv1977772553=19, srv1511908617=8} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-04-17 18:55:41,677 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-04-17 18:55:41,677 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-04-17 18:55:41,677 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-04-17 18:55:41,678 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-04-17 18:55:41,678 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-04-17 18:55:41,678 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-04-17 18:55:41,678 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-04-17 18:55:41,678 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-04-17 18:55:41,678 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-04-17 18:55:41,678 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-04-17 18:55:41,678 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-04-17 18:55:41,678 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-04-17 18:55:41,678 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-04-17 18:55:41,678 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-04-17 18:55:41,678 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-04-17 18:55:41,678 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-04-17 18:55:41,678 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-04-17 18:55:41,679 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-04-17 18:55:41,679 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-04-17 18:55:41,679 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-04-17 18:55:41,679 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-04-17 18:55:41,679 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-04-17 18:55:41,679 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-04-17 18:55:41,679 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-04-17 18:55:41,679 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-04-17 18:55:41,679 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-04-17 18:55:41,679 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-04-17 18:55:41,679 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-04-17 18:55:41,679 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-04-17 18:55:41,679 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-04-17 18:55:41,680 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=10, number of hosts=30, number of racks=4
2023-04-17 18:55:41,719 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=1.1038103535449624, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-04-17 18:55:41,719 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.991252014629858, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=1.1038103535449624, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=64800000
2023-04-17 18:57:41,691 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 120001 ms to try 6059176 different iterations.  Found a solution that moves 1855 regions; Going from a computed imbalance of 0.991252014629858 to a new imbalance of 4.329662539733032E-5. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); MoveCostFunction : (multiplier=7.0, imbalance=0.687037037037037, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-04-17 18:57:41,697 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1021451417:90 , srv1022592522:90 , srv1025075630:90 , srv1058425459:90 , srv1188942135:90 , srv1337167134:90 , srv1420200080:90 , srv1487437118:90 , srv1511908617:90 , srv156398246:90 , srv1776656675:90 , srv1802161491:90 , srv1852272651:90 , srv1864055306:90 , srv1866474154:90 , srv1893272504:90 , srv1896774115:90 , srv1940644042:90 , srv1950821797:90 , srv1977772553:90 , srv2011867389:90 , srv223262140:90 , srv24776807:90 , srv297598551:90 , srv340546161:90 , srv536776985:90 , srv653808288:90 , srv79588889:90 , srv810608988:90 , srv95161132:90 }
2023-04-17 18:57:41,698 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-04-17 18:57:41,698 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv95161132=29, srv79588889=27, srv223262140=21, srv1420200080=6, srv1802161491=11, srv1337167134=5, srv1852272651=12, srv1021451417=0, srv297598551=23, srv156398246=9, srv24776807=22, srv653808288=26, srv810608988=28, srv1864055306=13, srv340546161=24, srv1022592522=1, srv1893272504=15, srv1940644042=17, srv1950821797=18, srv1776656675=10, srv1866474154=14, srv1896774115=16, srv2011867389=20, srv1058425459=3, srv1025075630=2, srv1487437118=7, srv536776985=25, srv1188942135=4, srv1977772553=19, srv1511908617=8} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-04-17 18:57:41,702 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-04-17 18:57:41,702 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-04-17 18:57:41,702 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-04-17 18:57:41,702 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-04-17 18:57:41,702 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-04-17 18:57:41,702 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-04-17 18:57:41,702 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-04-17 18:57:41,702 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-04-17 18:57:41,702 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-04-17 18:57:41,702 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-04-17 18:57:41,702 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-04-17 18:57:41,702 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-04-17 18:57:41,702 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-04-17 18:57:41,702 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-04-17 18:57:41,702 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-04-17 18:57:41,702 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-04-17 18:57:41,702 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-04-17 18:57:41,702 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-04-17 18:57:41,703 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-04-17 18:57:41,703 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-04-17 18:57:41,703 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-04-17 18:57:41,703 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-04-17 18:57:41,703 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-04-17 18:57:41,703 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-04-17 18:57:41,703 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-04-17 18:57:41,703 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-04-17 18:57:41,703 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-04-17 18:57:41,703 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-04-17 18:57:41,703 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-04-17 18:57:41,703 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-04-17 18:57:41,703 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=10, number of hosts=30, number of racks=4
2023-04-17 18:57:41,714 INFO  [Time-limited test] balancer.StochasticLoadBalancer(381): Cluster wide - skipping load balancing because weighted average imbalance=0.0 <= threshold(0.025). If you want more aggressive balancing, either lower hbase.master.balancer.stochastic.minCostNeedBalance from 0.025 or increase the relative multiplier(s) of the specific cost function(s). functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-04-17 18:57:41,715 INFO  [Time-limited test] balancer.BalancerTestBase(570): Mock Final balance: { srv1021451417:90 , srv1022592522:90 , srv1025075630:90 , srv1058425459:90 , srv1188942135:90 , srv1337167134:90 , srv1420200080:90 , srv1487437118:90 , srv1511908617:90 , srv156398246:90 , srv1776656675:90 , srv1802161491:90 , srv1852272651:90 , srv1864055306:90 , srv1866474154:90 , srv1893272504:90 , srv1896774115:90 , srv1940644042:90 , srv1950821797:90 , srv1977772553:90 , srv2011867389:90 , srv223262140:90 , srv24776807:90 , srv297598551:90 , srv340546161:90 , srv536776985:90 , srv653808288:90 , srv79588889:90 , srv810608988:90 , srv95161132:90 }
2023-04-17 18:57:41,727 INFO  [Time-limited test] hbase.ResourceChecker(175): after: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnMidClusterWithRacks Thread=9 (was 10), OpenFileDescriptor=260 (was 262), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=278 (was 372), ProcessCount=169 (was 169), AvailableMemoryMB=861 (was 827) - AvailableMemoryMB LEAK? -