2024-02-17 10:53:14,886 INFO  [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks timeout: 13 mins
2024-02-17 10:53:15,194 WARN  [Time-limited test] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties
2024-02-17 10:53:15,308 INFO  [Time-limited test] metrics.MetricRegistriesLoader(60): Loaded MetricRegistries class org.apache.hadoop.hbase.metrics.impl.MetricRegistriesImpl
2024-02-17 10:53:15,373 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2024-02-17 10:53:15,380 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc.
2024-02-17 10:53:15,394 INFO  [Time-limited test] hbase.ResourceChecker(147): before: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnLargeClusterWithRacks Thread=12, OpenFileDescriptor=290, MaxFileDescriptor=60000, SystemLoadAverage=312, ProcessCount=168, AvailableMemoryMB=1955
2024-02-17 10:53:15,396 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2024-02-17 10:53:15,397 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=5000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=10000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc.
2024-02-17 10:53:15,526 INFO  [Time-limited test] balancer.BalancerTestBase(547): Mock Cluster : { srv1003571933:84 , srv1044279111:84 , srv1053909946:84 , srv1056224149:84 , srv1078524008:84 , srv1086218681:84 , srv1106786641:84 , srv1159757493:84 , srv1174472233:84 , srv11933808:84 , srv1216614494:84 , srv1233355056:84 , srv1245830476:84 , srv1263462861:84 , srv1275809962:84 , srv130408842:84 , srv133289342:84 , srv1358518470:84 , srv138197709:84 , srv1425767767:84 , srv143073341:84 , srv1440953896:84 , srv144204883:84 , srv1449721036:84 , srv1476852771:84 , srv1504697899:84 , srv1514924519:84 , srv1514984817:84 , srv1516501972:84 , srv1518826941:84 , srv1544261409:84 , srv154965032:84 , srv1578034630:84 , srv1580705329:84 , srv1605663024:84 , srv162832548:84 , srv1628525528:84 , srv1733663465:84 , srv1745945787:84 , srv1758712951:84 , srv1833048080:84 , srv1834803836:84 , srv1835520864:84 , srv1842061847:84 , srv1889282740:84 , srv1892013491:84 , srv1947201708:84 , srv1980129733:84 , srv2020495533:84 , srv2024152542:84 , srv2029415763:84 , srv2050605235:84 , srv2095357350:84 , srv2099162750:84 , srv2110467251:84 , srv248975882:84 , srv299895891:84 , srv328626039:84 , srv337600303:84 , srv339914388:84 , srv352241822:84 , srv370780886:84 , srv375845113:84 , srv420262672:84 , srv435657855:84 , srv467712304:84 , srv482675390:84 , srv517207957:84 , srv521582583:84 , srv546426981:84 , srv555093696:84 , srv568412740:84 , srv60533065:84 , srv605899145:84 , srv609838029:84 , srv615285969:84 , srv619608385:84 , srv622743213:84 , srv641388146:84 , srv656015974:84 , srv680193356:84 , srv695721388:84 , srv726987292:84 , srv760948267:84 , srv78098264:84 , srv804541006:84 , srv813289374:84 , srv816367065:84 , srv819499503:84 , srv823059069:84 , srv853896553:84 , srv855765978:84 , srv873187922:84 , srv917508647:84 , srv946949359:84 , srv959705867:84 , srv966973602:84 , srv973790956:84 , srv975188881:84 , srv420732972:684 } [srvr=100 rgns=9000 avg=90.0 max=90 min=90]
2024-02-17 10:53:15,533 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2024-02-17 10:53:15,539 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv154965032=31, srv1233355056=11, srv726987292=83, srv78098264=85, srv855765978=92, srv1889282740=44, srv133289342=16, srv2029415763=50, srv2095357350=52, srv11933808=9, srv641388146=79, srv555093696=71, srv1835520864=42, srv619608385=77, srv546426981=70, srv1745945787=38, srv352241822=60, srv1106786641=6, srv760948267=84, srv1834803836=41, srv370780886=61, srv1449721036=23, srv1605663024=34, srv1086218681=5, srv973790956=98, srv328626039=57, srv1892013491=45, srv1733663465=37, srv517207957=68, srv1078524008=4, srv420732972=64, srv695721388=82, srv60533065=73, srv1842061847=43, srv1947201708=46, srv1980129733=47, srv1358518470=17, srv2110467251=54, srv1053909946=2, srv435657855=65, srv1514984817=27, srv813289374=87, srv804541006=86, srv2050605235=51, srv680193356=81, srv1578034630=32, srv1758712951=39, srv2099162750=53, srv138197709=18, srv144204883=22, srv823059069=90, srv375845113=62, srv143073341=20, srv966973602=97, srv1476852771=24, srv2020495533=48, srv339914388=59, srv1504697899=25, srv1174472233=8, srv917508647=94, srv1263462861=13, srv819499503=89, srv1056224149=3, srv1628525528=36, srv1003571933=0, srv130408842=15, srv1516501972=28, srv1275809962=14, srv1833048080=40, srv1580705329=33, srv2024152542=49, srv1440953896=21, srv975188881=99, srv1425767767=19, srv946949359=95, srv299895891=56, srv609838029=75, srv248975882=55, srv615285969=76, srv873187922=93, srv1518826941=29, srv622743213=78, srv420262672=63, srv568412740=72, srv656015974=80, srv337600303=58, srv1514924519=26, srv1159757493=7, srv162832548=35, srv1245830476=12, srv605899145=74, srv853896553=91, srv1044279111=1, srv482675390=67, srv521582583=69, srv1544261409=30, srv959705867=96, srv816367065=88, srv1216614494=10, srv467712304=66} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2024-02-17 10:53:15,635 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2024-02-17 10:53:15,635 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2024-02-17 10:53:15,635 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2024-02-17 10:53:15,635 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2024-02-17 10:53:15,636 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2024-02-17 10:53:15,636 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2024-02-17 10:53:15,636 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2024-02-17 10:53:15,636 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2024-02-17 10:53:15,636 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2024-02-17 10:53:15,636 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2024-02-17 10:53:15,637 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2024-02-17 10:53:15,637 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2024-02-17 10:53:15,637 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2024-02-17 10:53:15,637 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2024-02-17 10:53:15,637 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2024-02-17 10:53:15,638 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2024-02-17 10:53:15,638 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2024-02-17 10:53:15,638 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2024-02-17 10:53:15,638 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2024-02-17 10:53:15,638 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2024-02-17 10:53:15,638 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2024-02-17 10:53:15,639 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2024-02-17 10:53:15,639 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2024-02-17 10:53:15,639 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2024-02-17 10:53:15,639 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2024-02-17 10:53:15,639 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2024-02-17 10:53:15,639 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2024-02-17 10:53:15,640 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2024-02-17 10:53:15,640 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2024-02-17 10:53:15,640 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2024-02-17 10:53:15,640 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2024-02-17 10:53:15,640 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2024-02-17 10:53:15,640 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2024-02-17 10:53:15,641 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2024-02-17 10:53:15,641 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2024-02-17 10:53:15,641 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2024-02-17 10:53:15,642 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2024-02-17 10:53:15,642 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2024-02-17 10:53:15,642 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2024-02-17 10:53:15,642 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2024-02-17 10:53:15,642 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2024-02-17 10:53:15,642 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2024-02-17 10:53:15,643 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2024-02-17 10:53:15,643 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2024-02-17 10:53:15,643 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2024-02-17 10:53:15,643 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2024-02-17 10:53:15,643 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2024-02-17 10:53:15,643 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2024-02-17 10:53:15,644 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2024-02-17 10:53:15,644 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2024-02-17 10:53:15,644 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2024-02-17 10:53:15,644 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2024-02-17 10:53:15,644 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2024-02-17 10:53:15,644 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2024-02-17 10:53:15,645 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2024-02-17 10:53:15,645 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2024-02-17 10:53:15,645 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2024-02-17 10:53:15,645 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2024-02-17 10:53:15,645 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2024-02-17 10:53:15,645 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2024-02-17 10:53:15,645 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2024-02-17 10:53:15,646 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2024-02-17 10:53:15,646 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2024-02-17 10:53:15,646 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2024-02-17 10:53:15,646 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2024-02-17 10:53:15,646 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2024-02-17 10:53:15,646 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2024-02-17 10:53:15,647 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2024-02-17 10:53:15,647 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2024-02-17 10:53:15,647 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2024-02-17 10:53:15,647 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2024-02-17 10:53:15,647 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2024-02-17 10:53:15,647 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2024-02-17 10:53:15,647 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2024-02-17 10:53:15,648 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2024-02-17 10:53:15,648 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2024-02-17 10:53:15,648 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2024-02-17 10:53:15,648 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2024-02-17 10:53:15,648 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2024-02-17 10:53:15,648 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2024-02-17 10:53:15,649 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2024-02-17 10:53:15,649 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2024-02-17 10:53:15,649 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2024-02-17 10:53:15,649 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2024-02-17 10:53:15,649 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2024-02-17 10:53:15,649 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2024-02-17 10:53:15,650 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2024-02-17 10:53:15,650 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2024-02-17 10:53:15,650 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2024-02-17 10:53:15,650 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2024-02-17 10:53:15,650 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2024-02-17 10:53:15,650 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2024-02-17 10:53:15,651 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2024-02-17 10:53:15,651 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2024-02-17 10:53:15,651 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2024-02-17 10:53:15,651 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2024-02-17 10:53:15,651 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2024-02-17 10:53:15,651 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2024-02-17 10:53:15,651 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2024-02-17 10:53:15,652 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2024-02-17 10:53:15,652 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2024-02-17 10:53:15,873 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.06666666666666667, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2024-02-17 10:53:15,874 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2024-02-17 10:53:15,874 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.9909252140407105, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.06666666666666667, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2024-02-17 10:53:16,709 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 1017 ms to try 5000 different iterations.  Found a solution that moves 4706 regions; Going from a computed imbalance of 0.9909252140407105 to a new imbalance of 0.17950430466213652. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.043003869994664656, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.05259804590686901, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.5228888888888888, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.043003869994664656, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.17441666666666666, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.24441666666666667, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2024-02-17 10:53:16,724 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1449721036:81 , srv1892013491:81 , srv467712304:81 , srv1174472233:82 , srv1358518470:82 , srv138197709:82 , srv1476852771:82 , srv1518826941:82 , srv2020495533:82 , srv2029415763:82 , srv656015974:82 , srv1056224149:83 , srv1159757493:83 , srv11933808:83 , srv352241822:83 , srv641388146:83 , srv695721388:83 , srv760948267:83 , srv78098264:83 , srv946949359:83 , srv1086218681:84 , srv1216614494:84 , srv133289342:84 , srv1514984817:84 , srv1516501972:84 , srv1733663465:84 , srv1980129733:84 , srv2024152542:84 , srv328626039:84 , srv482675390:84 , srv517207957:84 , srv615285969:84 , srv619608385:84 , srv804541006:84 , srv143073341:85 , srv144204883:85 , srv154965032:85 , srv1745945787:85 , srv248975882:85 , srv521582583:85 , srv609838029:85 , srv816367065:85 , srv819499503:85 , srv823059069:85 , srv873187922:85 , srv966973602:85 , srv1263462861:86 , srv1275809962:86 , srv1580705329:86 , srv162832548:86 , srv1835520864:86 , srv339914388:86 , srv370780886:86 , srv420262672:86 , srv546426981:86 , srv726987292:86 , srv813289374:86 , srv959705867:86 , srv975188881:86 , srv1078524008:87 , srv1233355056:87 , srv1834803836:87 , srv1947201708:87 , srv2099162750:87 , srv555093696:87 , srv568412740:87 , srv1003571933:88 , srv1053909946:88 , srv1106786641:88 , srv130408842:88 , srv1578034630:88 , srv1758712951:88 , srv1889282740:88 , srv337600303:88 , srv375845113:88 , srv435657855:88 , srv622743213:88 , srv680193356:88 , srv853896553:88 , srv973790956:88 , srv1044279111:89 , srv1440953896:89 , srv1842061847:89 , srv1514924519:90 , srv1544261409:90 , srv299895891:90 , srv60533065:90 , srv605899145:90 , srv1425767767:91 , srv1605663024:91 , srv1833048080:91 , srv2050605235:91 , srv917508647:91 , srv1245830476:92 , srv1504697899:92 , srv2110467251:92 , srv1628525528:93 , srv2095357350:93 , srv855765978:93 , srv420732972:472 }
2024-02-17 10:53:16,731 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2024-02-17 10:53:16,732 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv154965032=31, srv1233355056=11, srv726987292=83, srv78098264=85, srv855765978=92, srv1889282740=44, srv133289342=16, srv2029415763=50, srv2095357350=52, srv11933808=9, srv641388146=79, srv555093696=71, srv1835520864=42, srv619608385=77, srv546426981=70, srv1745945787=38, srv352241822=60, srv1106786641=6, srv760948267=84, srv1834803836=41, srv370780886=61, srv1449721036=23, srv1605663024=34, srv1086218681=5, srv973790956=98, srv328626039=57, srv1892013491=45, srv1733663465=37, srv517207957=68, srv1078524008=4, srv420732972=64, srv695721388=82, srv60533065=73, srv1842061847=43, srv1947201708=46, srv1980129733=47, srv1358518470=17, srv2110467251=54, srv1053909946=2, srv435657855=65, srv1514984817=27, srv813289374=87, srv804541006=86, srv2050605235=51, srv680193356=81, srv1578034630=32, srv1758712951=39, srv2099162750=53, srv138197709=18, srv144204883=22, srv823059069=90, srv375845113=62, srv143073341=20, srv966973602=97, srv1476852771=24, srv2020495533=48, srv339914388=59, srv1504697899=25, srv1174472233=8, srv917508647=94, srv1263462861=13, srv819499503=89, srv1056224149=3, srv1628525528=36, srv1003571933=0, srv130408842=15, srv1516501972=28, srv1275809962=14, srv1833048080=40, srv1580705329=33, srv2024152542=49, srv1440953896=21, srv975188881=99, srv1425767767=19, srv946949359=95, srv299895891=56, srv609838029=75, srv248975882=55, srv615285969=76, srv873187922=93, srv1518826941=29, srv622743213=78, srv420262672=63, srv568412740=72, srv656015974=80, srv337600303=58, srv1514924519=26, srv1159757493=7, srv162832548=35, srv1245830476=12, srv605899145=74, srv853896553=91, srv1044279111=1, srv482675390=67, srv521582583=69, srv1544261409=30, srv959705867=96, srv816367065=88, srv1216614494=10, srv467712304=66} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2024-02-17 10:53:16,757 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2024-02-17 10:53:16,757 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2024-02-17 10:53:16,757 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2024-02-17 10:53:16,757 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2024-02-17 10:53:16,757 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2024-02-17 10:53:16,758 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2024-02-17 10:53:16,758 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2024-02-17 10:53:16,758 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2024-02-17 10:53:16,758 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2024-02-17 10:53:16,758 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2024-02-17 10:53:16,758 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2024-02-17 10:53:16,758 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2024-02-17 10:53:16,759 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2024-02-17 10:53:16,759 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2024-02-17 10:53:16,759 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2024-02-17 10:53:16,759 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2024-02-17 10:53:16,759 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2024-02-17 10:53:16,759 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2024-02-17 10:53:16,759 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2024-02-17 10:53:16,759 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2024-02-17 10:53:16,760 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2024-02-17 10:53:16,760 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2024-02-17 10:53:16,760 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2024-02-17 10:53:16,760 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2024-02-17 10:53:16,760 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2024-02-17 10:53:16,760 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2024-02-17 10:53:16,760 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2024-02-17 10:53:16,760 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2024-02-17 10:53:16,761 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2024-02-17 10:53:16,761 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2024-02-17 10:53:16,761 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2024-02-17 10:53:16,761 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2024-02-17 10:53:16,761 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2024-02-17 10:53:16,761 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2024-02-17 10:53:16,761 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2024-02-17 10:53:16,761 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2024-02-17 10:53:16,762 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2024-02-17 10:53:16,762 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2024-02-17 10:53:16,762 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2024-02-17 10:53:16,762 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2024-02-17 10:53:16,762 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2024-02-17 10:53:16,762 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2024-02-17 10:53:16,762 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2024-02-17 10:53:16,762 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2024-02-17 10:53:16,762 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2024-02-17 10:53:16,763 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2024-02-17 10:53:16,763 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2024-02-17 10:53:16,763 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2024-02-17 10:53:16,763 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2024-02-17 10:53:16,763 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2024-02-17 10:53:16,763 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2024-02-17 10:53:16,763 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2024-02-17 10:53:16,763 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2024-02-17 10:53:16,764 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2024-02-17 10:53:16,764 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2024-02-17 10:53:16,764 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2024-02-17 10:53:16,764 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2024-02-17 10:53:16,764 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2024-02-17 10:53:16,764 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2024-02-17 10:53:16,764 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2024-02-17 10:53:16,764 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2024-02-17 10:53:16,765 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2024-02-17 10:53:16,765 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2024-02-17 10:53:16,765 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2024-02-17 10:53:16,765 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2024-02-17 10:53:16,765 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2024-02-17 10:53:16,765 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2024-02-17 10:53:16,765 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2024-02-17 10:53:16,765 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2024-02-17 10:53:16,765 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2024-02-17 10:53:16,766 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2024-02-17 10:53:16,766 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2024-02-17 10:53:16,766 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2024-02-17 10:53:16,766 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2024-02-17 10:53:16,766 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2024-02-17 10:53:16,766 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2024-02-17 10:53:16,766 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2024-02-17 10:53:16,766 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2024-02-17 10:53:16,767 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2024-02-17 10:53:16,767 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2024-02-17 10:53:16,767 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2024-02-17 10:53:16,767 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2024-02-17 10:53:16,767 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2024-02-17 10:53:16,767 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2024-02-17 10:53:16,767 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2024-02-17 10:53:16,767 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2024-02-17 10:53:16,767 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2024-02-17 10:53:16,768 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2024-02-17 10:53:16,768 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2024-02-17 10:53:16,768 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2024-02-17 10:53:16,768 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2024-02-17 10:53:16,768 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2024-02-17 10:53:16,768 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2024-02-17 10:53:16,768 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2024-02-17 10:53:16,768 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2024-02-17 10:53:16,768 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2024-02-17 10:53:16,769 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2024-02-17 10:53:16,769 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2024-02-17 10:53:16,769 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2024-02-17 10:53:16,769 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2024-02-17 10:53:16,769 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2024-02-17 10:53:16,961 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.043003869994664656, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.05259804590686901, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.043003869994664656, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.17441666666666666, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.24441666666666667, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2024-02-17 10:53:16,961 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2024-02-17 10:53:16,961 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.17947135254583682, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.043003869994664656, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.05259804590686901, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.043003869994664656, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.17441666666666666, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.24441666666666667, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2024-02-17 10:53:17,284 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 481 ms to try 5000 different iterations.  Found a solution that moves 2667 regions; Going from a computed imbalance of 0.17947135254583682 to a new imbalance of 0.012899714771022893. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.02015713307287078); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.02833976952051427, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.29633333333333334, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.02015713307287078); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.00975); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.043083333333333335, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2024-02-17 10:53:17,304 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1245830476:78 , srv1628525528:78 , srv2095357350:79 , srv917508647:79 , srv1605663024:81 , srv1833048080:81 , srv2110467251:81 , srv855765978:81 , srv1003571933:82 , srv1044279111:82 , srv1758712951:82 , srv2050605235:82 , srv337600303:82 , srv435657855:82 , srv605899145:82 , srv853896553:82 , srv1233355056:83 , srv1504697899:83 , srv1514924519:83 , srv1544261409:83 , srv1578034630:83 , srv1889282740:83 , srv2099162750:83 , srv375845113:83 , srv680193356:83 , srv1078524008:84 , srv1106786641:84 , srv130408842:84 , srv1842061847:84 , srv299895891:84 , srv420262672:84 , srv60533065:84 , srv622743213:84 , srv1053909946:85 , srv1440953896:85 , srv1834803836:85 , srv339914388:85 , srv555093696:85 , srv568412740:85 , srv726987292:85 , srv966973602:85 , srv973790956:85 , srv1263462861:86 , srv1425767767:86 , srv1580705329:86 , srv1835520864:86 , srv1947201708:86 , srv1980129733:86 , srv615285969:86 , srv816367065:86 , srv819499503:86 , srv823059069:86 , srv959705867:86 , srv975188881:86 , srv1275809962:87 , srv133289342:87 , srv144204883:87 , srv154965032:87 , srv1733663465:87 , srv2024152542:87 , srv521582583:87 , srv546426981:87 , srv1056224149:88 , srv1086218681:88 , srv2020495533:88 , srv248975882:88 , srv370780886:88 , srv517207957:88 , srv813289374:88 , srv11933808:89 , srv1216614494:89 , srv138197709:89 , srv1476852771:89 , srv1514984817:89 , srv1516501972:89 , srv1745945787:89 , srv328626039:89 , srv482675390:89 , srv609838029:89 , srv619608385:89 , srv695721388:89 , srv760948267:89 , srv78098264:89 , srv873187922:89 , srv946949359:89 , srv1159757493:90 , srv143073341:90 , srv162832548:90 , srv2029415763:90 , srv352241822:90 , srv641388146:90 , srv656015974:90 , srv1174472233:91 , srv1449721036:91 , srv1518826941:91 , srv804541006:91 , srv1892013491:92 , srv467712304:93 , srv1358518470:94 , srv420732972:481 }
2024-02-17 10:53:17,310 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2024-02-17 10:53:17,320 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv154965032=31, srv1233355056=11, srv726987292=83, srv78098264=85, srv855765978=92, srv1889282740=44, srv133289342=16, srv2029415763=50, srv2095357350=52, srv11933808=9, srv641388146=79, srv555093696=71, srv1835520864=42, srv619608385=77, srv546426981=70, srv1745945787=38, srv352241822=60, srv1106786641=6, srv760948267=84, srv1834803836=41, srv370780886=61, srv1449721036=23, srv1605663024=34, srv1086218681=5, srv973790956=98, srv328626039=57, srv1892013491=45, srv1733663465=37, srv517207957=68, srv1078524008=4, srv420732972=64, srv695721388=82, srv60533065=73, srv1842061847=43, srv1947201708=46, srv1980129733=47, srv1358518470=17, srv2110467251=54, srv1053909946=2, srv435657855=65, srv1514984817=27, srv813289374=87, srv804541006=86, srv2050605235=51, srv680193356=81, srv1578034630=32, srv1758712951=39, srv2099162750=53, srv138197709=18, srv144204883=22, srv823059069=90, srv375845113=62, srv143073341=20, srv966973602=97, srv1476852771=24, srv2020495533=48, srv339914388=59, srv1504697899=25, srv1174472233=8, srv917508647=94, srv1263462861=13, srv819499503=89, srv1056224149=3, srv1628525528=36, srv1003571933=0, srv130408842=15, srv1516501972=28, srv1275809962=14, srv1833048080=40, srv1580705329=33, srv2024152542=49, srv1440953896=21, srv975188881=99, srv1425767767=19, srv946949359=95, srv299895891=56, srv609838029=75, srv248975882=55, srv615285969=76, srv873187922=93, srv1518826941=29, srv622743213=78, srv420262672=63, srv568412740=72, srv656015974=80, srv337600303=58, srv1514924519=26, srv1159757493=7, srv162832548=35, srv1245830476=12, srv605899145=74, srv853896553=91, srv1044279111=1, srv482675390=67, srv521582583=69, srv1544261409=30, srv959705867=96, srv816367065=88, srv1216614494=10, srv467712304=66} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2024-02-17 10:53:17,357 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2024-02-17 10:53:17,357 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2024-02-17 10:53:17,357 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2024-02-17 10:53:17,357 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2024-02-17 10:53:17,358 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2024-02-17 10:53:17,358 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2024-02-17 10:53:17,358 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2024-02-17 10:53:17,358 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2024-02-17 10:53:17,358 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2024-02-17 10:53:17,358 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2024-02-17 10:53:17,358 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2024-02-17 10:53:17,358 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2024-02-17 10:53:17,358 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2024-02-17 10:53:17,359 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2024-02-17 10:53:17,359 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2024-02-17 10:53:17,359 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2024-02-17 10:53:17,359 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2024-02-17 10:53:17,359 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2024-02-17 10:53:17,359 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2024-02-17 10:53:17,359 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2024-02-17 10:53:17,359 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2024-02-17 10:53:17,359 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2024-02-17 10:53:17,359 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2024-02-17 10:53:17,360 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2024-02-17 10:53:17,360 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2024-02-17 10:53:17,360 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2024-02-17 10:53:17,360 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2024-02-17 10:53:17,360 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2024-02-17 10:53:17,360 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2024-02-17 10:53:17,360 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2024-02-17 10:53:17,360 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2024-02-17 10:53:17,360 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2024-02-17 10:53:17,361 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2024-02-17 10:53:17,361 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2024-02-17 10:53:17,361 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2024-02-17 10:53:17,361 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2024-02-17 10:53:17,361 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2024-02-17 10:53:17,361 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2024-02-17 10:53:17,361 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2024-02-17 10:53:17,361 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2024-02-17 10:53:17,361 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2024-02-17 10:53:17,362 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2024-02-17 10:53:17,362 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2024-02-17 10:53:17,362 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2024-02-17 10:53:17,362 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2024-02-17 10:53:17,362 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2024-02-17 10:53:17,362 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2024-02-17 10:53:17,362 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2024-02-17 10:53:17,362 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2024-02-17 10:53:17,362 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2024-02-17 10:53:17,363 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2024-02-17 10:53:17,363 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2024-02-17 10:53:17,363 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2024-02-17 10:53:17,363 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2024-02-17 10:53:17,363 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2024-02-17 10:53:17,363 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2024-02-17 10:53:17,363 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2024-02-17 10:53:17,363 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2024-02-17 10:53:17,363 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2024-02-17 10:53:17,363 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2024-02-17 10:53:17,364 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2024-02-17 10:53:17,364 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2024-02-17 10:53:17,364 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2024-02-17 10:53:17,364 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2024-02-17 10:53:17,364 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2024-02-17 10:53:17,364 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2024-02-17 10:53:17,364 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2024-02-17 10:53:17,364 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2024-02-17 10:53:17,364 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2024-02-17 10:53:17,365 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2024-02-17 10:53:17,365 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2024-02-17 10:53:17,365 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2024-02-17 10:53:17,365 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2024-02-17 10:53:17,365 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2024-02-17 10:53:17,365 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2024-02-17 10:53:17,365 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2024-02-17 10:53:17,365 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2024-02-17 10:53:17,365 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2024-02-17 10:53:17,365 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2024-02-17 10:53:17,366 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2024-02-17 10:53:17,366 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2024-02-17 10:53:17,366 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2024-02-17 10:53:17,366 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2024-02-17 10:53:17,366 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2024-02-17 10:53:17,366 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2024-02-17 10:53:17,366 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2024-02-17 10:53:17,366 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2024-02-17 10:53:17,366 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2024-02-17 10:53:17,367 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2024-02-17 10:53:17,367 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2024-02-17 10:53:17,367 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2024-02-17 10:53:17,367 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2024-02-17 10:53:17,367 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2024-02-17 10:53:17,367 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2024-02-17 10:53:17,367 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2024-02-17 10:53:17,367 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2024-02-17 10:53:17,367 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2024-02-17 10:53:17,368 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2024-02-17 10:53:17,368 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2024-02-17 10:53:17,371 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2024-02-17 10:53:17,371 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2024-02-17 10:53:17,537 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.02015713307287078); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.02833976952051427, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.02015713307287078); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.00975); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.043083333333333335, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2024-02-17 10:53:17,537 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2024-02-17 10:53:17,538 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.012881040037879815, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.02015713307287078); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.02833976952051427, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.02015713307287078); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.00975); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.043083333333333335, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2024-02-17 10:53:17,916 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 517 ms to try 5000 different iterations.  Found a solution that moves 950 regions; Going from a computed imbalance of 0.012881040037879815 to a new imbalance of 8.999020274513535E-4. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.004316335478630605); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.007153911599848797); MoveCostFunction : (multiplier=7.0, imbalance=0.10555555555555556, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.004316335478630605); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=5.833333333333334E-4); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0035); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2024-02-17 10:53:17,918 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1425767767:81 , srv162832548:81 , srv1358518470:82 , srv1504697899:82 , srv143073341:83 , srv1745945787:83 , srv60533065:83 , srv609838029:83 , srv804541006:83 , srv855765978:83 , srv1159757493:84 , srv1174472233:84 , srv1440953896:84 , srv1516501972:84 , srv1518826941:84 , srv1544261409:84 , srv1605663024:84 , srv2110467251:84 , srv299895891:84 , srv328626039:84 , srv352241822:84 , srv370780886:84 , srv467712304:84 , srv482675390:84 , srv619608385:84 , srv813289374:84 , srv873187922:84 , srv1053909946:85 , srv1216614494:85 , srv1275809962:85 , srv1449721036:85 , srv1514924519:85 , srv1514984817:85 , srv154965032:85 , srv1580705329:85 , srv1833048080:85 , srv1834803836:85 , srv1835520864:85 , srv1842061847:85 , srv1892013491:85 , srv1947201708:85 , srv2050605235:85 , srv248975882:85 , srv517207957:85 , srv546426981:85 , srv656015974:85 , srv760948267:85 , srv946949359:85 , srv973790956:85 , srv1056224149:86 , srv1078524008:86 , srv1106786641:86 , srv11933808:86 , srv130408842:86 , srv133289342:86 , srv144204883:86 , srv1476852771:86 , srv1628525528:86 , srv1733663465:86 , srv1889282740:86 , srv2029415763:86 , srv2095357350:86 , srv521582583:86 , srv555093696:86 , srv568412740:86 , srv605899145:86 , srv622743213:86 , srv641388146:86 , srv680193356:86 , srv695721388:86 , srv726987292:86 , srv78098264:86 , srv959705867:86 , srv975188881:86 , srv1003571933:87 , srv1044279111:87 , srv1086218681:87 , srv1233355056:87 , srv1263462861:87 , srv138197709:87 , srv1578034630:87 , srv2020495533:87 , srv2099162750:87 , srv375845113:87 , srv615285969:87 , srv816367065:87 , srv819499503:87 , srv823059069:87 , srv966973602:87 , srv1245830476:88 , srv1758712951:88 , srv1980129733:88 , srv2024152542:88 , srv337600303:88 , srv339914388:88 , srv420262672:88 , srv435657855:88 , srv853896553:88 , srv917508647:88 , srv420732972:543 }
2024-02-17 10:53:17,922 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2024-02-17 10:53:17,923 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv154965032=31, srv1233355056=11, srv726987292=83, srv78098264=85, srv855765978=92, srv1889282740=44, srv133289342=16, srv2029415763=50, srv2095357350=52, srv11933808=9, srv641388146=79, srv555093696=71, srv1835520864=42, srv619608385=77, srv546426981=70, srv1745945787=38, srv352241822=60, srv1106786641=6, srv760948267=84, srv1834803836=41, srv370780886=61, srv1449721036=23, srv1605663024=34, srv1086218681=5, srv973790956=98, srv328626039=57, srv1892013491=45, srv1733663465=37, srv517207957=68, srv1078524008=4, srv420732972=64, srv695721388=82, srv60533065=73, srv1842061847=43, srv1947201708=46, srv1980129733=47, srv1358518470=17, srv2110467251=54, srv1053909946=2, srv435657855=65, srv1514984817=27, srv813289374=87, srv804541006=86, srv2050605235=51, srv680193356=81, srv1578034630=32, srv1758712951=39, srv2099162750=53, srv138197709=18, srv144204883=22, srv823059069=90, srv375845113=62, srv143073341=20, srv966973602=97, srv1476852771=24, srv2020495533=48, srv339914388=59, srv1504697899=25, srv1174472233=8, srv917508647=94, srv1263462861=13, srv819499503=89, srv1056224149=3, srv1628525528=36, srv1003571933=0, srv130408842=15, srv1516501972=28, srv1275809962=14, srv1833048080=40, srv1580705329=33, srv2024152542=49, srv1440953896=21, srv975188881=99, srv1425767767=19, srv946949359=95, srv299895891=56, srv609838029=75, srv248975882=55, srv615285969=76, srv873187922=93, srv1518826941=29, srv622743213=78, srv420262672=63, srv568412740=72, srv656015974=80, srv337600303=58, srv1514924519=26, srv1159757493=7, srv162832548=35, srv1245830476=12, srv605899145=74, srv853896553=91, srv1044279111=1, srv482675390=67, srv521582583=69, srv1544261409=30, srv959705867=96, srv816367065=88, srv1216614494=10, srv467712304=66} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2024-02-17 10:53:17,940 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2024-02-17 10:53:17,940 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2024-02-17 10:53:17,940 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2024-02-17 10:53:17,940 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2024-02-17 10:53:17,940 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2024-02-17 10:53:17,940 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2024-02-17 10:53:17,941 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2024-02-17 10:53:17,941 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2024-02-17 10:53:17,941 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2024-02-17 10:53:17,941 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2024-02-17 10:53:17,941 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2024-02-17 10:53:17,941 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2024-02-17 10:53:17,941 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2024-02-17 10:53:17,941 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2024-02-17 10:53:17,941 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2024-02-17 10:53:17,941 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2024-02-17 10:53:17,942 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2024-02-17 10:53:17,942 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2024-02-17 10:53:17,942 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2024-02-17 10:53:17,942 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2024-02-17 10:53:17,942 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2024-02-17 10:53:17,942 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2024-02-17 10:53:17,942 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2024-02-17 10:53:17,942 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2024-02-17 10:53:17,942 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2024-02-17 10:53:17,943 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2024-02-17 10:53:17,943 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2024-02-17 10:53:17,943 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2024-02-17 10:53:17,943 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2024-02-17 10:53:17,943 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2024-02-17 10:53:17,943 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2024-02-17 10:53:17,943 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2024-02-17 10:53:17,943 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2024-02-17 10:53:17,943 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2024-02-17 10:53:17,943 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2024-02-17 10:53:17,944 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2024-02-17 10:53:17,944 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2024-02-17 10:53:17,944 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2024-02-17 10:53:17,944 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2024-02-17 10:53:17,944 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2024-02-17 10:53:17,944 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2024-02-17 10:53:17,944 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2024-02-17 10:53:17,944 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2024-02-17 10:53:17,944 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2024-02-17 10:53:17,944 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2024-02-17 10:53:17,945 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2024-02-17 10:53:17,945 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2024-02-17 10:53:17,945 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2024-02-17 10:53:17,945 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2024-02-17 10:53:17,945 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2024-02-17 10:53:17,945 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2024-02-17 10:53:17,945 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2024-02-17 10:53:17,945 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2024-02-17 10:53:17,945 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2024-02-17 10:53:17,945 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2024-02-17 10:53:17,946 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2024-02-17 10:53:17,946 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2024-02-17 10:53:17,946 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2024-02-17 10:53:17,946 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2024-02-17 10:53:17,946 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2024-02-17 10:53:17,946 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2024-02-17 10:53:17,946 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2024-02-17 10:53:17,946 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2024-02-17 10:53:17,946 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2024-02-17 10:53:17,947 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2024-02-17 10:53:17,947 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2024-02-17 10:53:17,947 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2024-02-17 10:53:17,947 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2024-02-17 10:53:17,947 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2024-02-17 10:53:17,947 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2024-02-17 10:53:17,948 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2024-02-17 10:53:17,948 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2024-02-17 10:53:17,948 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2024-02-17 10:53:17,948 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2024-02-17 10:53:17,948 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2024-02-17 10:53:17,948 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2024-02-17 10:53:17,948 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2024-02-17 10:53:17,948 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2024-02-17 10:53:17,948 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2024-02-17 10:53:17,949 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2024-02-17 10:53:17,949 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2024-02-17 10:53:17,949 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2024-02-17 10:53:17,949 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2024-02-17 10:53:17,949 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2024-02-17 10:53:17,949 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2024-02-17 10:53:17,949 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2024-02-17 10:53:17,949 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2024-02-17 10:53:17,949 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2024-02-17 10:53:17,949 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2024-02-17 10:53:17,949 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2024-02-17 10:53:17,949 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2024-02-17 10:53:17,950 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2024-02-17 10:53:17,950 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2024-02-17 10:53:17,950 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2024-02-17 10:53:17,950 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2024-02-17 10:53:17,950 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2024-02-17 10:53:17,950 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2024-02-17 10:53:17,950 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2024-02-17 10:53:17,950 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2024-02-17 10:53:17,950 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2024-02-17 10:53:17,951 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2024-02-17 10:53:18,069 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.004316335478630605); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.007153911599848797); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.004316335478630605); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=5.833333333333334E-4); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0035); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2024-02-17 10:53:18,069 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2024-02-17 10:53:18,069 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=8.932499852744053E-4, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.004316335478630605); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.007153911599848797); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.004316335478630605); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=5.833333333333334E-4); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0035); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2024-02-17 10:53:18,292 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 321 ms to try 5000 different iterations.  Found a solution that moves 220 regions; Going from a computed imbalance of 8.932499852744053E-4 to a new imbalance of 1.9536830154260656E-5. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=3.5313429231318235E-4); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0019534423844256277); MoveCostFunction : (multiplier=7.0, imbalance=0.024444444444444446); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=3.5313429231318235E-4); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=8.333333333333333E-5); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2024-02-17 10:53:18,293 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1086218681:83 , srv1263462861:83 , srv2024152542:83 , srv339914388:83 , srv641388146:83 , srv1044279111:84 , srv1053909946:84 , srv1106786641:84 , srv11933808:84 , srv1216614494:84 , srv1245830476:84 , srv1275809962:84 , srv130408842:84 , srv1358518470:84 , srv138197709:84 , srv1425767767:84 , srv143073341:84 , srv1440953896:84 , srv144204883:84 , srv1476852771:84 , srv1514984817:84 , srv1516501972:84 , srv1578034630:84 , srv1758712951:84 , srv1842061847:84 , srv1892013491:84 , srv1947201708:84 , srv1980129733:84 , srv2029415763:84 , srv2095357350:84 , srv248975882:84 , srv299895891:84 , srv337600303:84 , srv352241822:84 , srv375845113:84 , srv420262672:84 , srv435657855:84 , srv467712304:84 , srv521582583:84 , srv546426981:84 , srv555093696:84 , srv568412740:84 , srv605899145:84 , srv615285969:84 , srv622743213:84 , srv656015974:84 , srv695721388:84 , srv78098264:84 , srv804541006:84 , srv813289374:84 , srv816367065:84 , srv819499503:84 , srv823059069:84 , srv853896553:84 , srv917508647:84 , srv959705867:84 , srv973790956:84 , srv975188881:84 , srv1003571933:85 , srv1056224149:85 , srv1078524008:85 , srv1159757493:85 , srv1174472233:85 , srv1233355056:85 , srv133289342:85 , srv1449721036:85 , srv1504697899:85 , srv1514924519:85 , srv1518826941:85 , srv1544261409:85 , srv154965032:85 , srv1580705329:85 , srv162832548:85 , srv1628525528:85 , srv1733663465:85 , srv1745945787:85 , srv1833048080:85 , srv1834803836:85 , srv1889282740:85 , srv2020495533:85 , srv2050605235:85 , srv2099162750:85 , srv2110467251:85 , srv328626039:85 , srv370780886:85 , srv482675390:85 , srv517207957:85 , srv60533065:85 , srv609838029:85 , srv619608385:85 , srv680193356:85 , srv726987292:85 , srv760948267:85 , srv855765978:85 , srv873187922:85 , srv946949359:85 , srv966973602:85 , srv1605663024:86 , srv1835520864:86 , srv420732972:646 }
2024-02-17 10:53:18,296 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2024-02-17 10:53:18,297 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv154965032=31, srv1233355056=11, srv726987292=83, srv78098264=85, srv855765978=92, srv1889282740=44, srv133289342=16, srv2029415763=50, srv2095357350=52, srv11933808=9, srv641388146=79, srv555093696=71, srv1835520864=42, srv619608385=77, srv546426981=70, srv1745945787=38, srv352241822=60, srv1106786641=6, srv760948267=84, srv1834803836=41, srv370780886=61, srv1449721036=23, srv1605663024=34, srv1086218681=5, srv973790956=98, srv328626039=57, srv1892013491=45, srv1733663465=37, srv517207957=68, srv1078524008=4, srv420732972=64, srv695721388=82, srv60533065=73, srv1842061847=43, srv1947201708=46, srv1980129733=47, srv1358518470=17, srv2110467251=54, srv1053909946=2, srv435657855=65, srv1514984817=27, srv813289374=87, srv804541006=86, srv2050605235=51, srv680193356=81, srv1578034630=32, srv1758712951=39, srv2099162750=53, srv138197709=18, srv144204883=22, srv823059069=90, srv375845113=62, srv143073341=20, srv966973602=97, srv1476852771=24, srv2020495533=48, srv339914388=59, srv1504697899=25, srv1174472233=8, srv917508647=94, srv1263462861=13, srv819499503=89, srv1056224149=3, srv1628525528=36, srv1003571933=0, srv130408842=15, srv1516501972=28, srv1275809962=14, srv1833048080=40, srv1580705329=33, srv2024152542=49, srv1440953896=21, srv975188881=99, srv1425767767=19, srv946949359=95, srv299895891=56, srv609838029=75, srv248975882=55, srv615285969=76, srv873187922=93, srv1518826941=29, srv622743213=78, srv420262672=63, srv568412740=72, srv656015974=80, srv337600303=58, srv1514924519=26, srv1159757493=7, srv162832548=35, srv1245830476=12, srv605899145=74, srv853896553=91, srv1044279111=1, srv482675390=67, srv521582583=69, srv1544261409=30, srv959705867=96, srv816367065=88, srv1216614494=10, srv467712304=66} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2024-02-17 10:53:18,307 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2024-02-17 10:53:18,307 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2024-02-17 10:53:18,307 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2024-02-17 10:53:18,308 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2024-02-17 10:53:18,308 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2024-02-17 10:53:18,308 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2024-02-17 10:53:18,308 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2024-02-17 10:53:18,308 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2024-02-17 10:53:18,308 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2024-02-17 10:53:18,308 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2024-02-17 10:53:18,308 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2024-02-17 10:53:18,308 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2024-02-17 10:53:18,308 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2024-02-17 10:53:18,308 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2024-02-17 10:53:18,308 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2024-02-17 10:53:18,308 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2024-02-17 10:53:18,308 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2024-02-17 10:53:18,308 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2024-02-17 10:53:18,308 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2024-02-17 10:53:18,308 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2024-02-17 10:53:18,309 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2024-02-17 10:53:18,309 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2024-02-17 10:53:18,309 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2024-02-17 10:53:18,309 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2024-02-17 10:53:18,309 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2024-02-17 10:53:18,309 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2024-02-17 10:53:18,309 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2024-02-17 10:53:18,309 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2024-02-17 10:53:18,309 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2024-02-17 10:53:18,309 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2024-02-17 10:53:18,309 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2024-02-17 10:53:18,309 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2024-02-17 10:53:18,309 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2024-02-17 10:53:18,309 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2024-02-17 10:53:18,309 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2024-02-17 10:53:18,309 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2024-02-17 10:53:18,309 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2024-02-17 10:53:18,309 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2024-02-17 10:53:18,309 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2024-02-17 10:53:18,309 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2024-02-17 10:53:18,309 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2024-02-17 10:53:18,310 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2024-02-17 10:53:18,310 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2024-02-17 10:53:18,310 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2024-02-17 10:53:18,310 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2024-02-17 10:53:18,310 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2024-02-17 10:53:18,310 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2024-02-17 10:53:18,310 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2024-02-17 10:53:18,310 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2024-02-17 10:53:18,310 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2024-02-17 10:53:18,310 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2024-02-17 10:53:18,310 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2024-02-17 10:53:18,310 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2024-02-17 10:53:18,310 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2024-02-17 10:53:18,310 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2024-02-17 10:53:18,310 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2024-02-17 10:53:18,310 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2024-02-17 10:53:18,310 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2024-02-17 10:53:18,310 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2024-02-17 10:53:18,310 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2024-02-17 10:53:18,310 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2024-02-17 10:53:18,311 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2024-02-17 10:53:18,311 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2024-02-17 10:53:18,311 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2024-02-17 10:53:18,311 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2024-02-17 10:53:18,311 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2024-02-17 10:53:18,311 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2024-02-17 10:53:18,311 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2024-02-17 10:53:18,311 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2024-02-17 10:53:18,311 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2024-02-17 10:53:18,311 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2024-02-17 10:53:18,311 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2024-02-17 10:53:18,311 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2024-02-17 10:53:18,311 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2024-02-17 10:53:18,311 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2024-02-17 10:53:18,311 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2024-02-17 10:53:18,312 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2024-02-17 10:53:18,312 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2024-02-17 10:53:18,312 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2024-02-17 10:53:18,312 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2024-02-17 10:53:18,312 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2024-02-17 10:53:18,312 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2024-02-17 10:53:18,312 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2024-02-17 10:53:18,312 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2024-02-17 10:53:18,312 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2024-02-17 10:53:18,312 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2024-02-17 10:53:18,312 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2024-02-17 10:53:18,312 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2024-02-17 10:53:18,312 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2024-02-17 10:53:18,312 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2024-02-17 10:53:18,312 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2024-02-17 10:53:18,312 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2024-02-17 10:53:18,312 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2024-02-17 10:53:18,312 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2024-02-17 10:53:18,313 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2024-02-17 10:53:18,313 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2024-02-17 10:53:18,313 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2024-02-17 10:53:18,313 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2024-02-17 10:53:18,313 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2024-02-17 10:53:18,313 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2024-02-17 10:53:18,313 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2024-02-17 10:53:18,415 INFO  [Time-limited test] balancer.StochasticLoadBalancer(381): Cluster wide - skipping load balancing because weighted average imbalance=1.7996357229072622E-5 <= threshold(0.025). If you want more aggressive balancing, either lower hbase.master.balancer.stochastic.minCostNeedBalance from 0.025 or increase the relative multiplier(s) of the specific cost function(s). functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=3.5313429231318235E-4); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0019534423844256277); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=3.5313429231318235E-4); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=8.333333333333333E-5); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2024-02-17 10:53:18,416 INFO  [Time-limited test] balancer.BalancerTestBase(570): Mock Final balance: { srv1086218681:83 , srv1263462861:83 , srv2024152542:83 , srv339914388:83 , srv641388146:83 , srv1044279111:84 , srv1053909946:84 , srv1106786641:84 , srv11933808:84 , srv1216614494:84 , srv1245830476:84 , srv1275809962:84 , srv130408842:84 , srv1358518470:84 , srv138197709:84 , srv1425767767:84 , srv143073341:84 , srv1440953896:84 , srv144204883:84 , srv1476852771:84 , srv1514984817:84 , srv1516501972:84 , srv1578034630:84 , srv1758712951:84 , srv1842061847:84 , srv1892013491:84 , srv1947201708:84 , srv1980129733:84 , srv2029415763:84 , srv2095357350:84 , srv248975882:84 , srv299895891:84 , srv337600303:84 , srv352241822:84 , srv375845113:84 , srv420262672:84 , srv435657855:84 , srv467712304:84 , srv521582583:84 , srv546426981:84 , srv555093696:84 , srv568412740:84 , srv605899145:84 , srv615285969:84 , srv622743213:84 , srv656015974:84 , srv695721388:84 , srv78098264:84 , srv804541006:84 , srv813289374:84 , srv816367065:84 , srv819499503:84 , srv823059069:84 , srv853896553:84 , srv917508647:84 , srv959705867:84 , srv973790956:84 , srv975188881:84 , srv1003571933:85 , srv1056224149:85 , srv1078524008:85 , srv1159757493:85 , srv1174472233:85 , srv1233355056:85 , srv133289342:85 , srv1449721036:85 , srv1504697899:85 , srv1514924519:85 , srv1518826941:85 , srv1544261409:85 , srv154965032:85 , srv1580705329:85 , srv162832548:85 , srv1628525528:85 , srv1733663465:85 , srv1745945787:85 , srv1833048080:85 , srv1834803836:85 , srv1889282740:85 , srv2020495533:85 , srv2050605235:85 , srv2099162750:85 , srv2110467251:85 , srv328626039:85 , srv370780886:85 , srv482675390:85 , srv517207957:85 , srv60533065:85 , srv609838029:85 , srv619608385:85 , srv680193356:85 , srv726987292:85 , srv760948267:85 , srv855765978:85 , srv873187922:85 , srv946949359:85 , srv966973602:85 , srv1605663024:86 , srv1835520864:86 , srv420732972:646 }
2024-02-17 10:53:18,441 INFO  [Time-limited test] hbase.ResourceChecker(175): after: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnLargeClusterWithRacks Thread=12 (was 12), OpenFileDescriptor=290 (was 290), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=311 (was 312), ProcessCount=167 (was 168), AvailableMemoryMB=1213 (was 1955)
2024-02-17 10:53:18,448 INFO  [Time-limited test] hbase.ResourceChecker(147): before: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnMidClusterWithRacks Thread=12, OpenFileDescriptor=290, MaxFileDescriptor=60000, SystemLoadAverage=311, ProcessCount=167, AvailableMemoryMB=1213
2024-02-17 10:53:18,449 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2024-02-17 10:53:18,449 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=5000, runMaxSteps=true, stepsPerRegion=800, maxRunningTime=120000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 111077.0 etc.
2024-02-17 10:53:18,462 INFO  [Time-limited test] balancer.BalancerTestBase(547): Mock Cluster : { srv1008330457:84 , srv105226137:84 , srv1074141833:84 , srv1097857661:84 , srv1121442297:84 , srv1155146814:84 , srv1191186329:84 , srv1247833628:84 , srv1279274913:84 , srv1380252718:84 , srv1397270039:84 , srv1575144030:84 , srv1611627346:84 , srv169646471:84 , srv1733204468:84 , srv175896952:84 , srv2014983119:84 , srv2015494938:84 , srv2108239796:84 , srv2121020964:84 , srv239311746:84 , srv509757030:84 , srv546706984:84 , srv612861938:84 , srv688239717:84 , srv714751741:84 , srv829209378:84 , srv855523108:84 , srv872669048:84 , srv1727155564:264 } [srvr=30 rgns=2700 avg=90.0 max=90 min=90]
2024-02-17 10:53:18,464 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2024-02-17 10:53:18,464 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv2015494938=18, srv1279274913=8, srv169646471=13, srv1247833628=7, srv239311746=21, srv1575144030=11, srv855523108=28, srv1191186329=6, srv1733204468=15, srv1727155564=14, srv1380252718=9, srv612861938=24, srv105226137=1, srv1155146814=5, srv1611627346=12, srv2108239796=19, srv872669048=29, srv2014983119=17, srv2121020964=20, srv1008330457=0, srv1074141833=2, srv829209378=27, srv714751741=26, srv688239717=25, srv1121442297=4, srv175896952=16, srv546706984=23, srv1097857661=3, srv1397270039=10, srv509757030=22} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2024-02-17 10:53:18,477 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2024-02-17 10:53:18,477 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2024-02-17 10:53:18,477 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2024-02-17 10:53:18,477 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2024-02-17 10:53:18,477 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2024-02-17 10:53:18,477 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2024-02-17 10:53:18,477 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2024-02-17 10:53:18,477 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2024-02-17 10:53:18,477 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2024-02-17 10:53:18,477 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2024-02-17 10:53:18,477 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2024-02-17 10:53:18,478 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2024-02-17 10:53:18,478 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2024-02-17 10:53:18,478 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2024-02-17 10:53:18,478 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2024-02-17 10:53:18,478 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2024-02-17 10:53:18,478 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2024-02-17 10:53:18,478 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2024-02-17 10:53:18,478 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2024-02-17 10:53:18,478 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2024-02-17 10:53:18,478 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2024-02-17 10:53:18,479 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2024-02-17 10:53:18,479 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2024-02-17 10:53:18,479 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2024-02-17 10:53:18,479 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2024-02-17 10:53:18,479 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2024-02-17 10:53:18,479 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2024-02-17 10:53:18,479 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2024-02-17 10:53:18,479 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2024-02-17 10:53:18,479 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2024-02-17 10:53:18,479 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=10, number of hosts=30, number of racks=4
2024-02-17 10:53:18,503 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=1.1146841852750577, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2024-02-17 10:53:18,503 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.9912554409387299, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=1.1146841852750577, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=64800000
2024-02-17 10:55:18,483 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 120001 ms to try 6297092 different iterations.  Found a solution that moves 1847 regions; Going from a computed imbalance of 0.9912554409387299 to a new imbalance of 4.3109901406398434E-5. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); MoveCostFunction : (multiplier=7.0, imbalance=0.6840740740740741, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2024-02-17 10:55:18,488 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1008330457:90 , srv105226137:90 , srv1074141833:90 , srv1097857661:90 , srv1121442297:90 , srv1155146814:90 , srv1191186329:90 , srv1247833628:90 , srv1279274913:90 , srv1380252718:90 , srv1397270039:90 , srv1575144030:90 , srv1611627346:90 , srv169646471:90 , srv1727155564:90 , srv1733204468:90 , srv175896952:90 , srv2014983119:90 , srv2015494938:90 , srv2108239796:90 , srv2121020964:90 , srv239311746:90 , srv509757030:90 , srv546706984:90 , srv612861938:90 , srv688239717:90 , srv714751741:90 , srv829209378:90 , srv855523108:90 , srv872669048:90 }
2024-02-17 10:55:18,489 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2024-02-17 10:55:18,490 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv2015494938=18, srv1279274913=8, srv169646471=13, srv1247833628=7, srv239311746=21, srv1575144030=11, srv855523108=28, srv1191186329=6, srv1733204468=15, srv1727155564=14, srv1380252718=9, srv612861938=24, srv105226137=1, srv1155146814=5, srv1611627346=12, srv2108239796=19, srv872669048=29, srv2014983119=17, srv2121020964=20, srv1008330457=0, srv1074141833=2, srv829209378=27, srv714751741=26, srv688239717=25, srv1121442297=4, srv175896952=16, srv546706984=23, srv1097857661=3, srv1397270039=10, srv509757030=22} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2024-02-17 10:55:18,493 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2024-02-17 10:55:18,493 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2024-02-17 10:55:18,493 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2024-02-17 10:55:18,493 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2024-02-17 10:55:18,493 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2024-02-17 10:55:18,493 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2024-02-17 10:55:18,493 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2024-02-17 10:55:18,493 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2024-02-17 10:55:18,493 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2024-02-17 10:55:18,493 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2024-02-17 10:55:18,493 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2024-02-17 10:55:18,494 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2024-02-17 10:55:18,494 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2024-02-17 10:55:18,494 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2024-02-17 10:55:18,494 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2024-02-17 10:55:18,494 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2024-02-17 10:55:18,494 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2024-02-17 10:55:18,494 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2024-02-17 10:55:18,494 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2024-02-17 10:55:18,494 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2024-02-17 10:55:18,494 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2024-02-17 10:55:18,494 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2024-02-17 10:55:18,494 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2024-02-17 10:55:18,494 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2024-02-17 10:55:18,494 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2024-02-17 10:55:18,494 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2024-02-17 10:55:18,494 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2024-02-17 10:55:18,494 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2024-02-17 10:55:18,494 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2024-02-17 10:55:18,494 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2024-02-17 10:55:18,494 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=10, number of hosts=30, number of racks=4
2024-02-17 10:55:18,506 INFO  [Time-limited test] balancer.StochasticLoadBalancer(381): Cluster wide - skipping load balancing because weighted average imbalance=0.0 <= threshold(0.025). If you want more aggressive balancing, either lower hbase.master.balancer.stochastic.minCostNeedBalance from 0.025 or increase the relative multiplier(s) of the specific cost function(s). functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2024-02-17 10:55:18,506 INFO  [Time-limited test] balancer.BalancerTestBase(570): Mock Final balance: { srv1008330457:90 , srv105226137:90 , srv1074141833:90 , srv1097857661:90 , srv1121442297:90 , srv1155146814:90 , srv1191186329:90 , srv1247833628:90 , srv1279274913:90 , srv1380252718:90 , srv1397270039:90 , srv1575144030:90 , srv1611627346:90 , srv169646471:90 , srv1727155564:90 , srv1733204468:90 , srv175896952:90 , srv2014983119:90 , srv2015494938:90 , srv2108239796:90 , srv2121020964:90 , srv239311746:90 , srv509757030:90 , srv546706984:90 , srv612861938:90 , srv688239717:90 , srv714751741:90 , srv829209378:90 , srv855523108:90 , srv872669048:90 }
2024-02-17 10:55:18,519 INFO  [Time-limited test] hbase.ResourceChecker(175): after: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnMidClusterWithRacks Thread=11 (was 12), OpenFileDescriptor=290 (was 290), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=204 (was 311), ProcessCount=167 (was 167), AvailableMemoryMB=779 (was 1213)