2023-07-24 16:53:10,763 INFO  [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks timeout: 13 mins
2023-07-24 16:53:11,176 WARN  [Time-limited test] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties
2023-07-24 16:53:11,298 INFO  [Time-limited test] metrics.MetricRegistriesLoader(60): Loaded MetricRegistries class org.apache.hadoop.hbase.metrics.impl.MetricRegistriesImpl
2023-07-24 16:53:11,370 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2023-07-24 16:53:11,379 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc.
2023-07-24 16:53:11,395 INFO  [Time-limited test] hbase.ResourceChecker(147): before: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnLargeClusterWithRacks Thread=12, OpenFileDescriptor=263, MaxFileDescriptor=60000, SystemLoadAverage=330, ProcessCount=173, AvailableMemoryMB=10287
2023-07-24 16:53:11,397 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2023-07-24 16:53:11,397 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=5000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=10000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc.
2023-07-24 16:53:11,546 INFO  [Time-limited test] balancer.BalancerTestBase(547): Mock Cluster : { srv1026169657:84 , srv1042115800:84 , srv1059582942:84 , srv107352556:84 , srv1096902649:84 , srv1098251768:84 , srv1101430076:84 , srv1146361332:84 , srv1153545491:84 , srv1314363125:84 , srv1316256861:84 , srv1328111462:84 , srv13291949:84 , srv136355368:84 , srv1380743016:84 , srv1382764292:84 , srv1428429697:84 , srv144138241:84 , srv1477247884:84 , srv1529703466:84 , srv1569497017:84 , srv157462794:84 , srv161102447:84 , srv161626167:84 , srv1632272569:84 , srv165444349:84 , srv1669362301:84 , srv1685085682:84 , srv1692847279:84 , srv1710609523:84 , srv1717585998:84 , srv1718051592:84 , srv1735376798:84 , srv1769900552:84 , srv1774306967:84 , srv1785704300:84 , srv1832431051:84 , srv1835114564:84 , srv1848528154:84 , srv1849884022:84 , srv1851971390:84 , srv1852703164:84 , srv1862777095:84 , srv1871800685:84 , srv187491529:84 , srv1912371925:84 , srv1931459896:84 , srv1936976761:84 , srv1984917327:84 , srv2004065338:84 , srv2006676654:84 , srv2015060920:84 , srv2029610690:84 , srv2046243106:84 , srv205370328:84 , srv2064354398:84 , srv2088300549:84 , srv2101216731:84 , srv2109956617:84 , srv2110036226:84 , srv2112574672:84 , srv2141124961:84 , srv2144498648:84 , srv221979693:84 , srv255190696:84 , srv260879366:84 , srv270511423:84 , srv287846164:84 , srv311503806:84 , srv320015320:84 , srv320026287:84 , srv37760713:84 , srv389058046:84 , srv452320270:84 , srv466226016:84 , srv467397635:84 , srv546616396:84 , srv577193431:84 , srv62294764:84 , srv65484433:84 , srv667315097:84 , srv686131195:84 , srv695448667:84 , srv710453887:84 , srv725130931:84 , srv742250068:84 , srv776222230:84 , srv791797819:84 , srv802807945:84 , srv809449396:84 , srv82095266:84 , srv822836131:84 , srv823050974:84 , srv832524247:84 , srv866647391:84 , srv943097413:84 , srv950729866:84 , srv958540304:84 , srv980588626:84 , srv1930834849:684 } [srvr=100 rgns=9000 avg=90.0 max=90 min=90]
2023-07-24 16:53:11,559 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-07-24 16:53:11,568 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1101430076=6, srv2006676654=51, srv809449396=90, srv1835114564=37, srv187491529=44, srv710453887=84, srv1774306967=34, srv1785704300=35, srv1871800685=43, srv260879366=66, srv37760713=72, srv546616396=77, srv1685085682=27, srv1710609523=29, srv2112574672=61, srv161626167=23, srv144138241=17, srv165444349=25, srv1692847279=28, srv2064354398=56, srv2110036226=60, srv866647391=95, srv1042115800=1, srv725130931=85, srv107352556=3, srv980588626=99, srv1026169657=0, srv1769900552=33, srv1314363125=9, srv832524247=94, srv320015320=70, srv82095266=91, srv2109956617=59, srv1984917327=49, srv221979693=64, srv1912371925=45, srv1316256861=10, srv1477247884=18, srv2101216731=58, srv136355368=13, srv1382764292=15, srv13291949=12, srv2088300549=57, srv1862777095=42, srv1098251768=5, srv255190696=65, srv1669362301=26, srv1718051592=31, srv2004065338=50, srv802807945=89, srv1328111462=11, srv1735376798=32, srv695448667=83, srv287846164=68, srv742250068=86, srv1848528154=38, srv467397635=76, srv791797819=88, srv320026287=71, srv1632272569=24, srv1936976761=48, srv1852703164=41, srv157462794=21, srv1832431051=36, srv205370328=55, srv1930834849=46, srv1851971390=40, srv2144498648=63, srv686131195=82, srv1717585998=30, srv1380743016=14, srv2046243106=54, srv667315097=81, srv2141124961=62, srv950729866=97, srv389058046=73, srv776222230=87, srv1146361332=7, srv822836131=92, srv65484433=80, srv943097413=96, srv270511423=67, srv466226016=75, srv1428429697=16, srv1059582942=2, srv1931459896=47, srv1153545491=8, srv1096902649=4, srv1529703466=19, srv2015060920=52, srv452320270=74, srv2029610690=53, srv958540304=98, srv1569497017=20, srv823050974=93, srv1849884022=39, srv161102447=22, srv311503806=69, srv62294764=79, srv577193431=78} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-07-24 16:53:11,662 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-07-24 16:53:11,662 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-07-24 16:53:11,662 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-07-24 16:53:11,662 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-07-24 16:53:11,663 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-07-24 16:53:11,663 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-07-24 16:53:11,663 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-07-24 16:53:11,663 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-07-24 16:53:11,663 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-07-24 16:53:11,663 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-07-24 16:53:11,664 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-07-24 16:53:11,664 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-07-24 16:53:11,664 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-07-24 16:53:11,664 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-07-24 16:53:11,664 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-07-24 16:53:11,664 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-07-24 16:53:11,665 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-07-24 16:53:11,665 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-07-24 16:53:11,665 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-07-24 16:53:11,665 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-07-24 16:53:11,665 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-07-24 16:53:11,665 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-07-24 16:53:11,666 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-07-24 16:53:11,666 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-07-24 16:53:11,666 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-07-24 16:53:11,666 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-07-24 16:53:11,666 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-07-24 16:53:11,666 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-07-24 16:53:11,667 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-07-24 16:53:11,667 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-07-24 16:53:11,667 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-07-24 16:53:11,667 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-07-24 16:53:11,667 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-07-24 16:53:11,667 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-07-24 16:53:11,668 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-07-24 16:53:11,668 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-07-24 16:53:11,668 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-07-24 16:53:11,668 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-07-24 16:53:11,668 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-07-24 16:53:11,668 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-07-24 16:53:11,669 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-07-24 16:53:11,669 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-07-24 16:53:11,669 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-07-24 16:53:11,669 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-07-24 16:53:11,669 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-07-24 16:53:11,669 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-07-24 16:53:11,670 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-07-24 16:53:11,670 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-07-24 16:53:11,670 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-07-24 16:53:11,670 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-07-24 16:53:11,670 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-07-24 16:53:11,670 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-07-24 16:53:11,671 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-07-24 16:53:11,671 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-07-24 16:53:11,671 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-07-24 16:53:11,671 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-07-24 16:53:11,671 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-07-24 16:53:11,671 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-07-24 16:53:11,672 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-07-24 16:53:11,672 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-07-24 16:53:11,672 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-07-24 16:53:11,672 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-07-24 16:53:11,672 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-07-24 16:53:11,672 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-07-24 16:53:11,673 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-07-24 16:53:11,673 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-07-24 16:53:11,673 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-07-24 16:53:11,673 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-07-24 16:53:11,673 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-07-24 16:53:11,673 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-07-24 16:53:11,674 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-07-24 16:53:11,674 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-07-24 16:53:11,674 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-07-24 16:53:11,674 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-07-24 16:53:11,674 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-07-24 16:53:11,674 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-07-24 16:53:11,675 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-07-24 16:53:11,675 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-07-24 16:53:11,675 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-07-24 16:53:11,675 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-07-24 16:53:11,675 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-07-24 16:53:11,675 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-07-24 16:53:11,675 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-07-24 16:53:11,676 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-07-24 16:53:11,676 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-07-24 16:53:11,676 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-07-24 16:53:11,676 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-07-24 16:53:11,676 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-07-24 16:53:11,676 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-07-24 16:53:11,676 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-07-24 16:53:11,677 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-07-24 16:53:11,677 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-07-24 16:53:11,677 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-07-24 16:53:11,677 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-07-24 16:53:11,677 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-07-24 16:53:11,678 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-07-24 16:53:11,678 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-07-24 16:53:11,678 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-07-24 16:53:11,678 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-07-24 16:53:11,678 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-07-24 16:53:11,679 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-07-24 16:53:11,904 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.06666666666666667, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-07-24 16:53:11,904 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-07-24 16:53:11,904 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.9909252140407105, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.06666666666666667, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-07-24 16:53:12,298 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 591 ms to try 5000 different iterations.  Found a solution that moves 4714 regions; Going from a computed imbalance of 0.9909252140407105 to a new imbalance of 0.1752914373745675. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.03781143282033456, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.05223618983635319, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.5237777777777778, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.03781143282033456, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.17091666666666666, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.23291666666666666, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-07-24 16:53:12,343 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv136355368:82 , srv1785704300:82 , srv1936976761:82 , srv270511423:82 , srv1428429697:83 , srv1710609523:83 , srv1849884022:83 , srv311503806:83 , srv802807945:83 , srv1096902649:84 , srv1314363125:84 , srv1382764292:84 , srv2006676654:84 , srv2144498648:84 , srv37760713:84 , srv695448667:84 , srv822836131:84 , srv832524247:84 , srv1477247884:85 , srv161102447:85 , srv1692847279:85 , srv1852703164:85 , srv1871800685:85 , srv1931459896:85 , srv1984917327:85 , srv2112574672:85 , srv577193431:85 , srv1101430076:86 , srv1146361332:86 , srv1328111462:86 , srv13291949:86 , srv1685085682:86 , srv1735376798:86 , srv1832431051:86 , srv1835114564:86 , srv2004065338:86 , srv2109956617:86 , srv2141124961:86 , srv255190696:86 , srv320026287:86 , srv452320270:86 , srv466226016:86 , srv62294764:86 , srv667315097:86 , srv686131195:86 , srv725130931:86 , srv742250068:86 , srv943097413:86 , srv958540304:86 , srv1098251768:87 , srv1153545491:87 , srv1380743016:87 , srv1529703466:87 , srv157462794:87 , srv161626167:87 , srv165444349:87 , srv1669362301:87 , srv1718051592:87 , srv1769900552:87 , srv1774306967:87 , srv1851971390:87 , srv2015060920:87 , srv2088300549:87 , srv2101216731:87 , srv2110036226:87 , srv320015320:87 , srv389058046:87 , srv467397635:87 , srv791797819:87 , srv866647391:87 , srv950729866:87 , srv1026169657:88 , srv1316256861:88 , srv144138241:88 , srv1632272569:88 , srv1717585998:88 , srv1848528154:88 , srv187491529:88 , srv260879366:88 , srv546616396:88 , srv809449396:88 , srv82095266:88 , srv1059582942:89 , srv1912371925:89 , srv2029610690:89 , srv2064354398:89 , srv65484433:89 , srv710453887:89 , srv776222230:89 , srv823050974:89 , srv1042115800:90 , srv107352556:90 , srv1569497017:90 , srv205370328:90 , srv221979693:90 , srv287846164:90 , srv980588626:90 , srv1862777095:96 , srv2046243106:98 , srv1930834849:426 }
2023-07-24 16:53:12,350 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-07-24 16:53:12,351 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1101430076=6, srv2006676654=51, srv809449396=90, srv1835114564=37, srv187491529=44, srv710453887=84, srv1774306967=34, srv1785704300=35, srv1871800685=43, srv260879366=66, srv37760713=72, srv546616396=77, srv1685085682=27, srv1710609523=29, srv2112574672=61, srv161626167=23, srv144138241=17, srv165444349=25, srv1692847279=28, srv2064354398=56, srv2110036226=60, srv866647391=95, srv1042115800=1, srv725130931=85, srv107352556=3, srv980588626=99, srv1026169657=0, srv1769900552=33, srv1314363125=9, srv832524247=94, srv320015320=70, srv82095266=91, srv2109956617=59, srv1984917327=49, srv221979693=64, srv1912371925=45, srv1316256861=10, srv1477247884=18, srv2101216731=58, srv136355368=13, srv1382764292=15, srv13291949=12, srv2088300549=57, srv1862777095=42, srv1098251768=5, srv255190696=65, srv1669362301=26, srv1718051592=31, srv2004065338=50, srv802807945=89, srv1328111462=11, srv1735376798=32, srv695448667=83, srv287846164=68, srv742250068=86, srv1848528154=38, srv467397635=76, srv791797819=88, srv320026287=71, srv1632272569=24, srv1936976761=48, srv1852703164=41, srv157462794=21, srv1832431051=36, srv205370328=55, srv1930834849=46, srv1851971390=40, srv2144498648=63, srv686131195=82, srv1717585998=30, srv1380743016=14, srv2046243106=54, srv667315097=81, srv2141124961=62, srv950729866=97, srv389058046=73, srv776222230=87, srv1146361332=7, srv822836131=92, srv65484433=80, srv943097413=96, srv270511423=67, srv466226016=75, srv1428429697=16, srv1059582942=2, srv1931459896=47, srv1153545491=8, srv1096902649=4, srv1529703466=19, srv2015060920=52, srv452320270=74, srv2029610690=53, srv958540304=98, srv1569497017=20, srv823050974=93, srv1849884022=39, srv161102447=22, srv311503806=69, srv62294764=79, srv577193431=78} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-07-24 16:53:12,365 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-07-24 16:53:12,365 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-07-24 16:53:12,365 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-07-24 16:53:12,365 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-07-24 16:53:12,365 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-07-24 16:53:12,365 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-07-24 16:53:12,365 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-07-24 16:53:12,365 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-07-24 16:53:12,366 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-07-24 16:53:12,366 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-07-24 16:53:12,366 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-07-24 16:53:12,366 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-07-24 16:53:12,366 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-07-24 16:53:12,366 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-07-24 16:53:12,366 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-07-24 16:53:12,366 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-07-24 16:53:12,366 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-07-24 16:53:12,366 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-07-24 16:53:12,366 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-07-24 16:53:12,366 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-07-24 16:53:12,367 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-07-24 16:53:12,367 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-07-24 16:53:12,367 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-07-24 16:53:12,367 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-07-24 16:53:12,367 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-07-24 16:53:12,367 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-07-24 16:53:12,367 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-07-24 16:53:12,367 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-07-24 16:53:12,367 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-07-24 16:53:12,367 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-07-24 16:53:12,367 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-07-24 16:53:12,367 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-07-24 16:53:12,367 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-07-24 16:53:12,367 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-07-24 16:53:12,367 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-07-24 16:53:12,368 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-07-24 16:53:12,368 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-07-24 16:53:12,368 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-07-24 16:53:12,368 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-07-24 16:53:12,368 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-07-24 16:53:12,368 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-07-24 16:53:12,368 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-07-24 16:53:12,368 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-07-24 16:53:12,368 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-07-24 16:53:12,368 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-07-24 16:53:12,368 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-07-24 16:53:12,368 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-07-24 16:53:12,368 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-07-24 16:53:12,368 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-07-24 16:53:12,369 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-07-24 16:53:12,369 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-07-24 16:53:12,369 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-07-24 16:53:12,369 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-07-24 16:53:12,369 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-07-24 16:53:12,369 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-07-24 16:53:12,369 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-07-24 16:53:12,369 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-07-24 16:53:12,369 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-07-24 16:53:12,369 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-07-24 16:53:12,369 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-07-24 16:53:12,369 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-07-24 16:53:12,369 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-07-24 16:53:12,369 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-07-24 16:53:12,369 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-07-24 16:53:12,370 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-07-24 16:53:12,370 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-07-24 16:53:12,370 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-07-24 16:53:12,370 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-07-24 16:53:12,370 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-07-24 16:53:12,370 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-07-24 16:53:12,370 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-07-24 16:53:12,370 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-07-24 16:53:12,370 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-07-24 16:53:12,370 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-07-24 16:53:12,370 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-07-24 16:53:12,370 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-07-24 16:53:12,370 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-07-24 16:53:12,370 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-07-24 16:53:12,371 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-07-24 16:53:12,371 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-07-24 16:53:12,371 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-07-24 16:53:12,371 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-07-24 16:53:12,371 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-07-24 16:53:12,371 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-07-24 16:53:12,371 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-07-24 16:53:12,371 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-07-24 16:53:12,371 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-07-24 16:53:12,371 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-07-24 16:53:12,371 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-07-24 16:53:12,371 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-07-24 16:53:12,371 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-07-24 16:53:12,371 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-07-24 16:53:12,371 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-07-24 16:53:12,372 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-07-24 16:53:12,372 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-07-24 16:53:12,372 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-07-24 16:53:12,372 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-07-24 16:53:12,372 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-07-24 16:53:12,372 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-07-24 16:53:12,372 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-07-24 16:53:12,372 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-07-24 16:53:12,524 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.03781143282033456, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.05223618983635319, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.03781143282033456, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.17091666666666666, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.23291666666666666, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-07-24 16:53:12,524 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-07-24 16:53:12,524 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.17525842924107052, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.03781143282033456, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.05223618983635319, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.03781143282033456, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.17091666666666666, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.23291666666666666, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-07-24 16:53:12,857 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 463 ms to try 5000 different iterations.  Found a solution that moves 2572 regions; Going from a computed imbalance of 0.17525842924107052 to a new imbalance of 0.014733329884724892. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.019035215885850238); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.03036626399109142, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.2857777777777778, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.019035215885850238); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.01175); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.043416666666666666, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-07-24 16:53:12,873 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv2046243106:75 , srv1862777095:77 , srv1569497017:81 , srv287846164:81 , srv1042115800:82 , srv1912371925:82 , srv1026169657:83 , srv1059582942:83 , srv144138241:83 , srv1529703466:83 , srv1632272569:83 , srv1851971390:83 , srv221979693:83 , srv82095266:83 , srv980588626:83 , srv107352556:84 , srv161626167:84 , srv1718051592:84 , srv187491529:84 , srv2064354398:84 , srv2101216731:84 , srv546616396:84 , srv710453887:84 , srv725130931:84 , srv776222230:84 , srv809449396:84 , srv823050974:84 , srv866647391:84 , srv1098251768:85 , srv1153545491:85 , srv1316256861:85 , srv1380743016:85 , srv1477247884:85 , srv157462794:85 , srv1685085682:85 , srv1717585998:85 , srv1735376798:85 , srv2015060920:85 , srv2029610690:85 , srv205370328:85 , srv2088300549:85 , srv255190696:85 , srv260879366:85 , srv320026287:85 , srv389058046:85 , srv466226016:85 , srv467397635:85 , srv950729866:85 , srv1101430076:86 , srv1328111462:86 , srv161102447:86 , srv1669362301:86 , srv1774306967:86 , srv1832431051:86 , srv1835114564:86 , srv1848528154:86 , srv2112574672:86 , srv2141124961:86 , srv320015320:86 , srv452320270:86 , srv62294764:86 , srv686131195:86 , srv791797819:86 , srv943097413:86 , srv1146361332:87 , srv1314363125:87 , srv13291949:87 , srv1428429697:87 , srv1692847279:87 , srv1769900552:87 , srv1931459896:87 , srv1984917327:87 , srv2004065338:87 , srv2109956617:87 , srv2110036226:87 , srv37760713:87 , srv577193431:87 , srv822836131:87 , srv832524247:87 , srv958540304:87 , srv1096902649:88 , srv1382764292:88 , srv165444349:88 , srv667315097:88 , srv742250068:88 , srv802807945:88 , srv1849884022:89 , srv1852703164:89 , srv1871800685:89 , srv2006676654:89 , srv270511423:89 , srv695448667:89 , srv1785704300:90 , srv2144498648:90 , srv311503806:90 , srv1710609523:91 , srv1936976761:91 , srv136355368:92 , srv65484433:92 , srv1930834849:517 }
2023-07-24 16:53:12,879 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-07-24 16:53:12,880 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1101430076=6, srv2006676654=51, srv809449396=90, srv1835114564=37, srv187491529=44, srv710453887=84, srv1774306967=34, srv1785704300=35, srv1871800685=43, srv260879366=66, srv37760713=72, srv546616396=77, srv1685085682=27, srv1710609523=29, srv2112574672=61, srv161626167=23, srv144138241=17, srv165444349=25, srv1692847279=28, srv2064354398=56, srv2110036226=60, srv866647391=95, srv1042115800=1, srv725130931=85, srv107352556=3, srv980588626=99, srv1026169657=0, srv1769900552=33, srv1314363125=9, srv832524247=94, srv320015320=70, srv82095266=91, srv2109956617=59, srv1984917327=49, srv221979693=64, srv1912371925=45, srv1316256861=10, srv1477247884=18, srv2101216731=58, srv136355368=13, srv1382764292=15, srv13291949=12, srv2088300549=57, srv1862777095=42, srv1098251768=5, srv255190696=65, srv1669362301=26, srv1718051592=31, srv2004065338=50, srv802807945=89, srv1328111462=11, srv1735376798=32, srv695448667=83, srv287846164=68, srv742250068=86, srv1848528154=38, srv467397635=76, srv791797819=88, srv320026287=71, srv1632272569=24, srv1936976761=48, srv1852703164=41, srv157462794=21, srv1832431051=36, srv205370328=55, srv1930834849=46, srv1851971390=40, srv2144498648=63, srv686131195=82, srv1717585998=30, srv1380743016=14, srv2046243106=54, srv667315097=81, srv2141124961=62, srv950729866=97, srv389058046=73, srv776222230=87, srv1146361332=7, srv822836131=92, srv65484433=80, srv943097413=96, srv270511423=67, srv466226016=75, srv1428429697=16, srv1059582942=2, srv1931459896=47, srv1153545491=8, srv1096902649=4, srv1529703466=19, srv2015060920=52, srv452320270=74, srv2029610690=53, srv958540304=98, srv1569497017=20, srv823050974=93, srv1849884022=39, srv161102447=22, srv311503806=69, srv62294764=79, srv577193431=78} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-07-24 16:53:12,906 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-07-24 16:53:12,906 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-07-24 16:53:12,906 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-07-24 16:53:12,906 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-07-24 16:53:12,906 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-07-24 16:53:12,906 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-07-24 16:53:12,907 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-07-24 16:53:12,907 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-07-24 16:53:12,907 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-07-24 16:53:12,907 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-07-24 16:53:12,907 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-07-24 16:53:12,907 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-07-24 16:53:12,907 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-07-24 16:53:12,907 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-07-24 16:53:12,907 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-07-24 16:53:12,907 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-07-24 16:53:12,908 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-07-24 16:53:12,908 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-07-24 16:53:12,908 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-07-24 16:53:12,908 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-07-24 16:53:12,908 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-07-24 16:53:12,908 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-07-24 16:53:12,908 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-07-24 16:53:12,908 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-07-24 16:53:12,908 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-07-24 16:53:12,908 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-07-24 16:53:12,909 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-07-24 16:53:12,909 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-07-24 16:53:12,909 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-07-24 16:53:12,909 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-07-24 16:53:12,909 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-07-24 16:53:12,909 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-07-24 16:53:12,909 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-07-24 16:53:12,909 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-07-24 16:53:12,909 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-07-24 16:53:12,909 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-07-24 16:53:12,910 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-07-24 16:53:12,910 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-07-24 16:53:12,910 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-07-24 16:53:12,910 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-07-24 16:53:12,910 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-07-24 16:53:12,910 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-07-24 16:53:12,910 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-07-24 16:53:12,910 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-07-24 16:53:12,910 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-07-24 16:53:12,910 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-07-24 16:53:12,911 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-07-24 16:53:12,911 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-07-24 16:53:12,911 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-07-24 16:53:12,911 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-07-24 16:53:12,911 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-07-24 16:53:12,911 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-07-24 16:53:12,911 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-07-24 16:53:12,911 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-07-24 16:53:12,911 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-07-24 16:53:12,911 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-07-24 16:53:12,911 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-07-24 16:53:12,912 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-07-24 16:53:12,912 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-07-24 16:53:12,912 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-07-24 16:53:12,912 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-07-24 16:53:12,912 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-07-24 16:53:12,912 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-07-24 16:53:12,912 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-07-24 16:53:12,912 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-07-24 16:53:12,912 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-07-24 16:53:12,912 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-07-24 16:53:12,912 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-07-24 16:53:12,913 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-07-24 16:53:12,913 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-07-24 16:53:12,913 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-07-24 16:53:12,913 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-07-24 16:53:12,913 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-07-24 16:53:12,913 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-07-24 16:53:12,913 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-07-24 16:53:12,913 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-07-24 16:53:12,913 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-07-24 16:53:12,913 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-07-24 16:53:12,913 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-07-24 16:53:12,914 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-07-24 16:53:12,914 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-07-24 16:53:12,914 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-07-24 16:53:12,914 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-07-24 16:53:12,914 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-07-24 16:53:12,914 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-07-24 16:53:12,914 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-07-24 16:53:12,914 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-07-24 16:53:12,914 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-07-24 16:53:12,914 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-07-24 16:53:12,914 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-07-24 16:53:12,914 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-07-24 16:53:12,915 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-07-24 16:53:12,915 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-07-24 16:53:12,915 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-07-24 16:53:12,915 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-07-24 16:53:12,915 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-07-24 16:53:12,915 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-07-24 16:53:12,915 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-07-24 16:53:12,915 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-07-24 16:53:12,915 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-07-24 16:53:12,916 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-07-24 16:53:13,084 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.019035215885850238); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.03036626399109142, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.019035215885850238); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.01175); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.043416666666666666, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-07-24 16:53:13,084 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-07-24 16:53:13,084 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.014715320355799512, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.019035215885850238); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.03036626399109142, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.019035215885850238); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.01175); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.043416666666666666, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-07-24 16:53:13,377 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 423 ms to try 5000 different iterations.  Found a solution that moves 951 regions; Going from a computed imbalance of 0.014715320355799512 to a new imbalance of 6.652276085732744E-4. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.005213965342504877); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.005724697905173637); MoveCostFunction : (multiplier=7.0, imbalance=0.10566666666666667, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.005213965342504877); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=2.5E-4); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.00425); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-07-24 16:53:13,380 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv65484433:79 , srv205370328:82 , srv165444349:83 , srv1848528154:83 , srv1871800685:83 , srv107352556:84 , srv1146361332:84 , srv136355368:84 , srv1710609523:84 , srv1769900552:84 , srv1774306967:84 , srv1852703164:84 , srv1936976761:84 , srv2004065338:84 , srv2006676654:84 , srv2029610690:84 , srv2046243106:84 , srv2110036226:84 , srv2144498648:84 , srv260879366:84 , srv695448667:84 , srv710453887:84 , srv742250068:84 , srv776222230:84 , srv791797819:84 , srv958540304:84 , srv980588626:84 , srv1042115800:85 , srv1096902649:85 , srv1101430076:85 , srv1316256861:85 , srv1328111462:85 , srv13291949:85 , srv1382764292:85 , srv157462794:85 , srv1669362301:85 , srv1717585998:85 , srv1785704300:85 , srv1832431051:85 , srv1835114564:85 , srv1849884022:85 , srv1862777095:85 , srv1931459896:85 , srv2015060920:85 , srv2064354398:85 , srv2088300549:85 , srv2141124961:85 , srv221979693:85 , srv311503806:85 , srv320015320:85 , srv389058046:85 , srv452320270:85 , srv577193431:85 , srv667315097:85 , srv686131195:85 , srv823050974:85 , srv950729866:85 , srv1026169657:86 , srv1098251768:86 , srv1153545491:86 , srv1314363125:86 , srv1380743016:86 , srv144138241:86 , srv161626167:86 , srv1692847279:86 , srv1718051592:86 , srv1912371925:86 , srv1984917327:86 , srv2109956617:86 , srv255190696:86 , srv287846164:86 , srv320026287:86 , srv37760713:86 , srv466226016:86 , srv467397635:86 , srv546616396:86 , srv62294764:86 , srv802807945:86 , srv809449396:86 , srv822836131:86 , srv832524247:86 , srv866647391:86 , srv1059582942:87 , srv1428429697:87 , srv1477247884:87 , srv1529703466:87 , srv1569497017:87 , srv161102447:87 , srv1632272569:87 , srv1685085682:87 , srv1735376798:87 , srv1851971390:87 , srv187491529:87 , srv2101216731:87 , srv2112574672:87 , srv82095266:87 , srv943097413:87 , srv270511423:88 , srv725130931:88 , srv1930834849:561 }
2023-07-24 16:53:13,384 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-07-24 16:53:13,385 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1101430076=6, srv2006676654=51, srv809449396=90, srv1835114564=37, srv187491529=44, srv710453887=84, srv1774306967=34, srv1785704300=35, srv1871800685=43, srv260879366=66, srv37760713=72, srv546616396=77, srv1685085682=27, srv1710609523=29, srv2112574672=61, srv161626167=23, srv144138241=17, srv165444349=25, srv1692847279=28, srv2064354398=56, srv2110036226=60, srv866647391=95, srv1042115800=1, srv725130931=85, srv107352556=3, srv980588626=99, srv1026169657=0, srv1769900552=33, srv1314363125=9, srv832524247=94, srv320015320=70, srv82095266=91, srv2109956617=59, srv1984917327=49, srv221979693=64, srv1912371925=45, srv1316256861=10, srv1477247884=18, srv2101216731=58, srv136355368=13, srv1382764292=15, srv13291949=12, srv2088300549=57, srv1862777095=42, srv1098251768=5, srv255190696=65, srv1669362301=26, srv1718051592=31, srv2004065338=50, srv802807945=89, srv1328111462=11, srv1735376798=32, srv695448667=83, srv287846164=68, srv742250068=86, srv1848528154=38, srv467397635=76, srv791797819=88, srv320026287=71, srv1632272569=24, srv1936976761=48, srv1852703164=41, srv157462794=21, srv1832431051=36, srv205370328=55, srv1930834849=46, srv1851971390=40, srv2144498648=63, srv686131195=82, srv1717585998=30, srv1380743016=14, srv2046243106=54, srv667315097=81, srv2141124961=62, srv950729866=97, srv389058046=73, srv776222230=87, srv1146361332=7, srv822836131=92, srv65484433=80, srv943097413=96, srv270511423=67, srv466226016=75, srv1428429697=16, srv1059582942=2, srv1931459896=47, srv1153545491=8, srv1096902649=4, srv1529703466=19, srv2015060920=52, srv452320270=74, srv2029610690=53, srv958540304=98, srv1569497017=20, srv823050974=93, srv1849884022=39, srv161102447=22, srv311503806=69, srv62294764=79, srv577193431=78} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-07-24 16:53:13,399 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-07-24 16:53:13,399 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-07-24 16:53:13,399 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-07-24 16:53:13,400 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-07-24 16:53:13,400 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-07-24 16:53:13,400 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-07-24 16:53:13,400 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-07-24 16:53:13,400 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-07-24 16:53:13,400 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-07-24 16:53:13,400 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-07-24 16:53:13,400 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-07-24 16:53:13,400 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-07-24 16:53:13,400 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-07-24 16:53:13,400 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-07-24 16:53:13,400 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-07-24 16:53:13,400 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-07-24 16:53:13,400 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-07-24 16:53:13,400 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-07-24 16:53:13,400 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-07-24 16:53:13,400 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-07-24 16:53:13,400 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-07-24 16:53:13,401 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-07-24 16:53:13,401 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-07-24 16:53:13,401 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-07-24 16:53:13,401 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-07-24 16:53:13,401 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-07-24 16:53:13,401 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-07-24 16:53:13,401 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-07-24 16:53:13,401 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-07-24 16:53:13,401 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-07-24 16:53:13,402 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-07-24 16:53:13,402 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-07-24 16:53:13,402 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-07-24 16:53:13,402 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-07-24 16:53:13,402 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-07-24 16:53:13,402 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-07-24 16:53:13,403 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-07-24 16:53:13,403 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-07-24 16:53:13,403 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-07-24 16:53:13,403 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-07-24 16:53:13,403 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-07-24 16:53:13,403 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-07-24 16:53:13,403 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-07-24 16:53:13,403 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-07-24 16:53:13,403 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-07-24 16:53:13,403 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-07-24 16:53:13,404 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-07-24 16:53:13,404 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-07-24 16:53:13,404 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-07-24 16:53:13,404 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-07-24 16:53:13,404 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-07-24 16:53:13,404 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-07-24 16:53:13,404 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-07-24 16:53:13,404 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-07-24 16:53:13,404 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-07-24 16:53:13,404 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-07-24 16:53:13,405 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-07-24 16:53:13,405 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-07-24 16:53:13,405 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-07-24 16:53:13,405 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-07-24 16:53:13,405 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-07-24 16:53:13,405 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-07-24 16:53:13,405 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-07-24 16:53:13,405 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-07-24 16:53:13,405 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-07-24 16:53:13,405 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-07-24 16:53:13,406 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-07-24 16:53:13,406 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-07-24 16:53:13,406 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-07-24 16:53:13,406 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-07-24 16:53:13,406 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-07-24 16:53:13,406 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-07-24 16:53:13,406 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-07-24 16:53:13,406 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-07-24 16:53:13,406 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-07-24 16:53:13,407 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-07-24 16:53:13,407 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-07-24 16:53:13,407 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-07-24 16:53:13,407 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-07-24 16:53:13,407 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-07-24 16:53:13,407 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-07-24 16:53:13,407 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-07-24 16:53:13,407 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-07-24 16:53:13,407 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-07-24 16:53:13,407 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-07-24 16:53:13,407 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-07-24 16:53:13,408 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-07-24 16:53:13,408 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-07-24 16:53:13,408 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-07-24 16:53:13,408 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-07-24 16:53:13,408 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-07-24 16:53:13,408 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-07-24 16:53:13,408 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-07-24 16:53:13,408 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-07-24 16:53:13,408 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-07-24 16:53:13,408 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-07-24 16:53:13,409 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-07-24 16:53:13,409 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-07-24 16:53:13,409 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-07-24 16:53:13,409 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-07-24 16:53:13,409 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-07-24 16:53:13,538 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.005213965342504877); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.005724697905173637); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.005213965342504877); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=2.5E-4); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.00425); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-07-24 16:53:13,538 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-07-24 16:53:13,539 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=6.585685642466661E-4, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.005213965342504877); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.005724697905173637); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.005213965342504877); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=2.5E-4); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.00425); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-07-24 16:53:13,996 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 572 ms to try 5000 different iterations.  Found a solution that moves 218 regions; Going from a computed imbalance of 6.585685642466661E-4 to a new imbalance of 1.0881656145307114E-5. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=4.737793696791342E-4); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0015713484026367722); MoveCostFunction : (multiplier=7.0, imbalance=0.02422222222222222); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=4.737793696791342E-4); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-07-24 16:53:13,997 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1059582942:83 , srv187491529:83 , srv2109956617:83 , srv270511423:83 , srv65484433:83 , srv667315097:83 , srv943097413:83 , srv107352556:84 , srv1098251768:84 , srv1101430076:84 , srv1153545491:84 , srv1316256861:84 , srv13291949:84 , srv136355368:84 , srv1380743016:84 , srv1477247884:84 , srv1529703466:84 , srv1569497017:84 , srv161102447:84 , srv1632272569:84 , srv165444349:84 , srv1685085682:84 , srv1692847279:84 , srv1710609523:84 , srv1717585998:84 , srv1735376798:84 , srv1769900552:84 , srv1832431051:84 , srv1852703164:84 , srv1862777095:84 , srv2004065338:84 , srv2029610690:84 , srv2064354398:84 , srv2101216731:84 , srv2110036226:84 , srv2112574672:84 , srv221979693:84 , srv311503806:84 , srv320015320:84 , srv467397635:84 , srv577193431:84 , srv62294764:84 , srv686131195:84 , srv695448667:84 , srv742250068:84 , srv776222230:84 , srv809449396:84 , srv823050974:84 , srv1026169657:85 , srv1042115800:85 , srv1096902649:85 , srv1146361332:85 , srv1314363125:85 , srv1328111462:85 , srv1382764292:85 , srv1428429697:85 , srv144138241:85 , srv157462794:85 , srv161626167:85 , srv1669362301:85 , srv1718051592:85 , srv1774306967:85 , srv1785704300:85 , srv1835114564:85 , srv1848528154:85 , srv1849884022:85 , srv1851971390:85 , srv1871800685:85 , srv1912371925:85 , srv1931459896:85 , srv1936976761:85 , srv1984917327:85 , srv2006676654:85 , srv2015060920:85 , srv2046243106:85 , srv205370328:85 , srv2088300549:85 , srv2141124961:85 , srv2144498648:85 , srv255190696:85 , srv260879366:85 , srv320026287:85 , srv37760713:85 , srv389058046:85 , srv452320270:85 , srv466226016:85 , srv546616396:85 , srv710453887:85 , srv725130931:85 , srv802807945:85 , srv82095266:85 , srv822836131:85 , srv832524247:85 , srv866647391:85 , srv950729866:85 , srv958540304:85 , srv980588626:85 , srv287846164:86 , srv791797819:86 , srv1930834849:638 }
2023-07-24 16:53:14,003 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-07-24 16:53:14,004 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1101430076=6, srv2006676654=51, srv809449396=90, srv1835114564=37, srv187491529=44, srv710453887=84, srv1774306967=34, srv1785704300=35, srv1871800685=43, srv260879366=66, srv37760713=72, srv546616396=77, srv1685085682=27, srv1710609523=29, srv2112574672=61, srv161626167=23, srv144138241=17, srv165444349=25, srv1692847279=28, srv2064354398=56, srv2110036226=60, srv866647391=95, srv1042115800=1, srv725130931=85, srv107352556=3, srv980588626=99, srv1026169657=0, srv1769900552=33, srv1314363125=9, srv832524247=94, srv320015320=70, srv82095266=91, srv2109956617=59, srv1984917327=49, srv221979693=64, srv1912371925=45, srv1316256861=10, srv1477247884=18, srv2101216731=58, srv136355368=13, srv1382764292=15, srv13291949=12, srv2088300549=57, srv1862777095=42, srv1098251768=5, srv255190696=65, srv1669362301=26, srv1718051592=31, srv2004065338=50, srv802807945=89, srv1328111462=11, srv1735376798=32, srv695448667=83, srv287846164=68, srv742250068=86, srv1848528154=38, srv467397635=76, srv791797819=88, srv320026287=71, srv1632272569=24, srv1936976761=48, srv1852703164=41, srv157462794=21, srv1832431051=36, srv205370328=55, srv1930834849=46, srv1851971390=40, srv2144498648=63, srv686131195=82, srv1717585998=30, srv1380743016=14, srv2046243106=54, srv667315097=81, srv2141124961=62, srv950729866=97, srv389058046=73, srv776222230=87, srv1146361332=7, srv822836131=92, srv65484433=80, srv943097413=96, srv270511423=67, srv466226016=75, srv1428429697=16, srv1059582942=2, srv1931459896=47, srv1153545491=8, srv1096902649=4, srv1529703466=19, srv2015060920=52, srv452320270=74, srv2029610690=53, srv958540304=98, srv1569497017=20, srv823050974=93, srv1849884022=39, srv161102447=22, srv311503806=69, srv62294764=79, srv577193431=78} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-07-24 16:53:14,021 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-07-24 16:53:14,021 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-07-24 16:53:14,022 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-07-24 16:53:14,022 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-07-24 16:53:14,022 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-07-24 16:53:14,022 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-07-24 16:53:14,022 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-07-24 16:53:14,022 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-07-24 16:53:14,022 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-07-24 16:53:14,022 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-07-24 16:53:14,022 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-07-24 16:53:14,022 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-07-24 16:53:14,022 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-07-24 16:53:14,023 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-07-24 16:53:14,023 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-07-24 16:53:14,023 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-07-24 16:53:14,023 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-07-24 16:53:14,023 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-07-24 16:53:14,023 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-07-24 16:53:14,023 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-07-24 16:53:14,023 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-07-24 16:53:14,023 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-07-24 16:53:14,023 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-07-24 16:53:14,023 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-07-24 16:53:14,023 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-07-24 16:53:14,024 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-07-24 16:53:14,024 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-07-24 16:53:14,024 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-07-24 16:53:14,024 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-07-24 16:53:14,024 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-07-24 16:53:14,024 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-07-24 16:53:14,024 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-07-24 16:53:14,024 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-07-24 16:53:14,024 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-07-24 16:53:14,024 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-07-24 16:53:14,024 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-07-24 16:53:14,025 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-07-24 16:53:14,025 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-07-24 16:53:14,025 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-07-24 16:53:14,025 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-07-24 16:53:14,025 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-07-24 16:53:14,025 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-07-24 16:53:14,025 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-07-24 16:53:14,025 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-07-24 16:53:14,025 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-07-24 16:53:14,025 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-07-24 16:53:14,025 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-07-24 16:53:14,026 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-07-24 16:53:14,026 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-07-24 16:53:14,026 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-07-24 16:53:14,026 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-07-24 16:53:14,026 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-07-24 16:53:14,026 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-07-24 16:53:14,026 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-07-24 16:53:14,026 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-07-24 16:53:14,026 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-07-24 16:53:14,026 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-07-24 16:53:14,026 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-07-24 16:53:14,027 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-07-24 16:53:14,027 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-07-24 16:53:14,027 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-07-24 16:53:14,027 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-07-24 16:53:14,027 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-07-24 16:53:14,027 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-07-24 16:53:14,027 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-07-24 16:53:14,027 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-07-24 16:53:14,027 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-07-24 16:53:14,027 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-07-24 16:53:14,028 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-07-24 16:53:14,029 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-07-24 16:53:14,030 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-07-24 16:53:14,030 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-07-24 16:53:14,030 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-07-24 16:53:14,030 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-07-24 16:53:14,030 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-07-24 16:53:14,030 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-07-24 16:53:14,030 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-07-24 16:53:14,030 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-07-24 16:53:14,031 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-07-24 16:53:14,031 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-07-24 16:53:14,031 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-07-24 16:53:14,031 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-07-24 16:53:14,031 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-07-24 16:53:14,031 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-07-24 16:53:14,031 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-07-24 16:53:14,031 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-07-24 16:53:14,031 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-07-24 16:53:14,031 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-07-24 16:53:14,031 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-07-24 16:53:14,031 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-07-24 16:53:14,032 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-07-24 16:53:14,032 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-07-24 16:53:14,032 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-07-24 16:53:14,032 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-07-24 16:53:14,032 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-07-24 16:53:14,032 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-07-24 16:53:14,032 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-07-24 16:53:14,032 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-07-24 16:53:14,032 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-07-24 16:53:14,032 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-07-24 16:53:14,033 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-07-24 16:53:14,185 INFO  [Time-limited test] balancer.StochasticLoadBalancer(381): Cluster wide - skipping load balancing because weighted average imbalance=9.355187519438973E-6 <= threshold(0.025). If you want more aggressive balancing, either lower hbase.master.balancer.stochastic.minCostNeedBalance from 0.025 or increase the relative multiplier(s) of the specific cost function(s). functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=4.737793696791342E-4); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0015713484026367722); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=4.737793696791342E-4); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-07-24 16:53:14,185 INFO  [Time-limited test] balancer.BalancerTestBase(570): Mock Final balance: { srv1059582942:83 , srv187491529:83 , srv2109956617:83 , srv270511423:83 , srv65484433:83 , srv667315097:83 , srv943097413:83 , srv107352556:84 , srv1098251768:84 , srv1101430076:84 , srv1153545491:84 , srv1316256861:84 , srv13291949:84 , srv136355368:84 , srv1380743016:84 , srv1477247884:84 , srv1529703466:84 , srv1569497017:84 , srv161102447:84 , srv1632272569:84 , srv165444349:84 , srv1685085682:84 , srv1692847279:84 , srv1710609523:84 , srv1717585998:84 , srv1735376798:84 , srv1769900552:84 , srv1832431051:84 , srv1852703164:84 , srv1862777095:84 , srv2004065338:84 , srv2029610690:84 , srv2064354398:84 , srv2101216731:84 , srv2110036226:84 , srv2112574672:84 , srv221979693:84 , srv311503806:84 , srv320015320:84 , srv467397635:84 , srv577193431:84 , srv62294764:84 , srv686131195:84 , srv695448667:84 , srv742250068:84 , srv776222230:84 , srv809449396:84 , srv823050974:84 , srv1026169657:85 , srv1042115800:85 , srv1096902649:85 , srv1146361332:85 , srv1314363125:85 , srv1328111462:85 , srv1382764292:85 , srv1428429697:85 , srv144138241:85 , srv157462794:85 , srv161626167:85 , srv1669362301:85 , srv1718051592:85 , srv1774306967:85 , srv1785704300:85 , srv1835114564:85 , srv1848528154:85 , srv1849884022:85 , srv1851971390:85 , srv1871800685:85 , srv1912371925:85 , srv1931459896:85 , srv1936976761:85 , srv1984917327:85 , srv2006676654:85 , srv2015060920:85 , srv2046243106:85 , srv205370328:85 , srv2088300549:85 , srv2141124961:85 , srv2144498648:85 , srv255190696:85 , srv260879366:85 , srv320026287:85 , srv37760713:85 , srv389058046:85 , srv452320270:85 , srv466226016:85 , srv546616396:85 , srv710453887:85 , srv725130931:85 , srv802807945:85 , srv82095266:85 , srv822836131:85 , srv832524247:85 , srv866647391:85 , srv950729866:85 , srv958540304:85 , srv980588626:85 , srv287846164:86 , srv791797819:86 , srv1930834849:638 }
2023-07-24 16:53:14,233 INFO  [Time-limited test] hbase.ResourceChecker(175): after: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnLargeClusterWithRacks Thread=12 (was 12), OpenFileDescriptor=263 (was 263), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=330 (was 330), ProcessCount=173 (was 173), AvailableMemoryMB=9531 (was 10287)
2023-07-24 16:53:14,258 INFO  [Time-limited test] hbase.ResourceChecker(147): before: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnMidClusterWithRacks Thread=12, OpenFileDescriptor=263, MaxFileDescriptor=60000, SystemLoadAverage=330, ProcessCount=173, AvailableMemoryMB=9527
2023-07-24 16:53:14,259 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2023-07-24 16:53:14,259 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=5000, runMaxSteps=true, stepsPerRegion=800, maxRunningTime=120000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 111077.0 etc.
2023-07-24 16:53:14,271 INFO  [Time-limited test] balancer.BalancerTestBase(547): Mock Cluster : { srv1051286817:84 , srv1064175720:84 , srv1157861299:84 , srv116047425:84 , srv1222085786:84 , srv1319257216:84 , srv1324456508:84 , srv1496653396:84 , srv1502779943:84 , srv1534888099:84 , srv1703995346:84 , srv17049214:84 , srv1711057784:84 , srv174974446:84 , srv2017060458:84 , srv2092294330:84 , srv2147281688:84 , srv259709873:84 , srv283362897:84 , srv327971079:84 , srv357960272:84 , srv443342474:84 , srv473055019:84 , srv49099449:84 , srv55534605:84 , srv604224198:84 , srv887187347:84 , srv891913295:84 , srv945964130:84 , srv1336764147:264 } [srvr=30 rgns=2700 avg=90.0 max=90 min=90]
2023-07-24 16:53:14,273 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-07-24 16:53:14,273 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1496653396=8, srv116047425=3, srv1319257216=5, srv259709873=18, srv1157861299=2, srv2092294330=16, srv49099449=24, srv283362897=19, srv473055019=23, srv1051286817=0, srv1222085786=4, srv887187347=27, srv1502779943=9, srv1703995346=11, srv1064175720=1, srv2017060458=15, srv55534605=25, srv2147281688=17, srv1711057784=13, srv945964130=29, srv443342474=22, srv604224198=26, srv1534888099=10, srv1336764147=7, srv17049214=12, srv357960272=21, srv1324456508=6, srv327971079=20, srv891913295=28, srv174974446=14} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-07-24 16:53:14,292 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-07-24 16:53:14,293 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-07-24 16:53:14,293 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-07-24 16:53:14,293 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-07-24 16:53:14,293 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-07-24 16:53:14,293 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-07-24 16:53:14,293 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-07-24 16:53:14,293 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-07-24 16:53:14,293 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-07-24 16:53:14,293 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-07-24 16:53:14,293 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-07-24 16:53:14,293 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-07-24 16:53:14,293 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-07-24 16:53:14,293 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-07-24 16:53:14,294 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-07-24 16:53:14,294 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-07-24 16:53:14,294 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-07-24 16:53:14,294 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-07-24 16:53:14,294 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-07-24 16:53:14,294 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-07-24 16:53:14,294 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-07-24 16:53:14,294 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-07-24 16:53:14,294 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-07-24 16:53:14,294 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-07-24 16:53:14,294 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-07-24 16:53:14,294 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-07-24 16:53:14,294 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-07-24 16:53:14,304 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-07-24 16:53:14,304 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-07-24 16:53:14,304 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-07-24 16:53:14,304 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=10, number of hosts=30, number of racks=4
2023-07-24 16:53:14,336 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=1.1221282665348409, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-07-24 16:53:14,337 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.9912577865444276, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=1.1221282665348409, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=64800000
2023-07-24 16:55:14,309 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 120001 ms to try 5880142 different iterations.  Found a solution that moves 1859 regions; Going from a computed imbalance of 0.9912577865444276 to a new imbalance of 4.338998739279625E-5. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); MoveCostFunction : (multiplier=7.0, imbalance=0.6885185185185185, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-07-24 16:55:14,317 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1051286817:90 , srv1064175720:90 , srv1157861299:90 , srv116047425:90 , srv1222085786:90 , srv1319257216:90 , srv1324456508:90 , srv1336764147:90 , srv1496653396:90 , srv1502779943:90 , srv1534888099:90 , srv1703995346:90 , srv17049214:90 , srv1711057784:90 , srv174974446:90 , srv2017060458:90 , srv2092294330:90 , srv2147281688:90 , srv259709873:90 , srv283362897:90 , srv327971079:90 , srv357960272:90 , srv443342474:90 , srv473055019:90 , srv49099449:90 , srv55534605:90 , srv604224198:90 , srv887187347:90 , srv891913295:90 , srv945964130:90 }
2023-07-24 16:55:14,319 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-07-24 16:55:14,320 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1496653396=8, srv116047425=3, srv1319257216=5, srv259709873=18, srv1157861299=2, srv2092294330=16, srv49099449=24, srv283362897=19, srv473055019=23, srv1051286817=0, srv1222085786=4, srv887187347=27, srv1502779943=9, srv1703995346=11, srv1064175720=1, srv2017060458=15, srv55534605=25, srv2147281688=17, srv1711057784=13, srv945964130=29, srv443342474=22, srv604224198=26, srv1534888099=10, srv1336764147=7, srv17049214=12, srv357960272=21, srv1324456508=6, srv327971079=20, srv891913295=28, srv174974446=14} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-07-24 16:55:14,324 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-07-24 16:55:14,325 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-07-24 16:55:14,325 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-07-24 16:55:14,325 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-07-24 16:55:14,325 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-07-24 16:55:14,325 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-07-24 16:55:14,325 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-07-24 16:55:14,325 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-07-24 16:55:14,325 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-07-24 16:55:14,325 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-07-24 16:55:14,325 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-07-24 16:55:14,325 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-07-24 16:55:14,326 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-07-24 16:55:14,326 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-07-24 16:55:14,326 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-07-24 16:55:14,326 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-07-24 16:55:14,326 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-07-24 16:55:14,326 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-07-24 16:55:14,326 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-07-24 16:55:14,326 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-07-24 16:55:14,326 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-07-24 16:55:14,326 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-07-24 16:55:14,326 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-07-24 16:55:14,326 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-07-24 16:55:14,327 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-07-24 16:55:14,327 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-07-24 16:55:14,327 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-07-24 16:55:14,327 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-07-24 16:55:14,327 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-07-24 16:55:14,327 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-07-24 16:55:14,327 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=10, number of hosts=30, number of racks=4
2023-07-24 16:55:14,344 INFO  [Time-limited test] balancer.StochasticLoadBalancer(381): Cluster wide - skipping load balancing because weighted average imbalance=0.0 <= threshold(0.025). If you want more aggressive balancing, either lower hbase.master.balancer.stochastic.minCostNeedBalance from 0.025 or increase the relative multiplier(s) of the specific cost function(s). functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-07-24 16:55:14,344 INFO  [Time-limited test] balancer.BalancerTestBase(570): Mock Final balance: { srv1051286817:90 , srv1064175720:90 , srv1157861299:90 , srv116047425:90 , srv1222085786:90 , srv1319257216:90 , srv1324456508:90 , srv1336764147:90 , srv1496653396:90 , srv1502779943:90 , srv1534888099:90 , srv1703995346:90 , srv17049214:90 , srv1711057784:90 , srv174974446:90 , srv2017060458:90 , srv2092294330:90 , srv2147281688:90 , srv259709873:90 , srv283362897:90 , srv327971079:90 , srv357960272:90 , srv443342474:90 , srv473055019:90 , srv49099449:90 , srv55534605:90 , srv604224198:90 , srv887187347:90 , srv891913295:90 , srv945964130:90 }
2023-07-24 16:55:14,363 INFO  [Time-limited test] hbase.ResourceChecker(175): after: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnMidClusterWithRacks Thread=11 (was 12), OpenFileDescriptor=263 (was 263), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=200 (was 330), ProcessCount=172 (was 173), AvailableMemoryMB=9302 (was 9527)