2023-05-06 05:53:38,125 INFO  [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks timeout: 13 mins
2023-05-06 05:53:38,468 WARN  [Time-limited test] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties
2023-05-06 05:53:38,591 INFO  [Time-limited test] metrics.MetricRegistriesLoader(60): Loaded MetricRegistries class org.apache.hadoop.hbase.metrics.impl.MetricRegistriesImpl
2023-05-06 05:53:38,652 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2023-05-06 05:53:38,660 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc.
2023-05-06 05:53:38,676 INFO  [Time-limited test] hbase.ResourceChecker(147): before: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnLargeClusterWithRacks Thread=10, OpenFileDescriptor=260, MaxFileDescriptor=60000, SystemLoadAverage=342, ProcessCount=179, AvailableMemoryMB=4871
2023-05-06 05:53:38,678 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2023-05-06 05:53:38,678 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=5000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=10000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc.
2023-05-06 05:53:38,822 INFO  [Time-limited test] balancer.BalancerTestBase(547): Mock Cluster : { srv1012891376:84 , srv1019712088:84 , srv1021832795:84 , srv1024522512:84 , srv1060824578:84 , srv1094403322:84 , srv1095654383:84 , srv1106261587:84 , srv1121894379:84 , srv1168356468:84 , srv1190432992:84 , srv1204117272:84 , srv124229136:84 , srv1251410111:84 , srv1270665660:84 , srv1277506200:84 , srv1308002013:84 , srv1315212001:84 , srv1358860784:84 , srv1362690316:84 , srv1368218843:84 , srv138837464:84 , srv1398646207:84 , srv1449201095:84 , srv1455345645:84 , srv1563547467:84 , srv1590960055:84 , srv1653381021:84 , srv1658980717:84 , srv1667334467:84 , srv1710259417:84 , srv1725807395:84 , srv1727613417:84 , srv1783516476:84 , srv1789013699:84 , srv1806055456:84 , srv1853865418:84 , srv1871722198:84 , srv1871886482:84 , srv1942563614:84 , srv1943248107:84 , srv1945130466:84 , srv1953251028:84 , srv196030793:84 , srv1965429643:84 , srv2004643687:84 , srv2066595304:84 , srv2078912803:84 , srv20815288:84 , srv2096475654:84 , srv2110876859:84 , srv2128478489:84 , srv2129161784:84 , srv235899910:84 , srv242494126:84 , srv265309167:84 , srv276986309:84 , srv296838697:84 , srv29930291:84 , srv301026626:84 , srv302066512:84 , srv348106355:84 , srv368161506:84 , srv402993271:84 , srv406422995:84 , srv411773210:84 , srv419205601:84 , srv460090076:84 , srv484899138:84 , srv509058166:84 , srv537407271:84 , srv576630705:84 , srv641659498:84 , srv644579671:84 , srv66305277:84 , srv66401803:84 , srv667270521:84 , srv684761760:84 , srv699315952:84 , srv702349878:84 , srv743210585:84 , srv743492157:84 , srv761872238:84 , srv768808130:84 , srv793664483:84 , srv810009118:84 , srv816408068:84 , srv839972412:84 , srv841288760:84 , srv851505822:84 , srv874295899:84 , srv877848300:84 , srv89938278:84 , srv902288489:84 , srv940399424:84 , srv95845089:84 , srv961904824:84 , srv987713075:84 , srv988124149:84 , srv1511306042:684 } [srvr=100 rgns=9000 avg=90.0 max=90 min=90]
2023-05-06 05:53:38,836 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-05-06 05:53:38,845 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv89938278=93, srv66305277=75, srv684761760=78, srv1853865418=37, srv406422995=65, srv1315212001=17, srv743210585=81, srv1308002013=16, srv124229136=12, srv242494126=55, srv1398646207=22, srv1121894379=8, srv66401803=76, srv1455345645=24, srv874295899=91, srv816408068=87, srv1362690316=19, srv402993271=64, srv2078912803=48, srv768808130=84, srv484899138=69, srv1943248107=41, srv2128478489=52, srv419205601=67, srv1021832795=2, srv1667334467=30, srv1871722198=38, srv1710259417=31, srv743492157=82, srv196030793=44, srv1204117272=11, srv1725807395=32, srv940399424=95, srv301026626=60, srv1019712088=1, srv1095654383=6, srv1358860784=18, srv1783516476=34, srv411773210=66, srv1590960055=27, srv988124149=99, srv810009118=86, srv1871886482=39, srv1653381021=28, srv509058166=70, srv2129161784=53, srv2004643687=46, srv2110876859=51, srv641659498=73, srv1658980717=29, srv537407271=71, srv368161506=63, srv296838697=58, srv302066512=61, srv1168356468=9, srv902288489=94, srv235899910=54, srv460090076=68, srv1945130466=42, srv1024522512=3, srv1953251028=43, srv1012891376=0, srv1511306042=25, srv265309167=56, srv276986309=57, srv793664483=85, srv702349878=80, srv95845089=96, srv1942563614=40, srv851505822=90, srv987713075=98, srv2066595304=47, srv1563547467=26, srv1190432992=10, srv961904824=97, srv1449201095=23, srv667270521=77, srv1789013699=35, srv348106355=62, srv2096475654=50, srv761872238=83, srv1251410111=13, srv29930291=59, srv1965429643=45, srv1368218843=20, srv841288760=89, srv1277506200=15, srv138837464=21, srv1270665660=14, srv576630705=72, srv1727613417=33, srv1094403322=5, srv877848300=92, srv1106261587=7, srv839972412=88, srv1060824578=4, srv1806055456=36, srv20815288=49, srv699315952=79, srv644579671=74} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-05-06 05:53:38,943 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-05-06 05:53:38,943 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-05-06 05:53:38,943 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-05-06 05:53:38,943 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-05-06 05:53:38,943 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-05-06 05:53:38,943 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-05-06 05:53:38,944 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-05-06 05:53:38,944 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-05-06 05:53:38,944 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-05-06 05:53:38,944 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-05-06 05:53:38,944 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-05-06 05:53:38,944 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-05-06 05:53:38,944 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-05-06 05:53:38,944 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-05-06 05:53:38,945 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-05-06 05:53:38,945 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-05-06 05:53:38,945 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-05-06 05:53:38,945 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-05-06 05:53:38,945 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-05-06 05:53:38,945 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-05-06 05:53:38,945 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-05-06 05:53:38,945 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-05-06 05:53:38,945 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-05-06 05:53:38,945 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-05-06 05:53:38,945 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-05-06 05:53:38,945 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-05-06 05:53:38,946 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-05-06 05:53:38,946 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-05-06 05:53:38,946 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-05-06 05:53:38,946 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-05-06 05:53:38,946 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-05-06 05:53:38,946 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-05-06 05:53:38,946 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-05-06 05:53:38,946 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-05-06 05:53:38,946 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-05-06 05:53:38,947 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-05-06 05:53:38,947 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-05-06 05:53:38,947 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-05-06 05:53:38,947 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-05-06 05:53:38,947 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-05-06 05:53:38,947 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-05-06 05:53:38,948 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-05-06 05:53:38,948 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-05-06 05:53:38,948 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-05-06 05:53:38,948 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-05-06 05:53:38,948 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-05-06 05:53:38,948 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-05-06 05:53:38,948 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-05-06 05:53:38,948 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-05-06 05:53:38,948 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-05-06 05:53:38,949 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-05-06 05:53:38,949 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-05-06 05:53:38,949 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-05-06 05:53:38,949 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-05-06 05:53:38,949 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-05-06 05:53:38,949 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-05-06 05:53:38,949 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-05-06 05:53:38,949 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-05-06 05:53:38,950 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-05-06 05:53:38,950 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-05-06 05:53:38,950 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-05-06 05:53:38,950 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-05-06 05:53:38,950 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-05-06 05:53:38,950 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-05-06 05:53:38,950 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-05-06 05:53:38,950 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-05-06 05:53:38,951 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-05-06 05:53:38,951 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-05-06 05:53:38,951 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-05-06 05:53:38,951 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-05-06 05:53:38,951 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-05-06 05:53:38,951 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-05-06 05:53:38,951 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-05-06 05:53:38,951 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-05-06 05:53:38,951 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-05-06 05:53:38,952 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-05-06 05:53:38,952 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-05-06 05:53:38,952 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-05-06 05:53:38,952 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-05-06 05:53:38,952 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-05-06 05:53:38,952 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-05-06 05:53:38,952 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-05-06 05:53:38,953 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-05-06 05:53:38,953 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-05-06 05:53:38,953 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-05-06 05:53:38,953 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-05-06 05:53:38,953 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-05-06 05:53:38,953 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-05-06 05:53:38,953 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-05-06 05:53:38,954 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-05-06 05:53:38,954 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-05-06 05:53:38,954 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-05-06 05:53:38,954 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-05-06 05:53:38,954 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-05-06 05:53:38,954 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-05-06 05:53:38,954 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-05-06 05:53:38,955 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-05-06 05:53:38,955 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-05-06 05:53:38,955 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-05-06 05:53:38,955 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-05-06 05:53:38,955 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-05-06 05:53:39,166 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.06666666666666667, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-05-06 05:53:39,166 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-05-06 05:53:39,166 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.9909252140407105, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.06666666666666667, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-05-06 05:53:39,536 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 553 ms to try 5000 different iterations.  Found a solution that moves 4711 regions; Going from a computed imbalance of 0.9909252140407105 to a new imbalance of 0.18028788932237083. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.03749747466244368, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.05589191107759443, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.5234444444444445, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.03749747466244368, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.17525, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.24491666666666667, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-05-06 05:53:39,559 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1942563614:81 , srv66305277:82 , srv987713075:82 , srv1095654383:83 , srv1121894379:83 , srv1658980717:83 , srv460090076:83 , srv699315952:83 , srv768808130:83 , srv851505822:83 , srv1019712088:84 , srv1358860784:84 , srv1362690316:84 , srv1727613417:84 , srv1789013699:84 , srv2066595304:84 , srv368161506:84 , srv402993271:84 , srv509058166:84 , srv66401803:84 , srv761872238:84 , srv902288489:84 , srv95845089:84 , srv1094403322:85 , srv1251410111:85 , srv1871886482:85 , srv1953251028:85 , srv196030793:85 , srv2110876859:85 , srv242494126:85 , srv301026626:85 , srv348106355:85 , srv537407271:85 , srv641659498:85 , srv684761760:85 , srv961904824:85 , srv1024522512:86 , srv1204117272:86 , srv1277506200:86 , srv1398646207:86 , srv1563547467:86 , srv1590960055:86 , srv1667334467:86 , srv1853865418:86 , srv2096475654:86 , srv2128478489:86 , srv235899910:86 , srv265309167:86 , srv296838697:86 , srv29930291:86 , srv411773210:86 , srv484899138:86 , srv644579671:86 , srv667270521:86 , srv810009118:86 , srv1012891376:87 , srv1455345645:87 , srv1710259417:87 , srv1871722198:87 , srv2004643687:87 , srv302066512:87 , srv743210585:87 , srv743492157:87 , srv988124149:87 , srv1190432992:88 , srv124229136:88 , srv1315212001:88 , srv1945130466:88 , srv1965429643:88 , srv2078912803:88 , srv276986309:88 , srv419205601:88 , srv793664483:88 , srv874295899:88 , srv89938278:88 , srv940399424:88 , srv1021832795:89 , srv1060824578:89 , srv1368218843:89 , srv138837464:89 , srv1449201095:89 , srv1653381021:89 , srv1783516476:89 , srv1943248107:89 , srv2129161784:89 , srv576630705:89 , srv839972412:89 , srv877848300:89 , srv1308002013:90 , srv1806055456:90 , srv702349878:90 , srv1270665660:92 , srv406422995:92 , srv816408068:92 , srv1106261587:93 , srv1725807395:93 , srv20815288:93 , srv841288760:93 , srv1168356468:95 , srv1511306042:423 }
2023-05-06 05:53:39,562 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-05-06 05:53:39,563 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv89938278=93, srv66305277=75, srv684761760=78, srv1853865418=37, srv406422995=65, srv1315212001=17, srv743210585=81, srv1308002013=16, srv124229136=12, srv242494126=55, srv1398646207=22, srv1121894379=8, srv66401803=76, srv1455345645=24, srv874295899=91, srv816408068=87, srv1362690316=19, srv402993271=64, srv2078912803=48, srv768808130=84, srv484899138=69, srv1943248107=41, srv2128478489=52, srv419205601=67, srv1021832795=2, srv1667334467=30, srv1871722198=38, srv1710259417=31, srv743492157=82, srv196030793=44, srv1204117272=11, srv1725807395=32, srv940399424=95, srv301026626=60, srv1019712088=1, srv1095654383=6, srv1358860784=18, srv1783516476=34, srv411773210=66, srv1590960055=27, srv988124149=99, srv810009118=86, srv1871886482=39, srv1653381021=28, srv509058166=70, srv2129161784=53, srv2004643687=46, srv2110876859=51, srv641659498=73, srv1658980717=29, srv537407271=71, srv368161506=63, srv296838697=58, srv302066512=61, srv1168356468=9, srv902288489=94, srv235899910=54, srv460090076=68, srv1945130466=42, srv1024522512=3, srv1953251028=43, srv1012891376=0, srv1511306042=25, srv265309167=56, srv276986309=57, srv793664483=85, srv702349878=80, srv95845089=96, srv1942563614=40, srv851505822=90, srv987713075=98, srv2066595304=47, srv1563547467=26, srv1190432992=10, srv961904824=97, srv1449201095=23, srv667270521=77, srv1789013699=35, srv348106355=62, srv2096475654=50, srv761872238=83, srv1251410111=13, srv29930291=59, srv1965429643=45, srv1368218843=20, srv841288760=89, srv1277506200=15, srv138837464=21, srv1270665660=14, srv576630705=72, srv1727613417=33, srv1094403322=5, srv877848300=92, srv1106261587=7, srv839972412=88, srv1060824578=4, srv1806055456=36, srv20815288=49, srv699315952=79, srv644579671=74} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-05-06 05:53:39,599 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-05-06 05:53:39,599 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-05-06 05:53:39,600 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-05-06 05:53:39,600 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-05-06 05:53:39,600 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-05-06 05:53:39,600 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-05-06 05:53:39,600 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-05-06 05:53:39,600 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-05-06 05:53:39,600 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-05-06 05:53:39,602 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-05-06 05:53:39,602 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-05-06 05:53:39,602 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-05-06 05:53:39,602 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-05-06 05:53:39,602 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-05-06 05:53:39,602 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-05-06 05:53:39,602 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-05-06 05:53:39,603 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-05-06 05:53:39,603 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-05-06 05:53:39,603 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-05-06 05:53:39,603 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-05-06 05:53:39,603 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-05-06 05:53:39,603 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-05-06 05:53:39,603 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-05-06 05:53:39,603 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-05-06 05:53:39,603 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-05-06 05:53:39,603 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-05-06 05:53:39,603 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-05-06 05:53:39,603 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-05-06 05:53:39,604 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-05-06 05:53:39,604 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-05-06 05:53:39,604 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-05-06 05:53:39,604 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-05-06 05:53:39,604 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-05-06 05:53:39,604 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-05-06 05:53:39,604 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-05-06 05:53:39,604 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-05-06 05:53:39,604 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-05-06 05:53:39,604 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-05-06 05:53:39,604 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-05-06 05:53:39,604 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-05-06 05:53:39,604 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-05-06 05:53:39,604 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-05-06 05:53:39,605 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-05-06 05:53:39,605 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-05-06 05:53:39,605 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-05-06 05:53:39,605 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-05-06 05:53:39,605 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-05-06 05:53:39,605 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-05-06 05:53:39,605 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-05-06 05:53:39,605 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-05-06 05:53:39,605 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-05-06 05:53:39,605 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-05-06 05:53:39,605 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-05-06 05:53:39,605 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-05-06 05:53:39,605 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-05-06 05:53:39,605 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-05-06 05:53:39,605 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-05-06 05:53:39,605 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-05-06 05:53:39,606 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-05-06 05:53:39,606 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-05-06 05:53:39,606 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-05-06 05:53:39,606 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-05-06 05:53:39,606 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-05-06 05:53:39,606 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-05-06 05:53:39,606 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-05-06 05:53:39,606 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-05-06 05:53:39,606 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-05-06 05:53:39,606 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-05-06 05:53:39,607 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-05-06 05:53:39,607 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-05-06 05:53:39,607 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-05-06 05:53:39,607 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-05-06 05:53:39,607 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-05-06 05:53:39,607 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-05-06 05:53:39,608 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-05-06 05:53:39,608 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-05-06 05:53:39,608 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-05-06 05:53:39,608 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-05-06 05:53:39,608 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-05-06 05:53:39,608 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-05-06 05:53:39,608 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-05-06 05:53:39,608 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-05-06 05:53:39,608 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-05-06 05:53:39,608 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-05-06 05:53:39,608 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-05-06 05:53:39,609 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-05-06 05:53:39,609 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-05-06 05:53:39,609 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-05-06 05:53:39,609 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-05-06 05:53:39,609 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-05-06 05:53:39,609 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-05-06 05:53:39,609 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-05-06 05:53:39,609 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-05-06 05:53:39,609 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-05-06 05:53:39,609 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-05-06 05:53:39,609 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-05-06 05:53:39,610 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-05-06 05:53:39,610 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-05-06 05:53:39,610 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-05-06 05:53:39,610 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-05-06 05:53:39,610 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-05-06 05:53:39,748 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.03749747466244368, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.05589191107759443, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.03749747466244368, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.17525, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.24491666666666667, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-05-06 05:53:39,749 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-05-06 05:53:39,749 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.1802549021953228, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.03749747466244368, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.05589191107759443, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.03749747466244368, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.17525, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.24491666666666667, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-05-06 05:53:40,093 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 461 ms to try 5000 different iterations.  Found a solution that moves 2624 regions; Going from a computed imbalance of 0.1802549021953228 to a new imbalance of 0.015629638721122736. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.020374349167592884); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.03297109573186521, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.29155555555555557, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.020374349167592884); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.01275); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.043166666666666666, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-05-06 05:53:40,108 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv20815288:78 , srv1106261587:79 , srv841288760:79 , srv1168356468:80 , srv1270665660:80 , srv1308002013:80 , srv406422995:80 , srv702349878:80 , srv1943248107:81 , srv1060824578:82 , srv1725807395:82 , srv1783516476:82 , srv2078912803:82 , srv576630705:82 , srv816408068:82 , srv1021832795:83 , srv1449201095:83 , srv1653381021:83 , srv1945130466:83 , srv2004643687:83 , srv2129161784:83 , srv877848300:83 , srv1190432992:84 , srv124229136:84 , srv1315212001:84 , srv1806055456:84 , srv1965429643:84 , srv276986309:84 , srv302066512:84 , srv419205601:84 , srv743210585:84 , srv810009118:84 , srv874295899:84 , srv89938278:84 , srv940399424:84 , srv988124149:84 , srv1368218843:85 , srv138837464:85 , srv1398646207:85 , srv1853865418:85 , srv1871722198:85 , srv235899910:85 , srv296838697:85 , srv484899138:85 , srv641659498:85 , srv684761760:85 , srv793664483:85 , srv839972412:85 , srv1012891376:86 , srv1024522512:86 , srv1563547467:86 , srv1590960055:86 , srv1667334467:86 , srv2110876859:86 , srv242494126:86 , srv301026626:86 , srv348106355:86 , srv644579671:86 , srv66401803:86 , srv667270521:86 , srv743492157:86 , srv1094403322:87 , srv1251410111:87 , srv1277506200:87 , srv1358860784:87 , srv1871886482:87 , srv2096475654:87 , srv2128478489:87 , srv265309167:87 , srv29930291:87 , srv460090076:87 , srv851505822:87 , srv1019712088:88 , srv1121894379:88 , srv1204117272:88 , srv1455345645:88 , srv1658980717:88 , srv1789013699:88 , srv1953251028:88 , srv196030793:88 , srv2066595304:88 , srv402993271:88 , srv761872238:88 , srv961904824:88 , srv1095654383:89 , srv1710259417:89 , srv1727613417:89 , srv368161506:89 , srv411773210:89 , srv509058166:89 , srv768808130:89 , srv902288489:89 , srv1362690316:90 , srv699315952:90 , srv537407271:91 , srv95845089:91 , srv987713075:91 , srv66305277:92 , srv1942563614:94 , srv1511306042:532 }
2023-05-06 05:53:40,114 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-05-06 05:53:40,115 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv89938278=93, srv66305277=75, srv684761760=78, srv1853865418=37, srv406422995=65, srv1315212001=17, srv743210585=81, srv1308002013=16, srv124229136=12, srv242494126=55, srv1398646207=22, srv1121894379=8, srv66401803=76, srv1455345645=24, srv874295899=91, srv816408068=87, srv1362690316=19, srv402993271=64, srv2078912803=48, srv768808130=84, srv484899138=69, srv1943248107=41, srv2128478489=52, srv419205601=67, srv1021832795=2, srv1667334467=30, srv1871722198=38, srv1710259417=31, srv743492157=82, srv196030793=44, srv1204117272=11, srv1725807395=32, srv940399424=95, srv301026626=60, srv1019712088=1, srv1095654383=6, srv1358860784=18, srv1783516476=34, srv411773210=66, srv1590960055=27, srv988124149=99, srv810009118=86, srv1871886482=39, srv1653381021=28, srv509058166=70, srv2129161784=53, srv2004643687=46, srv2110876859=51, srv641659498=73, srv1658980717=29, srv537407271=71, srv368161506=63, srv296838697=58, srv302066512=61, srv1168356468=9, srv902288489=94, srv235899910=54, srv460090076=68, srv1945130466=42, srv1024522512=3, srv1953251028=43, srv1012891376=0, srv1511306042=25, srv265309167=56, srv276986309=57, srv793664483=85, srv702349878=80, srv95845089=96, srv1942563614=40, srv851505822=90, srv987713075=98, srv2066595304=47, srv1563547467=26, srv1190432992=10, srv961904824=97, srv1449201095=23, srv667270521=77, srv1789013699=35, srv348106355=62, srv2096475654=50, srv761872238=83, srv1251410111=13, srv29930291=59, srv1965429643=45, srv1368218843=20, srv841288760=89, srv1277506200=15, srv138837464=21, srv1270665660=14, srv576630705=72, srv1727613417=33, srv1094403322=5, srv877848300=92, srv1106261587=7, srv839972412=88, srv1060824578=4, srv1806055456=36, srv20815288=49, srv699315952=79, srv644579671=74} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-05-06 05:53:40,146 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-05-06 05:53:40,146 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-05-06 05:53:40,146 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-05-06 05:53:40,146 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-05-06 05:53:40,146 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-05-06 05:53:40,146 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-05-06 05:53:40,147 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-05-06 05:53:40,147 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-05-06 05:53:40,147 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-05-06 05:53:40,147 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-05-06 05:53:40,147 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-05-06 05:53:40,147 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-05-06 05:53:40,147 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-05-06 05:53:40,147 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-05-06 05:53:40,147 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-05-06 05:53:40,147 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-05-06 05:53:40,147 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-05-06 05:53:40,148 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-05-06 05:53:40,148 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-05-06 05:53:40,148 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-05-06 05:53:40,148 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-05-06 05:53:40,148 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-05-06 05:53:40,148 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-05-06 05:53:40,148 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-05-06 05:53:40,148 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-05-06 05:53:40,149 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-05-06 05:53:40,149 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-05-06 05:53:40,149 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-05-06 05:53:40,149 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-05-06 05:53:40,149 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-05-06 05:53:40,149 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-05-06 05:53:40,149 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-05-06 05:53:40,149 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-05-06 05:53:40,149 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-05-06 05:53:40,150 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-05-06 05:53:40,150 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-05-06 05:53:40,150 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-05-06 05:53:40,150 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-05-06 05:53:40,150 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-05-06 05:53:40,150 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-05-06 05:53:40,150 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-05-06 05:53:40,150 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-05-06 05:53:40,150 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-05-06 05:53:40,150 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-05-06 05:53:40,151 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-05-06 05:53:40,151 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-05-06 05:53:40,151 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-05-06 05:53:40,151 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-05-06 05:53:40,151 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-05-06 05:53:40,151 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-05-06 05:53:40,151 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-05-06 05:53:40,151 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-05-06 05:53:40,151 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-05-06 05:53:40,152 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-05-06 05:53:40,152 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-05-06 05:53:40,152 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-05-06 05:53:40,152 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-05-06 05:53:40,152 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-05-06 05:53:40,152 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-05-06 05:53:40,152 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-05-06 05:53:40,152 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-05-06 05:53:40,153 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-05-06 05:53:40,153 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-05-06 05:53:40,153 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-05-06 05:53:40,153 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-05-06 05:53:40,153 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-05-06 05:53:40,153 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-05-06 05:53:40,153 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-05-06 05:53:40,153 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-05-06 05:53:40,153 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-05-06 05:53:40,153 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-05-06 05:53:40,154 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-05-06 05:53:40,154 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-05-06 05:53:40,154 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-05-06 05:53:40,154 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-05-06 05:53:40,154 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-05-06 05:53:40,154 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-05-06 05:53:40,154 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-05-06 05:53:40,154 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-05-06 05:53:40,154 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-05-06 05:53:40,154 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-05-06 05:53:40,155 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-05-06 05:53:40,155 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-05-06 05:53:40,155 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-05-06 05:53:40,155 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-05-06 05:53:40,155 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-05-06 05:53:40,155 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-05-06 05:53:40,155 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-05-06 05:53:40,155 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-05-06 05:53:40,155 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-05-06 05:53:40,155 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-05-06 05:53:40,156 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-05-06 05:53:40,156 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-05-06 05:53:40,156 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-05-06 05:53:40,156 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-05-06 05:53:40,156 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-05-06 05:53:40,156 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-05-06 05:53:40,156 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-05-06 05:53:40,156 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-05-06 05:53:40,156 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-05-06 05:53:40,157 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-05-06 05:53:40,313 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.020374349167592884); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.03297109573186521, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.020374349167592884); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.01275); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.043166666666666666, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-05-06 05:53:40,314 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-05-06 05:53:40,314 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.01561126508041504, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.020374349167592884); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.03297109573186521, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.020374349167592884); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.01275); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.043166666666666666, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-05-06 05:53:40,633 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 450 ms to try 5000 different iterations.  Found a solution that moves 987 regions; Going from a computed imbalance of 0.01561126508041504 to a new imbalance of 5.537382226696657E-4. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.004566232594791834); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.008260625575862978); MoveCostFunction : (multiplier=7.0, imbalance=0.10966666666666666, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.004566232594791834); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.6666666666666666E-4); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.00375); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-05-06 05:53:40,635 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1710259417:81 , srv1725807395:82 , srv537407271:82 , srv1168356468:83 , srv1204117272:83 , srv138837464:83 , srv1455345645:83 , srv1942563614:83 , srv2128478489:83 , srv411773210:83 , srv839972412:83 , srv1012891376:84 , srv1094403322:84 , srv1251410111:84 , srv1277506200:84 , srv1362690316:84 , srv1368218843:84 , srv1727613417:84 , srv1789013699:84 , srv1806055456:84 , srv1953251028:84 , srv2129161784:84 , srv29930291:84 , srv509058166:84 , srv66305277:84 , srv743492157:84 , srv793664483:84 , srv816408068:84 , srv902288489:84 , srv95845089:84 , srv961904824:84 , srv1019712088:85 , srv1106261587:85 , srv1315212001:85 , srv1871886482:85 , srv1965429643:85 , srv265309167:85 , srv276986309:85 , srv368161506:85 , srv402993271:85 , srv406422995:85 , srv576630705:85 , srv667270521:85 , srv699315952:85 , srv877848300:85 , srv987713075:85 , srv1024522512:86 , srv1060824578:86 , srv1190432992:86 , srv124229136:86 , srv1270665660:86 , srv1449201095:86 , srv1563547467:86 , srv1590960055:86 , srv1658980717:86 , srv1667334467:86 , srv1853865418:86 , srv196030793:86 , srv2066595304:86 , srv20815288:86 , srv2096475654:86 , srv2110876859:86 , srv301026626:86 , srv302066512:86 , srv419205601:86 , srv484899138:86 , srv644579671:86 , srv743210585:86 , srv761872238:86 , srv768808130:86 , srv841288760:86 , srv874295899:86 , srv89938278:86 , srv940399424:86 , srv1021832795:87 , srv1095654383:87 , srv1121894379:87 , srv1308002013:87 , srv1358860784:87 , srv1398646207:87 , srv1653381021:87 , srv1783516476:87 , srv1871722198:87 , srv1943248107:87 , srv1945130466:87 , srv2078912803:87 , srv235899910:87 , srv296838697:87 , srv348106355:87 , srv66401803:87 , srv988124149:87 , srv2004643687:88 , srv242494126:88 , srv684761760:88 , srv702349878:88 , srv810009118:88 , srv851505822:88 , srv460090076:89 , srv641659498:89 , srv1511306042:543 }
2023-05-06 05:53:40,640 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-05-06 05:53:40,641 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv89938278=93, srv66305277=75, srv684761760=78, srv1853865418=37, srv406422995=65, srv1315212001=17, srv743210585=81, srv1308002013=16, srv124229136=12, srv242494126=55, srv1398646207=22, srv1121894379=8, srv66401803=76, srv1455345645=24, srv874295899=91, srv816408068=87, srv1362690316=19, srv402993271=64, srv2078912803=48, srv768808130=84, srv484899138=69, srv1943248107=41, srv2128478489=52, srv419205601=67, srv1021832795=2, srv1667334467=30, srv1871722198=38, srv1710259417=31, srv743492157=82, srv196030793=44, srv1204117272=11, srv1725807395=32, srv940399424=95, srv301026626=60, srv1019712088=1, srv1095654383=6, srv1358860784=18, srv1783516476=34, srv411773210=66, srv1590960055=27, srv988124149=99, srv810009118=86, srv1871886482=39, srv1653381021=28, srv509058166=70, srv2129161784=53, srv2004643687=46, srv2110876859=51, srv641659498=73, srv1658980717=29, srv537407271=71, srv368161506=63, srv296838697=58, srv302066512=61, srv1168356468=9, srv902288489=94, srv235899910=54, srv460090076=68, srv1945130466=42, srv1024522512=3, srv1953251028=43, srv1012891376=0, srv1511306042=25, srv265309167=56, srv276986309=57, srv793664483=85, srv702349878=80, srv95845089=96, srv1942563614=40, srv851505822=90, srv987713075=98, srv2066595304=47, srv1563547467=26, srv1190432992=10, srv961904824=97, srv1449201095=23, srv667270521=77, srv1789013699=35, srv348106355=62, srv2096475654=50, srv761872238=83, srv1251410111=13, srv29930291=59, srv1965429643=45, srv1368218843=20, srv841288760=89, srv1277506200=15, srv138837464=21, srv1270665660=14, srv576630705=72, srv1727613417=33, srv1094403322=5, srv877848300=92, srv1106261587=7, srv839972412=88, srv1060824578=4, srv1806055456=36, srv20815288=49, srv699315952=79, srv644579671=74} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-05-06 05:53:40,661 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-05-06 05:53:40,661 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-05-06 05:53:40,662 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-05-06 05:53:40,662 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-05-06 05:53:40,662 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-05-06 05:53:40,662 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-05-06 05:53:40,662 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-05-06 05:53:40,662 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-05-06 05:53:40,662 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-05-06 05:53:40,662 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-05-06 05:53:40,663 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-05-06 05:53:40,663 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-05-06 05:53:40,663 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-05-06 05:53:40,663 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-05-06 05:53:40,663 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-05-06 05:53:40,663 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-05-06 05:53:40,663 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-05-06 05:53:40,663 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-05-06 05:53:40,664 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-05-06 05:53:40,664 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-05-06 05:53:40,664 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-05-06 05:53:40,664 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-05-06 05:53:40,664 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-05-06 05:53:40,664 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-05-06 05:53:40,664 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-05-06 05:53:40,664 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-05-06 05:53:40,664 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-05-06 05:53:40,665 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-05-06 05:53:40,665 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-05-06 05:53:40,665 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-05-06 05:53:40,665 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-05-06 05:53:40,665 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-05-06 05:53:40,665 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-05-06 05:53:40,665 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-05-06 05:53:40,665 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-05-06 05:53:40,665 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-05-06 05:53:40,666 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-05-06 05:53:40,666 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-05-06 05:53:40,666 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-05-06 05:53:40,666 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-05-06 05:53:40,666 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-05-06 05:53:40,666 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-05-06 05:53:40,666 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-05-06 05:53:40,666 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-05-06 05:53:40,666 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-05-06 05:53:40,667 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-05-06 05:53:40,667 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-05-06 05:53:40,667 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-05-06 05:53:40,667 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-05-06 05:53:40,667 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-05-06 05:53:40,667 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-05-06 05:53:40,667 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-05-06 05:53:40,667 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-05-06 05:53:40,667 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-05-06 05:53:40,668 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-05-06 05:53:40,668 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-05-06 05:53:40,668 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-05-06 05:53:40,668 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-05-06 05:53:40,668 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-05-06 05:53:40,668 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-05-06 05:53:40,668 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-05-06 05:53:40,668 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-05-06 05:53:40,668 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-05-06 05:53:40,668 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-05-06 05:53:40,669 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-05-06 05:53:40,669 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-05-06 05:53:40,669 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-05-06 05:53:40,669 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-05-06 05:53:40,669 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-05-06 05:53:40,669 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-05-06 05:53:40,669 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-05-06 05:53:40,669 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-05-06 05:53:40,669 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-05-06 05:53:40,670 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-05-06 05:53:40,670 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-05-06 05:53:40,670 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-05-06 05:53:40,670 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-05-06 05:53:40,670 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-05-06 05:53:40,670 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-05-06 05:53:40,670 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-05-06 05:53:40,670 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-05-06 05:53:40,670 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-05-06 05:53:40,671 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-05-06 05:53:40,671 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-05-06 05:53:40,671 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-05-06 05:53:40,671 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-05-06 05:53:40,671 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-05-06 05:53:40,671 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-05-06 05:53:40,671 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-05-06 05:53:40,671 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-05-06 05:53:40,671 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-05-06 05:53:40,671 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-05-06 05:53:40,671 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-05-06 05:53:40,672 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-05-06 05:53:40,672 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-05-06 05:53:40,672 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-05-06 05:53:40,672 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-05-06 05:53:40,672 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-05-06 05:53:40,672 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-05-06 05:53:40,672 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-05-06 05:53:40,672 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-05-06 05:53:40,829 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.004566232594791834); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.008260625575862978); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.004566232594791834); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.6666666666666666E-4); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.00375); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-05-06 05:53:40,829 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-05-06 05:53:40,829 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=5.468271009552993E-4, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.004566232594791834); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.008260625575862978); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.004566232594791834); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.6666666666666666E-4); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.00375); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-05-06 05:53:41,283 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 595 ms to try 5000 different iterations.  Found a solution that moves 253 regions; Going from a computed imbalance of 5.468271009552993E-4 to a new imbalance of 2.208859794200343E-5. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=4.4668347344853864E-4); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0023688968483956715); MoveCostFunction : (multiplier=7.0, imbalance=0.02811111111111111, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=4.4668347344853864E-4); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=8.333333333333333E-5); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-05-06 05:53:41,284 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1021832795:83 , srv1095654383:83 , srv1168356468:83 , srv1653381021:83 , srv196030793:83 , srv2096475654:83 , srv460090076:83 , srv641659498:83 , srv95845089:83 , srv1024522512:84 , srv1121894379:84 , srv1190432992:84 , srv124229136:84 , srv1270665660:84 , srv1358860784:84 , srv1362690316:84 , srv1368218843:84 , srv1398646207:84 , srv1449201095:84 , srv1455345645:84 , srv1563547467:84 , srv1590960055:84 , srv1667334467:84 , srv1783516476:84 , srv1806055456:84 , srv1871722198:84 , srv1942563614:84 , srv1945130466:84 , srv2004643687:84 , srv2066595304:84 , srv20815288:84 , srv235899910:84 , srv242494126:84 , srv265309167:84 , srv348106355:84 , srv368161506:84 , srv411773210:84 , srv419205601:84 , srv537407271:84 , srv644579671:84 , srv66305277:84 , srv684761760:84 , srv699315952:84 , srv702349878:84 , srv761872238:84 , srv768808130:84 , srv793664483:84 , srv810009118:84 , srv816408068:84 , srv841288760:84 , srv851505822:84 , srv874295899:84 , srv940399424:84 , srv961904824:84 , srv987713075:84 , srv988124149:84 , srv1012891376:85 , srv1019712088:85 , srv1060824578:85 , srv1094403322:85 , srv1106261587:85 , srv1204117272:85 , srv1251410111:85 , srv1277506200:85 , srv1315212001:85 , srv138837464:85 , srv1658980717:85 , srv1710259417:85 , srv1725807395:85 , srv1727613417:85 , srv1871886482:85 , srv1943248107:85 , srv1953251028:85 , srv1965429643:85 , srv2078912803:85 , srv2110876859:85 , srv2128478489:85 , srv276986309:85 , srv296838697:85 , srv29930291:85 , srv301026626:85 , srv402993271:85 , srv406422995:85 , srv484899138:85 , srv509058166:85 , srv66401803:85 , srv667270521:85 , srv743210585:85 , srv743492157:85 , srv839972412:85 , srv877848300:85 , srv89938278:85 , srv902288489:85 , srv1308002013:86 , srv1789013699:86 , srv1853865418:86 , srv302066512:86 , srv576630705:86 , srv2129161784:87 , srv1511306042:643 }
2023-05-06 05:53:41,291 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-05-06 05:53:41,292 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv89938278=93, srv66305277=75, srv684761760=78, srv1853865418=37, srv406422995=65, srv1315212001=17, srv743210585=81, srv1308002013=16, srv124229136=12, srv242494126=55, srv1398646207=22, srv1121894379=8, srv66401803=76, srv1455345645=24, srv874295899=91, srv816408068=87, srv1362690316=19, srv402993271=64, srv2078912803=48, srv768808130=84, srv484899138=69, srv1943248107=41, srv2128478489=52, srv419205601=67, srv1021832795=2, srv1667334467=30, srv1871722198=38, srv1710259417=31, srv743492157=82, srv196030793=44, srv1204117272=11, srv1725807395=32, srv940399424=95, srv301026626=60, srv1019712088=1, srv1095654383=6, srv1358860784=18, srv1783516476=34, srv411773210=66, srv1590960055=27, srv988124149=99, srv810009118=86, srv1871886482=39, srv1653381021=28, srv509058166=70, srv2129161784=53, srv2004643687=46, srv2110876859=51, srv641659498=73, srv1658980717=29, srv537407271=71, srv368161506=63, srv296838697=58, srv302066512=61, srv1168356468=9, srv902288489=94, srv235899910=54, srv460090076=68, srv1945130466=42, srv1024522512=3, srv1953251028=43, srv1012891376=0, srv1511306042=25, srv265309167=56, srv276986309=57, srv793664483=85, srv702349878=80, srv95845089=96, srv1942563614=40, srv851505822=90, srv987713075=98, srv2066595304=47, srv1563547467=26, srv1190432992=10, srv961904824=97, srv1449201095=23, srv667270521=77, srv1789013699=35, srv348106355=62, srv2096475654=50, srv761872238=83, srv1251410111=13, srv29930291=59, srv1965429643=45, srv1368218843=20, srv841288760=89, srv1277506200=15, srv138837464=21, srv1270665660=14, srv576630705=72, srv1727613417=33, srv1094403322=5, srv877848300=92, srv1106261587=7, srv839972412=88, srv1060824578=4, srv1806055456=36, srv20815288=49, srv699315952=79, srv644579671=74} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-05-06 05:53:41,312 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-05-06 05:53:41,312 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-05-06 05:53:41,313 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-05-06 05:53:41,313 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-05-06 05:53:41,313 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-05-06 05:53:41,313 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-05-06 05:53:41,313 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-05-06 05:53:41,313 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-05-06 05:53:41,313 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-05-06 05:53:41,313 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-05-06 05:53:41,313 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-05-06 05:53:41,313 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-05-06 05:53:41,313 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-05-06 05:53:41,313 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-05-06 05:53:41,314 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-05-06 05:53:41,314 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-05-06 05:53:41,314 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-05-06 05:53:41,314 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-05-06 05:53:41,314 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-05-06 05:53:41,314 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-05-06 05:53:41,314 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-05-06 05:53:41,314 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-05-06 05:53:41,314 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-05-06 05:53:41,314 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-05-06 05:53:41,314 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-05-06 05:53:41,314 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-05-06 05:53:41,315 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-05-06 05:53:41,315 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-05-06 05:53:41,315 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-05-06 05:53:41,315 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-05-06 05:53:41,315 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-05-06 05:53:41,315 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-05-06 05:53:41,315 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-05-06 05:53:41,315 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-05-06 05:53:41,315 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-05-06 05:53:41,315 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-05-06 05:53:41,315 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-05-06 05:53:41,316 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-05-06 05:53:41,316 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-05-06 05:53:41,316 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-05-06 05:53:41,316 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-05-06 05:53:41,316 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-05-06 05:53:41,316 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-05-06 05:53:41,316 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-05-06 05:53:41,316 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-05-06 05:53:41,316 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-05-06 05:53:41,316 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-05-06 05:53:41,316 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-05-06 05:53:41,317 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-05-06 05:53:41,317 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-05-06 05:53:41,317 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-05-06 05:53:41,317 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-05-06 05:53:41,317 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-05-06 05:53:41,317 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-05-06 05:53:41,317 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-05-06 05:53:41,317 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-05-06 05:53:41,317 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-05-06 05:53:41,317 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-05-06 05:53:41,317 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-05-06 05:53:41,317 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-05-06 05:53:41,318 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-05-06 05:53:41,318 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-05-06 05:53:41,318 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-05-06 05:53:41,318 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-05-06 05:53:41,318 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-05-06 05:53:41,318 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-05-06 05:53:41,318 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-05-06 05:53:41,318 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-05-06 05:53:41,318 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-05-06 05:53:41,319 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-05-06 05:53:41,319 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-05-06 05:53:41,319 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-05-06 05:53:41,319 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-05-06 05:53:41,319 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-05-06 05:53:41,319 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-05-06 05:53:41,319 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-05-06 05:53:41,320 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-05-06 05:53:41,320 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-05-06 05:53:41,320 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-05-06 05:53:41,320 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-05-06 05:53:41,320 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-05-06 05:53:41,320 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-05-06 05:53:41,320 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-05-06 05:53:41,320 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-05-06 05:53:41,320 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-05-06 05:53:41,320 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-05-06 05:53:41,320 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-05-06 05:53:41,321 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-05-06 05:53:41,321 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-05-06 05:53:41,321 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-05-06 05:53:41,321 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-05-06 05:53:41,321 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-05-06 05:53:41,321 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-05-06 05:53:41,321 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-05-06 05:53:41,321 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-05-06 05:53:41,321 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-05-06 05:53:41,321 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-05-06 05:53:41,321 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-05-06 05:53:41,321 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-05-06 05:53:41,322 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-05-06 05:53:41,322 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-05-06 05:53:41,451 INFO  [Time-limited test] balancer.StochasticLoadBalancer(381): Cluster wide - skipping load balancing because weighted average imbalance=2.0317054078037193E-5 <= threshold(0.025). If you want more aggressive balancing, either lower hbase.master.balancer.stochastic.minCostNeedBalance from 0.025 or increase the relative multiplier(s) of the specific cost function(s). functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=4.4668347344853864E-4); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0023688968483956715); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=4.4668347344853864E-4); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=8.333333333333333E-5); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-05-06 05:53:41,451 INFO  [Time-limited test] balancer.BalancerTestBase(570): Mock Final balance: { srv1021832795:83 , srv1095654383:83 , srv1168356468:83 , srv1653381021:83 , srv196030793:83 , srv2096475654:83 , srv460090076:83 , srv641659498:83 , srv95845089:83 , srv1024522512:84 , srv1121894379:84 , srv1190432992:84 , srv124229136:84 , srv1270665660:84 , srv1358860784:84 , srv1362690316:84 , srv1368218843:84 , srv1398646207:84 , srv1449201095:84 , srv1455345645:84 , srv1563547467:84 , srv1590960055:84 , srv1667334467:84 , srv1783516476:84 , srv1806055456:84 , srv1871722198:84 , srv1942563614:84 , srv1945130466:84 , srv2004643687:84 , srv2066595304:84 , srv20815288:84 , srv235899910:84 , srv242494126:84 , srv265309167:84 , srv348106355:84 , srv368161506:84 , srv411773210:84 , srv419205601:84 , srv537407271:84 , srv644579671:84 , srv66305277:84 , srv684761760:84 , srv699315952:84 , srv702349878:84 , srv761872238:84 , srv768808130:84 , srv793664483:84 , srv810009118:84 , srv816408068:84 , srv841288760:84 , srv851505822:84 , srv874295899:84 , srv940399424:84 , srv961904824:84 , srv987713075:84 , srv988124149:84 , srv1012891376:85 , srv1019712088:85 , srv1060824578:85 , srv1094403322:85 , srv1106261587:85 , srv1204117272:85 , srv1251410111:85 , srv1277506200:85 , srv1315212001:85 , srv138837464:85 , srv1658980717:85 , srv1710259417:85 , srv1725807395:85 , srv1727613417:85 , srv1871886482:85 , srv1943248107:85 , srv1953251028:85 , srv1965429643:85 , srv2078912803:85 , srv2110876859:85 , srv2128478489:85 , srv276986309:85 , srv296838697:85 , srv29930291:85 , srv301026626:85 , srv402993271:85 , srv406422995:85 , srv484899138:85 , srv509058166:85 , srv66401803:85 , srv667270521:85 , srv743210585:85 , srv743492157:85 , srv839972412:85 , srv877848300:85 , srv89938278:85 , srv902288489:85 , srv1308002013:86 , srv1789013699:86 , srv1853865418:86 , srv302066512:86 , srv576630705:86 , srv2129161784:87 , srv1511306042:643 }
2023-05-06 05:53:41,484 INFO  [Time-limited test] hbase.ResourceChecker(175): after: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnLargeClusterWithRacks Thread=10 (was 10), OpenFileDescriptor=260 (was 260), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=342 (was 342), ProcessCount=179 (was 179), AvailableMemoryMB=4160 (was 4871)
2023-05-06 05:53:41,497 INFO  [Time-limited test] hbase.ResourceChecker(147): before: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnMidClusterWithRacks Thread=10, OpenFileDescriptor=260, MaxFileDescriptor=60000, SystemLoadAverage=342, ProcessCount=179, AvailableMemoryMB=4160
2023-05-06 05:53:41,498 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2023-05-06 05:53:41,498 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=5000, runMaxSteps=true, stepsPerRegion=800, maxRunningTime=120000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 111077.0 etc.
2023-05-06 05:53:41,512 INFO  [Time-limited test] balancer.BalancerTestBase(547): Mock Cluster : { srv1033013772:84 , srv1041461180:84 , srv1213788359:84 , srv1292960426:84 , srv1427042820:84 , srv1459907246:84 , srv1551444489:84 , srv1637425164:84 , srv1752373472:84 , srv1838312979:84 , srv195356639:84 , srv1970909874:84 , srv1980320603:84 , srv2069285907:84 , srv227465394:84 , srv281165346:84 , srv306012647:84 , srv356347544:84 , srv37970188:84 , srv410322608:84 , srv436506933:84 , srv506394355:84 , srv667655722:84 , srv668992439:84 , srv713903271:84 , srv716133046:84 , srv743701593:84 , srv826837596:84 , srv841339967:84 , srv638147755:264 } [srvr=30 rgns=2700 avg=90.0 max=90 min=90]
2023-05-06 05:53:41,514 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-05-06 05:53:41,515 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1427042820=4, srv1033013772=0, srv1551444489=6, srv281165346=15, srv1980320603=12, srv227465394=14, srv1459907246=5, srv37970188=18, srv195356639=10, srv667655722=23, srv1637425164=7, srv743701593=27, srv506394355=21, srv638147755=22, srv668992439=24, srv826837596=28, srv716133046=26, srv841339967=29, srv1292960426=3, srv410322608=19, srv356347544=17, srv1041461180=1, srv1213788359=2, srv306012647=16, srv1970909874=11, srv2069285907=13, srv713903271=25, srv1838312979=9, srv1752373472=8, srv436506933=20} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-05-06 05:53:41,528 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-05-06 05:53:41,529 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-05-06 05:53:41,529 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-05-06 05:53:41,529 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-05-06 05:53:41,529 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-05-06 05:53:41,529 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-05-06 05:53:41,529 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-05-06 05:53:41,529 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-05-06 05:53:41,529 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-05-06 05:53:41,529 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-05-06 05:53:41,529 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-05-06 05:53:41,529 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-05-06 05:53:41,530 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-05-06 05:53:41,530 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-05-06 05:53:41,530 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-05-06 05:53:41,530 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-05-06 05:53:41,530 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-05-06 05:53:41,530 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-05-06 05:53:41,530 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-05-06 05:53:41,530 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-05-06 05:53:41,530 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-05-06 05:53:41,530 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-05-06 05:53:41,530 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-05-06 05:53:41,530 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-05-06 05:53:41,531 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-05-06 05:53:41,531 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-05-06 05:53:41,531 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-05-06 05:53:41,531 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-05-06 05:53:41,531 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-05-06 05:53:41,531 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-05-06 05:53:41,531 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=10, number of hosts=30, number of racks=4
2023-05-06 05:53:41,558 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=1.0742134184386052, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-05-06 05:53:41,559 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.991242688732249, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=1.0742134184386052, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=64800000
2023-05-06 05:55:41,535 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 120001 ms to try 6115720 different iterations.  Found a solution that moves 1853 regions; Going from a computed imbalance of 0.991242688732249 to a new imbalance of 4.324994439959734E-5. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); MoveCostFunction : (multiplier=7.0, imbalance=0.6862962962962963, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-05-06 05:55:41,542 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1033013772:90 , srv1041461180:90 , srv1213788359:90 , srv1292960426:90 , srv1427042820:90 , srv1459907246:90 , srv1551444489:90 , srv1637425164:90 , srv1752373472:90 , srv1838312979:90 , srv195356639:90 , srv1970909874:90 , srv1980320603:90 , srv2069285907:90 , srv227465394:90 , srv281165346:90 , srv306012647:90 , srv356347544:90 , srv37970188:90 , srv410322608:90 , srv436506933:90 , srv506394355:90 , srv638147755:90 , srv667655722:90 , srv668992439:90 , srv713903271:90 , srv716133046:90 , srv743701593:90 , srv826837596:90 , srv841339967:90 }
2023-05-06 05:55:41,543 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-05-06 05:55:41,543 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1427042820=4, srv1033013772=0, srv1551444489=6, srv281165346=15, srv1980320603=12, srv227465394=14, srv1459907246=5, srv37970188=18, srv195356639=10, srv667655722=23, srv1637425164=7, srv743701593=27, srv506394355=21, srv638147755=22, srv668992439=24, srv826837596=28, srv716133046=26, srv841339967=29, srv1292960426=3, srv410322608=19, srv356347544=17, srv1041461180=1, srv1213788359=2, srv306012647=16, srv1970909874=11, srv2069285907=13, srv713903271=25, srv1838312979=9, srv1752373472=8, srv436506933=20} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-05-06 05:55:41,546 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-05-06 05:55:41,547 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-05-06 05:55:41,547 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-05-06 05:55:41,547 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-05-06 05:55:41,547 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-05-06 05:55:41,547 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-05-06 05:55:41,547 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-05-06 05:55:41,547 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-05-06 05:55:41,547 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-05-06 05:55:41,547 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-05-06 05:55:41,547 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-05-06 05:55:41,547 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-05-06 05:55:41,547 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-05-06 05:55:41,547 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-05-06 05:55:41,547 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-05-06 05:55:41,547 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-05-06 05:55:41,547 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-05-06 05:55:41,547 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-05-06 05:55:41,547 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-05-06 05:55:41,547 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-05-06 05:55:41,547 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-05-06 05:55:41,548 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-05-06 05:55:41,548 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-05-06 05:55:41,548 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-05-06 05:55:41,548 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-05-06 05:55:41,548 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-05-06 05:55:41,548 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-05-06 05:55:41,548 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-05-06 05:55:41,548 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-05-06 05:55:41,548 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-05-06 05:55:41,548 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=10, number of hosts=30, number of racks=4
2023-05-06 05:55:41,560 INFO  [Time-limited test] balancer.StochasticLoadBalancer(381): Cluster wide - skipping load balancing because weighted average imbalance=0.0 <= threshold(0.025). If you want more aggressive balancing, either lower hbase.master.balancer.stochastic.minCostNeedBalance from 0.025 or increase the relative multiplier(s) of the specific cost function(s). functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-05-06 05:55:41,561 INFO  [Time-limited test] balancer.BalancerTestBase(570): Mock Final balance: { srv1033013772:90 , srv1041461180:90 , srv1213788359:90 , srv1292960426:90 , srv1427042820:90 , srv1459907246:90 , srv1551444489:90 , srv1637425164:90 , srv1752373472:90 , srv1838312979:90 , srv195356639:90 , srv1970909874:90 , srv1980320603:90 , srv2069285907:90 , srv227465394:90 , srv281165346:90 , srv306012647:90 , srv356347544:90 , srv37970188:90 , srv410322608:90 , srv436506933:90 , srv506394355:90 , srv638147755:90 , srv667655722:90 , srv668992439:90 , srv713903271:90 , srv716133046:90 , srv743701593:90 , srv826837596:90 , srv841339967:90 }
2023-05-06 05:55:41,575 INFO  [Time-limited test] hbase.ResourceChecker(175): after: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnMidClusterWithRacks Thread=9 (was 10), OpenFileDescriptor=260 (was 260), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=167 (was 342), ProcessCount=179 (was 179), AvailableMemoryMB=4314 (was 4160) - AvailableMemoryMB LEAK? -