2023-02-07 15:53:05,481 INFO  [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks timeout: 13 mins
2023-02-07 15:53:05,794 WARN  [Time-limited test] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties
2023-02-07 15:53:05,900 INFO  [Time-limited test] metrics.MetricRegistriesLoader(60): Loaded MetricRegistries class org.apache.hadoop.hbase.metrics.impl.MetricRegistriesImpl
2023-02-07 15:53:05,961 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2023-02-07 15:53:05,968 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc.
2023-02-07 15:53:05,978 INFO  [Time-limited test] hbase.ResourceChecker(147): before: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnLargeClusterWithRacks Thread=10, OpenFileDescriptor=260, MaxFileDescriptor=60000, SystemLoadAverage=368, ProcessCount=174, AvailableMemoryMB=4484
2023-02-07 15:53:05,980 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2023-02-07 15:53:05,980 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=5000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=10000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc.
2023-02-07 15:53:06,120 INFO  [Time-limited test] balancer.BalancerTestBase(547): Mock Cluster : { srv1006750976:84 , srv1029378744:84 , srv1040821542:84 , srv1066541860:84 , srv1068261583:84 , srv1077761739:84 , srv1121836540:84 , srv1126181508:84 , srv1127428437:84 , srv1134429714:84 , srv1134614971:84 , srv1150532701:84 , srv1158328825:84 , srv1180467694:84 , srv12377290:84 , srv1299321113:84 , srv1334270310:84 , srv1341299437:84 , srv1348382581:84 , srv1361797144:84 , srv1386587692:84 , srv1427112161:84 , srv1493208182:84 , srv1501630059:84 , srv1524868328:84 , srv1535696138:84 , srv1546877555:84 , srv156332005:84 , srv1567196843:84 , srv1579213478:84 , srv158676231:84 , srv1596735302:84 , srv1625434641:84 , srv1644053969:84 , srv1659025270:84 , srv1674845468:84 , srv1719996273:84 , srv1724231084:84 , srv1737464731:84 , srv1788301523:84 , srv1798561625:84 , srv1800841416:84 , srv1814892048:84 , srv1815439903:84 , srv1822352762:84 , srv1853520375:84 , srv1861046226:84 , srv1870792414:84 , srv1883595041:84 , srv1895710110:84 , srv1950691326:84 , srv2060600009:84 , srv2061051712:84 , srv2131500433:84 , srv273123110:84 , srv32263345:84 , srv333987595:84 , srv33490253:84 , srv356315279:84 , srv424042701:84 , srv442764464:84 , srv442918450:84 , srv445268130:84 , srv47727842:84 , srv496450722:84 , srv536939665:84 , srv580216475:84 , srv581767832:84 , srv598874462:84 , srv608181065:84 , srv627350956:84 , srv672976301:84 , srv679015266:84 , srv680869923:84 , srv693798349:84 , srv695611139:84 , srv698556870:84 , srv714357942:84 , srv718194271:84 , srv732069540:84 , srv73452990:84 , srv736534221:84 , srv742920435:84 , srv745674765:84 , srv764555555:84 , srv797973419:84 , srv802204981:84 , srv810697547:84 , srv845937488:84 , srv858062474:84 , srv862835039:84 , srv864789136:84 , srv883562532:84 , srv901526776:84 , srv906595069:84 , srv906750042:84 , srv922724332:84 , srv968813954:84 , srv994232802:84 , srv971610107:684 } [srvr=100 rgns=9000 avg=90.0 max=90 min=90]
2023-02-07 15:53:06,131 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-02-07 15:53:06,140 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv158676231=30, srv1334270310=16, srv273123110=54, srv1861046226=46, srv1427112161=21, srv32263345=55, srv445268130=62, srv797973419=85, srv1814892048=42, srv627350956=70, srv1788301523=39, srv742920435=82, srv1724231084=37, srv1737464731=38, srv1883595041=48, srv1579213478=29, srv1127428437=8, srv1029378744=1, srv1361797144=19, srv1567196843=28, srv1950691326=50, srv2061051712=52, srv1870792414=47, srv810697547=87, srv1719996273=36, srv2131500433=53, srv1121836540=6, srv858062474=89, srv1546877555=26, srv1644053969=33, srv1134614971=10, srv47727842=63, srv695611139=75, srv679015266=72, srv714357942=77, srv698556870=76, srv581767832=67, srv693798349=74, srv994232802=99, srv1348382581=18, srv1524868328=24, srv598874462=68, srv971610107=98, srv1535696138=25, srv906750042=95, srv2060600009=51, srv1815439903=43, srv745674765=83, srv1068261583=4, srv718194271=78, srv1006750976=0, srv680869923=73, srv1299321113=15, srv73452990=80, srv1493208182=22, srv1501630059=23, srv968813954=97, srv845937488=88, srv1853520375=45, srv1674845468=35, srv1798561625=40, srv608181065=69, srv1596735302=31, srv1822352762=44, srv1077761739=5, srv802204981=86, srv156332005=27, srv1800841416=41, srv1126181508=7, srv901526776=93, srv536939665=65, srv1386587692=20, srv356315279=58, srv922724332=96, srv1158328825=12, srv1659025270=34, srv442764464=60, srv580216475=66, srv883562532=92, srv1180467694=13, srv496450722=64, srv764555555=84, srv33490253=57, srv12377290=14, srv333987595=56, srv906595069=94, srv732069540=79, srv442918450=61, srv424042701=59, srv736534221=81, srv1066541860=3, srv1341299437=17, srv1895710110=49, srv1625434641=32, srv1134429714=9, srv1040821542=2, srv1150532701=11, srv862835039=90, srv672976301=71, srv864789136=91} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-02-07 15:53:06,233 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-02-07 15:53:06,233 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-02-07 15:53:06,233 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-02-07 15:53:06,233 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-02-07 15:53:06,234 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-02-07 15:53:06,234 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-02-07 15:53:06,234 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-02-07 15:53:06,234 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-02-07 15:53:06,234 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-02-07 15:53:06,234 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-02-07 15:53:06,234 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-02-07 15:53:06,235 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-02-07 15:53:06,235 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-02-07 15:53:06,235 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-02-07 15:53:06,235 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-02-07 15:53:06,235 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-02-07 15:53:06,235 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-02-07 15:53:06,235 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-02-07 15:53:06,236 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-02-07 15:53:06,236 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-02-07 15:53:06,236 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-02-07 15:53:06,236 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-02-07 15:53:06,236 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-02-07 15:53:06,236 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-02-07 15:53:06,237 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-02-07 15:53:06,237 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-02-07 15:53:06,237 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-02-07 15:53:06,237 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-02-07 15:53:06,237 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-02-07 15:53:06,237 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-02-07 15:53:06,237 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-02-07 15:53:06,238 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-02-07 15:53:06,238 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-02-07 15:53:06,238 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-02-07 15:53:06,238 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-02-07 15:53:06,238 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-02-07 15:53:06,238 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-02-07 15:53:06,238 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-02-07 15:53:06,239 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-02-07 15:53:06,239 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-02-07 15:53:06,239 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-02-07 15:53:06,239 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-02-07 15:53:06,239 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-02-07 15:53:06,239 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-02-07 15:53:06,239 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-02-07 15:53:06,240 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-02-07 15:53:06,240 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-02-07 15:53:06,240 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-02-07 15:53:06,240 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-02-07 15:53:06,240 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-02-07 15:53:06,240 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-02-07 15:53:06,240 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-02-07 15:53:06,241 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-02-07 15:53:06,241 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-02-07 15:53:06,241 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-02-07 15:53:06,241 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-02-07 15:53:06,241 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-02-07 15:53:06,241 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-02-07 15:53:06,241 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-02-07 15:53:06,242 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-02-07 15:53:06,242 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-02-07 15:53:06,242 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-02-07 15:53:06,242 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-02-07 15:53:06,242 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-02-07 15:53:06,242 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-02-07 15:53:06,242 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-02-07 15:53:06,243 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-02-07 15:53:06,243 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-02-07 15:53:06,243 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-02-07 15:53:06,243 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-02-07 15:53:06,243 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-02-07 15:53:06,243 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-02-07 15:53:06,243 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-02-07 15:53:06,244 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-02-07 15:53:06,244 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-02-07 15:53:06,244 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-02-07 15:53:06,244 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-02-07 15:53:06,244 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-02-07 15:53:06,244 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-02-07 15:53:06,244 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-02-07 15:53:06,245 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-02-07 15:53:06,245 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-02-07 15:53:06,245 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-02-07 15:53:06,245 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-02-07 15:53:06,245 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-02-07 15:53:06,245 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-02-07 15:53:06,245 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-02-07 15:53:06,246 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-02-07 15:53:06,246 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-02-07 15:53:06,246 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-02-07 15:53:06,246 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-02-07 15:53:06,246 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-02-07 15:53:06,246 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-02-07 15:53:06,246 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-02-07 15:53:06,246 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-02-07 15:53:06,247 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-02-07 15:53:06,247 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-02-07 15:53:06,247 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-02-07 15:53:06,247 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-02-07 15:53:06,247 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-02-07 15:53:06,247 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-02-07 15:53:06,727 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.06666666666666667, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-02-07 15:53:06,727 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-02-07 15:53:06,727 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.9909252140407105, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.06666666666666667, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-02-07 15:53:07,099 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 817 ms to try 5000 different iterations.  Found a solution that moves 4673 regions; Going from a computed imbalance of 0.9909252140407105 to a new imbalance of 0.1801155673887398. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.04005358675196541, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.05160064207571707, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.5192222222222223, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.04005358675196541, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.17558333333333334, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.23975, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-02-07 15:53:07,107 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1788301523:82 , srv1800841416:82 , srv672976301:82 , srv156332005:83 , srv1579213478:83 , srv1644053969:83 , srv1814892048:83 , srv1853520375:83 , srv1895710110:83 , srv424042701:83 , srv496450722:83 , srv581767832:83 , srv883562532:83 , srv968813954:83 , srv1066541860:84 , srv1077761739:84 , srv1299321113:84 , srv1524868328:84 , srv1596735302:84 , srv1719996273:84 , srv333987595:84 , srv442918450:84 , srv580216475:84 , srv608181065:84 , srv764555555:84 , srv858062474:84 , srv906750042:84 , srv1127428437:85 , srv1334270310:85 , srv1361797144:85 , srv1625434641:85 , srv1798561625:85 , srv627350956:85 , srv714357942:85 , srv736534221:85 , srv745674765:85 , srv864789136:85 , srv1029378744:86 , srv1040821542:86 , srv1126181508:86 , srv12377290:86 , srv1493208182:86 , srv1535696138:86 , srv1567196843:86 , srv158676231:86 , srv1724231084:86 , srv1815439903:86 , srv442764464:86 , srv679015266:86 , srv698556870:86 , srv797973419:86 , srv906595069:86 , srv922724332:86 , srv1006750976:87 , srv1158328825:87 , srv1674845468:87 , srv1737464731:87 , srv1822352762:87 , srv1883595041:87 , srv2131500433:87 , srv47727842:87 , srv536939665:87 , srv695611139:87 , srv802204981:87 , srv810697547:87 , srv1134429714:88 , srv1134614971:88 , srv1180467694:88 , srv1427112161:88 , srv1861046226:88 , srv1950691326:88 , srv2061051712:88 , srv273123110:88 , srv33490253:88 , srv356315279:88 , srv598874462:88 , srv680869923:88 , srv718194271:88 , srv742920435:88 , srv1121836540:89 , srv1150532701:89 , srv1341299437:89 , srv1348382581:89 , srv1386587692:89 , srv1659025270:89 , srv2060600009:89 , srv445268130:89 , srv693798349:89 , srv845937488:89 , srv901526776:89 , srv1870792414:90 , srv32263345:90 , srv994232802:90 , srv1068261583:91 , srv1546877555:91 , srv862835039:91 , srv73452990:92 , srv1501630059:93 , srv732069540:94 , srv971610107:446 }
2023-02-07 15:53:07,111 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-02-07 15:53:07,111 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv158676231=30, srv1334270310=16, srv273123110=54, srv1861046226=46, srv1427112161=21, srv32263345=55, srv445268130=62, srv797973419=85, srv1814892048=42, srv627350956=70, srv1788301523=39, srv742920435=82, srv1724231084=37, srv1737464731=38, srv1883595041=48, srv1579213478=29, srv1127428437=8, srv1029378744=1, srv1361797144=19, srv1567196843=28, srv1950691326=50, srv2061051712=52, srv1870792414=47, srv810697547=87, srv1719996273=36, srv2131500433=53, srv1121836540=6, srv858062474=89, srv1546877555=26, srv1644053969=33, srv1134614971=10, srv47727842=63, srv695611139=75, srv679015266=72, srv714357942=77, srv698556870=76, srv581767832=67, srv693798349=74, srv994232802=99, srv1348382581=18, srv1524868328=24, srv598874462=68, srv971610107=98, srv1535696138=25, srv906750042=95, srv2060600009=51, srv1815439903=43, srv745674765=83, srv1068261583=4, srv718194271=78, srv1006750976=0, srv680869923=73, srv1299321113=15, srv73452990=80, srv1493208182=22, srv1501630059=23, srv968813954=97, srv845937488=88, srv1853520375=45, srv1674845468=35, srv1798561625=40, srv608181065=69, srv1596735302=31, srv1822352762=44, srv1077761739=5, srv802204981=86, srv156332005=27, srv1800841416=41, srv1126181508=7, srv901526776=93, srv536939665=65, srv1386587692=20, srv356315279=58, srv922724332=96, srv1158328825=12, srv1659025270=34, srv442764464=60, srv580216475=66, srv883562532=92, srv1180467694=13, srv496450722=64, srv764555555=84, srv33490253=57, srv12377290=14, srv333987595=56, srv906595069=94, srv732069540=79, srv442918450=61, srv424042701=59, srv736534221=81, srv1066541860=3, srv1341299437=17, srv1895710110=49, srv1625434641=32, srv1134429714=9, srv1040821542=2, srv1150532701=11, srv862835039=90, srv672976301=71, srv864789136=91} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-02-07 15:53:07,124 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-02-07 15:53:07,124 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-02-07 15:53:07,124 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-02-07 15:53:07,125 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-02-07 15:53:07,125 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-02-07 15:53:07,125 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-02-07 15:53:07,125 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-02-07 15:53:07,125 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-02-07 15:53:07,125 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-02-07 15:53:07,125 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-02-07 15:53:07,125 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-02-07 15:53:07,125 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-02-07 15:53:07,125 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-02-07 15:53:07,125 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-02-07 15:53:07,125 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-02-07 15:53:07,126 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-02-07 15:53:07,126 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-02-07 15:53:07,126 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-02-07 15:53:07,126 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-02-07 15:53:07,126 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-02-07 15:53:07,126 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-02-07 15:53:07,126 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-02-07 15:53:07,126 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-02-07 15:53:07,126 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-02-07 15:53:07,126 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-02-07 15:53:07,126 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-02-07 15:53:07,126 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-02-07 15:53:07,126 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-02-07 15:53:07,126 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-02-07 15:53:07,127 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-02-07 15:53:07,127 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-02-07 15:53:07,127 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-02-07 15:53:07,127 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-02-07 15:53:07,127 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-02-07 15:53:07,127 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-02-07 15:53:07,127 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-02-07 15:53:07,127 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-02-07 15:53:07,127 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-02-07 15:53:07,127 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-02-07 15:53:07,127 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-02-07 15:53:07,127 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-02-07 15:53:07,127 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-02-07 15:53:07,127 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-02-07 15:53:07,128 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-02-07 15:53:07,128 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-02-07 15:53:07,128 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-02-07 15:53:07,128 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-02-07 15:53:07,128 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-02-07 15:53:07,128 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-02-07 15:53:07,128 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-02-07 15:53:07,128 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-02-07 15:53:07,128 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-02-07 15:53:07,128 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-02-07 15:53:07,128 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-02-07 15:53:07,128 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-02-07 15:53:07,128 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-02-07 15:53:07,128 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-02-07 15:53:07,129 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-02-07 15:53:07,129 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-02-07 15:53:07,129 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-02-07 15:53:07,129 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-02-07 15:53:07,129 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-02-07 15:53:07,129 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-02-07 15:53:07,129 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-02-07 15:53:07,129 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-02-07 15:53:07,129 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-02-07 15:53:07,129 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-02-07 15:53:07,129 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-02-07 15:53:07,129 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-02-07 15:53:07,129 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-02-07 15:53:07,129 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-02-07 15:53:07,130 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-02-07 15:53:07,130 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-02-07 15:53:07,130 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-02-07 15:53:07,130 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-02-07 15:53:07,130 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-02-07 15:53:07,130 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-02-07 15:53:07,130 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-02-07 15:53:07,130 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-02-07 15:53:07,130 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-02-07 15:53:07,130 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-02-07 15:53:07,130 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-02-07 15:53:07,130 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-02-07 15:53:07,130 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-02-07 15:53:07,130 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-02-07 15:53:07,130 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-02-07 15:53:07,131 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-02-07 15:53:07,131 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-02-07 15:53:07,131 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-02-07 15:53:07,131 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-02-07 15:53:07,131 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-02-07 15:53:07,131 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-02-07 15:53:07,131 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-02-07 15:53:07,131 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-02-07 15:53:07,131 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-02-07 15:53:07,131 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-02-07 15:53:07,131 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-02-07 15:53:07,131 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-02-07 15:53:07,132 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-02-07 15:53:07,132 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-02-07 15:53:07,132 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-02-07 15:53:07,234 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.04005358675196541, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.05160064207571707, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.04005358675196541, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.17558333333333334, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.23975, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-02-07 15:53:07,234 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-02-07 15:53:07,234 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.18008284634337887, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.04005358675196541, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.05160064207571707, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.04005358675196541, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.17558333333333334, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.23975, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-02-07 15:53:07,436 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 288 ms to try 5000 different iterations.  Found a solution that moves 2623 regions; Going from a computed imbalance of 0.18008284634337887 to a new imbalance of 0.01474160929928164. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.02252653587562743); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.033390523330136375, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.29144444444444445, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.02252653587562743); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.011916666666666667); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0415, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-02-07 15:53:07,445 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv73452990:77 , srv732069540:78 , srv1501630059:79 , srv1870792414:80 , srv1068261583:81 , srv1386587692:81 , srv1546877555:81 , srv32263345:81 , srv1348382581:82 , srv1659025270:82 , srv2061051712:82 , srv273123110:82 , srv536939665:82 , srv802204981:82 , srv901526776:82 , srv1121836540:83 , srv1150532701:83 , srv1361797144:83 , srv1950691326:83 , srv693798349:83 , srv718194271:83 , srv862835039:83 , srv1006750976:84 , srv1134429714:84 , srv1134614971:84 , srv1861046226:84 , srv2060600009:84 , srv33490253:84 , srv356315279:84 , srv698556870:84 , srv810697547:84 , srv845937488:84 , srv1180467694:85 , srv1299321113:85 , srv1334270310:85 , srv1341299437:85 , srv1535696138:85 , srv1724231084:85 , srv1815439903:85 , srv333987595:85 , srv442764464:85 , srv47727842:85 , srv679015266:85 , srv742920435:85 , srv864789136:85 , srv994232802:85 , srv1029378744:86 , srv1126181508:86 , srv1127428437:86 , srv1567196843:86 , srv1674845468:86 , srv1719996273:86 , srv1798561625:86 , srv1822352762:86 , srv445268130:86 , srv598874462:86 , srv627350956:86 , srv695611139:86 , srv736534221:86 , srv858062474:86 , srv1066541860:87 , srv1158328825:87 , srv12377290:87 , srv1493208182:87 , srv1737464731:87 , srv1788301523:87 , srv2131500433:87 , srv442918450:87 , srv580216475:87 , srv608181065:87 , srv745674765:87 , srv764555555:87 , srv797973419:87 , srv883562532:87 , srv906595069:87 , srv922724332:87 , srv1427112161:88 , srv1524868328:88 , srv158676231:88 , srv680869923:88 , srv714357942:88 , srv906750042:88 , srv1040821542:89 , srv156332005:89 , srv1596735302:89 , srv1800841416:89 , srv1853520375:89 , srv1883595041:89 , srv1895710110:89 , srv496450722:89 , srv581767832:89 , srv968813954:89 , srv1077761739:90 , srv1814892048:90 , srv672976301:90 , srv1625434641:91 , srv1644053969:91 , srv424042701:91 , srv1579213478:92 , srv971610107:528 }
2023-02-07 15:53:07,451 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-02-07 15:53:07,452 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv158676231=30, srv1334270310=16, srv273123110=54, srv1861046226=46, srv1427112161=21, srv32263345=55, srv445268130=62, srv797973419=85, srv1814892048=42, srv627350956=70, srv1788301523=39, srv742920435=82, srv1724231084=37, srv1737464731=38, srv1883595041=48, srv1579213478=29, srv1127428437=8, srv1029378744=1, srv1361797144=19, srv1567196843=28, srv1950691326=50, srv2061051712=52, srv1870792414=47, srv810697547=87, srv1719996273=36, srv2131500433=53, srv1121836540=6, srv858062474=89, srv1546877555=26, srv1644053969=33, srv1134614971=10, srv47727842=63, srv695611139=75, srv679015266=72, srv714357942=77, srv698556870=76, srv581767832=67, srv693798349=74, srv994232802=99, srv1348382581=18, srv1524868328=24, srv598874462=68, srv971610107=98, srv1535696138=25, srv906750042=95, srv2060600009=51, srv1815439903=43, srv745674765=83, srv1068261583=4, srv718194271=78, srv1006750976=0, srv680869923=73, srv1299321113=15, srv73452990=80, srv1493208182=22, srv1501630059=23, srv968813954=97, srv845937488=88, srv1853520375=45, srv1674845468=35, srv1798561625=40, srv608181065=69, srv1596735302=31, srv1822352762=44, srv1077761739=5, srv802204981=86, srv156332005=27, srv1800841416=41, srv1126181508=7, srv901526776=93, srv536939665=65, srv1386587692=20, srv356315279=58, srv922724332=96, srv1158328825=12, srv1659025270=34, srv442764464=60, srv580216475=66, srv883562532=92, srv1180467694=13, srv496450722=64, srv764555555=84, srv33490253=57, srv12377290=14, srv333987595=56, srv906595069=94, srv732069540=79, srv442918450=61, srv424042701=59, srv736534221=81, srv1066541860=3, srv1341299437=17, srv1895710110=49, srv1625434641=32, srv1134429714=9, srv1040821542=2, srv1150532701=11, srv862835039=90, srv672976301=71, srv864789136=91} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-02-07 15:53:07,466 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-02-07 15:53:07,466 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-02-07 15:53:07,466 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-02-07 15:53:07,466 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-02-07 15:53:07,466 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-02-07 15:53:07,466 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-02-07 15:53:07,466 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-02-07 15:53:07,466 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-02-07 15:53:07,466 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-02-07 15:53:07,467 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-02-07 15:53:07,467 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-02-07 15:53:07,467 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-02-07 15:53:07,467 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-02-07 15:53:07,467 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-02-07 15:53:07,467 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-02-07 15:53:07,467 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-02-07 15:53:07,467 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-02-07 15:53:07,467 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-02-07 15:53:07,467 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-02-07 15:53:07,467 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-02-07 15:53:07,467 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-02-07 15:53:07,467 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-02-07 15:53:07,467 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-02-07 15:53:07,467 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-02-07 15:53:07,468 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-02-07 15:53:07,468 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-02-07 15:53:07,468 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-02-07 15:53:07,468 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-02-07 15:53:07,468 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-02-07 15:53:07,468 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-02-07 15:53:07,468 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-02-07 15:53:07,468 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-02-07 15:53:07,468 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-02-07 15:53:07,468 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-02-07 15:53:07,468 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-02-07 15:53:07,468 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-02-07 15:53:07,468 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-02-07 15:53:07,468 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-02-07 15:53:07,468 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-02-07 15:53:07,469 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-02-07 15:53:07,469 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-02-07 15:53:07,469 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-02-07 15:53:07,469 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-02-07 15:53:07,469 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-02-07 15:53:07,469 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-02-07 15:53:07,469 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-02-07 15:53:07,469 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-02-07 15:53:07,469 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-02-07 15:53:07,469 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-02-07 15:53:07,470 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-02-07 15:53:07,470 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-02-07 15:53:07,470 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-02-07 15:53:07,470 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-02-07 15:53:07,470 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-02-07 15:53:07,470 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-02-07 15:53:07,470 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-02-07 15:53:07,470 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-02-07 15:53:07,470 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-02-07 15:53:07,471 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-02-07 15:53:07,471 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-02-07 15:53:07,471 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-02-07 15:53:07,471 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-02-07 15:53:07,471 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-02-07 15:53:07,471 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-02-07 15:53:07,471 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-02-07 15:53:07,471 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-02-07 15:53:07,472 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-02-07 15:53:07,472 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-02-07 15:53:07,472 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-02-07 15:53:07,472 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-02-07 15:53:07,472 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-02-07 15:53:07,472 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-02-07 15:53:07,472 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-02-07 15:53:07,472 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-02-07 15:53:07,472 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-02-07 15:53:07,473 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-02-07 15:53:07,473 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-02-07 15:53:07,473 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-02-07 15:53:07,473 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-02-07 15:53:07,473 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-02-07 15:53:07,473 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-02-07 15:53:07,473 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-02-07 15:53:07,473 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-02-07 15:53:07,473 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-02-07 15:53:07,474 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-02-07 15:53:07,474 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-02-07 15:53:07,474 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-02-07 15:53:07,474 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-02-07 15:53:07,474 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-02-07 15:53:07,474 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-02-07 15:53:07,474 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-02-07 15:53:07,474 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-02-07 15:53:07,474 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-02-07 15:53:07,474 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-02-07 15:53:07,474 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-02-07 15:53:07,474 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-02-07 15:53:07,474 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-02-07 15:53:07,474 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-02-07 15:53:07,474 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-02-07 15:53:07,475 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-02-07 15:53:07,475 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-02-07 15:53:07,581 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.02252653587562743); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.033390523330136375, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.02252653587562743); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.011916666666666667); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0415, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-02-07 15:53:07,582 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-02-07 15:53:07,582 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.014723242660723604, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.02252653587562743); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.033390523330136375, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.02252653587562743); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.011916666666666667); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0415, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-02-07 15:53:07,774 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 280 ms to try 5000 different iterations.  Found a solution that moves 978 regions; Going from a computed imbalance of 0.014723242660723604 to a new imbalance of 8.251428124819491E-4. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.006322977731057954); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.008355190191882916); MoveCostFunction : (multiplier=7.0, imbalance=0.10866666666666666, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.006322977731057954); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=4.166666666666667E-4); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.004166666666666667); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-02-07 15:53:07,776 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv680869923:81 , srv1040821542:82 , srv1427112161:82 , srv1625434641:82 , srv1883595041:82 , srv994232802:82 , srv1158328825:83 , srv1579213478:83 , srv158676231:83 , srv1644053969:83 , srv1737464731:83 , srv424042701:83 , srv445268130:83 , srv862835039:83 , srv1077761739:84 , srv1134614971:84 , srv1180467694:84 , srv12377290:84 , srv1341299437:84 , srv1493208182:84 , srv1596735302:84 , srv1674845468:84 , srv1814892048:84 , srv598874462:84 , srv695611139:84 , srv906595069:84 , srv1121836540:85 , srv1127428437:85 , srv1134429714:85 , srv1150532701:85 , srv1501630059:85 , srv1524868328:85 , srv1567196843:85 , srv1861046226:85 , srv2060600009:85 , srv2131500433:85 , srv33490253:85 , srv356315279:85 , srv581767832:85 , srv627350956:85 , srv672976301:85 , srv693798349:85 , srv714357942:85 , srv742920435:85 , srv797973419:85 , srv845937488:85 , srv906750042:85 , srv922724332:85 , srv968813954:85 , srv1029378744:86 , srv1068261583:86 , srv1126181508:86 , srv1348382581:86 , srv1535696138:86 , srv156332005:86 , srv1815439903:86 , srv1822352762:86 , srv1853520375:86 , srv1895710110:86 , srv1950691326:86 , srv442764464:86 , srv442918450:86 , srv47727842:86 , srv496450722:86 , srv608181065:86 , srv679015266:86 , srv718194271:86 , srv732069540:86 , srv745674765:86 , srv764555555:86 , srv883562532:86 , srv1006750976:87 , srv1066541860:87 , srv1334270310:87 , srv1546877555:87 , srv1659025270:87 , srv1719996273:87 , srv1724231084:87 , srv1798561625:87 , srv1800841416:87 , srv1870792414:87 , srv273123110:87 , srv32263345:87 , srv580216475:87 , srv698556870:87 , srv736534221:87 , srv810697547:87 , srv864789136:87 , srv901526776:87 , srv1386587692:88 , srv1788301523:88 , srv2061051712:88 , srv333987595:88 , srv802204981:88 , srv858062474:88 , srv1299321113:89 , srv1361797144:89 , srv536939665:89 , srv73452990:89 , srv971610107:540 }
2023-02-07 15:53:07,779 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-02-07 15:53:07,780 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv158676231=30, srv1334270310=16, srv273123110=54, srv1861046226=46, srv1427112161=21, srv32263345=55, srv445268130=62, srv797973419=85, srv1814892048=42, srv627350956=70, srv1788301523=39, srv742920435=82, srv1724231084=37, srv1737464731=38, srv1883595041=48, srv1579213478=29, srv1127428437=8, srv1029378744=1, srv1361797144=19, srv1567196843=28, srv1950691326=50, srv2061051712=52, srv1870792414=47, srv810697547=87, srv1719996273=36, srv2131500433=53, srv1121836540=6, srv858062474=89, srv1546877555=26, srv1644053969=33, srv1134614971=10, srv47727842=63, srv695611139=75, srv679015266=72, srv714357942=77, srv698556870=76, srv581767832=67, srv693798349=74, srv994232802=99, srv1348382581=18, srv1524868328=24, srv598874462=68, srv971610107=98, srv1535696138=25, srv906750042=95, srv2060600009=51, srv1815439903=43, srv745674765=83, srv1068261583=4, srv718194271=78, srv1006750976=0, srv680869923=73, srv1299321113=15, srv73452990=80, srv1493208182=22, srv1501630059=23, srv968813954=97, srv845937488=88, srv1853520375=45, srv1674845468=35, srv1798561625=40, srv608181065=69, srv1596735302=31, srv1822352762=44, srv1077761739=5, srv802204981=86, srv156332005=27, srv1800841416=41, srv1126181508=7, srv901526776=93, srv536939665=65, srv1386587692=20, srv356315279=58, srv922724332=96, srv1158328825=12, srv1659025270=34, srv442764464=60, srv580216475=66, srv883562532=92, srv1180467694=13, srv496450722=64, srv764555555=84, srv33490253=57, srv12377290=14, srv333987595=56, srv906595069=94, srv732069540=79, srv442918450=61, srv424042701=59, srv736534221=81, srv1066541860=3, srv1341299437=17, srv1895710110=49, srv1625434641=32, srv1134429714=9, srv1040821542=2, srv1150532701=11, srv862835039=90, srv672976301=71, srv864789136=91} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-02-07 15:53:07,789 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-02-07 15:53:07,789 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-02-07 15:53:07,789 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-02-07 15:53:07,789 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-02-07 15:53:07,789 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-02-07 15:53:07,789 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-02-07 15:53:07,789 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-02-07 15:53:07,790 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-02-07 15:53:07,790 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-02-07 15:53:07,790 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-02-07 15:53:07,790 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-02-07 15:53:07,790 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-02-07 15:53:07,790 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-02-07 15:53:07,790 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-02-07 15:53:07,790 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-02-07 15:53:07,790 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-02-07 15:53:07,790 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-02-07 15:53:07,790 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-02-07 15:53:07,790 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-02-07 15:53:07,790 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-02-07 15:53:07,790 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-02-07 15:53:07,790 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-02-07 15:53:07,791 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-02-07 15:53:07,791 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-02-07 15:53:07,791 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-02-07 15:53:07,791 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-02-07 15:53:07,791 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-02-07 15:53:07,791 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-02-07 15:53:07,791 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-02-07 15:53:07,791 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-02-07 15:53:07,791 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-02-07 15:53:07,791 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-02-07 15:53:07,792 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-02-07 15:53:07,792 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-02-07 15:53:07,792 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-02-07 15:53:07,792 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-02-07 15:53:07,792 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-02-07 15:53:07,792 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-02-07 15:53:07,792 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-02-07 15:53:07,792 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-02-07 15:53:07,792 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-02-07 15:53:07,792 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-02-07 15:53:07,792 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-02-07 15:53:07,792 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-02-07 15:53:07,792 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-02-07 15:53:07,792 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-02-07 15:53:07,792 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-02-07 15:53:07,793 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-02-07 15:53:07,793 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-02-07 15:53:07,793 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-02-07 15:53:07,793 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-02-07 15:53:07,793 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-02-07 15:53:07,793 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-02-07 15:53:07,793 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-02-07 15:53:07,793 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-02-07 15:53:07,793 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-02-07 15:53:07,793 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-02-07 15:53:07,793 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-02-07 15:53:07,793 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-02-07 15:53:07,793 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-02-07 15:53:07,793 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-02-07 15:53:07,793 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-02-07 15:53:07,793 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-02-07 15:53:07,794 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-02-07 15:53:07,794 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-02-07 15:53:07,794 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-02-07 15:53:07,794 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-02-07 15:53:07,794 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-02-07 15:53:07,794 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-02-07 15:53:07,794 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-02-07 15:53:07,794 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-02-07 15:53:07,794 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-02-07 15:53:07,794 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-02-07 15:53:07,794 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-02-07 15:53:07,794 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-02-07 15:53:07,794 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-02-07 15:53:07,794 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-02-07 15:53:07,794 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-02-07 15:53:07,794 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-02-07 15:53:07,794 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-02-07 15:53:07,795 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-02-07 15:53:07,795 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-02-07 15:53:07,795 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-02-07 15:53:07,795 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-02-07 15:53:07,795 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-02-07 15:53:07,795 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-02-07 15:53:07,795 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-02-07 15:53:07,795 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-02-07 15:53:07,795 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-02-07 15:53:07,795 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-02-07 15:53:07,795 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-02-07 15:53:07,795 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-02-07 15:53:07,795 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-02-07 15:53:07,795 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-02-07 15:53:07,795 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-02-07 15:53:07,795 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-02-07 15:53:07,795 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-02-07 15:53:07,795 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-02-07 15:53:07,796 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-02-07 15:53:07,796 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-02-07 15:53:07,796 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-02-07 15:53:07,884 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.006322977731057954); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.008355190191882916); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.006322977731057954); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=4.166666666666667E-4); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.004166666666666667); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-02-07 15:53:07,885 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-02-07 15:53:07,885 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=8.182947101145224E-4, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.006322977731057954); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.008355190191882916); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.006322977731057954); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=4.166666666666667E-4); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.004166666666666667); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-02-07 15:53:08,135 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 331 ms to try 5000 different iterations.  Found a solution that moves 257 regions; Going from a computed imbalance of 8.182947101145224E-4 to a new imbalance of 6.428704493565836E-5. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=4.737793696791342E-4); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0017082358106351274); MoveCostFunction : (multiplier=7.0, imbalance=0.028555555555555556, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=4.737793696791342E-4); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=5.833333333333334E-4); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-02-07 15:53:08,136 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1546877555:83 , srv1625434641:83 , srv1822352762:83 , srv580216475:83 , srv1006750976:84 , srv1029378744:84 , srv1040821542:84 , srv1066541860:84 , srv1068261583:84 , srv1077761739:84 , srv1126181508:84 , srv1299321113:84 , srv1341299437:84 , srv1386587692:84 , srv1427112161:84 , srv1493208182:84 , srv1579213478:84 , srv1659025270:84 , srv1724231084:84 , srv1798561625:84 , srv1800841416:84 , srv1861046226:84 , srv1883595041:84 , srv1895710110:84 , srv2061051712:84 , srv2131500433:84 , srv32263345:84 , srv356315279:84 , srv445268130:84 , srv47727842:84 , srv496450722:84 , srv536939665:84 , srv598874462:84 , srv714357942:84 , srv732069540:84 , srv736534221:84 , srv742920435:84 , srv745674765:84 , srv797973419:84 , srv802204981:84 , srv810697547:84 , srv845937488:84 , srv858062474:84 , srv922724332:84 , srv1121836540:85 , srv1134429714:85 , srv1134614971:85 , srv1150532701:85 , srv1158328825:85 , srv1180467694:85 , srv1334270310:85 , srv1348382581:85 , srv1361797144:85 , srv1501630059:85 , srv1524868328:85 , srv156332005:85 , srv1567196843:85 , srv158676231:85 , srv1596735302:85 , srv1644053969:85 , srv1674845468:85 , srv1719996273:85 , srv1737464731:85 , srv1788301523:85 , srv1814892048:85 , srv1815439903:85 , srv1853520375:85 , srv1870792414:85 , srv1950691326:85 , srv2060600009:85 , srv273123110:85 , srv333987595:85 , srv33490253:85 , srv424042701:85 , srv442764464:85 , srv442918450:85 , srv581767832:85 , srv608181065:85 , srv627350956:85 , srv679015266:85 , srv680869923:85 , srv693798349:85 , srv695611139:85 , srv698556870:85 , srv718194271:85 , srv73452990:85 , srv764555555:85 , srv862835039:85 , srv864789136:85 , srv901526776:85 , srv906595069:85 , srv906750042:85 , srv968813954:85 , srv994232802:85 , srv1127428437:86 , srv12377290:86 , srv1535696138:86 , srv672976301:86 , srv883562532:86 , srv971610107:628 }
2023-02-07 15:53:08,140 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-02-07 15:53:08,141 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv158676231=30, srv1334270310=16, srv273123110=54, srv1861046226=46, srv1427112161=21, srv32263345=55, srv445268130=62, srv797973419=85, srv1814892048=42, srv627350956=70, srv1788301523=39, srv742920435=82, srv1724231084=37, srv1737464731=38, srv1883595041=48, srv1579213478=29, srv1127428437=8, srv1029378744=1, srv1361797144=19, srv1567196843=28, srv1950691326=50, srv2061051712=52, srv1870792414=47, srv810697547=87, srv1719996273=36, srv2131500433=53, srv1121836540=6, srv858062474=89, srv1546877555=26, srv1644053969=33, srv1134614971=10, srv47727842=63, srv695611139=75, srv679015266=72, srv714357942=77, srv698556870=76, srv581767832=67, srv693798349=74, srv994232802=99, srv1348382581=18, srv1524868328=24, srv598874462=68, srv971610107=98, srv1535696138=25, srv906750042=95, srv2060600009=51, srv1815439903=43, srv745674765=83, srv1068261583=4, srv718194271=78, srv1006750976=0, srv680869923=73, srv1299321113=15, srv73452990=80, srv1493208182=22, srv1501630059=23, srv968813954=97, srv845937488=88, srv1853520375=45, srv1674845468=35, srv1798561625=40, srv608181065=69, srv1596735302=31, srv1822352762=44, srv1077761739=5, srv802204981=86, srv156332005=27, srv1800841416=41, srv1126181508=7, srv901526776=93, srv536939665=65, srv1386587692=20, srv356315279=58, srv922724332=96, srv1158328825=12, srv1659025270=34, srv442764464=60, srv580216475=66, srv883562532=92, srv1180467694=13, srv496450722=64, srv764555555=84, srv33490253=57, srv12377290=14, srv333987595=56, srv906595069=94, srv732069540=79, srv442918450=61, srv424042701=59, srv736534221=81, srv1066541860=3, srv1341299437=17, srv1895710110=49, srv1625434641=32, srv1134429714=9, srv1040821542=2, srv1150532701=11, srv862835039=90, srv672976301=71, srv864789136=91} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-02-07 15:53:08,149 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-02-07 15:53:08,149 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-02-07 15:53:08,149 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-02-07 15:53:08,149 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-02-07 15:53:08,149 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-02-07 15:53:08,149 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-02-07 15:53:08,149 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-02-07 15:53:08,149 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-02-07 15:53:08,149 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-02-07 15:53:08,149 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-02-07 15:53:08,149 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-02-07 15:53:08,149 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-02-07 15:53:08,149 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-02-07 15:53:08,150 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-02-07 15:53:08,150 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-02-07 15:53:08,150 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-02-07 15:53:08,150 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-02-07 15:53:08,150 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-02-07 15:53:08,150 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-02-07 15:53:08,150 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-02-07 15:53:08,150 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-02-07 15:53:08,150 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-02-07 15:53:08,150 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-02-07 15:53:08,150 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-02-07 15:53:08,150 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-02-07 15:53:08,150 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-02-07 15:53:08,150 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-02-07 15:53:08,150 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-02-07 15:53:08,150 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-02-07 15:53:08,150 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-02-07 15:53:08,150 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-02-07 15:53:08,150 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-02-07 15:53:08,150 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-02-07 15:53:08,151 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-02-07 15:53:08,151 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-02-07 15:53:08,151 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-02-07 15:53:08,151 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-02-07 15:53:08,151 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-02-07 15:53:08,151 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-02-07 15:53:08,151 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-02-07 15:53:08,151 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-02-07 15:53:08,151 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-02-07 15:53:08,151 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-02-07 15:53:08,151 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-02-07 15:53:08,151 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-02-07 15:53:08,151 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-02-07 15:53:08,151 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-02-07 15:53:08,151 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-02-07 15:53:08,151 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-02-07 15:53:08,151 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-02-07 15:53:08,151 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-02-07 15:53:08,152 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-02-07 15:53:08,152 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-02-07 15:53:08,152 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-02-07 15:53:08,152 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-02-07 15:53:08,152 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-02-07 15:53:08,152 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-02-07 15:53:08,152 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-02-07 15:53:08,152 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-02-07 15:53:08,152 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-02-07 15:53:08,152 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-02-07 15:53:08,152 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-02-07 15:53:08,152 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-02-07 15:53:08,152 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-02-07 15:53:08,152 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-02-07 15:53:08,152 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-02-07 15:53:08,152 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-02-07 15:53:08,152 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-02-07 15:53:08,153 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-02-07 15:53:08,153 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-02-07 15:53:08,153 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-02-07 15:53:08,153 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-02-07 15:53:08,153 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-02-07 15:53:08,153 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-02-07 15:53:08,153 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-02-07 15:53:08,153 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-02-07 15:53:08,153 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-02-07 15:53:08,153 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-02-07 15:53:08,153 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-02-07 15:53:08,153 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-02-07 15:53:08,153 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-02-07 15:53:08,154 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-02-07 15:53:08,154 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-02-07 15:53:08,154 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-02-07 15:53:08,154 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-02-07 15:53:08,154 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-02-07 15:53:08,154 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-02-07 15:53:08,154 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-02-07 15:53:08,154 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-02-07 15:53:08,154 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-02-07 15:53:08,154 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-02-07 15:53:08,154 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-02-07 15:53:08,154 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-02-07 15:53:08,154 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-02-07 15:53:08,154 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-02-07 15:53:08,154 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-02-07 15:53:08,154 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-02-07 15:53:08,154 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-02-07 15:53:08,154 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-02-07 15:53:08,154 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-02-07 15:53:08,155 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-02-07 15:53:08,233 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=4.737793696791342E-4); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0017082358106351274); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=4.737793696791342E-4); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=5.833333333333334E-4); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-02-07 15:53:08,233 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-02-07 15:53:08,233 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=6.248749247305233E-5, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=4.737793696791342E-4); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0017082358106351274); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=4.737793696791342E-4); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=5.833333333333334E-4); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-02-07 15:53:08,419 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 258 ms to try 5000 different iterations.  Found a solution that moves 31 regions; Going from a computed imbalance of 6.248749247305233E-5 to a new imbalance of 6.615052311728012E-6. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0014213381090374027); MoveCostFunction : (multiplier=7.0, imbalance=0.0034444444444444444); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-02-07 15:53:08,419 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv12377290:83 , srv1535696138:83 , srv156332005:83 , srv1853520375:83 , srv2060600009:83 , srv2131500433:83 , srv672976301:83 , srv73452990:83 , srv901526776:83 , srv1006750976:84 , srv1029378744:84 , srv1066541860:84 , srv1068261583:84 , srv1077761739:84 , srv1121836540:84 , srv1126181508:84 , srv1127428437:84 , srv1134429714:84 , srv1150532701:84 , srv1158328825:84 , srv1180467694:84 , srv1299321113:84 , srv1334270310:84 , srv1341299437:84 , srv1348382581:84 , srv1361797144:84 , srv1386587692:84 , srv1427112161:84 , srv1501630059:84 , srv1524868328:84 , srv1546877555:84 , srv1567196843:84 , srv1579213478:84 , srv158676231:84 , srv1596735302:84 , srv1644053969:84 , srv1659025270:84 , srv1674845468:84 , srv1719996273:84 , srv1724231084:84 , srv1737464731:84 , srv1788301523:84 , srv1798561625:84 , srv1800841416:84 , srv1814892048:84 , srv1815439903:84 , srv1822352762:84 , srv1870792414:84 , srv1883595041:84 , srv1895710110:84 , srv1950691326:84 , srv2061051712:84 , srv273123110:84 , srv32263345:84 , srv333987595:84 , srv33490253:84 , srv424042701:84 , srv442764464:84 , srv442918450:84 , srv445268130:84 , srv47727842:84 , srv496450722:84 , srv536939665:84 , srv581767832:84 , srv598874462:84 , srv608181065:84 , srv679015266:84 , srv680869923:84 , srv693798349:84 , srv695611139:84 , srv698556870:84 , srv714357942:84 , srv718194271:84 , srv732069540:84 , srv736534221:84 , srv742920435:84 , srv745674765:84 , srv764555555:84 , srv797973419:84 , srv810697547:84 , srv845937488:84 , srv858062474:84 , srv862835039:84 , srv864789136:84 , srv883562532:84 , srv906595069:84 , srv906750042:84 , srv922724332:84 , srv968813954:84 , srv994232802:84 , srv1040821542:85 , srv1134614971:85 , srv1493208182:85 , srv1625434641:85 , srv1861046226:85 , srv356315279:85 , srv580216475:85 , srv627350956:85 , srv802204981:85 , srv971610107:684 }
2023-02-07 15:53:08,423 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-02-07 15:53:08,423 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv158676231=30, srv1334270310=16, srv273123110=54, srv1861046226=46, srv1427112161=21, srv32263345=55, srv445268130=62, srv797973419=85, srv1814892048=42, srv627350956=70, srv1788301523=39, srv742920435=82, srv1724231084=37, srv1737464731=38, srv1883595041=48, srv1579213478=29, srv1127428437=8, srv1029378744=1, srv1361797144=19, srv1567196843=28, srv1950691326=50, srv2061051712=52, srv1870792414=47, srv810697547=87, srv1719996273=36, srv2131500433=53, srv1121836540=6, srv858062474=89, srv1546877555=26, srv1644053969=33, srv1134614971=10, srv47727842=63, srv695611139=75, srv679015266=72, srv714357942=77, srv698556870=76, srv581767832=67, srv693798349=74, srv994232802=99, srv1348382581=18, srv1524868328=24, srv598874462=68, srv971610107=98, srv1535696138=25, srv906750042=95, srv2060600009=51, srv1815439903=43, srv745674765=83, srv1068261583=4, srv718194271=78, srv1006750976=0, srv680869923=73, srv1299321113=15, srv73452990=80, srv1493208182=22, srv1501630059=23, srv968813954=97, srv845937488=88, srv1853520375=45, srv1674845468=35, srv1798561625=40, srv608181065=69, srv1596735302=31, srv1822352762=44, srv1077761739=5, srv802204981=86, srv156332005=27, srv1800841416=41, srv1126181508=7, srv901526776=93, srv536939665=65, srv1386587692=20, srv356315279=58, srv922724332=96, srv1158328825=12, srv1659025270=34, srv442764464=60, srv580216475=66, srv883562532=92, srv1180467694=13, srv496450722=64, srv764555555=84, srv33490253=57, srv12377290=14, srv333987595=56, srv906595069=94, srv732069540=79, srv442918450=61, srv424042701=59, srv736534221=81, srv1066541860=3, srv1341299437=17, srv1895710110=49, srv1625434641=32, srv1134429714=9, srv1040821542=2, srv1150532701=11, srv862835039=90, srv672976301=71, srv864789136=91} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-02-07 15:53:08,432 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-02-07 15:53:08,432 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-02-07 15:53:08,432 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-02-07 15:53:08,432 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-02-07 15:53:08,432 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-02-07 15:53:08,432 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-02-07 15:53:08,432 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-02-07 15:53:08,432 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-02-07 15:53:08,432 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-02-07 15:53:08,433 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-02-07 15:53:08,433 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-02-07 15:53:08,433 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-02-07 15:53:08,433 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-02-07 15:53:08,433 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-02-07 15:53:08,433 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-02-07 15:53:08,433 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-02-07 15:53:08,433 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-02-07 15:53:08,433 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-02-07 15:53:08,433 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-02-07 15:53:08,433 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-02-07 15:53:08,433 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-02-07 15:53:08,433 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-02-07 15:53:08,433 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-02-07 15:53:08,433 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-02-07 15:53:08,433 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-02-07 15:53:08,433 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-02-07 15:53:08,433 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-02-07 15:53:08,433 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-02-07 15:53:08,433 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-02-07 15:53:08,434 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-02-07 15:53:08,434 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-02-07 15:53:08,434 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-02-07 15:53:08,434 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-02-07 15:53:08,434 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-02-07 15:53:08,434 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-02-07 15:53:08,434 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-02-07 15:53:08,434 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-02-07 15:53:08,434 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-02-07 15:53:08,434 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-02-07 15:53:08,434 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-02-07 15:53:08,434 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-02-07 15:53:08,434 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-02-07 15:53:08,434 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-02-07 15:53:08,434 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-02-07 15:53:08,434 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-02-07 15:53:08,434 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-02-07 15:53:08,434 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-02-07 15:53:08,434 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-02-07 15:53:08,434 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-02-07 15:53:08,434 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-02-07 15:53:08,435 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-02-07 15:53:08,435 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-02-07 15:53:08,435 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-02-07 15:53:08,435 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-02-07 15:53:08,435 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-02-07 15:53:08,435 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-02-07 15:53:08,435 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-02-07 15:53:08,435 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-02-07 15:53:08,435 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-02-07 15:53:08,435 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-02-07 15:53:08,435 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-02-07 15:53:08,435 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-02-07 15:53:08,435 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-02-07 15:53:08,435 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-02-07 15:53:08,435 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-02-07 15:53:08,435 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-02-07 15:53:08,435 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-02-07 15:53:08,435 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-02-07 15:53:08,435 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-02-07 15:53:08,435 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-02-07 15:53:08,436 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-02-07 15:53:08,436 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-02-07 15:53:08,436 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-02-07 15:53:08,436 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-02-07 15:53:08,436 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-02-07 15:53:08,436 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-02-07 15:53:08,436 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-02-07 15:53:08,436 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-02-07 15:53:08,436 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-02-07 15:53:08,436 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-02-07 15:53:08,436 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-02-07 15:53:08,436 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-02-07 15:53:08,436 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-02-07 15:53:08,436 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-02-07 15:53:08,436 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-02-07 15:53:08,436 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-02-07 15:53:08,436 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-02-07 15:53:08,436 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-02-07 15:53:08,436 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-02-07 15:53:08,437 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-02-07 15:53:08,437 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-02-07 15:53:08,437 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-02-07 15:53:08,437 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-02-07 15:53:08,437 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-02-07 15:53:08,437 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-02-07 15:53:08,437 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-02-07 15:53:08,437 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-02-07 15:53:08,437 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-02-07 15:53:08,437 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-02-07 15:53:08,437 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-02-07 15:53:08,438 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-02-07 15:53:08,532 INFO  [Time-limited test] balancer.StochasticLoadBalancer(381): Cluster wide - skipping load balancing because weighted average imbalance=6.397985672269699E-6 <= threshold(0.025). If you want more aggressive balancing, either lower hbase.master.balancer.stochastic.minCostNeedBalance from 0.025 or increase the relative multiplier(s) of the specific cost function(s). functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0014213381090374027); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-02-07 15:53:08,533 INFO  [Time-limited test] balancer.BalancerTestBase(570): Mock Final balance: { srv12377290:83 , srv1535696138:83 , srv156332005:83 , srv1853520375:83 , srv2060600009:83 , srv2131500433:83 , srv672976301:83 , srv73452990:83 , srv901526776:83 , srv1006750976:84 , srv1029378744:84 , srv1066541860:84 , srv1068261583:84 , srv1077761739:84 , srv1121836540:84 , srv1126181508:84 , srv1127428437:84 , srv1134429714:84 , srv1150532701:84 , srv1158328825:84 , srv1180467694:84 , srv1299321113:84 , srv1334270310:84 , srv1341299437:84 , srv1348382581:84 , srv1361797144:84 , srv1386587692:84 , srv1427112161:84 , srv1501630059:84 , srv1524868328:84 , srv1546877555:84 , srv1567196843:84 , srv1579213478:84 , srv158676231:84 , srv1596735302:84 , srv1644053969:84 , srv1659025270:84 , srv1674845468:84 , srv1719996273:84 , srv1724231084:84 , srv1737464731:84 , srv1788301523:84 , srv1798561625:84 , srv1800841416:84 , srv1814892048:84 , srv1815439903:84 , srv1822352762:84 , srv1870792414:84 , srv1883595041:84 , srv1895710110:84 , srv1950691326:84 , srv2061051712:84 , srv273123110:84 , srv32263345:84 , srv333987595:84 , srv33490253:84 , srv424042701:84 , srv442764464:84 , srv442918450:84 , srv445268130:84 , srv47727842:84 , srv496450722:84 , srv536939665:84 , srv581767832:84 , srv598874462:84 , srv608181065:84 , srv679015266:84 , srv680869923:84 , srv693798349:84 , srv695611139:84 , srv698556870:84 , srv714357942:84 , srv718194271:84 , srv732069540:84 , srv736534221:84 , srv742920435:84 , srv745674765:84 , srv764555555:84 , srv797973419:84 , srv810697547:84 , srv845937488:84 , srv858062474:84 , srv862835039:84 , srv864789136:84 , srv883562532:84 , srv906595069:84 , srv906750042:84 , srv922724332:84 , srv968813954:84 , srv994232802:84 , srv1040821542:85 , srv1134614971:85 , srv1493208182:85 , srv1625434641:85 , srv1861046226:85 , srv356315279:85 , srv580216475:85 , srv627350956:85 , srv802204981:85 , srv971610107:684 }
2023-02-07 15:53:08,559 INFO  [Time-limited test] hbase.ResourceChecker(175): after: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnLargeClusterWithRacks Thread=10 (was 10), OpenFileDescriptor=260 (was 260), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=368 (was 368), ProcessCount=172 (was 174), AvailableMemoryMB=3818 (was 4484)
2023-02-07 15:53:08,569 INFO  [Time-limited test] hbase.ResourceChecker(147): before: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnMidClusterWithRacks Thread=10, OpenFileDescriptor=260, MaxFileDescriptor=60000, SystemLoadAverage=368, ProcessCount=172, AvailableMemoryMB=3817
2023-02-07 15:53:08,570 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2023-02-07 15:53:08,570 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=5000, runMaxSteps=true, stepsPerRegion=800, maxRunningTime=120000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 111077.0 etc.
2023-02-07 15:53:08,580 INFO  [Time-limited test] balancer.BalancerTestBase(547): Mock Cluster : { srv1022774784:84 , srv1071160225:84 , srv1111052907:84 , srv1123738525:84 , srv1139938843:84 , srv1180295298:84 , srv1245323863:84 , srv1260017924:84 , srv1334487586:84 , srv1371466006:84 , srv1411122312:84 , srv1644337782:84 , srv1915149900:84 , srv1938679882:84 , srv1940949198:84 , srv1957627028:84 , srv1987458631:84 , srv2005288650:84 , srv2045390831:84 , srv2136494366:84 , srv316394923:84 , srv34322672:84 , srv376713500:84 , srv636747976:84 , srv743457408:84 , srv783577185:84 , srv852268411:84 , srv886153021:84 , srv907195885:84 , srv1114636100:264 } [srvr=30 rgns=2700 avg=90.0 max=90 min=90]
2023-02-07 15:53:08,582 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-02-07 15:53:08,582 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1139938843=5, srv1915149900=13, srv376713500=23, srv1022774784=0, srv1644337782=12, srv1114636100=3, srv1334487586=9, srv1411122312=11, srv743457408=25, srv636747976=24, srv1245323863=7, srv1123738525=4, srv1111052907=2, srv1180295298=6, srv1260017924=8, srv1987458631=17, srv1957627028=16, srv316394923=21, srv1371466006=10, srv2005288650=18, srv2136494366=20, srv852268411=27, srv34322672=22, srv783577185=26, srv1938679882=14, srv2045390831=19, srv907195885=29, srv886153021=28, srv1940949198=15, srv1071160225=1} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-02-07 15:53:08,592 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-02-07 15:53:08,593 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-02-07 15:53:08,593 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-02-07 15:53:08,593 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-02-07 15:53:08,593 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-02-07 15:53:08,593 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-02-07 15:53:08,593 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-02-07 15:53:08,593 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-02-07 15:53:08,593 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-02-07 15:53:08,593 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-02-07 15:53:08,593 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-02-07 15:53:08,593 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-02-07 15:53:08,594 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-02-07 15:53:08,594 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-02-07 15:53:08,594 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-02-07 15:53:08,594 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-02-07 15:53:08,594 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-02-07 15:53:08,594 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-02-07 15:53:08,594 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-02-07 15:53:08,594 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-02-07 15:53:08,594 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-02-07 15:53:08,594 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-02-07 15:53:08,594 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-02-07 15:53:08,594 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-02-07 15:53:08,595 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-02-07 15:53:08,595 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-02-07 15:53:08,595 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-02-07 15:53:08,595 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-02-07 15:53:08,595 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-02-07 15:53:08,595 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-02-07 15:53:08,595 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=10, number of hosts=30, number of racks=4
2023-02-07 15:53:08,613 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=1.1076707191925896, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-02-07 15:53:08,613 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.9912532310184683, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=1.1076707191925896, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=64800000
2023-02-07 15:55:08,601 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 120001 ms to try 9401476 different iterations.  Found a solution that moves 1839 regions; Going from a computed imbalance of 0.9912532310184683 to a new imbalance of 4.292317741546655E-5. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); MoveCostFunction : (multiplier=7.0, imbalance=0.6811111111111111, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-02-07 15:55:08,607 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1022774784:90 , srv1071160225:90 , srv1111052907:90 , srv1114636100:90 , srv1123738525:90 , srv1139938843:90 , srv1180295298:90 , srv1245323863:90 , srv1260017924:90 , srv1334487586:90 , srv1371466006:90 , srv1411122312:90 , srv1644337782:90 , srv1915149900:90 , srv1938679882:90 , srv1940949198:90 , srv1957627028:90 , srv1987458631:90 , srv2005288650:90 , srv2045390831:90 , srv2136494366:90 , srv316394923:90 , srv34322672:90 , srv376713500:90 , srv636747976:90 , srv743457408:90 , srv783577185:90 , srv852268411:90 , srv886153021:90 , srv907195885:90 }
2023-02-07 15:55:08,609 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-02-07 15:55:08,609 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1139938843=5, srv1915149900=13, srv376713500=23, srv1022774784=0, srv1644337782=12, srv1114636100=3, srv1334487586=9, srv1411122312=11, srv743457408=25, srv636747976=24, srv1245323863=7, srv1123738525=4, srv1111052907=2, srv1180295298=6, srv1260017924=8, srv1987458631=17, srv1957627028=16, srv316394923=21, srv1371466006=10, srv2005288650=18, srv2136494366=20, srv852268411=27, srv34322672=22, srv783577185=26, srv1938679882=14, srv2045390831=19, srv907195885=29, srv886153021=28, srv1940949198=15, srv1071160225=1} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-02-07 15:55:08,611 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-02-07 15:55:08,612 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-02-07 15:55:08,612 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-02-07 15:55:08,612 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-02-07 15:55:08,612 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-02-07 15:55:08,612 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-02-07 15:55:08,612 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-02-07 15:55:08,612 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-02-07 15:55:08,612 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-02-07 15:55:08,612 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-02-07 15:55:08,612 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-02-07 15:55:08,612 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-02-07 15:55:08,612 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-02-07 15:55:08,612 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-02-07 15:55:08,612 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-02-07 15:55:08,612 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-02-07 15:55:08,612 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-02-07 15:55:08,612 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-02-07 15:55:08,612 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-02-07 15:55:08,612 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-02-07 15:55:08,612 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-02-07 15:55:08,613 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-02-07 15:55:08,613 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-02-07 15:55:08,613 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-02-07 15:55:08,613 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-02-07 15:55:08,613 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-02-07 15:55:08,613 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-02-07 15:55:08,613 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-02-07 15:55:08,613 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-02-07 15:55:08,613 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-02-07 15:55:08,613 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=10, number of hosts=30, number of racks=4
2023-02-07 15:55:08,622 INFO  [Time-limited test] balancer.StochasticLoadBalancer(381): Cluster wide - skipping load balancing because weighted average imbalance=0.0 <= threshold(0.025). If you want more aggressive balancing, either lower hbase.master.balancer.stochastic.minCostNeedBalance from 0.025 or increase the relative multiplier(s) of the specific cost function(s). functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-02-07 15:55:08,622 INFO  [Time-limited test] balancer.BalancerTestBase(570): Mock Final balance: { srv1022774784:90 , srv1071160225:90 , srv1111052907:90 , srv1114636100:90 , srv1123738525:90 , srv1139938843:90 , srv1180295298:90 , srv1245323863:90 , srv1260017924:90 , srv1334487586:90 , srv1371466006:90 , srv1411122312:90 , srv1644337782:90 , srv1915149900:90 , srv1938679882:90 , srv1940949198:90 , srv1957627028:90 , srv1987458631:90 , srv2005288650:90 , srv2045390831:90 , srv2136494366:90 , srv316394923:90 , srv34322672:90 , srv376713500:90 , srv636747976:90 , srv743457408:90 , srv783577185:90 , srv852268411:90 , srv886153021:90 , srv907195885:90 }
2023-02-07 15:55:08,632 INFO  [Time-limited test] hbase.ResourceChecker(175): after: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnMidClusterWithRacks Thread=9 (was 10), OpenFileDescriptor=260 (was 260), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=224 (was 368), ProcessCount=182 (was 172) - ProcessCount LEAK? -, AvailableMemoryMB=3097 (was 3817)