2023-04-10 23:54:41,613 INFO  [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks timeout: 13 mins
2023-04-10 23:54:41,861 WARN  [Time-limited test] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties
2023-04-10 23:54:41,951 INFO  [Time-limited test] metrics.MetricRegistriesLoader(60): Loaded MetricRegistries class org.apache.hadoop.hbase.metrics.impl.MetricRegistriesImpl
2023-04-10 23:54:41,999 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2023-04-10 23:54:42,005 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc.
2023-04-10 23:54:42,016 INFO  [Time-limited test] hbase.ResourceChecker(147): before: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnLargeClusterWithRacks Thread=10, OpenFileDescriptor=260, MaxFileDescriptor=60000, SystemLoadAverage=153, ProcessCount=168, AvailableMemoryMB=2443
2023-04-10 23:54:42,017 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2023-04-10 23:54:42,018 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=5000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=10000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc.
2023-04-10 23:54:42,125 INFO  [Time-limited test] balancer.BalancerTestBase(547): Mock Cluster : { srv1001090954:84 , srv1012199799:84 , srv1035977113:84 , srv1051871064:84 , srv1057268468:84 , srv1082991955:84 , srv1138675250:84 , srv1146924753:84 , srv1150984044:84 , srv1167119371:84 , srv1169158824:84 , srv1182012488:84 , srv1189315548:84 , srv119726837:84 , srv1202060849:84 , srv125456095:84 , srv1254837198:84 , srv1292400354:84 , srv1298980813:84 , srv1325958212:84 , srv1341384208:84 , srv1341514910:84 , srv1485637788:84 , srv1539590179:84 , srv1567348296:84 , srv1584153001:84 , srv1597693927:84 , srv1621102113:84 , srv1646517828:84 , srv1687276205:84 , srv1702903722:84 , srv1710797063:84 , srv1765344662:84 , srv1776016569:84 , srv1818752675:84 , srv186262916:84 , srv1872583462:84 , srv1891079877:84 , srv1901052913:84 , srv1949116293:84 , srv1970122744:84 , srv1983497747:84 , srv1991659057:84 , srv1996000814:84 , srv2007947432:84 , srv2055879652:84 , srv2086294142:84 , srv2100883543:84 , srv2110840322:84 , srv2138445348:84 , srv237829527:84 , srv243328706:84 , srv249535472:84 , srv264751667:84 , srv27317391:84 , srv285309009:84 , srv287633109:84 , srv338689237:84 , srv358636459:84 , srv373508334:84 , srv377976523:84 , srv383255708:84 , srv436419516:84 , srv446331625:84 , srv466245174:84 , srv466898725:84 , srv471263999:84 , srv489536567:84 , srv496835321:84 , srv499432309:84 , srv557582509:84 , srv577518904:84 , srv581522033:84 , srv588497622:84 , srv590816109:84 , srv614222414:84 , srv62496897:84 , srv637550001:84 , srv647117091:84 , srv657361059:84 , srv662986403:84 , srv679848880:84 , srv6841230:84 , srv709150185:84 , srv717618351:84 , srv725679109:84 , srv733834843:84 , srv748538255:84 , srv799263009:84 , srv814520874:84 , srv833909515:84 , srv850514005:84 , srv859335436:84 , srv885714435:84 , srv90256067:84 , srv917730367:84 , srv957472776:84 , srv96059211:84 , srv98269523:84 , srv1781285340:684 } [srvr=100 rgns=9000 avg=90.0 max=90 min=90]
2023-04-10 23:54:42,132 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-04-10 23:54:42,137 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1254837198=16, srv1167119371=9, srv709150185=84, srv377976523=61, srv446331625=64, srv1341514910=21, srv1949116293=40, srv249535472=53, srv1325958212=19, srv885714435=94, srv1341384208=20, srv285309009=56, srv373508334=60, srv859335436=93, srv264751667=54, srv590816109=75, srv2100883543=48, srv436419516=63, srv466245174=65, srv243328706=52, srv499432309=70, srv1051871064=3, srv1901052913=39, srv90256067=95, srv1970122744=41, srv1765344662=32, srv1001090954=0, srv1138675250=6, srv657361059=80, srv237829527=51, srv1983497747=42, srv1082991955=5, srv186262916=36, srv6841230=83, srv2110840322=49, srv1702903722=30, srv96059211=98, srv1292400354=17, srv383255708=62, srv799263009=89, srv1567348296=24, srv287633109=57, srv1182012488=11, srv662986403=81, srv833909515=91, srv679848880=82, srv717618351=85, srv338689237=58, srv62496897=77, srv2138445348=50, srv957472776=97, srv1781285340=34, srv2055879652=46, srv1150984044=8, srv125456095=15, srv1646517828=28, srv27317391=55, srv98269523=99, srv637550001=78, srv2086294142=47, srv725679109=86, srv1202060849=14, srv1891079877=38, srv814520874=90, srv733834843=87, srv466898725=66, srv1991659057=43, srv917730367=96, srv1872583462=37, srv1146924753=7, srv1687276205=29, srv2007947432=45, srv1012199799=1, srv1169158824=10, srv557582509=71, srv358636459=59, srv647117091=79, srv1298980813=18, srv496835321=69, srv588497622=74, srv1057268468=4, srv614222414=76, srv581522033=73, srv1584153001=25, srv1621102113=27, srv577518904=72, srv1035977113=2, srv1996000814=44, srv1485637788=22, srv850514005=92, srv119726837=13, srv1539590179=23, srv1597693927=26, srv1710797063=31, srv1776016569=33, srv1818752675=35, srv748538255=88, srv1189315548=12, srv471263999=67, srv489536567=68} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-04-10 23:54:42,216 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-04-10 23:54:42,216 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-04-10 23:54:42,216 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-04-10 23:54:42,216 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-04-10 23:54:42,216 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-04-10 23:54:42,217 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-04-10 23:54:42,217 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-04-10 23:54:42,217 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-04-10 23:54:42,217 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-04-10 23:54:42,217 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-04-10 23:54:42,217 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-04-10 23:54:42,217 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-04-10 23:54:42,217 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-04-10 23:54:42,217 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-04-10 23:54:42,217 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-04-10 23:54:42,218 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-04-10 23:54:42,218 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-04-10 23:54:42,218 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-04-10 23:54:42,218 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-04-10 23:54:42,218 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-04-10 23:54:42,218 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-04-10 23:54:42,218 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-04-10 23:54:42,218 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-04-10 23:54:42,218 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-04-10 23:54:42,218 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-04-10 23:54:42,219 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-04-10 23:54:42,219 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-04-10 23:54:42,219 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-04-10 23:54:42,219 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-04-10 23:54:42,219 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-04-10 23:54:42,219 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-04-10 23:54:42,219 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-04-10 23:54:42,219 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-04-10 23:54:42,219 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-04-10 23:54:42,219 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-04-10 23:54:42,219 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-04-10 23:54:42,220 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-04-10 23:54:42,220 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-04-10 23:54:42,220 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-04-10 23:54:42,220 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-04-10 23:54:42,220 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-04-10 23:54:42,220 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-04-10 23:54:42,220 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-04-10 23:54:42,220 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-04-10 23:54:42,220 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-04-10 23:54:42,220 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-04-10 23:54:42,220 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-04-10 23:54:42,221 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-04-10 23:54:42,221 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-04-10 23:54:42,221 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-04-10 23:54:42,221 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-04-10 23:54:42,221 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-04-10 23:54:42,221 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-04-10 23:54:42,221 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-04-10 23:54:42,221 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-04-10 23:54:42,221 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-04-10 23:54:42,222 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-04-10 23:54:42,222 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-04-10 23:54:42,222 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-04-10 23:54:42,222 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-04-10 23:54:42,222 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-04-10 23:54:42,222 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-04-10 23:54:42,222 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-04-10 23:54:42,222 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-04-10 23:54:42,222 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-04-10 23:54:42,222 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-04-10 23:54:42,222 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-04-10 23:54:42,223 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-04-10 23:54:42,223 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-04-10 23:54:42,223 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-04-10 23:54:42,223 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-04-10 23:54:42,223 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-04-10 23:54:42,223 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-04-10 23:54:42,223 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-04-10 23:54:42,223 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-04-10 23:54:42,223 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-04-10 23:54:42,223 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-04-10 23:54:42,223 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-04-10 23:54:42,224 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-04-10 23:54:42,224 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-04-10 23:54:42,224 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-04-10 23:54:42,224 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-04-10 23:54:42,224 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-04-10 23:54:42,224 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-04-10 23:54:42,224 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-04-10 23:54:42,224 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-04-10 23:54:42,224 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-04-10 23:54:42,224 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-04-10 23:54:42,224 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-04-10 23:54:42,225 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-04-10 23:54:42,225 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-04-10 23:54:42,225 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-04-10 23:54:42,225 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-04-10 23:54:42,225 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-04-10 23:54:42,225 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-04-10 23:54:42,225 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-04-10 23:54:42,225 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-04-10 23:54:42,225 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-04-10 23:54:42,225 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-04-10 23:54:42,225 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-04-10 23:54:42,225 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-04-10 23:54:42,374 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.06666666666666667, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-04-10 23:54:42,374 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-04-10 23:54:42,375 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.9909252140407105, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.06666666666666667, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-04-10 23:54:42,611 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 365 ms to try 5000 different iterations.  Found a solution that moves 4652 regions; Going from a computed imbalance of 0.9909252140407105 to a new imbalance of 0.1773191806767949. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.03724185789603644, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0584133650128223, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.5168888888888888, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.03724185789603644, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.17258333333333334, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.2385, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-04-10 23:54:42,621 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv27317391:82 , srv748538255:82 , srv1254837198:83 , srv1872583462:83 , srv285309009:83 , srv98269523:83 , srv1001090954:84 , srv1012199799:84 , srv1182012488:84 , srv1567348296:84 , srv1621102113:84 , srv383255708:84 , srv446331625:84 , srv637550001:84 , srv679848880:84 , srv833909515:84 , srv917730367:84 , srv1150984044:85 , srv1325958212:85 , srv1539590179:85 , srv186262916:85 , srv1901052913:85 , srv1970122744:85 , srv1983497747:85 , srv1996000814:85 , srv243328706:85 , srv614222414:85 , srv662986403:85 , srv717618351:85 , srv859335436:85 , srv1051871064:86 , srv1082991955:86 , srv1189315548:86 , srv1202060849:86 , srv1292400354:86 , srv1341514910:86 , srv1776016569:86 , srv2007947432:86 , srv2110840322:86 , srv2138445348:86 , srv237829527:86 , srv264751667:86 , srv466245174:86 , srv499432309:86 , srv577518904:86 , srv581522033:86 , srv590816109:86 , srv62496897:86 , srv657361059:86 , srv725679109:86 , srv733834843:86 , srv799263009:86 , srv1035977113:87 , srv1167119371:87 , srv1169158824:87 , srv119726837:87 , srv1584153001:87 , srv1597693927:87 , srv1646517828:87 , srv1891079877:87 , srv1991659057:87 , srv287633109:87 , srv338689237:87 , srv436419516:87 , srv496835321:87 , srv588497622:87 , srv6841230:87 , srv90256067:87 , srv96059211:87 , srv1146924753:88 , srv125456095:88 , srv1341384208:88 , srv1687276205:88 , srv1702903722:88 , srv1710797063:88 , srv1765344662:88 , srv1949116293:88 , srv2055879652:88 , srv2086294142:88 , srv2100883543:88 , srv373508334:88 , srv377976523:88 , srv471263999:88 , srv557582509:88 , srv647117091:88 , srv1485637788:89 , srv850514005:89 , srv1818752675:90 , srv466898725:90 , srv709150185:90 , srv885714435:90 , srv1057268468:91 , srv1138675250:91 , srv489536567:91 , srv957472776:92 , srv1298980813:93 , srv249535472:93 , srv358636459:93 , srv814520874:93 , srv1781285340:421 }
2023-04-10 23:54:42,625 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-04-10 23:54:42,625 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1254837198=16, srv1167119371=9, srv709150185=84, srv377976523=61, srv446331625=64, srv1341514910=21, srv1949116293=40, srv249535472=53, srv1325958212=19, srv885714435=94, srv1341384208=20, srv285309009=56, srv373508334=60, srv859335436=93, srv264751667=54, srv590816109=75, srv2100883543=48, srv436419516=63, srv466245174=65, srv243328706=52, srv499432309=70, srv1051871064=3, srv1901052913=39, srv90256067=95, srv1970122744=41, srv1765344662=32, srv1001090954=0, srv1138675250=6, srv657361059=80, srv237829527=51, srv1983497747=42, srv1082991955=5, srv186262916=36, srv6841230=83, srv2110840322=49, srv1702903722=30, srv96059211=98, srv1292400354=17, srv383255708=62, srv799263009=89, srv1567348296=24, srv287633109=57, srv1182012488=11, srv662986403=81, srv833909515=91, srv679848880=82, srv717618351=85, srv338689237=58, srv62496897=77, srv2138445348=50, srv957472776=97, srv1781285340=34, srv2055879652=46, srv1150984044=8, srv125456095=15, srv1646517828=28, srv27317391=55, srv98269523=99, srv637550001=78, srv2086294142=47, srv725679109=86, srv1202060849=14, srv1891079877=38, srv814520874=90, srv733834843=87, srv466898725=66, srv1991659057=43, srv917730367=96, srv1872583462=37, srv1146924753=7, srv1687276205=29, srv2007947432=45, srv1012199799=1, srv1169158824=10, srv557582509=71, srv358636459=59, srv647117091=79, srv1298980813=18, srv496835321=69, srv588497622=74, srv1057268468=4, srv614222414=76, srv581522033=73, srv1584153001=25, srv1621102113=27, srv577518904=72, srv1035977113=2, srv1996000814=44, srv1485637788=22, srv850514005=92, srv119726837=13, srv1539590179=23, srv1597693927=26, srv1710797063=31, srv1776016569=33, srv1818752675=35, srv748538255=88, srv1189315548=12, srv471263999=67, srv489536567=68} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-04-10 23:54:42,638 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-04-10 23:54:42,638 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-04-10 23:54:42,638 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-04-10 23:54:42,638 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-04-10 23:54:42,638 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-04-10 23:54:42,638 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-04-10 23:54:42,638 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-04-10 23:54:42,638 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-04-10 23:54:42,638 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-04-10 23:54:42,639 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-04-10 23:54:42,639 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-04-10 23:54:42,639 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-04-10 23:54:42,639 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-04-10 23:54:42,639 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-04-10 23:54:42,639 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-04-10 23:54:42,639 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-04-10 23:54:42,639 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-04-10 23:54:42,639 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-04-10 23:54:42,639 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-04-10 23:54:42,639 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-04-10 23:54:42,639 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-04-10 23:54:42,639 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-04-10 23:54:42,639 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-04-10 23:54:42,640 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-04-10 23:54:42,640 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-04-10 23:54:42,640 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-04-10 23:54:42,640 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-04-10 23:54:42,640 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-04-10 23:54:42,640 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-04-10 23:54:42,640 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-04-10 23:54:42,640 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-04-10 23:54:42,640 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-04-10 23:54:42,640 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-04-10 23:54:42,640 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-04-10 23:54:42,640 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-04-10 23:54:42,640 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-04-10 23:54:42,640 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-04-10 23:54:42,641 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-04-10 23:54:42,641 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-04-10 23:54:42,641 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-04-10 23:54:42,641 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-04-10 23:54:42,641 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-04-10 23:54:42,641 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-04-10 23:54:42,641 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-04-10 23:54:42,641 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-04-10 23:54:42,641 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-04-10 23:54:42,641 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-04-10 23:54:42,641 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-04-10 23:54:42,641 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-04-10 23:54:42,641 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-04-10 23:54:42,641 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-04-10 23:54:42,641 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-04-10 23:54:42,642 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-04-10 23:54:42,642 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-04-10 23:54:42,642 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-04-10 23:54:42,642 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-04-10 23:54:42,642 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-04-10 23:54:42,642 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-04-10 23:54:42,642 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-04-10 23:54:42,642 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-04-10 23:54:42,642 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-04-10 23:54:42,642 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-04-10 23:54:42,642 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-04-10 23:54:42,642 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-04-10 23:54:42,642 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-04-10 23:54:42,643 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-04-10 23:54:42,643 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-04-10 23:54:42,643 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-04-10 23:54:42,643 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-04-10 23:54:42,643 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-04-10 23:54:42,643 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-04-10 23:54:42,643 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-04-10 23:54:42,643 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-04-10 23:54:42,643 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-04-10 23:54:42,643 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-04-10 23:54:42,643 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-04-10 23:54:42,643 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-04-10 23:54:42,643 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-04-10 23:54:42,643 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-04-10 23:54:42,644 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-04-10 23:54:42,644 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-04-10 23:54:42,644 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-04-10 23:54:42,644 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-04-10 23:54:42,644 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-04-10 23:54:42,644 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-04-10 23:54:42,644 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-04-10 23:54:42,644 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-04-10 23:54:42,644 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-04-10 23:54:42,644 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-04-10 23:54:42,644 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-04-10 23:54:42,644 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-04-10 23:54:42,644 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-04-10 23:54:42,644 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-04-10 23:54:42,644 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-04-10 23:54:42,645 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-04-10 23:54:42,645 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-04-10 23:54:42,645 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-04-10 23:54:42,645 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-04-10 23:54:42,645 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-04-10 23:54:42,645 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-04-10 23:54:42,645 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-04-10 23:54:42,777 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.03724185789603644, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0584133650128223, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.03724185789603644, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.17258333333333334, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.2385, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-04-10 23:54:42,777 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-04-10 23:54:42,778 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.1772866066765768, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.03724185789603644, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0584133650128223, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.03724185789603644, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.17258333333333334, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.2385, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-04-10 23:54:42,977 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 314 ms to try 5000 different iterations.  Found a solution that moves 2716 regions; Going from a computed imbalance of 0.1772866066765768 to a new imbalance of 0.015030370544150925. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.020476308550903512); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.036255732160282106, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.30177777777777776, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.020476308550903512); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.011583333333333333); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.048, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-04-10 23:54:42,984 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1298980813:79 , srv1057268468:80 , srv358636459:80 , srv957472776:80 , srv249535472:81 , srv466898725:81 , srv709150185:81 , srv1687276205:82 , srv489536567:82 , srv814520874:82 , srv885714435:82 , srv1167119371:83 , srv1341384208:83 , srv1818752675:83 , srv471263999:83 , srv1138675250:84 , srv125456095:84 , srv1485637788:84 , srv1702903722:84 , srv1710797063:84 , srv1765344662:84 , srv1949116293:84 , srv2055879652:84 , srv2086294142:84 , srv2100883543:84 , srv377976523:84 , srv499432309:84 , srv557582509:84 , srv850514005:84 , srv96059211:84 , srv1146924753:85 , srv119726837:85 , srv1292400354:85 , srv1584153001:85 , srv1597693927:85 , srv1646517828:85 , srv1776016569:85 , srv1891079877:85 , srv1991659057:85 , srv2007947432:85 , srv2110840322:85 , srv2138445348:85 , srv373508334:85 , srv436419516:85 , srv581522033:85 , srv588497622:85 , srv62496897:85 , srv6841230:85 , srv725679109:85 , srv90256067:85 , srv1035977113:86 , srv1051871064:86 , srv1082991955:86 , srv1150984044:86 , srv1169158824:86 , srv1189315548:86 , srv1202060849:86 , srv1567348296:86 , srv1621102113:86 , srv1901052913:86 , srv264751667:86 , srv338689237:86 , srv496835321:86 , srv590816109:86 , srv614222414:86 , srv657361059:86 , srv717618351:86 , srv733834843:86 , srv859335436:86 , srv1001090954:87 , srv1182012488:87 , srv1325958212:87 , srv1341514910:87 , srv1539590179:87 , srv1996000814:87 , srv287633109:87 , srv577518904:87 , srv799263009:87 , srv833909515:87 , srv98269523:87 , srv1012199799:88 , srv1872583462:88 , srv237829527:88 , srv243328706:88 , srv383255708:88 , srv446331625:88 , srv637550001:88 , srv647117091:88 , srv679848880:88 , srv186262916:89 , srv1970122744:89 , srv466245174:89 , srv662986403:89 , srv917730367:89 , srv1254837198:90 , srv27317391:90 , srv285309009:90 , srv1983497747:92 , srv748538255:93 , srv1781285340:535 }
2023-04-10 23:54:42,988 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-04-10 23:54:42,988 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1254837198=16, srv1167119371=9, srv709150185=84, srv377976523=61, srv446331625=64, srv1341514910=21, srv1949116293=40, srv249535472=53, srv1325958212=19, srv885714435=94, srv1341384208=20, srv285309009=56, srv373508334=60, srv859335436=93, srv264751667=54, srv590816109=75, srv2100883543=48, srv436419516=63, srv466245174=65, srv243328706=52, srv499432309=70, srv1051871064=3, srv1901052913=39, srv90256067=95, srv1970122744=41, srv1765344662=32, srv1001090954=0, srv1138675250=6, srv657361059=80, srv237829527=51, srv1983497747=42, srv1082991955=5, srv186262916=36, srv6841230=83, srv2110840322=49, srv1702903722=30, srv96059211=98, srv1292400354=17, srv383255708=62, srv799263009=89, srv1567348296=24, srv287633109=57, srv1182012488=11, srv662986403=81, srv833909515=91, srv679848880=82, srv717618351=85, srv338689237=58, srv62496897=77, srv2138445348=50, srv957472776=97, srv1781285340=34, srv2055879652=46, srv1150984044=8, srv125456095=15, srv1646517828=28, srv27317391=55, srv98269523=99, srv637550001=78, srv2086294142=47, srv725679109=86, srv1202060849=14, srv1891079877=38, srv814520874=90, srv733834843=87, srv466898725=66, srv1991659057=43, srv917730367=96, srv1872583462=37, srv1146924753=7, srv1687276205=29, srv2007947432=45, srv1012199799=1, srv1169158824=10, srv557582509=71, srv358636459=59, srv647117091=79, srv1298980813=18, srv496835321=69, srv588497622=74, srv1057268468=4, srv614222414=76, srv581522033=73, srv1584153001=25, srv1621102113=27, srv577518904=72, srv1035977113=2, srv1996000814=44, srv1485637788=22, srv850514005=92, srv119726837=13, srv1539590179=23, srv1597693927=26, srv1710797063=31, srv1776016569=33, srv1818752675=35, srv748538255=88, srv1189315548=12, srv471263999=67, srv489536567=68} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-04-10 23:54:43,002 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-04-10 23:54:43,002 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-04-10 23:54:43,002 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-04-10 23:54:43,002 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-04-10 23:54:43,002 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-04-10 23:54:43,002 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-04-10 23:54:43,002 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-04-10 23:54:43,002 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-04-10 23:54:43,003 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-04-10 23:54:43,003 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-04-10 23:54:43,003 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-04-10 23:54:43,003 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-04-10 23:54:43,003 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-04-10 23:54:43,003 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-04-10 23:54:43,003 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-04-10 23:54:43,003 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-04-10 23:54:43,003 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-04-10 23:54:43,003 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-04-10 23:54:43,003 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-04-10 23:54:43,003 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-04-10 23:54:43,003 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-04-10 23:54:43,003 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-04-10 23:54:43,004 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-04-10 23:54:43,004 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-04-10 23:54:43,004 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-04-10 23:54:43,004 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-04-10 23:54:43,004 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-04-10 23:54:43,004 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-04-10 23:54:43,004 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-04-10 23:54:43,004 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-04-10 23:54:43,004 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-04-10 23:54:43,004 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-04-10 23:54:43,004 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-04-10 23:54:43,004 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-04-10 23:54:43,004 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-04-10 23:54:43,004 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-04-10 23:54:43,005 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-04-10 23:54:43,005 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-04-10 23:54:43,005 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-04-10 23:54:43,005 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-04-10 23:54:43,005 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-04-10 23:54:43,005 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-04-10 23:54:43,005 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-04-10 23:54:43,005 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-04-10 23:54:43,005 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-04-10 23:54:43,005 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-04-10 23:54:43,005 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-04-10 23:54:43,005 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-04-10 23:54:43,005 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-04-10 23:54:43,005 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-04-10 23:54:43,005 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-04-10 23:54:43,006 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-04-10 23:54:43,006 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-04-10 23:54:43,006 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-04-10 23:54:43,006 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-04-10 23:54:43,006 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-04-10 23:54:43,006 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-04-10 23:54:43,006 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-04-10 23:54:43,006 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-04-10 23:54:43,006 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-04-10 23:54:43,006 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-04-10 23:54:43,006 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-04-10 23:54:43,006 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-04-10 23:54:43,006 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-04-10 23:54:43,006 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-04-10 23:54:43,007 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-04-10 23:54:43,007 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-04-10 23:54:43,007 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-04-10 23:54:43,007 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-04-10 23:54:43,007 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-04-10 23:54:43,007 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-04-10 23:54:43,007 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-04-10 23:54:43,007 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-04-10 23:54:43,007 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-04-10 23:54:43,007 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-04-10 23:54:43,007 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-04-10 23:54:43,007 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-04-10 23:54:43,007 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-04-10 23:54:43,007 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-04-10 23:54:43,007 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-04-10 23:54:43,008 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-04-10 23:54:43,008 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-04-10 23:54:43,008 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-04-10 23:54:43,008 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-04-10 23:54:43,008 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-04-10 23:54:43,008 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-04-10 23:54:43,008 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-04-10 23:54:43,008 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-04-10 23:54:43,008 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-04-10 23:54:43,008 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-04-10 23:54:43,008 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-04-10 23:54:43,008 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-04-10 23:54:43,008 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-04-10 23:54:43,008 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-04-10 23:54:43,008 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-04-10 23:54:43,009 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-04-10 23:54:43,009 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-04-10 23:54:43,009 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-04-10 23:54:43,009 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-04-10 23:54:43,009 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-04-10 23:54:43,009 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-04-10 23:54:43,095 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.020476308550903512); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.036255732160282106, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.020476308550903512); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.011583333333333333); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.048, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-04-10 23:54:43,095 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-04-10 23:54:43,095 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.015011352705674512, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.020476308550903512); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.036255732160282106, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.020476308550903512); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.011583333333333333); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.048, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-04-10 23:54:43,260 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 236 ms to try 5000 different iterations.  Found a solution that moves 1024 regions; Going from a computed imbalance of 0.015011352705674512 to a new imbalance of 8.24817219186074E-4. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.005545445345984163); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.010709929101971124); MoveCostFunction : (multiplier=7.0, imbalance=0.11377777777777778, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.005545445345984163); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=5.0E-4); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.00325); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-04-10 23:54:43,261 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1983497747:81 , srv466245174:82 , srv1138675250:83 , srv186262916:83 , srv249535472:83 , srv647117091:83 , srv799263009:83 , srv814520874:83 , srv1254837198:84 , srv1818752675:84 , srv237829527:84 , srv285309009:84 , srv287633109:84 , srv489536567:84 , srv496835321:84 , srv662986403:84 , srv748538255:84 , srv917730367:84 , srv1012199799:85 , srv1035977113:85 , srv1051871064:85 , srv1082991955:85 , srv1146924753:85 , srv1169158824:85 , srv1298980813:85 , srv1325958212:85 , srv1341514910:85 , srv1485637788:85 , srv1584153001:85 , srv1597693927:85 , srv1646517828:85 , srv1702903722:85 , srv1710797063:85 , srv1765344662:85 , srv1891079877:85 , srv1949116293:85 , srv2055879652:85 , srv2100883543:85 , srv243328706:85 , srv264751667:85 , srv338689237:85 , srv358636459:85 , srv373508334:85 , srv377976523:85 , srv383255708:85 , srv436419516:85 , srv446331625:85 , srv577518904:85 , srv588497622:85 , srv637550001:85 , srv657361059:85 , srv679848880:85 , srv6841230:85 , srv850514005:85 , srv957472776:85 , srv1150984044:86 , srv1189315548:86 , srv119726837:86 , srv1202060849:86 , srv125456095:86 , srv1341384208:86 , srv1539590179:86 , srv1776016569:86 , srv1872583462:86 , srv1970122744:86 , srv1996000814:86 , srv2007947432:86 , srv2086294142:86 , srv2110840322:86 , srv2138445348:86 , srv27317391:86 , srv466898725:86 , srv471263999:86 , srv557582509:86 , srv590816109:86 , srv614222414:86 , srv709150185:86 , srv725679109:86 , srv733834843:86 , srv833909515:86 , srv885714435:86 , srv96059211:86 , srv1001090954:87 , srv1057268468:87 , srv1167119371:87 , srv1182012488:87 , srv1292400354:87 , srv1567348296:87 , srv1621102113:87 , srv1687276205:87 , srv1901052913:87 , srv1991659057:87 , srv581522033:87 , srv62496897:87 , srv717618351:87 , srv859335436:87 , srv90256067:87 , srv499432309:88 , srv98269523:88 , srv1781285340:551 }
2023-04-10 23:54:43,264 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-04-10 23:54:43,265 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1254837198=16, srv1167119371=9, srv709150185=84, srv377976523=61, srv446331625=64, srv1341514910=21, srv1949116293=40, srv249535472=53, srv1325958212=19, srv885714435=94, srv1341384208=20, srv285309009=56, srv373508334=60, srv859335436=93, srv264751667=54, srv590816109=75, srv2100883543=48, srv436419516=63, srv466245174=65, srv243328706=52, srv499432309=70, srv1051871064=3, srv1901052913=39, srv90256067=95, srv1970122744=41, srv1765344662=32, srv1001090954=0, srv1138675250=6, srv657361059=80, srv237829527=51, srv1983497747=42, srv1082991955=5, srv186262916=36, srv6841230=83, srv2110840322=49, srv1702903722=30, srv96059211=98, srv1292400354=17, srv383255708=62, srv799263009=89, srv1567348296=24, srv287633109=57, srv1182012488=11, srv662986403=81, srv833909515=91, srv679848880=82, srv717618351=85, srv338689237=58, srv62496897=77, srv2138445348=50, srv957472776=97, srv1781285340=34, srv2055879652=46, srv1150984044=8, srv125456095=15, srv1646517828=28, srv27317391=55, srv98269523=99, srv637550001=78, srv2086294142=47, srv725679109=86, srv1202060849=14, srv1891079877=38, srv814520874=90, srv733834843=87, srv466898725=66, srv1991659057=43, srv917730367=96, srv1872583462=37, srv1146924753=7, srv1687276205=29, srv2007947432=45, srv1012199799=1, srv1169158824=10, srv557582509=71, srv358636459=59, srv647117091=79, srv1298980813=18, srv496835321=69, srv588497622=74, srv1057268468=4, srv614222414=76, srv581522033=73, srv1584153001=25, srv1621102113=27, srv577518904=72, srv1035977113=2, srv1996000814=44, srv1485637788=22, srv850514005=92, srv119726837=13, srv1539590179=23, srv1597693927=26, srv1710797063=31, srv1776016569=33, srv1818752675=35, srv748538255=88, srv1189315548=12, srv471263999=67, srv489536567=68} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-04-10 23:54:43,274 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-04-10 23:54:43,274 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-04-10 23:54:43,274 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-04-10 23:54:43,275 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-04-10 23:54:43,275 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-04-10 23:54:43,275 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-04-10 23:54:43,275 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-04-10 23:54:43,275 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-04-10 23:54:43,275 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-04-10 23:54:43,275 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-04-10 23:54:43,275 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-04-10 23:54:43,275 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-04-10 23:54:43,275 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-04-10 23:54:43,275 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-04-10 23:54:43,275 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-04-10 23:54:43,275 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-04-10 23:54:43,275 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-04-10 23:54:43,275 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-04-10 23:54:43,275 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-04-10 23:54:43,275 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-04-10 23:54:43,275 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-04-10 23:54:43,276 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-04-10 23:54:43,276 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-04-10 23:54:43,276 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-04-10 23:54:43,276 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-04-10 23:54:43,276 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-04-10 23:54:43,276 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-04-10 23:54:43,276 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-04-10 23:54:43,276 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-04-10 23:54:43,276 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-04-10 23:54:43,276 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-04-10 23:54:43,276 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-04-10 23:54:43,276 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-04-10 23:54:43,276 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-04-10 23:54:43,276 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-04-10 23:54:43,276 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-04-10 23:54:43,276 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-04-10 23:54:43,277 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-04-10 23:54:43,277 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-04-10 23:54:43,277 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-04-10 23:54:43,277 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-04-10 23:54:43,277 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-04-10 23:54:43,277 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-04-10 23:54:43,277 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-04-10 23:54:43,277 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-04-10 23:54:43,277 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-04-10 23:54:43,277 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-04-10 23:54:43,277 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-04-10 23:54:43,277 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-04-10 23:54:43,277 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-04-10 23:54:43,277 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-04-10 23:54:43,277 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-04-10 23:54:43,277 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-04-10 23:54:43,278 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-04-10 23:54:43,278 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-04-10 23:54:43,278 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-04-10 23:54:43,278 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-04-10 23:54:43,278 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-04-10 23:54:43,278 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-04-10 23:54:43,278 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-04-10 23:54:43,278 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-04-10 23:54:43,278 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-04-10 23:54:43,278 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-04-10 23:54:43,278 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-04-10 23:54:43,278 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-04-10 23:54:43,278 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-04-10 23:54:43,278 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-04-10 23:54:43,279 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-04-10 23:54:43,279 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-04-10 23:54:43,279 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-04-10 23:54:43,279 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-04-10 23:54:43,279 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-04-10 23:54:43,279 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-04-10 23:54:43,279 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-04-10 23:54:43,279 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-04-10 23:54:43,279 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-04-10 23:54:43,279 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-04-10 23:54:43,279 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-04-10 23:54:43,279 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-04-10 23:54:43,279 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-04-10 23:54:43,279 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-04-10 23:54:43,279 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-04-10 23:54:43,279 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-04-10 23:54:43,279 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-04-10 23:54:43,280 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-04-10 23:54:43,280 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-04-10 23:54:43,280 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-04-10 23:54:43,280 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-04-10 23:54:43,280 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-04-10 23:54:43,280 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-04-10 23:54:43,280 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-04-10 23:54:43,280 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-04-10 23:54:43,280 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-04-10 23:54:43,280 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-04-10 23:54:43,280 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-04-10 23:54:43,280 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-04-10 23:54:43,280 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-04-10 23:54:43,280 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-04-10 23:54:43,280 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-04-10 23:54:43,280 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-04-10 23:54:43,281 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-04-10 23:54:43,364 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.005545445345984163); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.010709929101971124); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.005545445345984163); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=5.0E-4); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.00325); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-04-10 23:54:43,364 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-04-10 23:54:43,364 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=8.176470179342896E-4, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.005545445345984163); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.010709929101971124); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.005545445345984163); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=5.0E-4); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.00325); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-04-10 23:54:43,586 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 298 ms to try 5000 different iterations.  Found a solution that moves 265 regions; Going from a computed imbalance of 8.176470179342896E-4 to a new imbalance of 2.9171245848543342E-5. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=3.868392354571063E-4); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0023210354127426377); MoveCostFunction : (multiplier=7.0, imbalance=0.029444444444444443, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=3.868392354571063E-4); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.6666666666666666E-4); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-04-10 23:54:43,587 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1970122744:82 , srv748538255:82 , srv1138675250:83 , srv1991659057:83 , srv647117091:83 , srv885714435:83 , srv90256067:83 , srv1001090954:84 , srv1035977113:84 , srv1057268468:84 , srv1146924753:84 , srv1169158824:84 , srv1189315548:84 , srv119726837:84 , srv1202060849:84 , srv125456095:84 , srv1292400354:84 , srv1341514910:84 , srv1485637788:84 , srv1539590179:84 , srv1597693927:84 , srv1901052913:84 , srv1996000814:84 , srv2086294142:84 , srv243328706:84 , srv27317391:84 , srv287633109:84 , srv338689237:84 , srv358636459:84 , srv383255708:84 , srv436419516:84 , srv499432309:84 , srv557582509:84 , srv577518904:84 , srv581522033:84 , srv590816109:84 , srv62496897:84 , srv662986403:84 , srv717618351:84 , srv733834843:84 , srv814520874:84 , srv850514005:84 , srv859335436:84 , srv98269523:84 , srv1012199799:85 , srv1051871064:85 , srv1082991955:85 , srv1150984044:85 , srv1167119371:85 , srv1182012488:85 , srv1254837198:85 , srv1298980813:85 , srv1325958212:85 , srv1567348296:85 , srv1584153001:85 , srv1621102113:85 , srv1646517828:85 , srv1687276205:85 , srv1702903722:85 , srv1710797063:85 , srv1765344662:85 , srv1818752675:85 , srv186262916:85 , srv1872583462:85 , srv1891079877:85 , srv1949116293:85 , srv1983497747:85 , srv2007947432:85 , srv2055879652:85 , srv2100883543:85 , srv2110840322:85 , srv2138445348:85 , srv237829527:85 , srv249535472:85 , srv264751667:85 , srv285309009:85 , srv373508334:85 , srv377976523:85 , srv446331625:85 , srv466245174:85 , srv466898725:85 , srv471263999:85 , srv489536567:85 , srv496835321:85 , srv588497622:85 , srv614222414:85 , srv637550001:85 , srv657361059:85 , srv679848880:85 , srv6841230:85 , srv709150185:85 , srv725679109:85 , srv833909515:85 , srv917730367:85 , srv957472776:85 , srv96059211:85 , srv1341384208:86 , srv1776016569:86 , srv799263009:86 , srv1781285340:635 }
2023-04-10 23:54:43,590 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-04-10 23:54:43,590 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1254837198=16, srv1167119371=9, srv709150185=84, srv377976523=61, srv446331625=64, srv1341514910=21, srv1949116293=40, srv249535472=53, srv1325958212=19, srv885714435=94, srv1341384208=20, srv285309009=56, srv373508334=60, srv859335436=93, srv264751667=54, srv590816109=75, srv2100883543=48, srv436419516=63, srv466245174=65, srv243328706=52, srv499432309=70, srv1051871064=3, srv1901052913=39, srv90256067=95, srv1970122744=41, srv1765344662=32, srv1001090954=0, srv1138675250=6, srv657361059=80, srv237829527=51, srv1983497747=42, srv1082991955=5, srv186262916=36, srv6841230=83, srv2110840322=49, srv1702903722=30, srv96059211=98, srv1292400354=17, srv383255708=62, srv799263009=89, srv1567348296=24, srv287633109=57, srv1182012488=11, srv662986403=81, srv833909515=91, srv679848880=82, srv717618351=85, srv338689237=58, srv62496897=77, srv2138445348=50, srv957472776=97, srv1781285340=34, srv2055879652=46, srv1150984044=8, srv125456095=15, srv1646517828=28, srv27317391=55, srv98269523=99, srv637550001=78, srv2086294142=47, srv725679109=86, srv1202060849=14, srv1891079877=38, srv814520874=90, srv733834843=87, srv466898725=66, srv1991659057=43, srv917730367=96, srv1872583462=37, srv1146924753=7, srv1687276205=29, srv2007947432=45, srv1012199799=1, srv1169158824=10, srv557582509=71, srv358636459=59, srv647117091=79, srv1298980813=18, srv496835321=69, srv588497622=74, srv1057268468=4, srv614222414=76, srv581522033=73, srv1584153001=25, srv1621102113=27, srv577518904=72, srv1035977113=2, srv1996000814=44, srv1485637788=22, srv850514005=92, srv119726837=13, srv1539590179=23, srv1597693927=26, srv1710797063=31, srv1776016569=33, srv1818752675=35, srv748538255=88, srv1189315548=12, srv471263999=67, srv489536567=68} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-04-10 23:54:43,599 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-04-10 23:54:43,599 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-04-10 23:54:43,599 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-04-10 23:54:43,599 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-04-10 23:54:43,599 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-04-10 23:54:43,599 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-04-10 23:54:43,599 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-04-10 23:54:43,599 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-04-10 23:54:43,599 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-04-10 23:54:43,600 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-04-10 23:54:43,600 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-04-10 23:54:43,600 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-04-10 23:54:43,600 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-04-10 23:54:43,600 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-04-10 23:54:43,600 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-04-10 23:54:43,600 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-04-10 23:54:43,600 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-04-10 23:54:43,600 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-04-10 23:54:43,600 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-04-10 23:54:43,600 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-04-10 23:54:43,600 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-04-10 23:54:43,600 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-04-10 23:54:43,600 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-04-10 23:54:43,600 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-04-10 23:54:43,600 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-04-10 23:54:43,600 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-04-10 23:54:43,600 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-04-10 23:54:43,601 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-04-10 23:54:43,601 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-04-10 23:54:43,601 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-04-10 23:54:43,601 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-04-10 23:54:43,601 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-04-10 23:54:43,601 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-04-10 23:54:43,601 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-04-10 23:54:43,601 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-04-10 23:54:43,601 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-04-10 23:54:43,601 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-04-10 23:54:43,601 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-04-10 23:54:43,601 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-04-10 23:54:43,601 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-04-10 23:54:43,601 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-04-10 23:54:43,601 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-04-10 23:54:43,601 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-04-10 23:54:43,601 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-04-10 23:54:43,601 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-04-10 23:54:43,602 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-04-10 23:54:43,602 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-04-10 23:54:43,602 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-04-10 23:54:43,602 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-04-10 23:54:43,602 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-04-10 23:54:43,602 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-04-10 23:54:43,602 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-04-10 23:54:43,602 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-04-10 23:54:43,602 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-04-10 23:54:43,602 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-04-10 23:54:43,602 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-04-10 23:54:43,602 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-04-10 23:54:43,602 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-04-10 23:54:43,602 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-04-10 23:54:43,602 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-04-10 23:54:43,602 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-04-10 23:54:43,602 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-04-10 23:54:43,602 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-04-10 23:54:43,603 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-04-10 23:54:43,603 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-04-10 23:54:43,603 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-04-10 23:54:43,603 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-04-10 23:54:43,603 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-04-10 23:54:43,603 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-04-10 23:54:43,603 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-04-10 23:54:43,603 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-04-10 23:54:43,603 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-04-10 23:54:43,603 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-04-10 23:54:43,603 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-04-10 23:54:43,603 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-04-10 23:54:43,603 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-04-10 23:54:43,603 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-04-10 23:54:43,604 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-04-10 23:54:43,604 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-04-10 23:54:43,604 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-04-10 23:54:43,604 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-04-10 23:54:43,604 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-04-10 23:54:43,604 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-04-10 23:54:43,604 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-04-10 23:54:43,604 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-04-10 23:54:43,604 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-04-10 23:54:43,604 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-04-10 23:54:43,604 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-04-10 23:54:43,604 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-04-10 23:54:43,604 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-04-10 23:54:43,604 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-04-10 23:54:43,604 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-04-10 23:54:43,604 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-04-10 23:54:43,604 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-04-10 23:54:43,605 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-04-10 23:54:43,605 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-04-10 23:54:43,605 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-04-10 23:54:43,605 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-04-10 23:54:43,605 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-04-10 23:54:43,605 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-04-10 23:54:43,605 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-04-10 23:54:43,689 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=3.868392354571063E-4); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0023210354127426377); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=3.868392354571063E-4); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.6666666666666666E-4); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-04-10 23:54:43,689 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-04-10 23:54:43,690 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=2.7315676188657752E-5, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=3.868392354571063E-4); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0023210354127426377); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=3.868392354571063E-4); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.6666666666666666E-4); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-04-10 23:54:43,837 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 221 ms to try 5000 different iterations.  Found a solution that moves 28 regions; Going from a computed imbalance of 2.7315676188657752E-5 to a new imbalance of 8.175750307519066E-6. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0017727200782610348); MoveCostFunction : (multiplier=7.0, imbalance=0.003111111111111111); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-04-10 23:54:43,837 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1182012488:83 , srv1341384208:83 , srv1776016569:83 , srv1983497747:83 , srv237829527:83 , srv373508334:83 , srv1001090954:84 , srv1012199799:84 , srv1035977113:84 , srv1051871064:84 , srv1057268468:84 , srv1082991955:84 , srv1146924753:84 , srv1150984044:84 , srv1167119371:84 , srv1169158824:84 , srv1189315548:84 , srv119726837:84 , srv1202060849:84 , srv125456095:84 , srv1254837198:84 , srv1292400354:84 , srv1298980813:84 , srv1325958212:84 , srv1341514910:84 , srv1485637788:84 , srv1539590179:84 , srv1567348296:84 , srv1584153001:84 , srv1621102113:84 , srv1646517828:84 , srv1687276205:84 , srv1702903722:84 , srv1710797063:84 , srv1765344662:84 , srv1818752675:84 , srv186262916:84 , srv1872583462:84 , srv1891079877:84 , srv1901052913:84 , srv1949116293:84 , srv1970122744:84 , srv1991659057:84 , srv1996000814:84 , srv2007947432:84 , srv2055879652:84 , srv2086294142:84 , srv2100883543:84 , srv2110840322:84 , srv2138445348:84 , srv243328706:84 , srv249535472:84 , srv264751667:84 , srv27317391:84 , srv285309009:84 , srv287633109:84 , srv338689237:84 , srv358636459:84 , srv377976523:84 , srv446331625:84 , srv466245174:84 , srv466898725:84 , srv471263999:84 , srv489536567:84 , srv496835321:84 , srv499432309:84 , srv557582509:84 , srv577518904:84 , srv581522033:84 , srv588497622:84 , srv590816109:84 , srv614222414:84 , srv62496897:84 , srv637550001:84 , srv647117091:84 , srv657361059:84 , srv662986403:84 , srv679848880:84 , srv6841230:84 , srv709150185:84 , srv717618351:84 , srv725679109:84 , srv733834843:84 , srv799263009:84 , srv814520874:84 , srv833909515:84 , srv850514005:84 , srv859335436:84 , srv90256067:84 , srv917730367:84 , srv957472776:84 , srv96059211:84 , srv98269523:84 , srv1138675250:85 , srv1597693927:85 , srv383255708:85 , srv436419516:85 , srv748538255:85 , srv885714435:85 , srv1781285340:684 }
2023-04-10 23:54:43,841 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-04-10 23:54:43,841 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1254837198=16, srv1167119371=9, srv709150185=84, srv377976523=61, srv446331625=64, srv1341514910=21, srv1949116293=40, srv249535472=53, srv1325958212=19, srv885714435=94, srv1341384208=20, srv285309009=56, srv373508334=60, srv859335436=93, srv264751667=54, srv590816109=75, srv2100883543=48, srv436419516=63, srv466245174=65, srv243328706=52, srv499432309=70, srv1051871064=3, srv1901052913=39, srv90256067=95, srv1970122744=41, srv1765344662=32, srv1001090954=0, srv1138675250=6, srv657361059=80, srv237829527=51, srv1983497747=42, srv1082991955=5, srv186262916=36, srv6841230=83, srv2110840322=49, srv1702903722=30, srv96059211=98, srv1292400354=17, srv383255708=62, srv799263009=89, srv1567348296=24, srv287633109=57, srv1182012488=11, srv662986403=81, srv833909515=91, srv679848880=82, srv717618351=85, srv338689237=58, srv62496897=77, srv2138445348=50, srv957472776=97, srv1781285340=34, srv2055879652=46, srv1150984044=8, srv125456095=15, srv1646517828=28, srv27317391=55, srv98269523=99, srv637550001=78, srv2086294142=47, srv725679109=86, srv1202060849=14, srv1891079877=38, srv814520874=90, srv733834843=87, srv466898725=66, srv1991659057=43, srv917730367=96, srv1872583462=37, srv1146924753=7, srv1687276205=29, srv2007947432=45, srv1012199799=1, srv1169158824=10, srv557582509=71, srv358636459=59, srv647117091=79, srv1298980813=18, srv496835321=69, srv588497622=74, srv1057268468=4, srv614222414=76, srv581522033=73, srv1584153001=25, srv1621102113=27, srv577518904=72, srv1035977113=2, srv1996000814=44, srv1485637788=22, srv850514005=92, srv119726837=13, srv1539590179=23, srv1597693927=26, srv1710797063=31, srv1776016569=33, srv1818752675=35, srv748538255=88, srv1189315548=12, srv471263999=67, srv489536567=68} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-04-10 23:54:43,850 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-04-10 23:54:43,850 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-04-10 23:54:43,850 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-04-10 23:54:43,851 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-04-10 23:54:43,851 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-04-10 23:54:43,851 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-04-10 23:54:43,851 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-04-10 23:54:43,851 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-04-10 23:54:43,851 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-04-10 23:54:43,851 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-04-10 23:54:43,851 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-04-10 23:54:43,851 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-04-10 23:54:43,851 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-04-10 23:54:43,851 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-04-10 23:54:43,851 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-04-10 23:54:43,851 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-04-10 23:54:43,851 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-04-10 23:54:43,851 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-04-10 23:54:43,851 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-04-10 23:54:43,851 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-04-10 23:54:43,851 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-04-10 23:54:43,851 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-04-10 23:54:43,852 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-04-10 23:54:43,852 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-04-10 23:54:43,852 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-04-10 23:54:43,852 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-04-10 23:54:43,852 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-04-10 23:54:43,852 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-04-10 23:54:43,852 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-04-10 23:54:43,852 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-04-10 23:54:43,852 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-04-10 23:54:43,852 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-04-10 23:54:43,852 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-04-10 23:54:43,852 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-04-10 23:54:43,852 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-04-10 23:54:43,852 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-04-10 23:54:43,852 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-04-10 23:54:43,852 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-04-10 23:54:43,852 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-04-10 23:54:43,852 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-04-10 23:54:43,852 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-04-10 23:54:43,852 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-04-10 23:54:43,852 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-04-10 23:54:43,853 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-04-10 23:54:43,853 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-04-10 23:54:43,853 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-04-10 23:54:43,853 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-04-10 23:54:43,853 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-04-10 23:54:43,853 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-04-10 23:54:43,853 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-04-10 23:54:43,853 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-04-10 23:54:43,853 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-04-10 23:54:43,853 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-04-10 23:54:43,853 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-04-10 23:54:43,853 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-04-10 23:54:43,853 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-04-10 23:54:43,853 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-04-10 23:54:43,853 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-04-10 23:54:43,853 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-04-10 23:54:43,853 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-04-10 23:54:43,853 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-04-10 23:54:43,853 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-04-10 23:54:43,853 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-04-10 23:54:43,854 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-04-10 23:54:43,854 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-04-10 23:54:43,854 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-04-10 23:54:43,854 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-04-10 23:54:43,854 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-04-10 23:54:43,854 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-04-10 23:54:43,854 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-04-10 23:54:43,854 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-04-10 23:54:43,854 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-04-10 23:54:43,854 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-04-10 23:54:43,854 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-04-10 23:54:43,854 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-04-10 23:54:43,854 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-04-10 23:54:43,854 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-04-10 23:54:43,854 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-04-10 23:54:43,854 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-04-10 23:54:43,854 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-04-10 23:54:43,854 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-04-10 23:54:43,854 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-04-10 23:54:43,854 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-04-10 23:54:43,854 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-04-10 23:54:43,855 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-04-10 23:54:43,855 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-04-10 23:54:43,855 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-04-10 23:54:43,855 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-04-10 23:54:43,855 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-04-10 23:54:43,855 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-04-10 23:54:43,855 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-04-10 23:54:43,855 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-04-10 23:54:43,855 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-04-10 23:54:43,855 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-04-10 23:54:43,855 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-04-10 23:54:43,855 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-04-10 23:54:43,855 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-04-10 23:54:43,855 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-04-10 23:54:43,855 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-04-10 23:54:43,855 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-04-10 23:54:43,855 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-04-10 23:54:43,933 INFO  [Time-limited test] balancer.StochasticLoadBalancer(381): Cluster wide - skipping load balancing because weighted average imbalance=7.979690117040589E-6 <= threshold(0.025). If you want more aggressive balancing, either lower hbase.master.balancer.stochastic.minCostNeedBalance from 0.025 or increase the relative multiplier(s) of the specific cost function(s). functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0017727200782610348); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-04-10 23:54:43,933 INFO  [Time-limited test] balancer.BalancerTestBase(570): Mock Final balance: { srv1182012488:83 , srv1341384208:83 , srv1776016569:83 , srv1983497747:83 , srv237829527:83 , srv373508334:83 , srv1001090954:84 , srv1012199799:84 , srv1035977113:84 , srv1051871064:84 , srv1057268468:84 , srv1082991955:84 , srv1146924753:84 , srv1150984044:84 , srv1167119371:84 , srv1169158824:84 , srv1189315548:84 , srv119726837:84 , srv1202060849:84 , srv125456095:84 , srv1254837198:84 , srv1292400354:84 , srv1298980813:84 , srv1325958212:84 , srv1341514910:84 , srv1485637788:84 , srv1539590179:84 , srv1567348296:84 , srv1584153001:84 , srv1621102113:84 , srv1646517828:84 , srv1687276205:84 , srv1702903722:84 , srv1710797063:84 , srv1765344662:84 , srv1818752675:84 , srv186262916:84 , srv1872583462:84 , srv1891079877:84 , srv1901052913:84 , srv1949116293:84 , srv1970122744:84 , srv1991659057:84 , srv1996000814:84 , srv2007947432:84 , srv2055879652:84 , srv2086294142:84 , srv2100883543:84 , srv2110840322:84 , srv2138445348:84 , srv243328706:84 , srv249535472:84 , srv264751667:84 , srv27317391:84 , srv285309009:84 , srv287633109:84 , srv338689237:84 , srv358636459:84 , srv377976523:84 , srv446331625:84 , srv466245174:84 , srv466898725:84 , srv471263999:84 , srv489536567:84 , srv496835321:84 , srv499432309:84 , srv557582509:84 , srv577518904:84 , srv581522033:84 , srv588497622:84 , srv590816109:84 , srv614222414:84 , srv62496897:84 , srv637550001:84 , srv647117091:84 , srv657361059:84 , srv662986403:84 , srv679848880:84 , srv6841230:84 , srv709150185:84 , srv717618351:84 , srv725679109:84 , srv733834843:84 , srv799263009:84 , srv814520874:84 , srv833909515:84 , srv850514005:84 , srv859335436:84 , srv90256067:84 , srv917730367:84 , srv957472776:84 , srv96059211:84 , srv98269523:84 , srv1138675250:85 , srv1597693927:85 , srv383255708:85 , srv436419516:85 , srv748538255:85 , srv885714435:85 , srv1781285340:684 }
2023-04-10 23:54:43,955 INFO  [Time-limited test] hbase.ResourceChecker(175): after: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnLargeClusterWithRacks Thread=10 (was 10), OpenFileDescriptor=260 (was 260), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=153 (was 153), ProcessCount=168 (was 168), AvailableMemoryMB=1960 (was 2443)
2023-04-10 23:54:43,962 INFO  [Time-limited test] hbase.ResourceChecker(147): before: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnMidClusterWithRacks Thread=10, OpenFileDescriptor=260, MaxFileDescriptor=60000, SystemLoadAverage=153, ProcessCount=168, AvailableMemoryMB=1959
2023-04-10 23:54:43,963 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2023-04-10 23:54:43,963 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=5000, runMaxSteps=true, stepsPerRegion=800, maxRunningTime=120000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 111077.0 etc.
2023-04-10 23:54:43,971 INFO  [Time-limited test] balancer.BalancerTestBase(547): Mock Cluster : { srv105068008:84 , srv1246957316:84 , srv13567048:84 , srv1524288634:84 , srv1545913496:84 , srv1548257288:84 , srv1586268741:84 , srv1611156003:84 , srv1615514999:84 , srv1728604427:84 , srv1797116524:84 , srv181532388:84 , srv1876921881:84 , srv1895243679:84 , srv2084924475:84 , srv292712244:84 , srv322209305:84 , srv492751675:84 , srv52087896:84 , srv594790833:84 , srv683263120:84 , srv68399034:84 , srv689642000:84 , srv765485189:84 , srv768215225:84 , srv777575112:84 , srv803483883:84 , srv882129501:84 , srv962064417:84 , srv1831605341:264 } [srvr=30 rgns=2700 avg=90.0 max=90 min=90]
2023-04-10 23:54:43,972 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-04-10 23:54:43,972 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1876921881=13, srv777575112=26, srv765485189=24, srv1586268741=6, srv68399034=22, srv492751675=18, srv683263120=21, srv689642000=23, srv105068008=0, srv1246957316=1, srv292712244=16, srv2084924475=15, srv322209305=17, srv1524288634=3, srv1615514999=8, srv13567048=2, srv1545913496=4, srv594790833=20, srv962064417=29, srv1831605341=12, srv768215225=25, srv181532388=11, srv882129501=28, srv1548257288=5, srv1611156003=7, srv52087896=19, srv1797116524=10, srv1728604427=9, srv1895243679=14, srv803483883=27} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-04-10 23:54:43,980 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-04-10 23:54:43,980 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-04-10 23:54:43,980 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-04-10 23:54:43,980 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-04-10 23:54:43,980 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-04-10 23:54:43,981 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-04-10 23:54:43,981 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-04-10 23:54:43,981 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-04-10 23:54:43,981 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-04-10 23:54:43,981 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-04-10 23:54:43,981 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-04-10 23:54:43,981 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-04-10 23:54:43,981 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-04-10 23:54:43,981 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-04-10 23:54:43,981 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-04-10 23:54:43,981 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-04-10 23:54:43,981 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-04-10 23:54:43,981 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-04-10 23:54:43,981 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-04-10 23:54:43,981 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-04-10 23:54:43,981 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-04-10 23:54:43,981 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-04-10 23:54:43,981 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-04-10 23:54:43,981 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-04-10 23:54:43,982 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-04-10 23:54:43,982 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-04-10 23:54:43,982 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-04-10 23:54:43,982 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-04-10 23:54:43,982 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-04-10 23:54:43,982 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-04-10 23:54:43,982 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=10, number of hosts=30, number of racks=4
2023-04-10 23:54:43,996 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=1.1021654619401138, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-04-10 23:54:43,996 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.9912514963298844, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=1.1021654619401138, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=64800000
2023-04-10 23:56:43,985 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 120001 ms to try 9088013 different iterations.  Found a solution that moves 1827 regions; Going from a computed imbalance of 0.9912514963298844 to a new imbalance of 4.264309142906872E-5. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); MoveCostFunction : (multiplier=7.0, imbalance=0.6766666666666666, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-04-10 23:56:43,993 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv105068008:90 , srv1246957316:90 , srv13567048:90 , srv1524288634:90 , srv1545913496:90 , srv1548257288:90 , srv1586268741:90 , srv1611156003:90 , srv1615514999:90 , srv1728604427:90 , srv1797116524:90 , srv181532388:90 , srv1831605341:90 , srv1876921881:90 , srv1895243679:90 , srv2084924475:90 , srv292712244:90 , srv322209305:90 , srv492751675:90 , srv52087896:90 , srv594790833:90 , srv683263120:90 , srv68399034:90 , srv689642000:90 , srv765485189:90 , srv768215225:90 , srv777575112:90 , srv803483883:90 , srv882129501:90 , srv962064417:90 }
2023-04-10 23:56:43,995 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-04-10 23:56:43,995 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1876921881=13, srv777575112=26, srv765485189=24, srv1586268741=6, srv68399034=22, srv492751675=18, srv683263120=21, srv689642000=23, srv105068008=0, srv1246957316=1, srv292712244=16, srv2084924475=15, srv322209305=17, srv1524288634=3, srv1615514999=8, srv13567048=2, srv1545913496=4, srv594790833=20, srv962064417=29, srv1831605341=12, srv768215225=25, srv181532388=11, srv882129501=28, srv1548257288=5, srv1611156003=7, srv52087896=19, srv1797116524=10, srv1728604427=9, srv1895243679=14, srv803483883=27} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-04-10 23:56:43,999 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-04-10 23:56:43,999 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-04-10 23:56:43,999 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-04-10 23:56:43,999 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-04-10 23:56:44,000 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-04-10 23:56:44,000 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-04-10 23:56:44,000 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-04-10 23:56:44,000 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-04-10 23:56:44,000 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-04-10 23:56:44,000 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-04-10 23:56:44,000 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-04-10 23:56:44,000 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-04-10 23:56:44,000 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-04-10 23:56:44,000 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-04-10 23:56:44,000 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-04-10 23:56:44,000 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-04-10 23:56:44,000 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-04-10 23:56:44,000 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-04-10 23:56:44,000 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-04-10 23:56:44,000 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-04-10 23:56:44,000 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-04-10 23:56:44,001 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-04-10 23:56:44,001 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-04-10 23:56:44,001 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-04-10 23:56:44,001 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-04-10 23:56:44,001 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-04-10 23:56:44,001 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-04-10 23:56:44,001 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-04-10 23:56:44,001 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-04-10 23:56:44,001 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-04-10 23:56:44,001 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=10, number of hosts=30, number of racks=4
2023-04-10 23:56:44,011 INFO  [Time-limited test] balancer.StochasticLoadBalancer(381): Cluster wide - skipping load balancing because weighted average imbalance=0.0 <= threshold(0.025). If you want more aggressive balancing, either lower hbase.master.balancer.stochastic.minCostNeedBalance from 0.025 or increase the relative multiplier(s) of the specific cost function(s). functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-04-10 23:56:44,011 INFO  [Time-limited test] balancer.BalancerTestBase(570): Mock Final balance: { srv105068008:90 , srv1246957316:90 , srv13567048:90 , srv1524288634:90 , srv1545913496:90 , srv1548257288:90 , srv1586268741:90 , srv1611156003:90 , srv1615514999:90 , srv1728604427:90 , srv1797116524:90 , srv181532388:90 , srv1831605341:90 , srv1876921881:90 , srv1895243679:90 , srv2084924475:90 , srv292712244:90 , srv322209305:90 , srv492751675:90 , srv52087896:90 , srv594790833:90 , srv683263120:90 , srv68399034:90 , srv689642000:90 , srv765485189:90 , srv768215225:90 , srv777575112:90 , srv803483883:90 , srv882129501:90 , srv962064417:90 }
2023-04-10 23:56:44,026 INFO  [Time-limited test] hbase.ResourceChecker(175): after: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnMidClusterWithRacks Thread=9 (was 10), OpenFileDescriptor=260 (was 260), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=195 (was 153) - SystemLoadAverage LEAK? -, ProcessCount=168 (was 168), AvailableMemoryMB=1708 (was 1959)