2023-03-03 19:54:02,321 INFO  [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks timeout: 13 mins
2023-03-03 19:54:02,666 WARN  [Time-limited test] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties
2023-03-03 19:54:02,783 INFO  [Time-limited test] metrics.MetricRegistriesLoader(60): Loaded MetricRegistries class org.apache.hadoop.hbase.metrics.impl.MetricRegistriesImpl
2023-03-03 19:54:02,839 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2023-03-03 19:54:02,846 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc.
2023-03-03 19:54:02,860 INFO  [Time-limited test] hbase.ResourceChecker(147): before: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnLargeClusterWithRacks Thread=10, OpenFileDescriptor=260, MaxFileDescriptor=60000, SystemLoadAverage=352, ProcessCount=174, AvailableMemoryMB=5698
2023-03-03 19:54:02,862 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2023-03-03 19:54:02,863 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=5000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=10000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc.
2023-03-03 19:54:02,997 INFO  [Time-limited test] balancer.BalancerTestBase(547): Mock Cluster : { srv10016140:84 , srv1021024232:84 , srv1043060770:84 , srv1052445057:84 , srv1085782654:84 , srv1091286493:84 , srv1098479606:84 , srv1115592196:84 , srv1122648805:84 , srv1131838196:84 , srv1150762157:84 , srv1178504507:84 , srv1183219304:84 , srv1207212515:84 , srv1216060342:84 , srv1233626238:84 , srv1263281510:84 , srv1263380037:84 , srv1276140819:84 , srv1283812140:84 , srv1327437020:84 , srv1352518635:84 , srv1408318929:84 , srv1410278244:84 , srv1454067490:84 , srv145546103:84 , srv1459238240:84 , srv1460508129:84 , srv1460750818:84 , srv1493102915:84 , srv1554103688:84 , srv1572593143:84 , srv1583458437:84 , srv1592035504:84 , srv1597366380:84 , srv165240100:84 , srv1659449326:84 , srv1694684710:84 , srv1725389179:84 , srv1746586945:84 , srv1767906136:84 , srv1772448381:84 , srv1774492647:84 , srv1783678208:84 , srv1793246091:84 , srv1807362432:84 , srv1812871228:84 , srv1814604104:84 , srv1822286969:84 , srv1842821462:84 , srv1848276254:84 , srv1862636742:84 , srv1887698894:84 , srv1939857583:84 , srv1944670988:84 , srv2046783971:84 , srv2050522124:84 , srv2063813:84 , srv2065699478:84 , srv2067330011:84 , srv2080556863:84 , srv2134135989:84 , srv2140856532:84 , srv256727956:84 , srv286225116:84 , srv341312610:84 , srv358472997:84 , srv428670007:84 , srv429037855:84 , srv433901506:84 , srv442634672:84 , srv460006945:84 , srv504461767:84 , srv523125617:84 , srv526742553:84 , srv55664114:84 , srv570953413:84 , srv611796447:84 , srv618164048:84 , srv631546597:84 , srv638163286:84 , srv649593818:84 , srv666257331:84 , srv669293872:84 , srv673820162:84 , srv684061104:84 , srv720639874:84 , srv754798424:84 , srv796326125:84 , srv815010731:84 , srv835320787:84 , srv836347629:84 , srv838858050:84 , srv84137855:84 , srv852677679:84 , srv865241546:84 , srv867334635:84 , srv867605445:84 , srv984546502:84 , srv1983844833:684 } [srvr=100 rgns=9000 avg=90.0 max=90 min=90]
2023-03-03 19:54:03,009 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-03-03 19:54:03,018 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1807362432=45, srv1408318929=22, srv1583458437=32, srv1150762157=10, srv2050522124=57, srv1233626238=15, srv442634672=71, srv852677679=95, srv1814604104=47, srv984546502=99, srv1746586945=39, srv2063813=58, srv1207212515=13, srv1597366380=34, srv433901506=70, srv2134135989=62, srv1659449326=36, srv428670007=68, srv720639874=87, srv754798424=88, srv10016140=0, srv523125617=74, srv1725389179=38, srv286225116=65, srv1115592196=7, srv1812871228=46, srv649593818=82, srv1767906136=40, srv1783678208=43, srv1352518635=21, srv669293872=84, srv341312610=66, srv1592035504=33, srv796326125=89, srv1043060770=2, srv1572593143=31, srv1131838196=9, srv836347629=92, srv867605445=98, srv460006945=72, srv2065699478=59, srv865241546=96, srv1263281510=16, srv1822286969=48, srv1774492647=42, srv504461767=73, srv1939857583=53, srv631546597=80, srv1460750818=28, srv2046783971=56, srv2080556863=61, srv2140856532=63, srv1772448381=41, srv2067330011=60, srv815010731=90, srv666257331=83, srv1493102915=29, srv838858050=93, srv1944670988=54, srv1276140819=18, srv256727956=64, srv165240100=35, srv1327437020=20, srv429037855=69, srv145546103=25, srv1460508129=27, srv1021024232=1, srv1183219304=12, srv684061104=86, srv1554103688=30, srv1983844833=55, srv1178504507=11, srv1098479606=6, srv618164048=79, srv1862636742=51, srv1052445057=3, srv867334635=97, srv1263380037=17, srv1283812140=19, srv1694684710=37, srv1122648805=8, srv1459238240=26, srv1454067490=24, srv55664114=76, srv358472997=67, srv84137855=94, srv611796447=78, srv638163286=81, srv673820162=85, srv526742553=75, srv1793246091=44, srv570953413=77, srv1085782654=4, srv1842821462=49, srv835320787=91, srv1216060342=14, srv1091286493=5, srv1410278244=23, srv1848276254=50, srv1887698894=52} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-03-03 19:54:03,099 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-03-03 19:54:03,099 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-03-03 19:54:03,099 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-03-03 19:54:03,100 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-03-03 19:54:03,100 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-03-03 19:54:03,100 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-03-03 19:54:03,100 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-03-03 19:54:03,100 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-03-03 19:54:03,100 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-03-03 19:54:03,100 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-03-03 19:54:03,100 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-03-03 19:54:03,100 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-03-03 19:54:03,100 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-03-03 19:54:03,101 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-03-03 19:54:03,101 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-03-03 19:54:03,101 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-03-03 19:54:03,101 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-03-03 19:54:03,101 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-03-03 19:54:03,101 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-03-03 19:54:03,101 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-03-03 19:54:03,101 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-03-03 19:54:03,101 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-03-03 19:54:03,102 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-03-03 19:54:03,102 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-03-03 19:54:03,102 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-03-03 19:54:03,102 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-03-03 19:54:03,102 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-03-03 19:54:03,102 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-03-03 19:54:03,102 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-03-03 19:54:03,102 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-03-03 19:54:03,102 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-03-03 19:54:03,102 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-03-03 19:54:03,103 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-03-03 19:54:03,103 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-03-03 19:54:03,103 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-03-03 19:54:03,103 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-03-03 19:54:03,103 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-03-03 19:54:03,103 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-03-03 19:54:03,103 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-03-03 19:54:03,103 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-03-03 19:54:03,103 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-03-03 19:54:03,103 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-03-03 19:54:03,104 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-03-03 19:54:03,104 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-03-03 19:54:03,104 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-03-03 19:54:03,104 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-03-03 19:54:03,104 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-03-03 19:54:03,104 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-03-03 19:54:03,104 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-03-03 19:54:03,105 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-03-03 19:54:03,105 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-03-03 19:54:03,105 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-03-03 19:54:03,105 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-03-03 19:54:03,105 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-03-03 19:54:03,105 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-03-03 19:54:03,106 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-03-03 19:54:03,106 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-03-03 19:54:03,106 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-03-03 19:54:03,106 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-03-03 19:54:03,106 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-03-03 19:54:03,106 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-03-03 19:54:03,106 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-03-03 19:54:03,107 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-03-03 19:54:03,107 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-03-03 19:54:03,107 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-03-03 19:54:03,107 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-03-03 19:54:03,107 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-03-03 19:54:03,107 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-03-03 19:54:03,107 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-03-03 19:54:03,108 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-03-03 19:54:03,108 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-03-03 19:54:03,108 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-03-03 19:54:03,108 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-03-03 19:54:03,108 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-03-03 19:54:03,108 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-03-03 19:54:03,108 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-03-03 19:54:03,108 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-03-03 19:54:03,108 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-03-03 19:54:03,108 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-03-03 19:54:03,108 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-03-03 19:54:03,109 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-03-03 19:54:03,109 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-03-03 19:54:03,109 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-03-03 19:54:03,109 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-03-03 19:54:03,109 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-03-03 19:54:03,109 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-03-03 19:54:03,109 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-03-03 19:54:03,109 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-03-03 19:54:03,109 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-03-03 19:54:03,109 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-03-03 19:54:03,110 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-03-03 19:54:03,110 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-03-03 19:54:03,110 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-03-03 19:54:03,110 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-03-03 19:54:03,110 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-03-03 19:54:03,110 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-03-03 19:54:03,110 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-03-03 19:54:03,110 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-03-03 19:54:03,110 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-03-03 19:54:03,111 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-03-03 19:54:03,111 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-03-03 19:54:03,524 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.06666666666666667, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-03-03 19:54:03,524 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-03-03 19:54:03,525 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.9909252140407105, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.06666666666666667, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-03-03 19:54:04,208 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 1066 ms to try 5000 different iterations.  Found a solution that moves 4684 regions; Going from a computed imbalance of 0.9909252140407105 to a new imbalance of 0.17983205141466432. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0401686182859129, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.05347623951851445, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.5204444444444445, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0401686182859129, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.17541666666666667, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.23816666666666667, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-03-03 19:54:04,229 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv460006945:81 , srv2140856532:82 , srv638163286:82 , srv669293872:82 , srv1276140819:83 , srv1746586945:83 , srv1793246091:83 , srv1848276254:83 , srv2080556863:83 , srv523125617:83 , srv649593818:83 , srv684061104:83 , srv720639874:83 , srv1091286493:84 , srv1263281510:84 , srv1283812140:84 , srv1327437020:84 , srv1554103688:84 , srv1597366380:84 , srv1694684710:84 , srv1725389179:84 , srv1774492647:84 , srv504461767:84 , srv838858050:84 , srv865241546:84 , srv984546502:84 , srv1043060770:85 , srv1085782654:85 , srv1122648805:85 , srv1263380037:85 , srv1583458437:85 , srv1659449326:85 , srv1772448381:85 , srv1807362432:85 , srv341312610:85 , srv442634672:85 , srv611796447:85 , srv754798424:85 , srv852677679:85 , srv1098479606:86 , srv1115592196:86 , srv1150762157:86 , srv1352518635:86 , srv1410278244:86 , srv1454067490:86 , srv1460750818:86 , srv165240100:86 , srv1939857583:86 , srv286225116:86 , srv358472997:86 , srv673820162:86 , srv1131838196:87 , srv1183219304:87 , srv1207212515:87 , srv1216060342:87 , srv1408318929:87 , srv1459238240:87 , srv1493102915:87 , srv1822286969:87 , srv1842821462:87 , srv1944670988:87 , srv2046783971:87 , srv428670007:87 , srv526742553:87 , srv570953413:87 , srv618164048:87 , srv666257331:87 , srv796326125:87 , srv815010731:87 , srv867334635:87 , srv10016140:88 , srv1052445057:88 , srv2050522124:88 , srv2134135989:88 , srv256727956:88 , srv429037855:88 , srv433901506:88 , srv631546597:88 , srv1021024232:89 , srv1178504507:89 , srv1572593143:89 , srv1592035504:89 , srv1812871228:89 , srv1814604104:89 , srv1887698894:89 , srv2067330011:89 , srv55664114:89 , srv84137855:89 , srv2065699478:90 , srv836347629:90 , srv867605445:90 , srv1233626238:91 , srv1460508129:91 , srv1767906136:91 , srv1862636742:91 , srv835320787:91 , srv2063813:92 , srv145546103:93 , srv1783678208:93 , srv1983844833:447 }
2023-03-03 19:54:04,233 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-03-03 19:54:04,234 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1807362432=45, srv1408318929=22, srv1583458437=32, srv1150762157=10, srv2050522124=57, srv1233626238=15, srv442634672=71, srv852677679=95, srv1814604104=47, srv984546502=99, srv1746586945=39, srv2063813=58, srv1207212515=13, srv1597366380=34, srv433901506=70, srv2134135989=62, srv1659449326=36, srv428670007=68, srv720639874=87, srv754798424=88, srv10016140=0, srv523125617=74, srv1725389179=38, srv286225116=65, srv1115592196=7, srv1812871228=46, srv649593818=82, srv1767906136=40, srv1783678208=43, srv1352518635=21, srv669293872=84, srv341312610=66, srv1592035504=33, srv796326125=89, srv1043060770=2, srv1572593143=31, srv1131838196=9, srv836347629=92, srv867605445=98, srv460006945=72, srv2065699478=59, srv865241546=96, srv1263281510=16, srv1822286969=48, srv1774492647=42, srv504461767=73, srv1939857583=53, srv631546597=80, srv1460750818=28, srv2046783971=56, srv2080556863=61, srv2140856532=63, srv1772448381=41, srv2067330011=60, srv815010731=90, srv666257331=83, srv1493102915=29, srv838858050=93, srv1944670988=54, srv1276140819=18, srv256727956=64, srv165240100=35, srv1327437020=20, srv429037855=69, srv145546103=25, srv1460508129=27, srv1021024232=1, srv1183219304=12, srv684061104=86, srv1554103688=30, srv1983844833=55, srv1178504507=11, srv1098479606=6, srv618164048=79, srv1862636742=51, srv1052445057=3, srv867334635=97, srv1263380037=17, srv1283812140=19, srv1694684710=37, srv1122648805=8, srv1459238240=26, srv1454067490=24, srv55664114=76, srv358472997=67, srv84137855=94, srv611796447=78, srv638163286=81, srv673820162=85, srv526742553=75, srv1793246091=44, srv570953413=77, srv1085782654=4, srv1842821462=49, srv835320787=91, srv1216060342=14, srv1091286493=5, srv1410278244=23, srv1848276254=50, srv1887698894=52} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-03-03 19:54:04,248 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-03-03 19:54:04,248 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-03-03 19:54:04,248 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-03-03 19:54:04,248 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-03-03 19:54:04,248 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-03-03 19:54:04,248 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-03-03 19:54:04,248 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-03-03 19:54:04,248 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-03-03 19:54:04,248 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-03-03 19:54:04,249 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-03-03 19:54:04,249 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-03-03 19:54:04,249 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-03-03 19:54:04,249 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-03-03 19:54:04,249 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-03-03 19:54:04,249 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-03-03 19:54:04,250 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-03-03 19:54:04,250 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-03-03 19:54:04,250 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-03-03 19:54:04,250 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-03-03 19:54:04,250 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-03-03 19:54:04,250 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-03-03 19:54:04,250 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-03-03 19:54:04,250 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-03-03 19:54:04,251 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-03-03 19:54:04,251 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-03-03 19:54:04,251 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-03-03 19:54:04,251 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-03-03 19:54:04,251 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-03-03 19:54:04,251 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-03-03 19:54:04,251 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-03-03 19:54:04,251 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-03-03 19:54:04,252 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-03-03 19:54:04,252 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-03-03 19:54:04,252 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-03-03 19:54:04,252 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-03-03 19:54:04,252 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-03-03 19:54:04,252 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-03-03 19:54:04,252 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-03-03 19:54:04,252 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-03-03 19:54:04,253 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-03-03 19:54:04,253 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-03-03 19:54:04,253 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-03-03 19:54:04,253 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-03-03 19:54:04,253 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-03-03 19:54:04,253 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-03-03 19:54:04,253 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-03-03 19:54:04,253 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-03-03 19:54:04,253 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-03-03 19:54:04,254 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-03-03 19:54:04,254 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-03-03 19:54:04,254 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-03-03 19:54:04,254 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-03-03 19:54:04,254 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-03-03 19:54:04,254 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-03-03 19:54:04,254 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-03-03 19:54:04,254 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-03-03 19:54:04,254 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-03-03 19:54:04,255 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-03-03 19:54:04,255 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-03-03 19:54:04,255 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-03-03 19:54:04,255 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-03-03 19:54:04,255 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-03-03 19:54:04,255 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-03-03 19:54:04,255 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-03-03 19:54:04,255 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-03-03 19:54:04,256 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-03-03 19:54:04,256 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-03-03 19:54:04,256 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-03-03 19:54:04,256 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-03-03 19:54:04,256 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-03-03 19:54:04,256 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-03-03 19:54:04,256 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-03-03 19:54:04,256 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-03-03 19:54:04,256 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-03-03 19:54:04,257 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-03-03 19:54:04,257 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-03-03 19:54:04,257 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-03-03 19:54:04,257 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-03-03 19:54:04,257 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-03-03 19:54:04,257 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-03-03 19:54:04,257 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-03-03 19:54:04,257 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-03-03 19:54:04,257 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-03-03 19:54:04,258 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-03-03 19:54:04,258 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-03-03 19:54:04,258 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-03-03 19:54:04,258 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-03-03 19:54:04,258 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-03-03 19:54:04,258 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-03-03 19:54:04,258 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-03-03 19:54:04,258 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-03-03 19:54:04,258 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-03-03 19:54:04,259 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-03-03 19:54:04,259 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-03-03 19:54:04,259 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-03-03 19:54:04,259 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-03-03 19:54:04,259 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-03-03 19:54:04,259 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-03-03 19:54:04,259 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-03-03 19:54:04,259 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-03-03 19:54:04,259 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-03-03 19:54:04,425 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0401686182859129, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.05347623951851445, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0401686182859129, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.17541666666666667, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.23816666666666667, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-03-03 19:54:04,426 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-03-03 19:54:04,426 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.17979925334565713, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0401686182859129, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.05347623951851445, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0401686182859129, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.17541666666666667, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.23816666666666667, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-03-03 19:54:04,791 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 502 ms to try 5000 different iterations.  Found a solution that moves 2617 regions; Going from a computed imbalance of 0.17979925334565713 to a new imbalance of 0.012493629529494135. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.02042936056058359); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.027912803139860016, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.2907777777777778, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.02042936056058359); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.009583333333333333); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.04025, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-03-03 19:54:04,798 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1783678208:77 , srv1862636742:79 , srv835320787:80 , srv1021024232:81 , srv1178504507:81 , srv1233626238:81 , srv145546103:81 , srv55664114:81 , srv836347629:81 , srv1052445057:82 , srv1814604104:82 , srv2063813:82 , srv2067330011:82 , srv867605445:82 , srv10016140:83 , srv1207212515:83 , srv1408318929:83 , srv1460508129:83 , srv1767906136:83 , srv1812871228:83 , srv1944670988:83 , srv526742553:83 , srv1460750818:84 , srv1822286969:84 , srv2065699478:84 , srv2134135989:84 , srv256727956:84 , srv428670007:84 , srv433901506:84 , srv618164048:84 , srv84137855:84 , srv1150762157:85 , srv1183219304:85 , srv1263380037:85 , srv1493102915:85 , srv1572593143:85 , srv1659449326:85 , srv1807362432:85 , srv1887698894:85 , srv2046783971:85 , srv442634672:85 , srv570953413:85 , srv611796447:85 , srv631546597:85 , srv666257331:85 , srv867334635:85 , srv984546502:85 , srv1085782654:86 , srv1091286493:86 , srv1098479606:86 , srv1454067490:86 , srv1459238240:86 , srv1554103688:86 , srv165240100:86 , srv1725389179:86 , srv1842821462:86 , srv341312610:86 , srv358472997:86 , srv429037855:86 , srv673820162:86 , srv796326125:86 , srv1043060770:87 , srv1283812140:87 , srv1352518635:87 , srv1410278244:87 , srv1583458437:87 , srv1592035504:87 , srv1772448381:87 , srv754798424:87 , srv865241546:87 , srv1115592196:88 , srv1122648805:88 , srv1216060342:88 , srv1694684710:88 , srv1774492647:88 , srv1793246091:88 , srv1848276254:88 , srv2140856532:88 , srv286225116:88 , srv523125617:88 , srv720639874:88 , srv852677679:88 , srv1263281510:89 , srv1597366380:89 , srv1746586945:89 , srv1939857583:89 , srv504461767:89 , srv638163286:89 , srv1276140819:90 , srv1327437020:90 , srv2050522124:90 , srv684061104:90 , srv1131838196:91 , srv2080556863:91 , srv649593818:91 , srv669293872:91 , srv460006945:92 , srv815010731:92 , srv838858050:95 , srv1983844833:508 }
2023-03-03 19:54:04,802 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-03-03 19:54:04,803 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1807362432=45, srv1408318929=22, srv1583458437=32, srv1150762157=10, srv2050522124=57, srv1233626238=15, srv442634672=71, srv852677679=95, srv1814604104=47, srv984546502=99, srv1746586945=39, srv2063813=58, srv1207212515=13, srv1597366380=34, srv433901506=70, srv2134135989=62, srv1659449326=36, srv428670007=68, srv720639874=87, srv754798424=88, srv10016140=0, srv523125617=74, srv1725389179=38, srv286225116=65, srv1115592196=7, srv1812871228=46, srv649593818=82, srv1767906136=40, srv1783678208=43, srv1352518635=21, srv669293872=84, srv341312610=66, srv1592035504=33, srv796326125=89, srv1043060770=2, srv1572593143=31, srv1131838196=9, srv836347629=92, srv867605445=98, srv460006945=72, srv2065699478=59, srv865241546=96, srv1263281510=16, srv1822286969=48, srv1774492647=42, srv504461767=73, srv1939857583=53, srv631546597=80, srv1460750818=28, srv2046783971=56, srv2080556863=61, srv2140856532=63, srv1772448381=41, srv2067330011=60, srv815010731=90, srv666257331=83, srv1493102915=29, srv838858050=93, srv1944670988=54, srv1276140819=18, srv256727956=64, srv165240100=35, srv1327437020=20, srv429037855=69, srv145546103=25, srv1460508129=27, srv1021024232=1, srv1183219304=12, srv684061104=86, srv1554103688=30, srv1983844833=55, srv1178504507=11, srv1098479606=6, srv618164048=79, srv1862636742=51, srv1052445057=3, srv867334635=97, srv1263380037=17, srv1283812140=19, srv1694684710=37, srv1122648805=8, srv1459238240=26, srv1454067490=24, srv55664114=76, srv358472997=67, srv84137855=94, srv611796447=78, srv638163286=81, srv673820162=85, srv526742553=75, srv1793246091=44, srv570953413=77, srv1085782654=4, srv1842821462=49, srv835320787=91, srv1216060342=14, srv1091286493=5, srv1410278244=23, srv1848276254=50, srv1887698894=52} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-03-03 19:54:04,823 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-03-03 19:54:04,823 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-03-03 19:54:04,823 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-03-03 19:54:04,823 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-03-03 19:54:04,823 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-03-03 19:54:04,823 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-03-03 19:54:04,823 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-03-03 19:54:04,823 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-03-03 19:54:04,823 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-03-03 19:54:04,823 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-03-03 19:54:04,823 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-03-03 19:54:04,824 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-03-03 19:54:04,824 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-03-03 19:54:04,824 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-03-03 19:54:04,824 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-03-03 19:54:04,824 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-03-03 19:54:04,824 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-03-03 19:54:04,824 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-03-03 19:54:04,824 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-03-03 19:54:04,824 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-03-03 19:54:04,824 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-03-03 19:54:04,824 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-03-03 19:54:04,824 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-03-03 19:54:04,824 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-03-03 19:54:04,824 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-03-03 19:54:04,825 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-03-03 19:54:04,825 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-03-03 19:54:04,825 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-03-03 19:54:04,825 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-03-03 19:54:04,825 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-03-03 19:54:04,825 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-03-03 19:54:04,825 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-03-03 19:54:04,825 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-03-03 19:54:04,825 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-03-03 19:54:04,825 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-03-03 19:54:04,825 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-03-03 19:54:04,825 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-03-03 19:54:04,825 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-03-03 19:54:04,825 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-03-03 19:54:04,825 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-03-03 19:54:04,826 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-03-03 19:54:04,826 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-03-03 19:54:04,826 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-03-03 19:54:04,826 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-03-03 19:54:04,826 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-03-03 19:54:04,826 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-03-03 19:54:04,826 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-03-03 19:54:04,826 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-03-03 19:54:04,826 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-03-03 19:54:04,826 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-03-03 19:54:04,826 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-03-03 19:54:04,826 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-03-03 19:54:04,826 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-03-03 19:54:04,826 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-03-03 19:54:04,826 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-03-03 19:54:04,826 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-03-03 19:54:04,827 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-03-03 19:54:04,827 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-03-03 19:54:04,827 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-03-03 19:54:04,827 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-03-03 19:54:04,827 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-03-03 19:54:04,827 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-03-03 19:54:04,827 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-03-03 19:54:04,827 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-03-03 19:54:04,827 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-03-03 19:54:04,827 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-03-03 19:54:04,827 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-03-03 19:54:04,827 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-03-03 19:54:04,827 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-03-03 19:54:04,827 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-03-03 19:54:04,827 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-03-03 19:54:04,828 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-03-03 19:54:04,828 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-03-03 19:54:04,828 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-03-03 19:54:04,828 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-03-03 19:54:04,828 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-03-03 19:54:04,828 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-03-03 19:54:04,828 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-03-03 19:54:04,828 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-03-03 19:54:04,828 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-03-03 19:54:04,828 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-03-03 19:54:04,828 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-03-03 19:54:04,828 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-03-03 19:54:04,828 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-03-03 19:54:04,828 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-03-03 19:54:04,828 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-03-03 19:54:04,829 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-03-03 19:54:04,829 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-03-03 19:54:04,829 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-03-03 19:54:04,829 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-03-03 19:54:04,829 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-03-03 19:54:04,829 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-03-03 19:54:04,829 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-03-03 19:54:04,829 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-03-03 19:54:04,829 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-03-03 19:54:04,829 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-03-03 19:54:04,829 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-03-03 19:54:04,829 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-03-03 19:54:04,829 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-03-03 19:54:04,829 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-03-03 19:54:04,829 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-03-03 19:54:04,962 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.02042936056058359); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.027912803139860016, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.02042936056058359); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.009583333333333333); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.04025, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-03-03 19:54:04,963 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-03-03 19:54:04,963 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.012475304903834058, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.02042936056058359); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.027912803139860016, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.02042936056058359); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.009583333333333333); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.04025, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-03-03 19:54:05,194 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 345 ms to try 5000 different iterations.  Found a solution that moves 993 regions; Going from a computed imbalance of 0.012475304903834058 to a new imbalance of 6.758452724906639E-4. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.004356595308681583); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.003935507017934981); MoveCostFunction : (multiplier=7.0, imbalance=0.11033333333333334, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.004356595308681583); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=4.166666666666667E-4); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0028333333333333335); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-03-03 19:54:05,198 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv815010731:78 , srv1131838196:80 , srv838858050:80 , srv1592035504:81 , srv1216060342:82 , srv2050522124:82 , srv1115592196:83 , srv1410278244:83 , srv1460508129:83 , srv1694684710:83 , srv1767906136:83 , srv1939857583:83 , srv2080556863:83 , srv429037855:83 , srv649593818:83 , srv1122648805:84 , srv1276140819:84 , srv1327437020:84 , srv1352518635:84 , srv145546103:84 , srv1572593143:84 , srv1597366380:84 , srv1842821462:84 , srv1887698894:84 , srv2065699478:84 , srv504461767:84 , srv684061104:84 , srv84137855:84 , srv852677679:84 , srv1043060770:85 , srv1183219304:85 , srv1263281510:85 , srv1459238240:85 , srv1746586945:85 , srv1774492647:85 , srv1812871228:85 , srv2063813:85 , srv2134135989:85 , srv256727956:85 , srv286225116:85 , srv460006945:85 , srv666257331:85 , srv669293872:85 , srv796326125:85 , srv867334635:85 , srv867605445:85 , srv1098479606:86 , srv1233626238:86 , srv1283812140:86 , srv1454067490:86 , srv1493102915:86 , srv165240100:86 , srv1807362432:86 , srv1848276254:86 , srv2046783971:86 , srv2067330011:86 , srv341312610:86 , srv358472997:86 , srv433901506:86 , srv631546597:86 , srv638163286:86 , srv673820162:86 , srv754798424:86 , srv835320787:86 , srv865241546:86 , srv1021024232:87 , srv1052445057:87 , srv1085782654:87 , srv1150762157:87 , srv1178504507:87 , srv1263380037:87 , srv1554103688:87 , srv1583458437:87 , srv1793246091:87 , srv1814604104:87 , srv1822286969:87 , srv1944670988:87 , srv2140856532:87 , srv428670007:87 , srv523125617:87 , srv570953413:87 , srv611796447:87 , srv618164048:87 , srv836347629:87 , srv10016140:88 , srv1091286493:88 , srv1207212515:88 , srv1408318929:88 , srv1659449326:88 , srv1725389179:88 , srv1772448381:88 , srv1783678208:88 , srv1862636742:88 , srv442634672:88 , srv526742553:88 , srv55664114:88 , srv720639874:88 , srv984546502:88 , srv1460750818:89 , srv1983844833:541 }
2023-03-03 19:54:05,204 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-03-03 19:54:05,205 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1807362432=45, srv1408318929=22, srv1583458437=32, srv1150762157=10, srv2050522124=57, srv1233626238=15, srv442634672=71, srv852677679=95, srv1814604104=47, srv984546502=99, srv1746586945=39, srv2063813=58, srv1207212515=13, srv1597366380=34, srv433901506=70, srv2134135989=62, srv1659449326=36, srv428670007=68, srv720639874=87, srv754798424=88, srv10016140=0, srv523125617=74, srv1725389179=38, srv286225116=65, srv1115592196=7, srv1812871228=46, srv649593818=82, srv1767906136=40, srv1783678208=43, srv1352518635=21, srv669293872=84, srv341312610=66, srv1592035504=33, srv796326125=89, srv1043060770=2, srv1572593143=31, srv1131838196=9, srv836347629=92, srv867605445=98, srv460006945=72, srv2065699478=59, srv865241546=96, srv1263281510=16, srv1822286969=48, srv1774492647=42, srv504461767=73, srv1939857583=53, srv631546597=80, srv1460750818=28, srv2046783971=56, srv2080556863=61, srv2140856532=63, srv1772448381=41, srv2067330011=60, srv815010731=90, srv666257331=83, srv1493102915=29, srv838858050=93, srv1944670988=54, srv1276140819=18, srv256727956=64, srv165240100=35, srv1327437020=20, srv429037855=69, srv145546103=25, srv1460508129=27, srv1021024232=1, srv1183219304=12, srv684061104=86, srv1554103688=30, srv1983844833=55, srv1178504507=11, srv1098479606=6, srv618164048=79, srv1862636742=51, srv1052445057=3, srv867334635=97, srv1263380037=17, srv1283812140=19, srv1694684710=37, srv1122648805=8, srv1459238240=26, srv1454067490=24, srv55664114=76, srv358472997=67, srv84137855=94, srv611796447=78, srv638163286=81, srv673820162=85, srv526742553=75, srv1793246091=44, srv570953413=77, srv1085782654=4, srv1842821462=49, srv835320787=91, srv1216060342=14, srv1091286493=5, srv1410278244=23, srv1848276254=50, srv1887698894=52} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-03-03 19:54:05,224 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-03-03 19:54:05,224 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-03-03 19:54:05,225 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-03-03 19:54:05,225 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-03-03 19:54:05,225 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-03-03 19:54:05,225 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-03-03 19:54:05,225 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-03-03 19:54:05,225 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-03-03 19:54:05,225 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-03-03 19:54:05,225 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-03-03 19:54:05,225 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-03-03 19:54:05,226 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-03-03 19:54:05,226 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-03-03 19:54:05,226 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-03-03 19:54:05,226 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-03-03 19:54:05,226 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-03-03 19:54:05,226 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-03-03 19:54:05,226 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-03-03 19:54:05,226 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-03-03 19:54:05,226 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-03-03 19:54:05,227 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-03-03 19:54:05,227 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-03-03 19:54:05,227 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-03-03 19:54:05,227 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-03-03 19:54:05,227 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-03-03 19:54:05,227 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-03-03 19:54:05,227 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-03-03 19:54:05,227 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-03-03 19:54:05,228 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-03-03 19:54:05,228 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-03-03 19:54:05,228 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-03-03 19:54:05,228 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-03-03 19:54:05,228 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-03-03 19:54:05,228 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-03-03 19:54:05,228 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-03-03 19:54:05,228 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-03-03 19:54:05,229 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-03-03 19:54:05,229 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-03-03 19:54:05,229 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-03-03 19:54:05,229 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-03-03 19:54:05,229 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-03-03 19:54:05,229 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-03-03 19:54:05,229 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-03-03 19:54:05,229 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-03-03 19:54:05,229 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-03-03 19:54:05,230 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-03-03 19:54:05,230 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-03-03 19:54:05,230 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-03-03 19:54:05,230 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-03-03 19:54:05,230 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-03-03 19:54:05,230 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-03-03 19:54:05,230 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-03-03 19:54:05,230 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-03-03 19:54:05,230 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-03-03 19:54:05,231 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-03-03 19:54:05,231 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-03-03 19:54:05,231 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-03-03 19:54:05,231 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-03-03 19:54:05,231 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-03-03 19:54:05,231 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-03-03 19:54:05,231 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-03-03 19:54:05,231 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-03-03 19:54:05,231 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-03-03 19:54:05,231 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-03-03 19:54:05,232 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-03-03 19:54:05,232 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-03-03 19:54:05,232 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-03-03 19:54:05,232 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-03-03 19:54:05,232 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-03-03 19:54:05,232 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-03-03 19:54:05,232 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-03-03 19:54:05,232 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-03-03 19:54:05,232 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-03-03 19:54:05,233 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-03-03 19:54:05,233 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-03-03 19:54:05,233 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-03-03 19:54:05,233 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-03-03 19:54:05,233 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-03-03 19:54:05,233 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-03-03 19:54:05,233 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-03-03 19:54:05,233 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-03-03 19:54:05,233 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-03-03 19:54:05,233 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-03-03 19:54:05,234 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-03-03 19:54:05,234 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-03-03 19:54:05,234 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-03-03 19:54:05,234 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-03-03 19:54:05,234 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-03-03 19:54:05,234 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-03-03 19:54:05,234 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-03-03 19:54:05,234 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-03-03 19:54:05,234 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-03-03 19:54:05,234 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-03-03 19:54:05,235 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-03-03 19:54:05,235 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-03-03 19:54:05,235 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-03-03 19:54:05,235 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-03-03 19:54:05,235 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-03-03 19:54:05,235 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-03-03 19:54:05,235 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-03-03 19:54:05,235 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-03-03 19:54:05,361 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.004356595308681583); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.003935507017934981); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.004356595308681583); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=4.166666666666667E-4); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0028333333333333335); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-03-03 19:54:05,362 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-03-03 19:54:05,362 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=6.688921378783379E-4, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.004356595308681583); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.003935507017934981); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.004356595308681583); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=4.166666666666667E-4); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0028333333333333335); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-03-03 19:54:05,676 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 426 ms to try 5000 different iterations.  Found a solution that moves 185 regions; Going from a computed imbalance of 6.688921378783379E-4 to a new imbalance of 1.902921223987003E-5. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=3.5313429231318235E-4); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0018951174787165373); MoveCostFunction : (multiplier=7.0, imbalance=0.020555555555555556); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=3.5313429231318235E-4); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=8.333333333333333E-5); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-03-03 19:54:05,677 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1460750818:82 , srv1772448381:82 , srv2050522124:82 , srv10016140:83 , srv2063813:83 , srv286225116:83 , srv442634672:83 , srv526742553:83 , srv570953413:83 , srv631546597:83 , srv720639874:83 , srv838858050:83 , srv1085782654:84 , srv1091286493:84 , srv1098479606:84 , srv1131838196:84 , srv1150762157:84 , srv1207212515:84 , srv1233626238:84 , srv1263281510:84 , srv1283812140:84 , srv1408318929:84 , srv1454067490:84 , srv145546103:84 , srv1459238240:84 , srv1493102915:84 , srv1572593143:84 , srv1583458437:84 , srv165240100:84 , srv1659449326:84 , srv1725389179:84 , srv1783678208:84 , srv1793246091:84 , srv1814604104:84 , srv1822286969:84 , srv1862636742:84 , srv1939857583:84 , srv2046783971:84 , srv2065699478:84 , srv358472997:84 , srv428670007:84 , srv433901506:84 , srv460006945:84 , srv523125617:84 , srv55664114:84 , srv618164048:84 , srv666257331:84 , srv669293872:84 , srv673820162:84 , srv796326125:84 , srv836347629:84 , srv1021024232:85 , srv1043060770:85 , srv1052445057:85 , srv1115592196:85 , srv1122648805:85 , srv1178504507:85 , srv1183219304:85 , srv1216060342:85 , srv1263380037:85 , srv1276140819:85 , srv1327437020:85 , srv1352518635:85 , srv1460508129:85 , srv1554103688:85 , srv1592035504:85 , srv1597366380:85 , srv1746586945:85 , srv1767906136:85 , srv1774492647:85 , srv1812871228:85 , srv1842821462:85 , srv1848276254:85 , srv1887698894:85 , srv1944670988:85 , srv2067330011:85 , srv2080556863:85 , srv2134135989:85 , srv2140856532:85 , srv256727956:85 , srv341312610:85 , srv429037855:85 , srv504461767:85 , srv611796447:85 , srv638163286:85 , srv649593818:85 , srv684061104:85 , srv754798424:85 , srv815010731:85 , srv835320787:85 , srv84137855:85 , srv852677679:85 , srv865241546:85 , srv867334635:85 , srv867605445:85 , srv984546502:85 , srv1410278244:86 , srv1807362432:86 , srv1694684710:87 , srv1983844833:647 }
2023-03-03 19:54:05,680 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-03-03 19:54:05,681 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1807362432=45, srv1408318929=22, srv1583458437=32, srv1150762157=10, srv2050522124=57, srv1233626238=15, srv442634672=71, srv852677679=95, srv1814604104=47, srv984546502=99, srv1746586945=39, srv2063813=58, srv1207212515=13, srv1597366380=34, srv433901506=70, srv2134135989=62, srv1659449326=36, srv428670007=68, srv720639874=87, srv754798424=88, srv10016140=0, srv523125617=74, srv1725389179=38, srv286225116=65, srv1115592196=7, srv1812871228=46, srv649593818=82, srv1767906136=40, srv1783678208=43, srv1352518635=21, srv669293872=84, srv341312610=66, srv1592035504=33, srv796326125=89, srv1043060770=2, srv1572593143=31, srv1131838196=9, srv836347629=92, srv867605445=98, srv460006945=72, srv2065699478=59, srv865241546=96, srv1263281510=16, srv1822286969=48, srv1774492647=42, srv504461767=73, srv1939857583=53, srv631546597=80, srv1460750818=28, srv2046783971=56, srv2080556863=61, srv2140856532=63, srv1772448381=41, srv2067330011=60, srv815010731=90, srv666257331=83, srv1493102915=29, srv838858050=93, srv1944670988=54, srv1276140819=18, srv256727956=64, srv165240100=35, srv1327437020=20, srv429037855=69, srv145546103=25, srv1460508129=27, srv1021024232=1, srv1183219304=12, srv684061104=86, srv1554103688=30, srv1983844833=55, srv1178504507=11, srv1098479606=6, srv618164048=79, srv1862636742=51, srv1052445057=3, srv867334635=97, srv1263380037=17, srv1283812140=19, srv1694684710=37, srv1122648805=8, srv1459238240=26, srv1454067490=24, srv55664114=76, srv358472997=67, srv84137855=94, srv611796447=78, srv638163286=81, srv673820162=85, srv526742553=75, srv1793246091=44, srv570953413=77, srv1085782654=4, srv1842821462=49, srv835320787=91, srv1216060342=14, srv1091286493=5, srv1410278244=23, srv1848276254=50, srv1887698894=52} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-03-03 19:54:05,692 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-03-03 19:54:05,692 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-03-03 19:54:05,692 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-03-03 19:54:05,692 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-03-03 19:54:05,692 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-03-03 19:54:05,692 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-03-03 19:54:05,692 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-03-03 19:54:05,692 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-03-03 19:54:05,692 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-03-03 19:54:05,692 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-03-03 19:54:05,692 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-03-03 19:54:05,692 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-03-03 19:54:05,693 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-03-03 19:54:05,693 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-03-03 19:54:05,693 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-03-03 19:54:05,693 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-03-03 19:54:05,693 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-03-03 19:54:05,693 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-03-03 19:54:05,693 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-03-03 19:54:05,693 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-03-03 19:54:05,693 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-03-03 19:54:05,693 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-03-03 19:54:05,693 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-03-03 19:54:05,693 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-03-03 19:54:05,693 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-03-03 19:54:05,693 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-03-03 19:54:05,693 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-03-03 19:54:05,693 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-03-03 19:54:05,693 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-03-03 19:54:05,693 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-03-03 19:54:05,693 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-03-03 19:54:05,694 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-03-03 19:54:05,694 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-03-03 19:54:05,694 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-03-03 19:54:05,694 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-03-03 19:54:05,694 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-03-03 19:54:05,694 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-03-03 19:54:05,694 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-03-03 19:54:05,694 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-03-03 19:54:05,694 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-03-03 19:54:05,694 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-03-03 19:54:05,694 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-03-03 19:54:05,694 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-03-03 19:54:05,694 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-03-03 19:54:05,694 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-03-03 19:54:05,694 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-03-03 19:54:05,694 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-03-03 19:54:05,694 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-03-03 19:54:05,694 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-03-03 19:54:05,694 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-03-03 19:54:05,694 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-03-03 19:54:05,694 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-03-03 19:54:05,695 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-03-03 19:54:05,695 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-03-03 19:54:05,695 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-03-03 19:54:05,695 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-03-03 19:54:05,695 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-03-03 19:54:05,695 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-03-03 19:54:05,695 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-03-03 19:54:05,695 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-03-03 19:54:05,695 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-03-03 19:54:05,695 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-03-03 19:54:05,695 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-03-03 19:54:05,695 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-03-03 19:54:05,695 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-03-03 19:54:05,695 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-03-03 19:54:05,695 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-03-03 19:54:05,695 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-03-03 19:54:05,695 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-03-03 19:54:05,696 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-03-03 19:54:05,696 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-03-03 19:54:05,696 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-03-03 19:54:05,696 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-03-03 19:54:05,696 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-03-03 19:54:05,696 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-03-03 19:54:05,696 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-03-03 19:54:05,696 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-03-03 19:54:05,696 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-03-03 19:54:05,696 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-03-03 19:54:05,696 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-03-03 19:54:05,696 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-03-03 19:54:05,696 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-03-03 19:54:05,696 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-03-03 19:54:05,696 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-03-03 19:54:05,696 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-03-03 19:54:05,697 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-03-03 19:54:05,697 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-03-03 19:54:05,697 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-03-03 19:54:05,697 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-03-03 19:54:05,697 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-03-03 19:54:05,697 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-03-03 19:54:05,697 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-03-03 19:54:05,697 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-03-03 19:54:05,697 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-03-03 19:54:05,697 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-03-03 19:54:05,697 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-03-03 19:54:05,697 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-03-03 19:54:05,697 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-03-03 19:54:05,697 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-03-03 19:54:05,697 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-03-03 19:54:05,697 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-03-03 19:54:05,802 INFO  [Time-limited test] balancer.StochasticLoadBalancer(381): Cluster wide - skipping load balancing because weighted average imbalance=1.7733814552780093E-5 <= threshold(0.025). If you want more aggressive balancing, either lower hbase.master.balancer.stochastic.minCostNeedBalance from 0.025 or increase the relative multiplier(s) of the specific cost function(s). functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=3.5313429231318235E-4); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0018951174787165373); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=3.5313429231318235E-4); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=8.333333333333333E-5); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-03-03 19:54:05,802 INFO  [Time-limited test] balancer.BalancerTestBase(570): Mock Final balance: { srv1460750818:82 , srv1772448381:82 , srv2050522124:82 , srv10016140:83 , srv2063813:83 , srv286225116:83 , srv442634672:83 , srv526742553:83 , srv570953413:83 , srv631546597:83 , srv720639874:83 , srv838858050:83 , srv1085782654:84 , srv1091286493:84 , srv1098479606:84 , srv1131838196:84 , srv1150762157:84 , srv1207212515:84 , srv1233626238:84 , srv1263281510:84 , srv1283812140:84 , srv1408318929:84 , srv1454067490:84 , srv145546103:84 , srv1459238240:84 , srv1493102915:84 , srv1572593143:84 , srv1583458437:84 , srv165240100:84 , srv1659449326:84 , srv1725389179:84 , srv1783678208:84 , srv1793246091:84 , srv1814604104:84 , srv1822286969:84 , srv1862636742:84 , srv1939857583:84 , srv2046783971:84 , srv2065699478:84 , srv358472997:84 , srv428670007:84 , srv433901506:84 , srv460006945:84 , srv523125617:84 , srv55664114:84 , srv618164048:84 , srv666257331:84 , srv669293872:84 , srv673820162:84 , srv796326125:84 , srv836347629:84 , srv1021024232:85 , srv1043060770:85 , srv1052445057:85 , srv1115592196:85 , srv1122648805:85 , srv1178504507:85 , srv1183219304:85 , srv1216060342:85 , srv1263380037:85 , srv1276140819:85 , srv1327437020:85 , srv1352518635:85 , srv1460508129:85 , srv1554103688:85 , srv1592035504:85 , srv1597366380:85 , srv1746586945:85 , srv1767906136:85 , srv1774492647:85 , srv1812871228:85 , srv1842821462:85 , srv1848276254:85 , srv1887698894:85 , srv1944670988:85 , srv2067330011:85 , srv2080556863:85 , srv2134135989:85 , srv2140856532:85 , srv256727956:85 , srv341312610:85 , srv429037855:85 , srv504461767:85 , srv611796447:85 , srv638163286:85 , srv649593818:85 , srv684061104:85 , srv754798424:85 , srv815010731:85 , srv835320787:85 , srv84137855:85 , srv852677679:85 , srv865241546:85 , srv867334635:85 , srv867605445:85 , srv984546502:85 , srv1410278244:86 , srv1807362432:86 , srv1694684710:87 , srv1983844833:647 }
2023-03-03 19:54:05,828 INFO  [Time-limited test] hbase.ResourceChecker(175): after: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnLargeClusterWithRacks Thread=10 (was 10), OpenFileDescriptor=260 (was 260), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=364 (was 352) - SystemLoadAverage LEAK? -, ProcessCount=174 (was 174), AvailableMemoryMB=5194 (was 5698)
2023-03-03 19:54:05,835 INFO  [Time-limited test] hbase.ResourceChecker(147): before: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnMidClusterWithRacks Thread=10, OpenFileDescriptor=260, MaxFileDescriptor=60000, SystemLoadAverage=364, ProcessCount=174, AvailableMemoryMB=5194
2023-03-03 19:54:05,836 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2023-03-03 19:54:05,836 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=5000, runMaxSteps=true, stepsPerRegion=800, maxRunningTime=120000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 111077.0 etc.
2023-03-03 19:54:05,851 INFO  [Time-limited test] balancer.BalancerTestBase(547): Mock Cluster : { srv1092865155:84 , srv1122137127:84 , srv1310956486:84 , srv1447250827:84 , srv1481998647:84 , srv1564062375:84 , srv1638951424:84 , srv1645454222:84 , srv1732717189:84 , srv1743751494:84 , srv1752091366:84 , srv1909978258:84 , srv2042910169:84 , srv2068106001:84 , srv2105136477:84 , srv262272499:84 , srv302088368:84 , srv329133469:84 , srv473039770:84 , srv527380348:84 , srv642914634:84 , srv677772450:84 , srv69116390:84 , srv720748060:84 , srv821411363:84 , srv824765441:84 , srv879949902:84 , srv88498081:84 , srv965340407:84 , srv1350790209:264 } [srvr=30 rgns=2700 avg=90.0 max=90 min=90]
2023-03-03 19:54:05,853 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-03-03 19:54:05,853 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv2105136477=15, srv527380348=20, srv677772450=22, srv473039770=19, srv720748060=24, srv69116390=23, srv302088368=17, srv329133469=18, srv1310956486=2, srv1350790209=3, srv879949902=27, srv2068106001=14, srv1481998647=5, srv1122137127=1, srv1645454222=8, srv1638951424=7, srv2042910169=13, srv1743751494=10, srv1564062375=6, srv1092865155=0, srv642914634=21, srv1909978258=12, srv965340407=29, srv1732717189=9, srv1447250827=4, srv821411363=25, srv1752091366=11, srv88498081=28, srv262272499=16, srv824765441=26} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-03-03 19:54:05,864 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-03-03 19:54:05,865 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-03-03 19:54:05,865 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-03-03 19:54:05,865 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-03-03 19:54:05,865 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-03-03 19:54:05,865 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-03-03 19:54:05,865 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-03-03 19:54:05,865 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-03-03 19:54:05,865 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-03-03 19:54:05,865 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-03-03 19:54:05,865 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-03-03 19:54:05,865 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-03-03 19:54:05,865 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-03-03 19:54:05,865 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-03-03 19:54:05,865 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-03-03 19:54:05,865 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-03-03 19:54:05,865 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-03-03 19:54:05,865 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-03-03 19:54:05,865 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-03-03 19:54:05,865 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-03-03 19:54:05,865 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-03-03 19:54:05,866 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-03-03 19:54:05,866 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-03-03 19:54:05,866 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-03-03 19:54:05,866 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-03-03 19:54:05,866 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-03-03 19:54:05,866 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-03-03 19:54:05,866 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-03-03 19:54:05,866 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-03-03 19:54:05,866 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-03-03 19:54:05,866 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=10, number of hosts=30, number of racks=4
2023-03-03 19:54:05,882 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=1.1121938627985275, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-03-03 19:54:05,882 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.9912546562462491, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=1.1121938627985275, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=64800000
2023-03-03 19:56:05,869 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 120001 ms to try 6650228 different iterations.  Found a solution that moves 1850 regions; Going from a computed imbalance of 0.9912546562462491 to a new imbalance of 4.317992290299789E-5. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); MoveCostFunction : (multiplier=7.0, imbalance=0.6851851851851852, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-03-03 19:56:05,875 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1092865155:90 , srv1122137127:90 , srv1310956486:90 , srv1350790209:90 , srv1447250827:90 , srv1481998647:90 , srv1564062375:90 , srv1638951424:90 , srv1645454222:90 , srv1732717189:90 , srv1743751494:90 , srv1752091366:90 , srv1909978258:90 , srv2042910169:90 , srv2068106001:90 , srv2105136477:90 , srv262272499:90 , srv302088368:90 , srv329133469:90 , srv473039770:90 , srv527380348:90 , srv642914634:90 , srv677772450:90 , srv69116390:90 , srv720748060:90 , srv821411363:90 , srv824765441:90 , srv879949902:90 , srv88498081:90 , srv965340407:90 }
2023-03-03 19:56:05,876 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-03-03 19:56:05,876 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv2105136477=15, srv527380348=20, srv677772450=22, srv473039770=19, srv720748060=24, srv69116390=23, srv302088368=17, srv329133469=18, srv1310956486=2, srv1350790209=3, srv879949902=27, srv2068106001=14, srv1481998647=5, srv1122137127=1, srv1645454222=8, srv1638951424=7, srv2042910169=13, srv1743751494=10, srv1564062375=6, srv1092865155=0, srv642914634=21, srv1909978258=12, srv965340407=29, srv1732717189=9, srv1447250827=4, srv821411363=25, srv1752091366=11, srv88498081=28, srv262272499=16, srv824765441=26} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-03-03 19:56:05,879 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-03-03 19:56:05,879 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-03-03 19:56:05,879 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-03-03 19:56:05,879 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-03-03 19:56:05,880 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-03-03 19:56:05,880 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-03-03 19:56:05,880 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-03-03 19:56:05,880 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-03-03 19:56:05,880 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-03-03 19:56:05,880 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-03-03 19:56:05,880 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-03-03 19:56:05,880 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-03-03 19:56:05,880 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-03-03 19:56:05,880 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-03-03 19:56:05,880 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-03-03 19:56:05,880 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-03-03 19:56:05,880 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-03-03 19:56:05,880 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-03-03 19:56:05,880 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-03-03 19:56:05,880 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-03-03 19:56:05,880 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-03-03 19:56:05,880 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-03-03 19:56:05,880 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-03-03 19:56:05,880 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-03-03 19:56:05,880 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-03-03 19:56:05,881 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-03-03 19:56:05,881 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-03-03 19:56:05,881 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-03-03 19:56:05,881 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-03-03 19:56:05,881 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-03-03 19:56:05,881 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=10, number of hosts=30, number of racks=4
2023-03-03 19:56:05,892 INFO  [Time-limited test] balancer.StochasticLoadBalancer(381): Cluster wide - skipping load balancing because weighted average imbalance=0.0 <= threshold(0.025). If you want more aggressive balancing, either lower hbase.master.balancer.stochastic.minCostNeedBalance from 0.025 or increase the relative multiplier(s) of the specific cost function(s). functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-03-03 19:56:05,892 INFO  [Time-limited test] balancer.BalancerTestBase(570): Mock Final balance: { srv1092865155:90 , srv1122137127:90 , srv1310956486:90 , srv1350790209:90 , srv1447250827:90 , srv1481998647:90 , srv1564062375:90 , srv1638951424:90 , srv1645454222:90 , srv1732717189:90 , srv1743751494:90 , srv1752091366:90 , srv1909978258:90 , srv2042910169:90 , srv2068106001:90 , srv2105136477:90 , srv262272499:90 , srv302088368:90 , srv329133469:90 , srv473039770:90 , srv527380348:90 , srv642914634:90 , srv677772450:90 , srv69116390:90 , srv720748060:90 , srv821411363:90 , srv824765441:90 , srv879949902:90 , srv88498081:90 , srv965340407:90 }
2023-03-03 19:56:05,905 INFO  [Time-limited test] hbase.ResourceChecker(175): after: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnMidClusterWithRacks Thread=9 (was 10), OpenFileDescriptor=260 (was 260), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=206 (was 364), ProcessCount=177 (was 174) - ProcessCount LEAK? -, AvailableMemoryMB=5062 (was 5194)