2023-04-19 16:55:44,249 INFO  [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks timeout: 13 mins
2023-04-19 16:55:44,620 WARN  [Time-limited test] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties
2023-04-19 16:55:44,760 INFO  [Time-limited test] metrics.MetricRegistriesLoader(60): Loaded MetricRegistries class org.apache.hadoop.hbase.metrics.impl.MetricRegistriesImpl
2023-04-19 16:55:44,838 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2023-04-19 16:55:44,846 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc.
2023-04-19 16:55:44,863 INFO  [Time-limited test] hbase.ResourceChecker(147): before: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnLargeClusterWithRacks Thread=10, OpenFileDescriptor=260, MaxFileDescriptor=60000, SystemLoadAverage=341, ProcessCount=210, AvailableMemoryMB=6769
2023-04-19 16:55:44,866 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2023-04-19 16:55:44,867 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=5000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=10000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc.
2023-04-19 16:55:45,029 INFO  [Time-limited test] balancer.BalancerTestBase(547): Mock Cluster : { srv1002751182:84 , srv1019552578:84 , srv1051406365:84 , srv1065618515:84 , srv1095781038:84 , srv1127533968:84 , srv1184816529:84 , srv1195207456:84 , srv1209885994:84 , srv1210535213:84 , srv1233419042:84 , srv1323146511:84 , srv133544646:84 , srv1344823176:84 , srv1351407768:84 , srv1357118739:84 , srv1413065391:84 , srv1424438126:84 , srv1445049330:84 , srv1456195891:84 , srv1457350242:84 , srv1468006921:84 , srv1507055584:84 , srv1519299236:84 , srv1548251749:84 , srv1551516049:84 , srv1570294918:84 , srv1619141001:84 , srv1627491:84 , srv1641421907:84 , srv1675838198:84 , srv1700714545:84 , srv1708795886:84 , srv1709349663:84 , srv1723071167:84 , srv1724834595:84 , srv1738175580:84 , srv1768362734:84 , srv177016726:84 , srv1823817429:84 , srv1829907793:84 , srv1846589701:84 , srv1846903718:84 , srv1870863444:84 , srv1874321213:84 , srv1893017106:84 , srv1902302310:84 , srv1908593193:84 , srv1917265593:84 , srv1944705597:84 , srv1947516175:84 , srv1961199060:84 , srv1966598928:84 , srv1975014164:84 , srv2012753561:84 , srv2052427943:84 , srv2079225621:84 , srv2098787485:84 , srv2110765963:84 , srv2136753976:84 , srv220234224:84 , srv238982452:84 , srv253699608:84 , srv275705228:84 , srv302065902:84 , srv316104123:84 , srv344662603:84 , srv371151218:84 , srv371858818:84 , srv380867206:84 , srv415564491:84 , srv423791589:84 , srv522221017:84 , srv554642019:84 , srv595714103:84 , srv598699333:84 , srv614117423:84 , srv640353800:84 , srv640422827:84 , srv670071913:84 , srv691213441:84 , srv70871595:84 , srv716235791:84 , srv751804818:84 , srv761746264:84 , srv789824268:84 , srv790020237:84 , srv799063300:84 , srv82199904:84 , srv826769232:84 , srv858472271:84 , srv872445904:84 , srv893209646:84 , srv897223247:84 , srv93966261:84 , srv948370132:84 , srv983942171:84 , srv995635204:84 , srv998264879:84 , srv1967118285:684 } [srvr=100 rgns=9000 avg=90.0 max=90 min=90]
2023-04-19 16:55:45,044 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-04-19 16:55:45,052 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1456195891=19, srv302065902=65, srv380867206=70, srv1468006921=21, srv554642019=74, srv1947516175=50, srv1961199060=51, srv2052427943=56, srv275705228=64, srv826769232=90, srv1519299236=23, srv2110765963=59, srv1570294918=26, srv897223247=94, srv2136753976=60, srv2012753561=55, srv1351407768=14, srv1944705597=49, srv1874321213=44, srv799063300=88, srv998264879=99, srv1846903718=42, srv614117423=77, srv238982452=62, srv789824268=86, srv371858818=69, srv1210535213=9, srv1723071167=34, srv595714103=75, srv1619141001=27, srv995635204=98, srv640422827=79, srv415564491=71, srv1975014164=54, srv2098787485=58, srv1627491=28, srv1829907793=40, srv177016726=38, srv872445904=92, srv1209885994=8, srv1344823176=13, srv1675838198=30, srv1127533968=5, srv1413065391=16, srv751804818=84, srv1507055584=22, srv1846589701=41, srv344662603=67, srv1902302310=46, srv1002751182=0, srv1870863444=43, srv1641421907=29, srv1195207456=7, srv1445049330=18, srv670071913=80, srv1095781038=4, srv1065618515=3, srv371151218=68, srv716235791=83, srv1019552578=1, srv1233419042=10, srv790020237=87, srv1823817429=39, srv1966598928=52, srv1424438126=17, srv1917265593=48, srv133544646=12, srv1457350242=20, srv691213441=81, srv82199904=89, srv1724834595=35, srv598699333=76, srv316104123=66, srv1709349663=33, srv640353800=78, srv983942171=97, srv1051406365=2, srv1548251749=24, srv1893017106=45, srv948370132=96, srv1357118739=15, srv893209646=93, srv1700714545=31, srv1551516049=25, srv1738175580=36, srv253699608=63, srv220234224=61, srv1323146511=11, srv522221017=73, srv761746264=85, srv2079225621=57, srv858472271=91, srv1908593193=47, srv1768362734=37, srv93966261=95, srv423791589=72, srv1184816529=6, srv1708795886=32, srv1967118285=53, srv70871595=82} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-04-19 16:55:45,173 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-04-19 16:55:45,173 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-04-19 16:55:45,173 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-04-19 16:55:45,173 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-04-19 16:55:45,174 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-04-19 16:55:45,174 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-04-19 16:55:45,174 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-04-19 16:55:45,174 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-04-19 16:55:45,174 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-04-19 16:55:45,174 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-04-19 16:55:45,175 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-04-19 16:55:45,175 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-04-19 16:55:45,175 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-04-19 16:55:45,175 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-04-19 16:55:45,175 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-04-19 16:55:45,175 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-04-19 16:55:45,175 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-04-19 16:55:45,175 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-04-19 16:55:45,176 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-04-19 16:55:45,176 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-04-19 16:55:45,176 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-04-19 16:55:45,176 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-04-19 16:55:45,176 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-04-19 16:55:45,176 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-04-19 16:55:45,176 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-04-19 16:55:45,177 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-04-19 16:55:45,177 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-04-19 16:55:45,177 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-04-19 16:55:45,177 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-04-19 16:55:45,177 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-04-19 16:55:45,177 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-04-19 16:55:45,177 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-04-19 16:55:45,178 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-04-19 16:55:45,178 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-04-19 16:55:45,178 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-04-19 16:55:45,178 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-04-19 16:55:45,178 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-04-19 16:55:45,178 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-04-19 16:55:45,178 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-04-19 16:55:45,179 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-04-19 16:55:45,179 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-04-19 16:55:45,179 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-04-19 16:55:45,179 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-04-19 16:55:45,179 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-04-19 16:55:45,179 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-04-19 16:55:45,179 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-04-19 16:55:45,180 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-04-19 16:55:45,180 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-04-19 16:55:45,180 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-04-19 16:55:45,180 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-04-19 16:55:45,180 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-04-19 16:55:45,180 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-04-19 16:55:45,180 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-04-19 16:55:45,181 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-04-19 16:55:45,181 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-04-19 16:55:45,181 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-04-19 16:55:45,181 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-04-19 16:55:45,181 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-04-19 16:55:45,181 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-04-19 16:55:45,181 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-04-19 16:55:45,181 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-04-19 16:55:45,182 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-04-19 16:55:45,182 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-04-19 16:55:45,182 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-04-19 16:55:45,182 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-04-19 16:55:45,182 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-04-19 16:55:45,182 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-04-19 16:55:45,182 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-04-19 16:55:45,183 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-04-19 16:55:45,183 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-04-19 16:55:45,183 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-04-19 16:55:45,183 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-04-19 16:55:45,183 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-04-19 16:55:45,183 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-04-19 16:55:45,183 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-04-19 16:55:45,183 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-04-19 16:55:45,184 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-04-19 16:55:45,184 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-04-19 16:55:45,184 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-04-19 16:55:45,184 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-04-19 16:55:45,184 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-04-19 16:55:45,184 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-04-19 16:55:45,184 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-04-19 16:55:45,185 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-04-19 16:55:45,185 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-04-19 16:55:45,185 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-04-19 16:55:45,185 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-04-19 16:55:45,185 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-04-19 16:55:45,185 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-04-19 16:55:45,185 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-04-19 16:55:45,185 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-04-19 16:55:45,186 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-04-19 16:55:45,186 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-04-19 16:55:45,186 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-04-19 16:55:45,186 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-04-19 16:55:45,186 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-04-19 16:55:45,186 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-04-19 16:55:45,186 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-04-19 16:55:45,186 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-04-19 16:55:45,187 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-04-19 16:55:45,187 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-04-19 16:55:45,398 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.06666666666666667, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-04-19 16:55:45,399 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-04-19 16:55:45,399 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.9909252140407105, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.06666666666666667, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-04-19 16:55:46,317 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 1096 ms to try 5000 different iterations.  Found a solution that moves 4651 regions; Going from a computed imbalance of 0.9909252140407105 to a new imbalance of 0.18593425243522452. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.039722820665282384, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.051299608494118465, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.5167777777777778, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.039722820665282384, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.18108333333333335, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.24941666666666668, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-04-19 16:55:46,351 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv2136753976:81 , srv1551516049:82 , srv177016726:82 , srv1944705597:82 , srv220234224:82 , srv93966261:82 , srv1823817429:83 , srv2098787485:83 , srv253699608:83 , srv380867206:83 , srv640353800:83 , srv790020237:83 , srv826769232:83 , srv858472271:83 , srv1195207456:84 , srv1233419042:84 , srv1445049330:84 , srv1619141001:84 , srv371151218:84 , srv423791589:84 , srv554642019:84 , srv595714103:84 , srv1019552578:85 , srv1456195891:85 , srv1507055584:85 , srv1829907793:85 , srv1846903718:85 , srv1893017106:85 , srv1902302310:85 , srv1917265593:85 , srv1947516175:85 , srv275705228:85 , srv751804818:85 , srv761746264:85 , srv872445904:85 , srv893209646:85 , srv1210535213:86 , srv1323146511:86 , srv133544646:86 , srv1344823176:86 , srv1351407768:86 , srv1424438126:86 , srv1519299236:86 , srv1627491:86 , srv1700714545:86 , srv1708795886:86 , srv1724834595:86 , srv1975014164:86 , srv2012753561:86 , srv2052427943:86 , srv522221017:86 , srv598699333:86 , srv789824268:86 , srv897223247:86 , srv995635204:86 , srv998264879:86 , srv1127533968:87 , srv1413065391:87 , srv1468006921:87 , srv1570294918:87 , srv1738175580:87 , srv1870863444:87 , srv1966598928:87 , srv2110765963:87 , srv302065902:87 , srv344662603:87 , srv799063300:87 , srv948370132:87 , srv1184816529:88 , srv1357118739:88 , srv1641421907:88 , srv1723071167:88 , srv1846589701:88 , srv640422827:88 , srv1002751182:89 , srv1051406365:89 , srv1065618515:89 , srv1457350242:89 , srv1548251749:89 , srv1675838198:89 , srv1709349663:89 , srv1768362734:89 , srv2079225621:89 , srv238982452:89 , srv614117423:89 , srv670071913:89 , srv691213441:89 , srv82199904:89 , srv1874321213:90 , srv371858818:90 , srv716235791:90 , srv1209885994:91 , srv1908593193:91 , srv316104123:91 , srv415564491:91 , srv70871595:91 , srv983942171:91 , srv1095781038:92 , srv1961199060:94 , srv1967118285:443 }
2023-04-19 16:55:46,358 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-04-19 16:55:46,360 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1456195891=19, srv302065902=65, srv380867206=70, srv1468006921=21, srv554642019=74, srv1947516175=50, srv1961199060=51, srv2052427943=56, srv275705228=64, srv826769232=90, srv1519299236=23, srv2110765963=59, srv1570294918=26, srv897223247=94, srv2136753976=60, srv2012753561=55, srv1351407768=14, srv1944705597=49, srv1874321213=44, srv799063300=88, srv998264879=99, srv1846903718=42, srv614117423=77, srv238982452=62, srv789824268=86, srv371858818=69, srv1210535213=9, srv1723071167=34, srv595714103=75, srv1619141001=27, srv995635204=98, srv640422827=79, srv415564491=71, srv1975014164=54, srv2098787485=58, srv1627491=28, srv1829907793=40, srv177016726=38, srv872445904=92, srv1209885994=8, srv1344823176=13, srv1675838198=30, srv1127533968=5, srv1413065391=16, srv751804818=84, srv1507055584=22, srv1846589701=41, srv344662603=67, srv1902302310=46, srv1002751182=0, srv1870863444=43, srv1641421907=29, srv1195207456=7, srv1445049330=18, srv670071913=80, srv1095781038=4, srv1065618515=3, srv371151218=68, srv716235791=83, srv1019552578=1, srv1233419042=10, srv790020237=87, srv1823817429=39, srv1966598928=52, srv1424438126=17, srv1917265593=48, srv133544646=12, srv1457350242=20, srv691213441=81, srv82199904=89, srv1724834595=35, srv598699333=76, srv316104123=66, srv1709349663=33, srv640353800=78, srv983942171=97, srv1051406365=2, srv1548251749=24, srv1893017106=45, srv948370132=96, srv1357118739=15, srv893209646=93, srv1700714545=31, srv1551516049=25, srv1738175580=36, srv253699608=63, srv220234224=61, srv1323146511=11, srv522221017=73, srv761746264=85, srv2079225621=57, srv858472271=91, srv1908593193=47, srv1768362734=37, srv93966261=95, srv423791589=72, srv1184816529=6, srv1708795886=32, srv1967118285=53, srv70871595=82} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-04-19 16:55:46,391 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-04-19 16:55:46,391 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-04-19 16:55:46,392 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-04-19 16:55:46,392 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-04-19 16:55:46,392 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-04-19 16:55:46,392 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-04-19 16:55:46,392 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-04-19 16:55:46,392 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-04-19 16:55:46,392 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-04-19 16:55:46,393 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-04-19 16:55:46,393 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-04-19 16:55:46,393 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-04-19 16:55:46,393 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-04-19 16:55:46,393 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-04-19 16:55:46,393 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-04-19 16:55:46,393 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-04-19 16:55:46,394 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-04-19 16:55:46,394 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-04-19 16:55:46,394 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-04-19 16:55:46,394 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-04-19 16:55:46,394 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-04-19 16:55:46,394 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-04-19 16:55:46,394 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-04-19 16:55:46,395 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-04-19 16:55:46,395 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-04-19 16:55:46,395 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-04-19 16:55:46,395 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-04-19 16:55:46,395 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-04-19 16:55:46,395 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-04-19 16:55:46,395 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-04-19 16:55:46,395 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-04-19 16:55:46,396 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-04-19 16:55:46,396 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-04-19 16:55:46,396 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-04-19 16:55:46,396 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-04-19 16:55:46,396 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-04-19 16:55:46,396 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-04-19 16:55:46,396 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-04-19 16:55:46,396 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-04-19 16:55:46,397 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-04-19 16:55:46,397 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-04-19 16:55:46,397 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-04-19 16:55:46,397 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-04-19 16:55:46,397 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-04-19 16:55:46,397 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-04-19 16:55:46,397 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-04-19 16:55:46,397 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-04-19 16:55:46,398 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-04-19 16:55:46,398 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-04-19 16:55:46,398 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-04-19 16:55:46,398 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-04-19 16:55:46,398 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-04-19 16:55:46,398 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-04-19 16:55:46,398 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-04-19 16:55:46,398 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-04-19 16:55:46,399 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-04-19 16:55:46,399 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-04-19 16:55:46,399 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-04-19 16:55:46,399 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-04-19 16:55:46,399 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-04-19 16:55:46,399 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-04-19 16:55:46,399 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-04-19 16:55:46,400 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-04-19 16:55:46,400 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-04-19 16:55:46,400 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-04-19 16:55:46,400 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-04-19 16:55:46,400 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-04-19 16:55:46,400 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-04-19 16:55:46,400 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-04-19 16:55:46,401 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-04-19 16:55:46,401 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-04-19 16:55:46,401 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-04-19 16:55:46,401 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-04-19 16:55:46,401 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-04-19 16:55:46,401 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-04-19 16:55:46,401 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-04-19 16:55:46,401 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-04-19 16:55:46,401 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-04-19 16:55:46,402 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-04-19 16:55:46,402 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-04-19 16:55:46,402 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-04-19 16:55:46,402 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-04-19 16:55:46,402 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-04-19 16:55:46,402 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-04-19 16:55:46,402 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-04-19 16:55:46,402 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-04-19 16:55:46,403 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-04-19 16:55:46,403 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-04-19 16:55:46,403 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-04-19 16:55:46,403 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-04-19 16:55:46,403 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-04-19 16:55:46,403 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-04-19 16:55:46,403 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-04-19 16:55:46,403 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-04-19 16:55:46,404 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-04-19 16:55:46,404 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-04-19 16:55:46,404 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-04-19 16:55:46,404 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-04-19 16:55:46,404 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-04-19 16:55:46,404 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-04-19 16:55:46,404 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-04-19 16:55:46,576 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.039722820665282384, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.051299608494118465, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.039722820665282384, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.18108333333333335, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.24941666666666668, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-04-19 16:55:46,576 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-04-19 16:55:46,576 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.18590168543715613, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.039722820665282384, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.051299608494118465, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.039722820665282384, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.18108333333333335, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.24941666666666668, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-04-19 16:55:46,967 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 532 ms to try 5000 different iterations.  Found a solution that moves 2673 regions; Going from a computed imbalance of 0.18590168543715613 to a new imbalance of 0.013305134887603032. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.019352274736410196); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.025924001852605086, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.297, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.019352274736410196); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.01025); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.04275, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-04-19 16:55:46,979 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1961199060:77 , srv1908593193:79 , srv1095781038:80 , srv70871595:80 , srv1874321213:81 , srv371858818:81 , srv415564491:81 , srv1209885994:82 , srv1457350242:82 , srv1184816529:83 , srv1548251749:83 , srv1641421907:83 , srv1709349663:83 , srv1768362734:83 , srv2079225621:83 , srv238982452:83 , srv316104123:83 , srv614117423:83 , srv691213441:83 , srv716235791:83 , srv82199904:83 , srv983942171:83 , srv1051406365:84 , srv1065618515:84 , srv1323146511:84 , srv1413065391:84 , srv1424438126:84 , srv1570294918:84 , srv1675838198:84 , srv1127533968:85 , srv133544646:85 , srv1357118739:85 , srv1627491:85 , srv1724834595:85 , srv1738175580:85 , srv1846589701:85 , srv2012753561:85 , srv2110765963:85 , srv344662603:85 , srv640422827:85 , srv670071913:85 , srv872445904:85 , srv897223247:85 , srv1210535213:86 , srv1456195891:86 , srv1468006921:86 , srv1507055584:86 , srv1519299236:86 , srv1870863444:86 , srv1966598928:86 , srv1975014164:86 , srv275705228:86 , srv302065902:86 , srv522221017:86 , srv751804818:86 , srv789824268:86 , srv948370132:86 , srv1002751182:87 , srv1019552578:87 , srv1344823176:87 , srv1700714545:87 , srv1708795886:87 , srv1723071167:87 , srv1902302310:87 , srv1917265593:87 , srv1947516175:87 , srv598699333:87 , srv761746264:87 , srv995635204:87 , srv1195207456:88 , srv1233419042:88 , srv1351407768:88 , srv1445049330:88 , srv177016726:88 , srv1893017106:88 , srv380867206:88 , srv554642019:88 , srv640353800:88 , srv799063300:88 , srv893209646:88 , srv998264879:88 , srv1551516049:89 , srv1619141001:89 , srv1823817429:89 , srv1829907793:89 , srv1846903718:89 , srv2098787485:89 , srv253699608:89 , srv371151218:89 , srv595714103:89 , srv858472271:89 , srv93966261:89 , srv2052427943:90 , srv220234224:90 , srv790020237:90 , srv826769232:90 , srv1944705597:91 , srv423791589:91 , srv2136753976:92 , srv1967118285:503 }
2023-04-19 16:55:46,985 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-04-19 16:55:46,986 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1456195891=19, srv302065902=65, srv380867206=70, srv1468006921=21, srv554642019=74, srv1947516175=50, srv1961199060=51, srv2052427943=56, srv275705228=64, srv826769232=90, srv1519299236=23, srv2110765963=59, srv1570294918=26, srv897223247=94, srv2136753976=60, srv2012753561=55, srv1351407768=14, srv1944705597=49, srv1874321213=44, srv799063300=88, srv998264879=99, srv1846903718=42, srv614117423=77, srv238982452=62, srv789824268=86, srv371858818=69, srv1210535213=9, srv1723071167=34, srv595714103=75, srv1619141001=27, srv995635204=98, srv640422827=79, srv415564491=71, srv1975014164=54, srv2098787485=58, srv1627491=28, srv1829907793=40, srv177016726=38, srv872445904=92, srv1209885994=8, srv1344823176=13, srv1675838198=30, srv1127533968=5, srv1413065391=16, srv751804818=84, srv1507055584=22, srv1846589701=41, srv344662603=67, srv1902302310=46, srv1002751182=0, srv1870863444=43, srv1641421907=29, srv1195207456=7, srv1445049330=18, srv670071913=80, srv1095781038=4, srv1065618515=3, srv371151218=68, srv716235791=83, srv1019552578=1, srv1233419042=10, srv790020237=87, srv1823817429=39, srv1966598928=52, srv1424438126=17, srv1917265593=48, srv133544646=12, srv1457350242=20, srv691213441=81, srv82199904=89, srv1724834595=35, srv598699333=76, srv316104123=66, srv1709349663=33, srv640353800=78, srv983942171=97, srv1051406365=2, srv1548251749=24, srv1893017106=45, srv948370132=96, srv1357118739=15, srv893209646=93, srv1700714545=31, srv1551516049=25, srv1738175580=36, srv253699608=63, srv220234224=61, srv1323146511=11, srv522221017=73, srv761746264=85, srv2079225621=57, srv858472271=91, srv1908593193=47, srv1768362734=37, srv93966261=95, srv423791589=72, srv1184816529=6, srv1708795886=32, srv1967118285=53, srv70871595=82} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-04-19 16:55:46,999 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-04-19 16:55:46,999 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-04-19 16:55:46,999 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-04-19 16:55:46,999 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-04-19 16:55:46,999 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-04-19 16:55:46,999 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-04-19 16:55:46,999 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-04-19 16:55:46,999 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-04-19 16:55:46,999 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-04-19 16:55:46,999 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-04-19 16:55:47,000 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-04-19 16:55:47,000 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-04-19 16:55:47,000 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-04-19 16:55:47,000 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-04-19 16:55:47,000 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-04-19 16:55:47,000 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-04-19 16:55:47,000 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-04-19 16:55:47,000 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-04-19 16:55:47,000 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-04-19 16:55:47,000 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-04-19 16:55:47,000 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-04-19 16:55:47,000 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-04-19 16:55:47,000 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-04-19 16:55:47,000 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-04-19 16:55:47,001 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-04-19 16:55:47,001 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-04-19 16:55:47,001 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-04-19 16:55:47,001 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-04-19 16:55:47,001 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-04-19 16:55:47,001 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-04-19 16:55:47,001 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-04-19 16:55:47,001 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-04-19 16:55:47,001 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-04-19 16:55:47,001 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-04-19 16:55:47,001 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-04-19 16:55:47,001 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-04-19 16:55:47,001 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-04-19 16:55:47,001 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-04-19 16:55:47,001 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-04-19 16:55:47,002 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-04-19 16:55:47,002 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-04-19 16:55:47,002 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-04-19 16:55:47,002 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-04-19 16:55:47,002 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-04-19 16:55:47,002 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-04-19 16:55:47,002 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-04-19 16:55:47,002 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-04-19 16:55:47,002 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-04-19 16:55:47,002 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-04-19 16:55:47,002 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-04-19 16:55:47,002 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-04-19 16:55:47,002 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-04-19 16:55:47,002 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-04-19 16:55:47,002 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-04-19 16:55:47,003 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-04-19 16:55:47,003 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-04-19 16:55:47,003 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-04-19 16:55:47,003 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-04-19 16:55:47,003 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-04-19 16:55:47,003 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-04-19 16:55:47,003 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-04-19 16:55:47,003 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-04-19 16:55:47,003 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-04-19 16:55:47,003 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-04-19 16:55:47,003 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-04-19 16:55:47,003 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-04-19 16:55:47,004 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-04-19 16:55:47,004 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-04-19 16:55:47,004 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-04-19 16:55:47,004 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-04-19 16:55:47,004 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-04-19 16:55:47,004 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-04-19 16:55:47,004 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-04-19 16:55:47,004 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-04-19 16:55:47,004 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-04-19 16:55:47,005 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-04-19 16:55:47,005 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-04-19 16:55:47,005 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-04-19 16:55:47,005 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-04-19 16:55:47,005 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-04-19 16:55:47,005 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-04-19 16:55:47,005 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-04-19 16:55:47,005 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-04-19 16:55:47,005 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-04-19 16:55:47,006 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-04-19 16:55:47,006 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-04-19 16:55:47,006 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-04-19 16:55:47,006 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-04-19 16:55:47,006 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-04-19 16:55:47,006 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-04-19 16:55:47,006 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-04-19 16:55:47,006 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-04-19 16:55:47,006 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-04-19 16:55:47,006 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-04-19 16:55:47,007 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-04-19 16:55:47,007 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-04-19 16:55:47,007 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-04-19 16:55:47,007 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-04-19 16:55:47,007 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-04-19 16:55:47,007 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-04-19 16:55:47,007 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-04-19 16:55:47,141 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.019352274736410196); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.025924001852605086, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.019352274736410196); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.01025); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.04275, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-04-19 16:55:47,141 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-04-19 16:55:47,142 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.013286418141561998, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.019352274736410196); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.025924001852605086, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.019352274736410196); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.01025); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.04275, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-04-19 16:55:47,501 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 474 ms to try 5000 different iterations.  Found a solution that moves 986 regions; Going from a computed imbalance of 0.013286418141561998 to a new imbalance of 5.62497118821215E-4. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.004103049699311091); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0073702773119008885); MoveCostFunction : (multiplier=7.0, imbalance=0.10955555555555556, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.004103049699311091); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.6666666666666666E-4); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.003916666666666666); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-04-19 16:55:47,503 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv2052427943:81 , srv1002751182:82 , srv799063300:82 , srv1723071167:83 , srv1829907793:83 , srv1944705597:83 , srv423791589:83 , srv983942171:83 , srv1209885994:84 , srv1344823176:84 , srv1619141001:84 , srv1700714545:84 , srv1768362734:84 , srv1846903718:84 , srv1893017106:84 , srv2136753976:84 , srv302065902:84 , srv316104123:84 , srv371151218:84 , srv670071913:84 , srv716235791:84 , srv790020237:84 , srv998264879:84 , srv1019552578:85 , srv1051406365:85 , srv1127533968:85 , srv1195207456:85 , srv1351407768:85 , srv1445049330:85 , srv1468006921:85 , srv1519299236:85 , srv1675838198:85 , srv1708795886:85 , srv1738175580:85 , srv1870863444:85 , srv1902302310:85 , srv1917265593:85 , srv1947516175:85 , srv1966598928:85 , srv2110765963:85 , srv253699608:85 , srv522221017:85 , srv595714103:85 , srv598699333:85 , srv614117423:85 , srv640422827:85 , srv691213441:85 , srv826769232:85 , srv893209646:85 , srv948370132:85 , srv995635204:85 , srv1065618515:86 , srv1095781038:86 , srv1233419042:86 , srv133544646:86 , srv1357118739:86 , srv1413065391:86 , srv1456195891:86 , srv1548251749:86 , srv1627491:86 , srv1641421907:86 , srv1709349663:86 , srv1724834595:86 , srv1823817429:86 , srv1846589701:86 , srv1874321213:86 , srv1975014164:86 , srv2012753561:86 , srv2079225621:86 , srv2098787485:86 , srv220234224:86 , srv238982452:86 , srv415564491:86 , srv554642019:86 , srv70871595:86 , srv761746264:86 , srv789824268:86 , srv82199904:86 , srv858472271:86 , srv93966261:86 , srv1184816529:87 , srv1210535213:87 , srv1424438126:87 , srv1457350242:87 , srv1551516049:87 , srv1570294918:87 , srv1961199060:87 , srv275705228:87 , srv344662603:87 , srv371858818:87 , srv380867206:87 , srv640353800:87 , srv751804818:87 , srv897223247:87 , srv1323146511:88 , srv1507055584:88 , srv177016726:88 , srv1908593193:88 , srv872445904:88 , srv1967118285:548 }
2023-04-19 16:55:47,509 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-04-19 16:55:47,510 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1456195891=19, srv302065902=65, srv380867206=70, srv1468006921=21, srv554642019=74, srv1947516175=50, srv1961199060=51, srv2052427943=56, srv275705228=64, srv826769232=90, srv1519299236=23, srv2110765963=59, srv1570294918=26, srv897223247=94, srv2136753976=60, srv2012753561=55, srv1351407768=14, srv1944705597=49, srv1874321213=44, srv799063300=88, srv998264879=99, srv1846903718=42, srv614117423=77, srv238982452=62, srv789824268=86, srv371858818=69, srv1210535213=9, srv1723071167=34, srv595714103=75, srv1619141001=27, srv995635204=98, srv640422827=79, srv415564491=71, srv1975014164=54, srv2098787485=58, srv1627491=28, srv1829907793=40, srv177016726=38, srv872445904=92, srv1209885994=8, srv1344823176=13, srv1675838198=30, srv1127533968=5, srv1413065391=16, srv751804818=84, srv1507055584=22, srv1846589701=41, srv344662603=67, srv1902302310=46, srv1002751182=0, srv1870863444=43, srv1641421907=29, srv1195207456=7, srv1445049330=18, srv670071913=80, srv1095781038=4, srv1065618515=3, srv371151218=68, srv716235791=83, srv1019552578=1, srv1233419042=10, srv790020237=87, srv1823817429=39, srv1966598928=52, srv1424438126=17, srv1917265593=48, srv133544646=12, srv1457350242=20, srv691213441=81, srv82199904=89, srv1724834595=35, srv598699333=76, srv316104123=66, srv1709349663=33, srv640353800=78, srv983942171=97, srv1051406365=2, srv1548251749=24, srv1893017106=45, srv948370132=96, srv1357118739=15, srv893209646=93, srv1700714545=31, srv1551516049=25, srv1738175580=36, srv253699608=63, srv220234224=61, srv1323146511=11, srv522221017=73, srv761746264=85, srv2079225621=57, srv858472271=91, srv1908593193=47, srv1768362734=37, srv93966261=95, srv423791589=72, srv1184816529=6, srv1708795886=32, srv1967118285=53, srv70871595=82} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-04-19 16:55:47,535 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-04-19 16:55:47,535 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-04-19 16:55:47,535 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-04-19 16:55:47,536 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-04-19 16:55:47,536 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-04-19 16:55:47,536 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-04-19 16:55:47,536 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-04-19 16:55:47,536 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-04-19 16:55:47,536 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-04-19 16:55:47,536 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-04-19 16:55:47,536 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-04-19 16:55:47,536 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-04-19 16:55:47,536 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-04-19 16:55:47,537 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-04-19 16:55:47,537 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-04-19 16:55:47,537 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-04-19 16:55:47,537 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-04-19 16:55:47,537 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-04-19 16:55:47,537 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-04-19 16:55:47,537 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-04-19 16:55:47,537 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-04-19 16:55:47,537 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-04-19 16:55:47,537 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-04-19 16:55:47,538 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-04-19 16:55:47,538 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-04-19 16:55:47,538 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-04-19 16:55:47,538 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-04-19 16:55:47,538 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-04-19 16:55:47,538 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-04-19 16:55:47,538 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-04-19 16:55:47,538 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-04-19 16:55:47,538 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-04-19 16:55:47,538 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-04-19 16:55:47,539 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-04-19 16:55:47,539 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-04-19 16:55:47,539 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-04-19 16:55:47,539 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-04-19 16:55:47,539 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-04-19 16:55:47,539 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-04-19 16:55:47,539 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-04-19 16:55:47,539 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-04-19 16:55:47,539 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-04-19 16:55:47,540 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-04-19 16:55:47,540 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-04-19 16:55:47,540 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-04-19 16:55:47,540 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-04-19 16:55:47,540 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-04-19 16:55:47,540 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-04-19 16:55:47,540 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-04-19 16:55:47,540 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-04-19 16:55:47,540 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-04-19 16:55:47,540 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-04-19 16:55:47,541 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-04-19 16:55:47,541 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-04-19 16:55:47,541 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-04-19 16:55:47,541 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-04-19 16:55:47,541 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-04-19 16:55:47,541 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-04-19 16:55:47,541 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-04-19 16:55:47,541 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-04-19 16:55:47,541 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-04-19 16:55:47,541 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-04-19 16:55:47,542 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-04-19 16:55:47,542 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-04-19 16:55:47,542 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-04-19 16:55:47,542 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-04-19 16:55:47,542 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-04-19 16:55:47,542 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-04-19 16:55:47,542 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-04-19 16:55:47,542 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-04-19 16:55:47,542 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-04-19 16:55:47,542 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-04-19 16:55:47,543 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-04-19 16:55:47,543 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-04-19 16:55:47,543 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-04-19 16:55:47,543 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-04-19 16:55:47,543 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-04-19 16:55:47,543 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-04-19 16:55:47,543 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-04-19 16:55:47,543 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-04-19 16:55:47,543 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-04-19 16:55:47,543 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-04-19 16:55:47,543 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-04-19 16:55:47,544 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-04-19 16:55:47,544 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-04-19 16:55:47,544 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-04-19 16:55:47,544 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-04-19 16:55:47,544 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-04-19 16:55:47,544 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-04-19 16:55:47,544 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-04-19 16:55:47,544 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-04-19 16:55:47,544 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-04-19 16:55:47,544 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-04-19 16:55:47,544 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-04-19 16:55:47,545 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-04-19 16:55:47,545 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-04-19 16:55:47,545 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-04-19 16:55:47,545 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-04-19 16:55:47,545 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-04-19 16:55:47,545 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-04-19 16:55:47,545 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-04-19 16:55:47,664 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.004103049699311091); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0073702773119008885); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.004103049699311091); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.6666666666666666E-4); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.003916666666666666); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-04-19 16:55:47,664 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-04-19 16:55:47,664 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=5.555929992565086E-4, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.004103049699311091); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0073702773119008885); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.004103049699311091); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.6666666666666666E-4); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.003916666666666666); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-04-19 16:55:47,995 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 431 ms to try 5000 different iterations.  Found a solution that moves 235 regions; Going from a computed imbalance of 5.555929992565086E-4 to a new imbalance of 2.5545622055258097E-5. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=4.4668347344853864E-4); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0014982219165849825); MoveCostFunction : (multiplier=7.0, imbalance=0.026111111111111113, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=4.4668347344853864E-4); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.6666666666666666E-4); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-04-19 16:55:47,996 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1210535213:82 , srv1065618515:83 , srv1351407768:83 , srv1846589701:83 , srv2079225621:83 , srv344662603:83 , srv371858818:83 , srv1002751182:84 , srv1051406365:84 , srv1095781038:84 , srv1184816529:84 , srv1233419042:84 , srv1357118739:84 , srv1457350242:84 , srv1468006921:84 , srv1507055584:84 , srv1548251749:84 , srv1551516049:84 , srv1570294918:84 , srv1627491:84 , srv1641421907:84 , srv1675838198:84 , srv1708795886:84 , srv1709349663:84 , srv1723071167:84 , srv177016726:84 , srv1823817429:84 , srv1846903718:84 , srv1870863444:84 , srv1908593193:84 , srv1917265593:84 , srv1961199060:84 , srv1975014164:84 , srv220234224:84 , srv238982452:84 , srv275705228:84 , srv380867206:84 , srv423791589:84 , srv522221017:84 , srv554642019:84 , srv595714103:84 , srv598699333:84 , srv640353800:84 , srv640422827:84 , srv670071913:84 , srv751804818:84 , srv761746264:84 , srv789824268:84 , srv82199904:84 , srv826769232:84 , srv872445904:84 , srv893209646:84 , srv897223247:84 , srv93966261:84 , srv948370132:84 , srv995635204:84 , srv998264879:84 , srv1019552578:85 , srv1127533968:85 , srv1195207456:85 , srv1209885994:85 , srv1323146511:85 , srv133544646:85 , srv1344823176:85 , srv1413065391:85 , srv1424438126:85 , srv1445049330:85 , srv1456195891:85 , srv1519299236:85 , srv1619141001:85 , srv1700714545:85 , srv1724834595:85 , srv1738175580:85 , srv1829907793:85 , srv1874321213:85 , srv1893017106:85 , srv1902302310:85 , srv1947516175:85 , srv1966598928:85 , srv2012753561:85 , srv2052427943:85 , srv2098787485:85 , srv2110765963:85 , srv2136753976:85 , srv253699608:85 , srv302065902:85 , srv316104123:85 , srv371151218:85 , srv415564491:85 , srv614117423:85 , srv691213441:85 , srv70871595:85 , srv716235791:85 , srv790020237:85 , srv799063300:85 , srv858472271:85 , srv983942171:85 , srv1768362734:86 , srv1944705597:86 , srv1967118285:648 }
2023-04-19 16:55:47,999 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-04-19 16:55:48,000 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1456195891=19, srv302065902=65, srv380867206=70, srv1468006921=21, srv554642019=74, srv1947516175=50, srv1961199060=51, srv2052427943=56, srv275705228=64, srv826769232=90, srv1519299236=23, srv2110765963=59, srv1570294918=26, srv897223247=94, srv2136753976=60, srv2012753561=55, srv1351407768=14, srv1944705597=49, srv1874321213=44, srv799063300=88, srv998264879=99, srv1846903718=42, srv614117423=77, srv238982452=62, srv789824268=86, srv371858818=69, srv1210535213=9, srv1723071167=34, srv595714103=75, srv1619141001=27, srv995635204=98, srv640422827=79, srv415564491=71, srv1975014164=54, srv2098787485=58, srv1627491=28, srv1829907793=40, srv177016726=38, srv872445904=92, srv1209885994=8, srv1344823176=13, srv1675838198=30, srv1127533968=5, srv1413065391=16, srv751804818=84, srv1507055584=22, srv1846589701=41, srv344662603=67, srv1902302310=46, srv1002751182=0, srv1870863444=43, srv1641421907=29, srv1195207456=7, srv1445049330=18, srv670071913=80, srv1095781038=4, srv1065618515=3, srv371151218=68, srv716235791=83, srv1019552578=1, srv1233419042=10, srv790020237=87, srv1823817429=39, srv1966598928=52, srv1424438126=17, srv1917265593=48, srv133544646=12, srv1457350242=20, srv691213441=81, srv82199904=89, srv1724834595=35, srv598699333=76, srv316104123=66, srv1709349663=33, srv640353800=78, srv983942171=97, srv1051406365=2, srv1548251749=24, srv1893017106=45, srv948370132=96, srv1357118739=15, srv893209646=93, srv1700714545=31, srv1551516049=25, srv1738175580=36, srv253699608=63, srv220234224=61, srv1323146511=11, srv522221017=73, srv761746264=85, srv2079225621=57, srv858472271=91, srv1908593193=47, srv1768362734=37, srv93966261=95, srv423791589=72, srv1184816529=6, srv1708795886=32, srv1967118285=53, srv70871595=82} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-04-19 16:55:48,011 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-04-19 16:55:48,011 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-04-19 16:55:48,011 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-04-19 16:55:48,011 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-04-19 16:55:48,011 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-04-19 16:55:48,011 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-04-19 16:55:48,011 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-04-19 16:55:48,011 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-04-19 16:55:48,011 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-04-19 16:55:48,011 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-04-19 16:55:48,011 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-04-19 16:55:48,011 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-04-19 16:55:48,011 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-04-19 16:55:48,012 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-04-19 16:55:48,012 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-04-19 16:55:48,012 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-04-19 16:55:48,012 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-04-19 16:55:48,012 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-04-19 16:55:48,012 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-04-19 16:55:48,012 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-04-19 16:55:48,012 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-04-19 16:55:48,012 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-04-19 16:55:48,012 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-04-19 16:55:48,012 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-04-19 16:55:48,012 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-04-19 16:55:48,012 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-04-19 16:55:48,012 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-04-19 16:55:48,012 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-04-19 16:55:48,012 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-04-19 16:55:48,012 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-04-19 16:55:48,012 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-04-19 16:55:48,012 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-04-19 16:55:48,012 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-04-19 16:55:48,013 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-04-19 16:55:48,013 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-04-19 16:55:48,013 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-04-19 16:55:48,013 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-04-19 16:55:48,013 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-04-19 16:55:48,013 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-04-19 16:55:48,013 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-04-19 16:55:48,013 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-04-19 16:55:48,013 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-04-19 16:55:48,013 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-04-19 16:55:48,013 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-04-19 16:55:48,013 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-04-19 16:55:48,013 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-04-19 16:55:48,013 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-04-19 16:55:48,013 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-04-19 16:55:48,013 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-04-19 16:55:48,013 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-04-19 16:55:48,013 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-04-19 16:55:48,013 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-04-19 16:55:48,013 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-04-19 16:55:48,013 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-04-19 16:55:48,013 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-04-19 16:55:48,014 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-04-19 16:55:48,014 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-04-19 16:55:48,014 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-04-19 16:55:48,014 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-04-19 16:55:48,014 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-04-19 16:55:48,014 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-04-19 16:55:48,014 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-04-19 16:55:48,014 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-04-19 16:55:48,014 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-04-19 16:55:48,014 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-04-19 16:55:48,014 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-04-19 16:55:48,014 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-04-19 16:55:48,014 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-04-19 16:55:48,014 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-04-19 16:55:48,015 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-04-19 16:55:48,015 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-04-19 16:55:48,015 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-04-19 16:55:48,015 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-04-19 16:55:48,015 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-04-19 16:55:48,015 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-04-19 16:55:48,015 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-04-19 16:55:48,015 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-04-19 16:55:48,015 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-04-19 16:55:48,015 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-04-19 16:55:48,016 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-04-19 16:55:48,016 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-04-19 16:55:48,016 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-04-19 16:55:48,016 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-04-19 16:55:48,016 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-04-19 16:55:48,016 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-04-19 16:55:48,016 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-04-19 16:55:48,016 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-04-19 16:55:48,016 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-04-19 16:55:48,016 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-04-19 16:55:48,016 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-04-19 16:55:48,016 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-04-19 16:55:48,017 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-04-19 16:55:48,017 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-04-19 16:55:48,017 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-04-19 16:55:48,017 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-04-19 16:55:48,017 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-04-19 16:55:48,017 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-04-19 16:55:48,017 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-04-19 16:55:48,017 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-04-19 16:55:48,017 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-04-19 16:55:48,017 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-04-19 16:55:48,125 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=4.4668347344853864E-4); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0014982219165849825); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=4.4668347344853864E-4); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.6666666666666666E-4); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-04-19 16:55:48,126 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-04-19 16:55:48,126 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=2.3900116885170886E-5, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=4.4668347344853864E-4); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0014982219165849825); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=4.4668347344853864E-4); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.6666666666666666E-4); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-04-19 16:55:48,439 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 412 ms to try 5000 different iterations.  Found a solution that moves 18 regions; Going from a computed imbalance of 2.3900116885170886E-5 to a new imbalance of 5.768531687405695E-6. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0012535023884839248); MoveCostFunction : (multiplier=7.0, imbalance=0.002); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-04-19 16:55:48,440 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1323146511:83 , srv1357118739:83 , srv1507055584:83 , srv1966598928:83 , srv2098787485:83 , srv316104123:83 , srv415564491:83 , srv858472271:83 , srv1002751182:84 , srv1019552578:84 , srv1051406365:84 , srv1065618515:84 , srv1095781038:84 , srv1127533968:84 , srv1184816529:84 , srv1195207456:84 , srv1209885994:84 , srv1233419042:84 , srv133544646:84 , srv1344823176:84 , srv1351407768:84 , srv1413065391:84 , srv1424438126:84 , srv1445049330:84 , srv1456195891:84 , srv1457350242:84 , srv1468006921:84 , srv1519299236:84 , srv1548251749:84 , srv1551516049:84 , srv1570294918:84 , srv1619141001:84 , srv1675838198:84 , srv1700714545:84 , srv1708795886:84 , srv1709349663:84 , srv1723071167:84 , srv1724834595:84 , srv1738175580:84 , srv1768362734:84 , srv177016726:84 , srv1823817429:84 , srv1829907793:84 , srv1846589701:84 , srv1846903718:84 , srv1870863444:84 , srv1874321213:84 , srv1893017106:84 , srv1902302310:84 , srv1908593193:84 , srv1944705597:84 , srv1947516175:84 , srv1961199060:84 , srv1975014164:84 , srv2012753561:84 , srv2052427943:84 , srv2110765963:84 , srv2136753976:84 , srv220234224:84 , srv238982452:84 , srv253699608:84 , srv275705228:84 , srv302065902:84 , srv344662603:84 , srv371151218:84 , srv380867206:84 , srv423791589:84 , srv554642019:84 , srv595714103:84 , srv598699333:84 , srv614117423:84 , srv640353800:84 , srv640422827:84 , srv670071913:84 , srv691213441:84 , srv70871595:84 , srv716235791:84 , srv751804818:84 , srv761746264:84 , srv789824268:84 , srv790020237:84 , srv799063300:84 , srv82199904:84 , srv826769232:84 , srv872445904:84 , srv893209646:84 , srv897223247:84 , srv948370132:84 , srv983942171:84 , srv995635204:84 , srv998264879:84 , srv1210535213:85 , srv1627491:85 , srv1641421907:85 , srv1917265593:85 , srv2079225621:85 , srv371858818:85 , srv522221017:85 , srv93966261:85 , srv1967118285:684 }
2023-04-19 16:55:48,446 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-04-19 16:55:48,446 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1456195891=19, srv302065902=65, srv380867206=70, srv1468006921=21, srv554642019=74, srv1947516175=50, srv1961199060=51, srv2052427943=56, srv275705228=64, srv826769232=90, srv1519299236=23, srv2110765963=59, srv1570294918=26, srv897223247=94, srv2136753976=60, srv2012753561=55, srv1351407768=14, srv1944705597=49, srv1874321213=44, srv799063300=88, srv998264879=99, srv1846903718=42, srv614117423=77, srv238982452=62, srv789824268=86, srv371858818=69, srv1210535213=9, srv1723071167=34, srv595714103=75, srv1619141001=27, srv995635204=98, srv640422827=79, srv415564491=71, srv1975014164=54, srv2098787485=58, srv1627491=28, srv1829907793=40, srv177016726=38, srv872445904=92, srv1209885994=8, srv1344823176=13, srv1675838198=30, srv1127533968=5, srv1413065391=16, srv751804818=84, srv1507055584=22, srv1846589701=41, srv344662603=67, srv1902302310=46, srv1002751182=0, srv1870863444=43, srv1641421907=29, srv1195207456=7, srv1445049330=18, srv670071913=80, srv1095781038=4, srv1065618515=3, srv371151218=68, srv716235791=83, srv1019552578=1, srv1233419042=10, srv790020237=87, srv1823817429=39, srv1966598928=52, srv1424438126=17, srv1917265593=48, srv133544646=12, srv1457350242=20, srv691213441=81, srv82199904=89, srv1724834595=35, srv598699333=76, srv316104123=66, srv1709349663=33, srv640353800=78, srv983942171=97, srv1051406365=2, srv1548251749=24, srv1893017106=45, srv948370132=96, srv1357118739=15, srv893209646=93, srv1700714545=31, srv1551516049=25, srv1738175580=36, srv253699608=63, srv220234224=61, srv1323146511=11, srv522221017=73, srv761746264=85, srv2079225621=57, srv858472271=91, srv1908593193=47, srv1768362734=37, srv93966261=95, srv423791589=72, srv1184816529=6, srv1708795886=32, srv1967118285=53, srv70871595=82} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-04-19 16:55:48,462 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-04-19 16:55:48,463 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-04-19 16:55:48,463 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-04-19 16:55:48,463 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-04-19 16:55:48,463 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-04-19 16:55:48,463 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-04-19 16:55:48,463 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-04-19 16:55:48,463 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-04-19 16:55:48,463 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-04-19 16:55:48,463 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-04-19 16:55:48,463 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-04-19 16:55:48,463 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-04-19 16:55:48,463 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-04-19 16:55:48,463 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-04-19 16:55:48,464 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-04-19 16:55:48,464 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-04-19 16:55:48,464 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-04-19 16:55:48,464 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-04-19 16:55:48,464 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-04-19 16:55:48,464 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-04-19 16:55:48,464 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-04-19 16:55:48,464 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-04-19 16:55:48,464 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-04-19 16:55:48,464 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-04-19 16:55:48,464 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-04-19 16:55:48,464 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-04-19 16:55:48,464 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-04-19 16:55:48,465 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-04-19 16:55:48,465 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-04-19 16:55:48,465 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-04-19 16:55:48,465 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-04-19 16:55:48,465 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-04-19 16:55:48,465 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-04-19 16:55:48,465 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-04-19 16:55:48,465 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-04-19 16:55:48,465 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-04-19 16:55:48,465 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-04-19 16:55:48,465 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-04-19 16:55:48,465 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-04-19 16:55:48,465 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-04-19 16:55:48,466 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-04-19 16:55:48,466 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-04-19 16:55:48,466 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-04-19 16:55:48,466 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-04-19 16:55:48,466 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-04-19 16:55:48,466 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-04-19 16:55:48,466 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-04-19 16:55:48,466 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-04-19 16:55:48,466 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-04-19 16:55:48,466 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-04-19 16:55:48,466 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-04-19 16:55:48,466 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-04-19 16:55:48,466 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-04-19 16:55:48,467 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-04-19 16:55:48,467 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-04-19 16:55:48,467 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-04-19 16:55:48,467 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-04-19 16:55:48,467 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-04-19 16:55:48,467 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-04-19 16:55:48,467 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-04-19 16:55:48,467 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-04-19 16:55:48,467 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-04-19 16:55:48,467 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-04-19 16:55:48,467 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-04-19 16:55:48,467 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-04-19 16:55:48,467 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-04-19 16:55:48,468 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-04-19 16:55:48,468 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-04-19 16:55:48,468 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-04-19 16:55:48,468 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-04-19 16:55:48,468 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-04-19 16:55:48,468 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-04-19 16:55:48,468 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-04-19 16:55:48,468 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-04-19 16:55:48,468 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-04-19 16:55:48,468 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-04-19 16:55:48,468 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-04-19 16:55:48,468 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-04-19 16:55:48,468 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-04-19 16:55:48,469 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-04-19 16:55:48,469 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-04-19 16:55:48,469 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-04-19 16:55:48,469 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-04-19 16:55:48,469 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-04-19 16:55:48,469 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-04-19 16:55:48,469 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-04-19 16:55:48,469 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-04-19 16:55:48,469 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-04-19 16:55:48,469 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-04-19 16:55:48,469 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-04-19 16:55:48,470 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-04-19 16:55:48,470 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-04-19 16:55:48,470 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-04-19 16:55:48,470 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-04-19 16:55:48,470 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-04-19 16:55:48,470 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-04-19 16:55:48,470 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-04-19 16:55:48,470 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-04-19 16:55:48,470 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-04-19 16:55:48,470 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-04-19 16:55:48,470 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-04-19 16:55:48,590 INFO  [Time-limited test] balancer.StochasticLoadBalancer(381): Cluster wide - skipping load balancing because weighted average imbalance=5.642492993526674E-6 <= threshold(0.025). If you want more aggressive balancing, either lower hbase.master.balancer.stochastic.minCostNeedBalance from 0.025 or increase the relative multiplier(s) of the specific cost function(s). functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0012535023884839248); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-04-19 16:55:48,591 INFO  [Time-limited test] balancer.BalancerTestBase(570): Mock Final balance: { srv1323146511:83 , srv1357118739:83 , srv1507055584:83 , srv1966598928:83 , srv2098787485:83 , srv316104123:83 , srv415564491:83 , srv858472271:83 , srv1002751182:84 , srv1019552578:84 , srv1051406365:84 , srv1065618515:84 , srv1095781038:84 , srv1127533968:84 , srv1184816529:84 , srv1195207456:84 , srv1209885994:84 , srv1233419042:84 , srv133544646:84 , srv1344823176:84 , srv1351407768:84 , srv1413065391:84 , srv1424438126:84 , srv1445049330:84 , srv1456195891:84 , srv1457350242:84 , srv1468006921:84 , srv1519299236:84 , srv1548251749:84 , srv1551516049:84 , srv1570294918:84 , srv1619141001:84 , srv1675838198:84 , srv1700714545:84 , srv1708795886:84 , srv1709349663:84 , srv1723071167:84 , srv1724834595:84 , srv1738175580:84 , srv1768362734:84 , srv177016726:84 , srv1823817429:84 , srv1829907793:84 , srv1846589701:84 , srv1846903718:84 , srv1870863444:84 , srv1874321213:84 , srv1893017106:84 , srv1902302310:84 , srv1908593193:84 , srv1944705597:84 , srv1947516175:84 , srv1961199060:84 , srv1975014164:84 , srv2012753561:84 , srv2052427943:84 , srv2110765963:84 , srv2136753976:84 , srv220234224:84 , srv238982452:84 , srv253699608:84 , srv275705228:84 , srv302065902:84 , srv344662603:84 , srv371151218:84 , srv380867206:84 , srv423791589:84 , srv554642019:84 , srv595714103:84 , srv598699333:84 , srv614117423:84 , srv640353800:84 , srv640422827:84 , srv670071913:84 , srv691213441:84 , srv70871595:84 , srv716235791:84 , srv751804818:84 , srv761746264:84 , srv789824268:84 , srv790020237:84 , srv799063300:84 , srv82199904:84 , srv826769232:84 , srv872445904:84 , srv893209646:84 , srv897223247:84 , srv948370132:84 , srv983942171:84 , srv995635204:84 , srv998264879:84 , srv1210535213:85 , srv1627491:85 , srv1641421907:85 , srv1917265593:85 , srv2079225621:85 , srv371858818:85 , srv522221017:85 , srv93966261:85 , srv1967118285:684 }
2023-04-19 16:55:48,619 INFO  [Time-limited test] hbase.ResourceChecker(175): after: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnLargeClusterWithRacks Thread=10 (was 10), OpenFileDescriptor=260 (was 260), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=369 (was 341) - SystemLoadAverage LEAK? -, ProcessCount=210 (was 210), AvailableMemoryMB=6269 (was 6769)
2023-04-19 16:55:48,639 INFO  [Time-limited test] hbase.ResourceChecker(147): before: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnMidClusterWithRacks Thread=10, OpenFileDescriptor=260, MaxFileDescriptor=60000, SystemLoadAverage=369, ProcessCount=210, AvailableMemoryMB=6269
2023-04-19 16:55:48,640 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2023-04-19 16:55:48,640 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=5000, runMaxSteps=true, stepsPerRegion=800, maxRunningTime=120000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 111077.0 etc.
2023-04-19 16:55:48,652 INFO  [Time-limited test] balancer.BalancerTestBase(547): Mock Cluster : { srv1055577492:84 , srv107155829:84 , srv1178777319:84 , srv1288937991:84 , srv1386881430:84 , srv1412879079:84 , srv142021562:84 , srv1442705392:84 , srv1533724595:84 , srv1538434054:84 , srv162063626:84 , srv1776268378:84 , srv1837007612:84 , srv1906101471:84 , srv204394069:84 , srv2049565434:84 , srv2146108241:84 , srv223434493:84 , srv478247544:84 , srv485665700:84 , srv550358558:84 , srv59563280:84 , srv790125937:84 , srv80659024:84 , srv838805885:84 , srv897596306:84 , srv91304631:84 , srv94561057:84 , srv962582660:84 , srv374120573:264 } [srvr=30 rgns=2700 avg=90.0 max=90 min=90]
2023-04-19 16:55:48,654 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-04-19 16:55:48,654 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv374120573=18, srv550358558=21, srv107155829=1, srv2049565434=15, srv1442705392=7, srv162063626=10, srv59563280=22, srv1906101471=13, srv1055577492=0, srv80659024=24, srv790125937=23, srv94561057=28, srv897596306=26, srv1178777319=2, srv204394069=14, srv1837007612=12, srv838805885=25, srv1776268378=11, srv1412879079=5, srv1538434054=9, srv223434493=17, srv962582660=29, srv2146108241=16, srv478247544=19, srv1288937991=3, srv485665700=20, srv1386881430=4, srv142021562=6, srv91304631=27, srv1533724595=8} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-04-19 16:55:48,673 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-04-19 16:55:48,673 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-04-19 16:55:48,673 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-04-19 16:55:48,673 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-04-19 16:55:48,673 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-04-19 16:55:48,673 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-04-19 16:55:48,673 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-04-19 16:55:48,673 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-04-19 16:55:48,673 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-04-19 16:55:48,674 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-04-19 16:55:48,674 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-04-19 16:55:48,674 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-04-19 16:55:48,674 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-04-19 16:55:48,674 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-04-19 16:55:48,674 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-04-19 16:55:48,674 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-04-19 16:55:48,674 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-04-19 16:55:48,674 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-04-19 16:55:48,674 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-04-19 16:55:48,674 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-04-19 16:55:48,674 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-04-19 16:55:48,674 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-04-19 16:55:48,674 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-04-19 16:55:48,675 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-04-19 16:55:48,675 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-04-19 16:55:48,675 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-04-19 16:55:48,675 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-04-19 16:55:48,675 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-04-19 16:55:48,675 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-04-19 16:55:48,675 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-04-19 16:55:48,675 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=10, number of hosts=30, number of racks=4
2023-04-19 16:55:48,704 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=1.1235812733163404, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-04-19 16:55:48,705 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.99125824438212, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=1.1235812733163404, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=64800000
2023-04-19 16:57:48,681 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 120001 ms to try 6213838 different iterations.  Found a solution that moves 1866 regions; Going from a computed imbalance of 0.99125824438212 to a new imbalance of 4.3553370884861656E-5. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); MoveCostFunction : (multiplier=7.0, imbalance=0.6911111111111111, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-04-19 16:57:48,690 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1055577492:90 , srv107155829:90 , srv1178777319:90 , srv1288937991:90 , srv1386881430:90 , srv1412879079:90 , srv142021562:90 , srv1442705392:90 , srv1533724595:90 , srv1538434054:90 , srv162063626:90 , srv1776268378:90 , srv1837007612:90 , srv1906101471:90 , srv204394069:90 , srv2049565434:90 , srv2146108241:90 , srv223434493:90 , srv374120573:90 , srv478247544:90 , srv485665700:90 , srv550358558:90 , srv59563280:90 , srv790125937:90 , srv80659024:90 , srv838805885:90 , srv897596306:90 , srv91304631:90 , srv94561057:90 , srv962582660:90 }
2023-04-19 16:57:48,697 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-04-19 16:57:48,697 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv374120573=18, srv550358558=21, srv107155829=1, srv2049565434=15, srv1442705392=7, srv162063626=10, srv59563280=22, srv1906101471=13, srv1055577492=0, srv80659024=24, srv790125937=23, srv94561057=28, srv897596306=26, srv1178777319=2, srv204394069=14, srv1837007612=12, srv838805885=25, srv1776268378=11, srv1412879079=5, srv1538434054=9, srv223434493=17, srv962582660=29, srv2146108241=16, srv478247544=19, srv1288937991=3, srv485665700=20, srv1386881430=4, srv142021562=6, srv91304631=27, srv1533724595=8} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-04-19 16:57:48,702 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-04-19 16:57:48,702 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-04-19 16:57:48,703 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-04-19 16:57:48,703 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-04-19 16:57:48,703 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-04-19 16:57:48,703 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-04-19 16:57:48,703 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-04-19 16:57:48,703 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-04-19 16:57:48,703 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-04-19 16:57:48,703 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-04-19 16:57:48,703 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-04-19 16:57:48,703 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-04-19 16:57:48,703 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-04-19 16:57:48,703 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-04-19 16:57:48,703 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-04-19 16:57:48,703 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-04-19 16:57:48,704 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-04-19 16:57:48,704 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-04-19 16:57:48,704 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-04-19 16:57:48,704 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-04-19 16:57:48,704 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-04-19 16:57:48,704 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-04-19 16:57:48,704 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-04-19 16:57:48,704 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-04-19 16:57:48,704 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-04-19 16:57:48,704 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-04-19 16:57:48,704 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-04-19 16:57:48,704 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-04-19 16:57:48,704 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-04-19 16:57:48,704 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-04-19 16:57:48,705 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=10, number of hosts=30, number of racks=4
2023-04-19 16:57:48,721 INFO  [Time-limited test] balancer.StochasticLoadBalancer(381): Cluster wide - skipping load balancing because weighted average imbalance=0.0 <= threshold(0.025). If you want more aggressive balancing, either lower hbase.master.balancer.stochastic.minCostNeedBalance from 0.025 or increase the relative multiplier(s) of the specific cost function(s). functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-04-19 16:57:48,722 INFO  [Time-limited test] balancer.BalancerTestBase(570): Mock Final balance: { srv1055577492:90 , srv107155829:90 , srv1178777319:90 , srv1288937991:90 , srv1386881430:90 , srv1412879079:90 , srv142021562:90 , srv1442705392:90 , srv1533724595:90 , srv1538434054:90 , srv162063626:90 , srv1776268378:90 , srv1837007612:90 , srv1906101471:90 , srv204394069:90 , srv2049565434:90 , srv2146108241:90 , srv223434493:90 , srv374120573:90 , srv478247544:90 , srv485665700:90 , srv550358558:90 , srv59563280:90 , srv790125937:90 , srv80659024:90 , srv838805885:90 , srv897596306:90 , srv91304631:90 , srv94561057:90 , srv962582660:90 }
2023-04-19 16:57:48,738 INFO  [Time-limited test] hbase.ResourceChecker(175): after: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnMidClusterWithRacks Thread=9 (was 10), OpenFileDescriptor=260 (was 260), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=356 (was 369), ProcessCount=169 (was 210), AvailableMemoryMB=6574 (was 6269) - AvailableMemoryMB LEAK? -