2023-03-27 10:55:56,641 INFO  [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks timeout: 13 mins
2023-03-27 10:55:57,066 WARN  [Time-limited test] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties
2023-03-27 10:55:57,217 INFO  [Time-limited test] metrics.MetricRegistriesLoader(60): Loaded MetricRegistries class org.apache.hadoop.hbase.metrics.impl.MetricRegistriesImpl
2023-03-27 10:55:57,291 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2023-03-27 10:55:57,300 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc.
2023-03-27 10:55:57,318 INFO  [Time-limited test] hbase.ResourceChecker(147): before: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnLargeClusterWithRacks Thread=10, OpenFileDescriptor=260, MaxFileDescriptor=60000, SystemLoadAverage=362, ProcessCount=168, AvailableMemoryMB=8023
2023-03-27 10:55:57,321 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2023-03-27 10:55:57,321 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=5000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=10000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc.
2023-03-27 10:55:57,489 INFO  [Time-limited test] balancer.BalancerTestBase(547): Mock Cluster : { srv1033327186:84 , srv1076460536:84 , srv108136835:84 , srv1098459091:84 , srv1125069272:84 , srv1129182701:84 , srv1157556523:84 , srv1167063299:84 , srv1175813154:84 , srv1176517086:84 , srv1199566116:84 , srv126445661:84 , srv1285406325:84 , srv1285648371:84 , srv1302788050:84 , srv1306553048:84 , srv1322146319:84 , srv1326223842:84 , srv1326797368:84 , srv1358237132:84 , srv1366499599:84 , srv1389375870:84 , srv1433211820:84 , srv1456100588:84 , srv1456243145:84 , srv1522899974:84 , srv1547940174:84 , srv1583426124:84 , srv1600195903:84 , srv1621384357:84 , srv1630273684:84 , srv163939333:84 , srv1639812500:84 , srv1654576046:84 , srv1737097427:84 , srv1748844740:84 , srv1754396885:84 , srv1754718362:84 , srv1758113858:84 , srv1767348427:84 , srv1768087904:84 , srv1769842406:84 , srv1810831082:84 , srv1831835564:84 , srv1849107357:84 , srv1849444208:84 , srv189623750:84 , srv1897752502:84 , srv1899658493:84 , srv1929562041:84 , srv1935801985:84 , srv1954010949:84 , srv1982157034:84 , srv1986682733:84 , srv1997280839:84 , srv2034851471:84 , srv2066951417:84 , srv2102679678:84 , srv2141655009:84 , srv2141977124:84 , srv257800421:84 , srv265064846:84 , srv271423012:84 , srv278126247:84 , srv288587414:84 , srv297614041:84 , srv321981466:84 , srv322827270:84 , srv355346759:84 , srv387042030:84 , srv415064745:84 , srv417505759:84 , srv436957185:84 , srv558091283:84 , srv566323784:84 , srv582850463:84 , srv593985691:84 , srv596363103:84 , srv59754918:84 , srv603432764:84 , srv612557519:84 , srv615120929:84 , srv628654389:84 , srv653527423:84 , srv666401882:84 , srv670728745:84 , srv673729915:84 , srv696833966:84 , srv717678101:84 , srv734408225:84 , srv751094678:84 , srv794120948:84 , srv807137723:84 , srv809095610:84 , srv883907040:84 , srv886711897:84 , srv923848127:84 , srv955183082:84 , srv982183020:84 , srv1351881244:684 } [srvr=100 rgns=9000 avg=90.0 max=90 min=90]
2023-03-27 10:55:57,502 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-03-27 10:55:57,526 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv603432764=80, srv1389375870=22, srv1630273684=31, srv163939333=32, srv1033327186=0, srv189623750=47, srv278126247=64, srv1456243145=25, srv2034851471=56, srv883907040=95, srv886711897=96, srv1768087904=41, srv1935801985=51, srv982183020=99, srv1098459091=3, srv1899658493=49, srv1351881244=19, srv558091283=74, srv751094678=91, srv126445661=11, srv1758113858=39, srv1433211820=23, srv1810831082=43, srv1600195903=29, srv322827270=68, srv2066951417=57, srv1125069272=4, srv321981466=67, srv1456100588=24, srv1522899974=26, srv257800421=61, srv1175813154=8, srv1366499599=21, srv1326223842=17, srv1157556523=6, srv596363103=78, srv1954010949=52, srv387042030=70, srv955183082=98, srv108136835=2, srv59754918=79, srv1167063299=7, srv809095610=94, srv1639812500=33, srv794120948=92, srv1306553048=15, srv1997280839=55, srv673729915=87, srv1322146319=16, srv670728745=86, srv1358237132=20, srv1982157034=53, srv1583426124=28, srv1897752502=48, srv417505759=72, srv1621384357=30, srv1302788050=14, srv1849107357=45, srv566323784=75, srv696833966=88, srv807137723=93, srv923848127=97, srv297614041=66, srv628654389=83, srv653527423=84, srv1176517086=9, srv1767348427=40, srv1129182701=5, srv1076460536=1, srv2141655009=59, srv582850463=76, srv1754718362=38, srv355346759=69, srv265064846=62, srv1326797368=18, srv415064745=71, srv436957185=73, srv1754396885=37, srv1929562041=50, srv1737097427=35, srv1849444208=46, srv734408225=90, srv2102679678=58, srv1285648371=13, srv666401882=85, srv1654576046=34, srv1199566116=10, srv717678101=89, srv593985691=77, srv1769842406=42, srv1547940174=27, srv271423012=63, srv612557519=81, srv615120929=82, srv1986682733=54, srv1831835564=44, srv1748844740=36, srv1285406325=12, srv288587414=65, srv2141977124=60} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-03-27 10:55:57,650 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-03-27 10:55:57,650 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-03-27 10:55:57,650 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-03-27 10:55:57,651 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-03-27 10:55:57,651 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-03-27 10:55:57,651 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-03-27 10:55:57,651 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-03-27 10:55:57,651 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-03-27 10:55:57,651 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-03-27 10:55:57,651 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-03-27 10:55:57,651 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-03-27 10:55:57,651 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-03-27 10:55:57,651 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-03-27 10:55:57,652 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-03-27 10:55:57,652 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-03-27 10:55:57,652 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-03-27 10:55:57,652 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-03-27 10:55:57,652 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-03-27 10:55:57,652 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-03-27 10:55:57,652 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-03-27 10:55:57,652 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-03-27 10:55:57,652 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-03-27 10:55:57,653 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-03-27 10:55:57,653 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-03-27 10:55:57,653 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-03-27 10:55:57,653 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-03-27 10:55:57,653 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-03-27 10:55:57,653 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-03-27 10:55:57,653 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-03-27 10:55:57,654 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-03-27 10:55:57,654 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-03-27 10:55:57,654 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-03-27 10:55:57,654 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-03-27 10:55:57,654 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-03-27 10:55:57,654 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-03-27 10:55:57,655 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-03-27 10:55:57,655 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-03-27 10:55:57,655 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-03-27 10:55:57,655 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-03-27 10:55:57,655 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-03-27 10:55:57,655 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-03-27 10:55:57,656 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-03-27 10:55:57,656 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-03-27 10:55:57,656 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-03-27 10:55:57,656 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-03-27 10:55:57,656 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-03-27 10:55:57,656 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-03-27 10:55:57,656 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-03-27 10:55:57,657 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-03-27 10:55:57,657 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-03-27 10:55:57,657 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-03-27 10:55:57,657 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-03-27 10:55:57,657 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-03-27 10:55:57,658 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-03-27 10:55:57,658 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-03-27 10:55:57,658 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-03-27 10:55:57,658 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-03-27 10:55:57,658 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-03-27 10:55:57,658 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-03-27 10:55:57,658 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-03-27 10:55:57,658 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-03-27 10:55:57,659 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-03-27 10:55:57,659 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-03-27 10:55:57,659 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-03-27 10:55:57,659 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-03-27 10:55:57,659 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-03-27 10:55:57,659 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-03-27 10:55:57,659 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-03-27 10:55:57,660 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-03-27 10:55:57,660 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-03-27 10:55:57,660 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-03-27 10:55:57,660 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-03-27 10:55:57,660 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-03-27 10:55:57,660 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-03-27 10:55:57,660 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-03-27 10:55:57,661 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-03-27 10:55:57,661 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-03-27 10:55:57,661 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-03-27 10:55:57,661 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-03-27 10:55:57,661 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-03-27 10:55:57,661 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-03-27 10:55:57,661 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-03-27 10:55:57,662 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-03-27 10:55:57,662 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-03-27 10:55:57,662 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-03-27 10:55:57,662 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-03-27 10:55:57,662 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-03-27 10:55:57,662 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-03-27 10:55:57,662 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-03-27 10:55:57,663 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-03-27 10:55:57,663 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-03-27 10:55:57,663 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-03-27 10:55:57,663 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-03-27 10:55:57,663 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-03-27 10:55:57,664 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-03-27 10:55:57,664 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-03-27 10:55:57,664 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-03-27 10:55:57,664 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-03-27 10:55:57,664 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-03-27 10:55:57,664 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-03-27 10:55:57,664 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-03-27 10:55:58,104 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.06666666666666667, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-03-27 10:55:58,105 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-03-27 10:55:58,105 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.9909252140407105, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.06666666666666667, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-03-27 10:55:59,074 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 1379 ms to try 5000 different iterations.  Found a solution that moves 4713 regions; Going from a computed imbalance of 0.9909252140407105 to a new imbalance of 0.17624349639325348. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.039726901610370326, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.05169191302373972, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.5236666666666666, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.039726901610370326, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.1715, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.23758333333333334, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-03-27 10:55:59,119 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1076460536:82 , srv1129182701:83 , srv1285406325:83 , srv1389375870:83 , srv1754396885:83 , srv1754718362:83 , srv2102679678:83 , srv265064846:83 , srv582850463:83 , srv717678101:83 , srv807137723:83 , srv955183082:83 , srv108136835:84 , srv1175813154:84 , srv1285648371:84 , srv1366499599:84 , srv1600195903:84 , srv1639812500:84 , srv1810831082:84 , srv1899658493:84 , srv1935801985:84 , srv1986682733:84 , srv257800421:84 , srv278126247:84 , srv288587414:84 , srv596363103:84 , srv615120929:84 , srv883907040:84 , srv886711897:84 , srv1433211820:85 , srv1583426124:85 , srv1654576046:85 , srv1737097427:85 , srv1849444208:85 , srv1954010949:85 , srv558091283:85 , srv59754918:85 , srv612557519:85 , srv1157556523:86 , srv1199566116:86 , srv126445661:86 , srv1322146319:86 , srv1326223842:86 , srv1621384357:86 , srv163939333:86 , srv1748844740:86 , srv1768087904:86 , srv1897752502:86 , srv1929562041:86 , srv2066951417:86 , srv670728745:86 , srv734408225:86 , srv794120948:86 , srv1125069272:87 , srv1167063299:87 , srv1358237132:87 , srv1456243145:87 , srv1522899974:87 , srv1831835564:87 , srv1849107357:87 , srv355346759:87 , srv417505759:87 , srv436957185:87 , srv566323784:87 , srv603432764:87 , srv653527423:87 , srv666401882:87 , srv673729915:87 , srv751094678:87 , srv809095610:87 , srv923848127:87 , srv982183020:87 , srv1033327186:88 , srv1098459091:88 , srv1306553048:88 , srv1326797368:88 , srv1456100588:88 , srv2141655009:88 , srv271423012:88 , srv1176517086:89 , srv1302788050:89 , srv1769842406:89 , srv1982157034:89 , srv2034851471:89 , srv322827270:89 , srv387042030:89 , srv1547940174:90 , srv1758113858:90 , srv1997280839:90 , srv297614041:90 , srv415064745:90 , srv593985691:90 , srv628654389:90 , srv696833966:90 , srv1630273684:92 , srv2141977124:93 , srv321981466:93 , srv1767348427:94 , srv189623750:95 , srv1351881244:443 }
2023-03-27 10:55:59,126 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-03-27 10:55:59,128 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv603432764=80, srv1389375870=22, srv1630273684=31, srv163939333=32, srv1033327186=0, srv189623750=47, srv278126247=64, srv1456243145=25, srv2034851471=56, srv883907040=95, srv886711897=96, srv1768087904=41, srv1935801985=51, srv982183020=99, srv1098459091=3, srv1899658493=49, srv1351881244=19, srv558091283=74, srv751094678=91, srv126445661=11, srv1758113858=39, srv1433211820=23, srv1810831082=43, srv1600195903=29, srv322827270=68, srv2066951417=57, srv1125069272=4, srv321981466=67, srv1456100588=24, srv1522899974=26, srv257800421=61, srv1175813154=8, srv1366499599=21, srv1326223842=17, srv1157556523=6, srv596363103=78, srv1954010949=52, srv387042030=70, srv955183082=98, srv108136835=2, srv59754918=79, srv1167063299=7, srv809095610=94, srv1639812500=33, srv794120948=92, srv1306553048=15, srv1997280839=55, srv673729915=87, srv1322146319=16, srv670728745=86, srv1358237132=20, srv1982157034=53, srv1583426124=28, srv1897752502=48, srv417505759=72, srv1621384357=30, srv1302788050=14, srv1849107357=45, srv566323784=75, srv696833966=88, srv807137723=93, srv923848127=97, srv297614041=66, srv628654389=83, srv653527423=84, srv1176517086=9, srv1767348427=40, srv1129182701=5, srv1076460536=1, srv2141655009=59, srv582850463=76, srv1754718362=38, srv355346759=69, srv265064846=62, srv1326797368=18, srv415064745=71, srv436957185=73, srv1754396885=37, srv1929562041=50, srv1737097427=35, srv1849444208=46, srv734408225=90, srv2102679678=58, srv1285648371=13, srv666401882=85, srv1654576046=34, srv1199566116=10, srv717678101=89, srv593985691=77, srv1769842406=42, srv1547940174=27, srv271423012=63, srv612557519=81, srv615120929=82, srv1986682733=54, srv1831835564=44, srv1748844740=36, srv1285406325=12, srv288587414=65, srv2141977124=60} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-03-27 10:55:59,165 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-03-27 10:55:59,166 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-03-27 10:55:59,166 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-03-27 10:55:59,166 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-03-27 10:55:59,166 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-03-27 10:55:59,166 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-03-27 10:55:59,166 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-03-27 10:55:59,167 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-03-27 10:55:59,167 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-03-27 10:55:59,167 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-03-27 10:55:59,167 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-03-27 10:55:59,167 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-03-27 10:55:59,167 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-03-27 10:55:59,167 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-03-27 10:55:59,167 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-03-27 10:55:59,168 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-03-27 10:55:59,168 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-03-27 10:55:59,168 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-03-27 10:55:59,168 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-03-27 10:55:59,168 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-03-27 10:55:59,168 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-03-27 10:55:59,168 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-03-27 10:55:59,168 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-03-27 10:55:59,169 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-03-27 10:55:59,169 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-03-27 10:55:59,169 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-03-27 10:55:59,169 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-03-27 10:55:59,169 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-03-27 10:55:59,169 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-03-27 10:55:59,169 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-03-27 10:55:59,171 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-03-27 10:55:59,171 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-03-27 10:55:59,171 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-03-27 10:55:59,171 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-03-27 10:55:59,171 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-03-27 10:55:59,172 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-03-27 10:55:59,172 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-03-27 10:55:59,172 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-03-27 10:55:59,172 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-03-27 10:55:59,172 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-03-27 10:55:59,172 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-03-27 10:55:59,172 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-03-27 10:55:59,172 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-03-27 10:55:59,172 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-03-27 10:55:59,172 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-03-27 10:55:59,173 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-03-27 10:55:59,173 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-03-27 10:55:59,173 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-03-27 10:55:59,173 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-03-27 10:55:59,174 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-03-27 10:55:59,174 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-03-27 10:55:59,174 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-03-27 10:55:59,174 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-03-27 10:55:59,174 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-03-27 10:55:59,174 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-03-27 10:55:59,174 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-03-27 10:55:59,174 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-03-27 10:55:59,174 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-03-27 10:55:59,175 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-03-27 10:55:59,175 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-03-27 10:55:59,175 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-03-27 10:55:59,175 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-03-27 10:55:59,175 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-03-27 10:55:59,175 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-03-27 10:55:59,175 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-03-27 10:55:59,175 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-03-27 10:55:59,176 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-03-27 10:55:59,176 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-03-27 10:55:59,176 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-03-27 10:55:59,176 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-03-27 10:55:59,176 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-03-27 10:55:59,176 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-03-27 10:55:59,176 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-03-27 10:55:59,176 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-03-27 10:55:59,177 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-03-27 10:55:59,177 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-03-27 10:55:59,177 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-03-27 10:55:59,177 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-03-27 10:55:59,177 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-03-27 10:55:59,177 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-03-27 10:55:59,177 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-03-27 10:55:59,177 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-03-27 10:55:59,178 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-03-27 10:55:59,178 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-03-27 10:55:59,178 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-03-27 10:55:59,178 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-03-27 10:55:59,178 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-03-27 10:55:59,178 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-03-27 10:55:59,178 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-03-27 10:55:59,178 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-03-27 10:55:59,178 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-03-27 10:55:59,179 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-03-27 10:55:59,179 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-03-27 10:55:59,179 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-03-27 10:55:59,179 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-03-27 10:55:59,179 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-03-27 10:55:59,179 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-03-27 10:55:59,179 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-03-27 10:55:59,179 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-03-27 10:55:59,179 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-03-27 10:55:59,179 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-03-27 10:55:59,430 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.039726901610370326, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.05169191302373972, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.039726901610370326, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.1715, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.23758333333333334, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-03-27 10:55:59,430 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-03-27 10:55:59,430 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.17621049526190616, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.039726901610370326, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.05169191302373972, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.039726901610370326, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.1715, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.23758333333333334, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-03-27 10:55:59,801 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 565 ms to try 5000 different iterations.  Found a solution that moves 2625 regions; Going from a computed imbalance of 0.17621049526190616 to a new imbalance of 0.014079512474992548. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.022039088267152465); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.03015485659030801, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.2916666666666667, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.022039088267152465); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.011); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0435, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-03-27 10:55:59,821 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv189623750:75 , srv1767348427:78 , srv1630273684:79 , srv321981466:79 , srv415064745:80 , srv1547940174:81 , srv2141977124:81 , srv1302788050:82 , srv1982157034:82 , srv2034851471:82 , srv297614041:82 , srv387042030:82 , srv696833966:82 , srv1098459091:83 , srv1176517086:83 , srv1758113858:83 , srv1769842406:83 , srv1849107357:83 , srv593985691:83 , srv628654389:83 , srv1125069272:84 , srv1157556523:84 , srv1326797368:84 , srv1456100588:84 , srv2066951417:84 , srv2141655009:84 , srv603432764:84 , srv653527423:84 , srv673729915:84 , srv982183020:84 , srv1167063299:85 , srv1199566116:85 , srv1306553048:85 , srv1326223842:85 , srv1522899974:85 , srv1621384357:85 , srv1654576046:85 , srv1748844740:85 , srv1768087904:85 , srv1831835564:85 , srv1897752502:85 , srv1929562041:85 , srv1997280839:85 , srv271423012:85 , srv417505759:85 , srv666401882:85 , srv923848127:85 , srv1033327186:86 , srv126445661:86 , srv1358237132:86 , srv1433211820:86 , srv1456243145:86 , srv1737097427:86 , srv278126247:86 , srv322827270:86 , srv436957185:86 , srv558091283:86 , srv612557519:86 , srv734408225:86 , srv809095610:86 , srv1322146319:87 , srv1639812500:87 , srv1849444208:87 , srv1935801985:87 , srv1954010949:87 , srv355346759:87 , srv615120929:87 , srv751094678:87 , srv794120948:87 , srv807137723:87 , srv108136835:88 , srv1175813154:88 , srv1583426124:88 , srv1600195903:88 , srv163939333:88 , srv1810831082:88 , srv1899658493:88 , srv1986682733:88 , srv566323784:88 , srv582850463:88 , srv596363103:88 , srv59754918:88 , srv670728745:88 , srv717678101:88 , srv883907040:88 , srv1129182701:89 , srv1285406325:89 , srv1285648371:89 , srv1366499599:89 , srv1389375870:89 , srv1754396885:89 , srv1754718362:89 , srv257800421:89 , srv1076460536:90 , srv265064846:90 , srv288587414:90 , srv955183082:90 , srv2102679678:91 , srv886711897:91 , srv1351881244:527 }
2023-03-27 10:55:59,828 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-03-27 10:55:59,830 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv603432764=80, srv1389375870=22, srv1630273684=31, srv163939333=32, srv1033327186=0, srv189623750=47, srv278126247=64, srv1456243145=25, srv2034851471=56, srv883907040=95, srv886711897=96, srv1768087904=41, srv1935801985=51, srv982183020=99, srv1098459091=3, srv1899658493=49, srv1351881244=19, srv558091283=74, srv751094678=91, srv126445661=11, srv1758113858=39, srv1433211820=23, srv1810831082=43, srv1600195903=29, srv322827270=68, srv2066951417=57, srv1125069272=4, srv321981466=67, srv1456100588=24, srv1522899974=26, srv257800421=61, srv1175813154=8, srv1366499599=21, srv1326223842=17, srv1157556523=6, srv596363103=78, srv1954010949=52, srv387042030=70, srv955183082=98, srv108136835=2, srv59754918=79, srv1167063299=7, srv809095610=94, srv1639812500=33, srv794120948=92, srv1306553048=15, srv1997280839=55, srv673729915=87, srv1322146319=16, srv670728745=86, srv1358237132=20, srv1982157034=53, srv1583426124=28, srv1897752502=48, srv417505759=72, srv1621384357=30, srv1302788050=14, srv1849107357=45, srv566323784=75, srv696833966=88, srv807137723=93, srv923848127=97, srv297614041=66, srv628654389=83, srv653527423=84, srv1176517086=9, srv1767348427=40, srv1129182701=5, srv1076460536=1, srv2141655009=59, srv582850463=76, srv1754718362=38, srv355346759=69, srv265064846=62, srv1326797368=18, srv415064745=71, srv436957185=73, srv1754396885=37, srv1929562041=50, srv1737097427=35, srv1849444208=46, srv734408225=90, srv2102679678=58, srv1285648371=13, srv666401882=85, srv1654576046=34, srv1199566116=10, srv717678101=89, srv593985691=77, srv1769842406=42, srv1547940174=27, srv271423012=63, srv612557519=81, srv615120929=82, srv1986682733=54, srv1831835564=44, srv1748844740=36, srv1285406325=12, srv288587414=65, srv2141977124=60} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-03-27 10:55:59,854 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-03-27 10:55:59,854 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-03-27 10:55:59,854 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-03-27 10:55:59,854 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-03-27 10:55:59,854 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-03-27 10:55:59,854 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-03-27 10:55:59,855 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-03-27 10:55:59,855 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-03-27 10:55:59,856 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-03-27 10:55:59,856 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-03-27 10:55:59,856 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-03-27 10:55:59,858 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-03-27 10:55:59,858 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-03-27 10:55:59,858 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-03-27 10:55:59,858 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-03-27 10:55:59,859 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-03-27 10:55:59,859 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-03-27 10:55:59,859 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-03-27 10:55:59,859 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-03-27 10:55:59,859 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-03-27 10:55:59,859 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-03-27 10:55:59,859 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-03-27 10:55:59,859 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-03-27 10:55:59,859 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-03-27 10:55:59,859 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-03-27 10:55:59,860 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-03-27 10:55:59,860 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-03-27 10:55:59,864 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-03-27 10:55:59,865 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-03-27 10:55:59,872 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-03-27 10:55:59,873 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-03-27 10:55:59,873 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-03-27 10:55:59,873 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-03-27 10:55:59,873 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-03-27 10:55:59,873 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-03-27 10:55:59,873 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-03-27 10:55:59,873 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-03-27 10:55:59,873 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-03-27 10:55:59,873 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-03-27 10:55:59,873 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-03-27 10:55:59,874 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-03-27 10:55:59,874 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-03-27 10:55:59,874 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-03-27 10:55:59,874 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-03-27 10:55:59,874 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-03-27 10:55:59,874 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-03-27 10:55:59,874 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-03-27 10:55:59,874 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-03-27 10:55:59,874 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-03-27 10:55:59,874 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-03-27 10:55:59,874 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-03-27 10:55:59,875 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-03-27 10:55:59,875 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-03-27 10:55:59,875 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-03-27 10:55:59,875 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-03-27 10:55:59,875 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-03-27 10:55:59,875 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-03-27 10:55:59,875 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-03-27 10:55:59,875 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-03-27 10:55:59,875 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-03-27 10:55:59,875 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-03-27 10:55:59,875 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-03-27 10:55:59,876 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-03-27 10:55:59,876 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-03-27 10:55:59,876 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-03-27 10:55:59,878 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-03-27 10:55:59,878 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-03-27 10:55:59,878 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-03-27 10:55:59,878 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-03-27 10:55:59,878 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-03-27 10:55:59,879 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-03-27 10:55:59,879 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-03-27 10:55:59,879 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-03-27 10:55:59,879 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-03-27 10:55:59,879 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-03-27 10:55:59,879 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-03-27 10:55:59,879 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-03-27 10:55:59,879 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-03-27 10:55:59,879 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-03-27 10:55:59,879 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-03-27 10:55:59,879 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-03-27 10:55:59,879 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-03-27 10:55:59,880 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-03-27 10:55:59,880 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-03-27 10:55:59,880 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-03-27 10:55:59,880 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-03-27 10:55:59,880 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-03-27 10:55:59,880 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-03-27 10:55:59,880 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-03-27 10:55:59,880 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-03-27 10:55:59,880 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-03-27 10:55:59,880 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-03-27 10:55:59,880 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-03-27 10:55:59,881 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-03-27 10:55:59,881 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-03-27 10:55:59,881 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-03-27 10:55:59,881 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-03-27 10:55:59,881 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-03-27 10:55:59,881 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-03-27 10:55:59,881 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-03-27 10:55:59,881 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-03-27 10:56:00,071 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.022039088267152465); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.03015485659030801, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.022039088267152465); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.011); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0435, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-03-27 10:56:00,072 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-03-27 10:56:00,072 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.014061131832135192, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.022039088267152465); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.03015485659030801, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.022039088267152465); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.011); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0435, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-03-27 10:56:00,445 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 509 ms to try 5000 different iterations.  Found a solution that moves 1015 regions; Going from a computed imbalance of 0.014061131832135192 to a new imbalance of 6.737054172614933E-4. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.004106087870552497); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.007027283689263065); MoveCostFunction : (multiplier=7.0, imbalance=0.11277777777777778, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.004106087870552497); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=3.333333333333333E-4); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0035); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-03-27 10:56:00,447 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1997280839:82 , srv886711897:82 , srv271423012:83 , srv322827270:83 , srv566323784:83 , srv670728745:83 , srv751094678:83 , srv1033327186:84 , srv1285648371:84 , srv1322146319:84 , srv1358237132:84 , srv1583426124:84 , srv1758113858:84 , srv2102679678:84 , srv2141977124:84 , srv257800421:84 , srv265064846:84 , srv288587414:84 , srv355346759:84 , srv628654389:84 , srv794120948:84 , srv923848127:84 , srv108136835:85 , srv1306553048:85 , srv1326797368:85 , srv1366499599:85 , srv1456243145:85 , srv1522899974:85 , srv1600195903:85 , srv163939333:85 , srv1754396885:85 , srv1754718362:85 , srv1769842406:85 , srv1831835564:85 , srv1849444208:85 , srv1899658493:85 , srv436957185:85 , srv582850463:85 , srv593985691:85 , srv59754918:85 , srv666401882:85 , srv809095610:85 , srv883907040:85 , srv955183082:85 , srv1076460536:86 , srv1098459091:86 , srv1129182701:86 , srv1175813154:86 , srv1176517086:86 , srv126445661:86 , srv1285406325:86 , srv1389375870:86 , srv1433211820:86 , srv1456100588:86 , srv1621384357:86 , srv1737097427:86 , srv1767348427:86 , srv1897752502:86 , srv1929562041:86 , srv1954010949:86 , srv1986682733:86 , srv2034851471:86 , srv2141655009:86 , srv297614041:86 , srv321981466:86 , srv596363103:86 , srv603432764:86 , srv673729915:86 , srv696833966:86 , srv734408225:86 , srv982183020:86 , srv1125069272:87 , srv1167063299:87 , srv1199566116:87 , srv1302788050:87 , srv1326223842:87 , srv1547940174:87 , srv1630273684:87 , srv1639812500:87 , srv1748844740:87 , srv1768087904:87 , srv1810831082:87 , srv1849107357:87 , srv1982157034:87 , srv278126247:87 , srv387042030:87 , srv417505759:87 , srv612557519:87 , srv653527423:87 , srv717678101:87 , srv1157556523:88 , srv1654576046:88 , srv189623750:88 , srv1935801985:88 , srv2066951417:88 , srv415064745:88 , srv558091283:88 , srv615120929:88 , srv807137723:88 , srv1351881244:524 }
2023-03-27 10:56:00,454 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-03-27 10:56:00,455 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv603432764=80, srv1389375870=22, srv1630273684=31, srv163939333=32, srv1033327186=0, srv189623750=47, srv278126247=64, srv1456243145=25, srv2034851471=56, srv883907040=95, srv886711897=96, srv1768087904=41, srv1935801985=51, srv982183020=99, srv1098459091=3, srv1899658493=49, srv1351881244=19, srv558091283=74, srv751094678=91, srv126445661=11, srv1758113858=39, srv1433211820=23, srv1810831082=43, srv1600195903=29, srv322827270=68, srv2066951417=57, srv1125069272=4, srv321981466=67, srv1456100588=24, srv1522899974=26, srv257800421=61, srv1175813154=8, srv1366499599=21, srv1326223842=17, srv1157556523=6, srv596363103=78, srv1954010949=52, srv387042030=70, srv955183082=98, srv108136835=2, srv59754918=79, srv1167063299=7, srv809095610=94, srv1639812500=33, srv794120948=92, srv1306553048=15, srv1997280839=55, srv673729915=87, srv1322146319=16, srv670728745=86, srv1358237132=20, srv1982157034=53, srv1583426124=28, srv1897752502=48, srv417505759=72, srv1621384357=30, srv1302788050=14, srv1849107357=45, srv566323784=75, srv696833966=88, srv807137723=93, srv923848127=97, srv297614041=66, srv628654389=83, srv653527423=84, srv1176517086=9, srv1767348427=40, srv1129182701=5, srv1076460536=1, srv2141655009=59, srv582850463=76, srv1754718362=38, srv355346759=69, srv265064846=62, srv1326797368=18, srv415064745=71, srv436957185=73, srv1754396885=37, srv1929562041=50, srv1737097427=35, srv1849444208=46, srv734408225=90, srv2102679678=58, srv1285648371=13, srv666401882=85, srv1654576046=34, srv1199566116=10, srv717678101=89, srv593985691=77, srv1769842406=42, srv1547940174=27, srv271423012=63, srv612557519=81, srv615120929=82, srv1986682733=54, srv1831835564=44, srv1748844740=36, srv1285406325=12, srv288587414=65, srv2141977124=60} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-03-27 10:56:00,479 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-03-27 10:56:00,479 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-03-27 10:56:00,479 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-03-27 10:56:00,480 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-03-27 10:56:00,480 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-03-27 10:56:00,480 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-03-27 10:56:00,480 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-03-27 10:56:00,480 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-03-27 10:56:00,480 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-03-27 10:56:00,480 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-03-27 10:56:00,480 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-03-27 10:56:00,480 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-03-27 10:56:00,480 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-03-27 10:56:00,481 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-03-27 10:56:00,481 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-03-27 10:56:00,481 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-03-27 10:56:00,481 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-03-27 10:56:00,481 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-03-27 10:56:00,481 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-03-27 10:56:00,481 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-03-27 10:56:00,481 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-03-27 10:56:00,481 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-03-27 10:56:00,481 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-03-27 10:56:00,482 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-03-27 10:56:00,482 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-03-27 10:56:00,482 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-03-27 10:56:00,482 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-03-27 10:56:00,482 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-03-27 10:56:00,482 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-03-27 10:56:00,482 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-03-27 10:56:00,482 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-03-27 10:56:00,482 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-03-27 10:56:00,482 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-03-27 10:56:00,482 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-03-27 10:56:00,483 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-03-27 10:56:00,483 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-03-27 10:56:00,483 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-03-27 10:56:00,483 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-03-27 10:56:00,483 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-03-27 10:56:00,483 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-03-27 10:56:00,483 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-03-27 10:56:00,483 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-03-27 10:56:00,483 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-03-27 10:56:00,483 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-03-27 10:56:00,483 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-03-27 10:56:00,483 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-03-27 10:56:00,483 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-03-27 10:56:00,484 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-03-27 10:56:00,484 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-03-27 10:56:00,484 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-03-27 10:56:00,484 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-03-27 10:56:00,484 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-03-27 10:56:00,484 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-03-27 10:56:00,484 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-03-27 10:56:00,484 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-03-27 10:56:00,484 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-03-27 10:56:00,485 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-03-27 10:56:00,485 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-03-27 10:56:00,485 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-03-27 10:56:00,485 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-03-27 10:56:00,485 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-03-27 10:56:00,485 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-03-27 10:56:00,485 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-03-27 10:56:00,485 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-03-27 10:56:00,485 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-03-27 10:56:00,485 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-03-27 10:56:00,486 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-03-27 10:56:00,486 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-03-27 10:56:00,486 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-03-27 10:56:00,486 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-03-27 10:56:00,486 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-03-27 10:56:00,486 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-03-27 10:56:00,486 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-03-27 10:56:00,486 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-03-27 10:56:00,486 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-03-27 10:56:00,486 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-03-27 10:56:00,486 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-03-27 10:56:00,487 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-03-27 10:56:00,487 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-03-27 10:56:00,487 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-03-27 10:56:00,487 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-03-27 10:56:00,487 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-03-27 10:56:00,487 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-03-27 10:56:00,487 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-03-27 10:56:00,487 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-03-27 10:56:00,487 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-03-27 10:56:00,487 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-03-27 10:56:00,488 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-03-27 10:56:00,488 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-03-27 10:56:00,488 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-03-27 10:56:00,488 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-03-27 10:56:00,488 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-03-27 10:56:00,488 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-03-27 10:56:00,488 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-03-27 10:56:00,488 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-03-27 10:56:00,488 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-03-27 10:56:00,488 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-03-27 10:56:00,489 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-03-27 10:56:00,489 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-03-27 10:56:00,489 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-03-27 10:56:00,489 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-03-27 10:56:00,642 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.004106087870552497); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.007027283689263065); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.004106087870552497); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=3.333333333333333E-4); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0035); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-03-27 10:56:00,642 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-03-27 10:56:00,644 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=6.665982353566486E-4, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.004106087870552497); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.007027283689263065); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.004106087870552497); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=3.333333333333333E-4); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0035); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-03-27 10:56:00,997 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 491 ms to try 5000 different iterations.  Found a solution that moves 243 regions; Going from a computed imbalance of 6.665982353566486E-4 to a new imbalance of 3.4331398896634935E-5. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=3.868392354571063E-4); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0018349396085439343); MoveCostFunction : (multiplier=7.0, imbalance=0.027, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=3.868392354571063E-4); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=2.5E-4); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-03-27 10:56:00,998 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1167063299:83 , srv163939333:83 , srv1810831082:83 , srv1935801985:83 , srv2141655009:83 , srv558091283:83 , srv615120929:83 , srv1033327186:84 , srv1076460536:84 , srv1125069272:84 , srv1129182701:84 , srv1157556523:84 , srv1175813154:84 , srv1176517086:84 , srv126445661:84 , srv1285406325:84 , srv1302788050:84 , srv1306553048:84 , srv1326223842:84 , srv1366499599:84 , srv1389375870:84 , srv1456100588:84 , srv1456243145:84 , srv1547940174:84 , srv1621384357:84 , srv1630273684:84 , srv1639812500:84 , srv1654576046:84 , srv1737097427:84 , srv1748844740:84 , srv1758113858:84 , srv1767348427:84 , srv1768087904:84 , srv189623750:84 , srv1954010949:84 , srv1982157034:84 , srv1986682733:84 , srv1997280839:84 , srv2066951417:84 , srv2102679678:84 , srv2141977124:84 , srv288587414:84 , srv297614041:84 , srv321981466:84 , srv322827270:84 , srv355346759:84 , srv387042030:84 , srv415064745:84 , srv417505759:84 , srv436957185:84 , srv566323784:84 , srv593985691:84 , srv59754918:84 , srv612557519:84 , srv653527423:84 , srv696833966:84 , srv717678101:84 , srv734408225:84 , srv751094678:84 , srv807137723:84 , srv809095610:84 , srv108136835:85 , srv1098459091:85 , srv1199566116:85 , srv1285648371:85 , srv1322146319:85 , srv1326797368:85 , srv1358237132:85 , srv1433211820:85 , srv1522899974:85 , srv1583426124:85 , srv1600195903:85 , srv1754396885:85 , srv1754718362:85 , srv1769842406:85 , srv1831835564:85 , srv1849444208:85 , srv1897752502:85 , srv1899658493:85 , srv1929562041:85 , srv2034851471:85 , srv257800421:85 , srv265064846:85 , srv278126247:85 , srv596363103:85 , srv628654389:85 , srv666401882:85 , srv670728745:85 , srv673729915:85 , srv794120948:85 , srv883907040:85 , srv886711897:85 , srv955183082:85 , srv982183020:85 , srv1849107357:86 , srv271423012:86 , srv582850463:86 , srv603432764:86 , srv923848127:86 , srv1351881244:648 }
2023-03-27 10:56:01,002 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-03-27 10:56:01,002 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv603432764=80, srv1389375870=22, srv1630273684=31, srv163939333=32, srv1033327186=0, srv189623750=47, srv278126247=64, srv1456243145=25, srv2034851471=56, srv883907040=95, srv886711897=96, srv1768087904=41, srv1935801985=51, srv982183020=99, srv1098459091=3, srv1899658493=49, srv1351881244=19, srv558091283=74, srv751094678=91, srv126445661=11, srv1758113858=39, srv1433211820=23, srv1810831082=43, srv1600195903=29, srv322827270=68, srv2066951417=57, srv1125069272=4, srv321981466=67, srv1456100588=24, srv1522899974=26, srv257800421=61, srv1175813154=8, srv1366499599=21, srv1326223842=17, srv1157556523=6, srv596363103=78, srv1954010949=52, srv387042030=70, srv955183082=98, srv108136835=2, srv59754918=79, srv1167063299=7, srv809095610=94, srv1639812500=33, srv794120948=92, srv1306553048=15, srv1997280839=55, srv673729915=87, srv1322146319=16, srv670728745=86, srv1358237132=20, srv1982157034=53, srv1583426124=28, srv1897752502=48, srv417505759=72, srv1621384357=30, srv1302788050=14, srv1849107357=45, srv566323784=75, srv696833966=88, srv807137723=93, srv923848127=97, srv297614041=66, srv628654389=83, srv653527423=84, srv1176517086=9, srv1767348427=40, srv1129182701=5, srv1076460536=1, srv2141655009=59, srv582850463=76, srv1754718362=38, srv355346759=69, srv265064846=62, srv1326797368=18, srv415064745=71, srv436957185=73, srv1754396885=37, srv1929562041=50, srv1737097427=35, srv1849444208=46, srv734408225=90, srv2102679678=58, srv1285648371=13, srv666401882=85, srv1654576046=34, srv1199566116=10, srv717678101=89, srv593985691=77, srv1769842406=42, srv1547940174=27, srv271423012=63, srv612557519=81, srv615120929=82, srv1986682733=54, srv1831835564=44, srv1748844740=36, srv1285406325=12, srv288587414=65, srv2141977124=60} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-03-27 10:56:01,014 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-03-27 10:56:01,014 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-03-27 10:56:01,014 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-03-27 10:56:01,014 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-03-27 10:56:01,014 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-03-27 10:56:01,015 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-03-27 10:56:01,015 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-03-27 10:56:01,015 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-03-27 10:56:01,015 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-03-27 10:56:01,015 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-03-27 10:56:01,015 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-03-27 10:56:01,015 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-03-27 10:56:01,015 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-03-27 10:56:01,015 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-03-27 10:56:01,015 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-03-27 10:56:01,015 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-03-27 10:56:01,015 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-03-27 10:56:01,015 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-03-27 10:56:01,015 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-03-27 10:56:01,015 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-03-27 10:56:01,015 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-03-27 10:56:01,015 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-03-27 10:56:01,015 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-03-27 10:56:01,015 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-03-27 10:56:01,015 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-03-27 10:56:01,015 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-03-27 10:56:01,016 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-03-27 10:56:01,016 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-03-27 10:56:01,016 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-03-27 10:56:01,016 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-03-27 10:56:01,016 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-03-27 10:56:01,016 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-03-27 10:56:01,016 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-03-27 10:56:01,016 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-03-27 10:56:01,016 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-03-27 10:56:01,016 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-03-27 10:56:01,016 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-03-27 10:56:01,016 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-03-27 10:56:01,016 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-03-27 10:56:01,016 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-03-27 10:56:01,016 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-03-27 10:56:01,016 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-03-27 10:56:01,016 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-03-27 10:56:01,016 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-03-27 10:56:01,016 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-03-27 10:56:01,016 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-03-27 10:56:01,017 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-03-27 10:56:01,017 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-03-27 10:56:01,017 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-03-27 10:56:01,017 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-03-27 10:56:01,017 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-03-27 10:56:01,017 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-03-27 10:56:01,017 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-03-27 10:56:01,017 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-03-27 10:56:01,017 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-03-27 10:56:01,017 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-03-27 10:56:01,017 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-03-27 10:56:01,017 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-03-27 10:56:01,017 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-03-27 10:56:01,017 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-03-27 10:56:01,017 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-03-27 10:56:01,017 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-03-27 10:56:01,017 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-03-27 10:56:01,017 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-03-27 10:56:01,017 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-03-27 10:56:01,018 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-03-27 10:56:01,018 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-03-27 10:56:01,018 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-03-27 10:56:01,018 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-03-27 10:56:01,018 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-03-27 10:56:01,018 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-03-27 10:56:01,018 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-03-27 10:56:01,018 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-03-27 10:56:01,018 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-03-27 10:56:01,018 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-03-27 10:56:01,018 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-03-27 10:56:01,018 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-03-27 10:56:01,018 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-03-27 10:56:01,018 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-03-27 10:56:01,019 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-03-27 10:56:01,019 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-03-27 10:56:01,019 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-03-27 10:56:01,019 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-03-27 10:56:01,019 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-03-27 10:56:01,019 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-03-27 10:56:01,019 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-03-27 10:56:01,019 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-03-27 10:56:01,019 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-03-27 10:56:01,019 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-03-27 10:56:01,019 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-03-27 10:56:01,019 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-03-27 10:56:01,019 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-03-27 10:56:01,019 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-03-27 10:56:01,019 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-03-27 10:56:01,019 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-03-27 10:56:01,019 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-03-27 10:56:01,019 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-03-27 10:56:01,019 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-03-27 10:56:01,019 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-03-27 10:56:01,020 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-03-27 10:56:01,020 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-03-27 10:56:01,167 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=3.868392354571063E-4); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0018349396085439343); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=3.868392354571063E-4); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=2.5E-4); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-03-27 10:56:01,167 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-03-27 10:56:01,167 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=3.2629876529268156E-5, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=3.868392354571063E-4); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0018349396085439343); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=3.868392354571063E-4); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=2.5E-4); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-03-27 10:56:01,495 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 463 ms to try 5000 different iterations.  Found a solution that moves 20 regions; Going from a computed imbalance of 3.2629876529268156E-5 to a new imbalance of 7.213282289528359E-6. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0015713484026367722); MoveCostFunction : (multiplier=7.0, imbalance=0.0022222222222222222); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-03-27 10:56:01,495 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1199566116:83 , srv1849107357:83 , srv417505759:83 , srv596363103:83 , srv603432764:83 , srv955183082:83 , srv1033327186:84 , srv1076460536:84 , srv108136835:84 , srv1098459091:84 , srv1125069272:84 , srv1129182701:84 , srv1157556523:84 , srv1167063299:84 , srv1175813154:84 , srv1176517086:84 , srv126445661:84 , srv1285406325:84 , srv1285648371:84 , srv1302788050:84 , srv1306553048:84 , srv1322146319:84 , srv1326223842:84 , srv1326797368:84 , srv1358237132:84 , srv1366499599:84 , srv1389375870:84 , srv1433211820:84 , srv1456100588:84 , srv1456243145:84 , srv1522899974:84 , srv1547940174:84 , srv1583426124:84 , srv1600195903:84 , srv1630273684:84 , srv163939333:84 , srv1639812500:84 , srv1654576046:84 , srv1748844740:84 , srv1754396885:84 , srv1754718362:84 , srv1767348427:84 , srv1768087904:84 , srv1769842406:84 , srv1810831082:84 , srv1831835564:84 , srv1849444208:84 , srv189623750:84 , srv1897752502:84 , srv1899658493:84 , srv1929562041:84 , srv1935801985:84 , srv1954010949:84 , srv1982157034:84 , srv1986682733:84 , srv2034851471:84 , srv2066951417:84 , srv2102679678:84 , srv2141977124:84 , srv257800421:84 , srv265064846:84 , srv271423012:84 , srv278126247:84 , srv288587414:84 , srv297614041:84 , srv321981466:84 , srv322827270:84 , srv355346759:84 , srv387042030:84 , srv415064745:84 , srv436957185:84 , srv558091283:84 , srv566323784:84 , srv582850463:84 , srv593985691:84 , srv59754918:84 , srv612557519:84 , srv615120929:84 , srv628654389:84 , srv653527423:84 , srv666401882:84 , srv670728745:84 , srv673729915:84 , srv696833966:84 , srv717678101:84 , srv734408225:84 , srv794120948:84 , srv807137723:84 , srv809095610:84 , srv883907040:84 , srv886711897:84 , srv923848127:84 , srv982183020:84 , srv1621384357:85 , srv1737097427:85 , srv1758113858:85 , srv1997280839:85 , srv2141655009:85 , srv751094678:85 , srv1351881244:684 }
2023-03-27 10:56:01,502 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-03-27 10:56:01,503 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv603432764=80, srv1389375870=22, srv1630273684=31, srv163939333=32, srv1033327186=0, srv189623750=47, srv278126247=64, srv1456243145=25, srv2034851471=56, srv883907040=95, srv886711897=96, srv1768087904=41, srv1935801985=51, srv982183020=99, srv1098459091=3, srv1899658493=49, srv1351881244=19, srv558091283=74, srv751094678=91, srv126445661=11, srv1758113858=39, srv1433211820=23, srv1810831082=43, srv1600195903=29, srv322827270=68, srv2066951417=57, srv1125069272=4, srv321981466=67, srv1456100588=24, srv1522899974=26, srv257800421=61, srv1175813154=8, srv1366499599=21, srv1326223842=17, srv1157556523=6, srv596363103=78, srv1954010949=52, srv387042030=70, srv955183082=98, srv108136835=2, srv59754918=79, srv1167063299=7, srv809095610=94, srv1639812500=33, srv794120948=92, srv1306553048=15, srv1997280839=55, srv673729915=87, srv1322146319=16, srv670728745=86, srv1358237132=20, srv1982157034=53, srv1583426124=28, srv1897752502=48, srv417505759=72, srv1621384357=30, srv1302788050=14, srv1849107357=45, srv566323784=75, srv696833966=88, srv807137723=93, srv923848127=97, srv297614041=66, srv628654389=83, srv653527423=84, srv1176517086=9, srv1767348427=40, srv1129182701=5, srv1076460536=1, srv2141655009=59, srv582850463=76, srv1754718362=38, srv355346759=69, srv265064846=62, srv1326797368=18, srv415064745=71, srv436957185=73, srv1754396885=37, srv1929562041=50, srv1737097427=35, srv1849444208=46, srv734408225=90, srv2102679678=58, srv1285648371=13, srv666401882=85, srv1654576046=34, srv1199566116=10, srv717678101=89, srv593985691=77, srv1769842406=42, srv1547940174=27, srv271423012=63, srv612557519=81, srv615120929=82, srv1986682733=54, srv1831835564=44, srv1748844740=36, srv1285406325=12, srv288587414=65, srv2141977124=60} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-03-27 10:56:01,520 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-03-27 10:56:01,521 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-03-27 10:56:01,521 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-03-27 10:56:01,521 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-03-27 10:56:01,521 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-03-27 10:56:01,521 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-03-27 10:56:01,521 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-03-27 10:56:01,521 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-03-27 10:56:01,521 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-03-27 10:56:01,521 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-03-27 10:56:01,521 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-03-27 10:56:01,521 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-03-27 10:56:01,522 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-03-27 10:56:01,522 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-03-27 10:56:01,522 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-03-27 10:56:01,522 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-03-27 10:56:01,522 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-03-27 10:56:01,522 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-03-27 10:56:01,522 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-03-27 10:56:01,522 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-03-27 10:56:01,522 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-03-27 10:56:01,522 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-03-27 10:56:01,522 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-03-27 10:56:01,522 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-03-27 10:56:01,522 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-03-27 10:56:01,523 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-03-27 10:56:01,523 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-03-27 10:56:01,523 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-03-27 10:56:01,523 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-03-27 10:56:01,523 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-03-27 10:56:01,523 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-03-27 10:56:01,523 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-03-27 10:56:01,523 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-03-27 10:56:01,523 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-03-27 10:56:01,523 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-03-27 10:56:01,523 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-03-27 10:56:01,523 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-03-27 10:56:01,523 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-03-27 10:56:01,524 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-03-27 10:56:01,524 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-03-27 10:56:01,524 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-03-27 10:56:01,524 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-03-27 10:56:01,524 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-03-27 10:56:01,524 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-03-27 10:56:01,524 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-03-27 10:56:01,524 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-03-27 10:56:01,524 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-03-27 10:56:01,524 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-03-27 10:56:01,524 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-03-27 10:56:01,524 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-03-27 10:56:01,525 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-03-27 10:56:01,525 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-03-27 10:56:01,525 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-03-27 10:56:01,525 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-03-27 10:56:01,525 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-03-27 10:56:01,525 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-03-27 10:56:01,525 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-03-27 10:56:01,525 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-03-27 10:56:01,525 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-03-27 10:56:01,525 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-03-27 10:56:01,525 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-03-27 10:56:01,525 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-03-27 10:56:01,525 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-03-27 10:56:01,526 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-03-27 10:56:01,526 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-03-27 10:56:01,526 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-03-27 10:56:01,526 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-03-27 10:56:01,526 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-03-27 10:56:01,526 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-03-27 10:56:01,526 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-03-27 10:56:01,526 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-03-27 10:56:01,526 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-03-27 10:56:01,526 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-03-27 10:56:01,526 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-03-27 10:56:01,526 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-03-27 10:56:01,526 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-03-27 10:56:01,527 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-03-27 10:56:01,527 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-03-27 10:56:01,527 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-03-27 10:56:01,527 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-03-27 10:56:01,527 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-03-27 10:56:01,527 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-03-27 10:56:01,527 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-03-27 10:56:01,527 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-03-27 10:56:01,527 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-03-27 10:56:01,527 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-03-27 10:56:01,527 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-03-27 10:56:01,527 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-03-27 10:56:01,527 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-03-27 10:56:01,528 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-03-27 10:56:01,528 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-03-27 10:56:01,528 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-03-27 10:56:01,528 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-03-27 10:56:01,528 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-03-27 10:56:01,528 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-03-27 10:56:01,528 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-03-27 10:56:01,528 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-03-27 10:56:01,528 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-03-27 10:56:01,528 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-03-27 10:56:01,528 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-03-27 10:56:01,528 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-03-27 10:56:01,680 INFO  [Time-limited test] balancer.StochasticLoadBalancer(381): Cluster wide - skipping load balancing because weighted average imbalance=7.073239296329447E-6 <= threshold(0.025). If you want more aggressive balancing, either lower hbase.master.balancer.stochastic.minCostNeedBalance from 0.025 or increase the relative multiplier(s) of the specific cost function(s). functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0015713484026367722); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-03-27 10:56:01,681 INFO  [Time-limited test] balancer.BalancerTestBase(570): Mock Final balance: { srv1199566116:83 , srv1849107357:83 , srv417505759:83 , srv596363103:83 , srv603432764:83 , srv955183082:83 , srv1033327186:84 , srv1076460536:84 , srv108136835:84 , srv1098459091:84 , srv1125069272:84 , srv1129182701:84 , srv1157556523:84 , srv1167063299:84 , srv1175813154:84 , srv1176517086:84 , srv126445661:84 , srv1285406325:84 , srv1285648371:84 , srv1302788050:84 , srv1306553048:84 , srv1322146319:84 , srv1326223842:84 , srv1326797368:84 , srv1358237132:84 , srv1366499599:84 , srv1389375870:84 , srv1433211820:84 , srv1456100588:84 , srv1456243145:84 , srv1522899974:84 , srv1547940174:84 , srv1583426124:84 , srv1600195903:84 , srv1630273684:84 , srv163939333:84 , srv1639812500:84 , srv1654576046:84 , srv1748844740:84 , srv1754396885:84 , srv1754718362:84 , srv1767348427:84 , srv1768087904:84 , srv1769842406:84 , srv1810831082:84 , srv1831835564:84 , srv1849444208:84 , srv189623750:84 , srv1897752502:84 , srv1899658493:84 , srv1929562041:84 , srv1935801985:84 , srv1954010949:84 , srv1982157034:84 , srv1986682733:84 , srv2034851471:84 , srv2066951417:84 , srv2102679678:84 , srv2141977124:84 , srv257800421:84 , srv265064846:84 , srv271423012:84 , srv278126247:84 , srv288587414:84 , srv297614041:84 , srv321981466:84 , srv322827270:84 , srv355346759:84 , srv387042030:84 , srv415064745:84 , srv436957185:84 , srv558091283:84 , srv566323784:84 , srv582850463:84 , srv593985691:84 , srv59754918:84 , srv612557519:84 , srv615120929:84 , srv628654389:84 , srv653527423:84 , srv666401882:84 , srv670728745:84 , srv673729915:84 , srv696833966:84 , srv717678101:84 , srv734408225:84 , srv794120948:84 , srv807137723:84 , srv809095610:84 , srv883907040:84 , srv886711897:84 , srv923848127:84 , srv982183020:84 , srv1621384357:85 , srv1737097427:85 , srv1758113858:85 , srv1997280839:85 , srv2141655009:85 , srv751094678:85 , srv1351881244:684 }
2023-03-27 10:56:01,723 INFO  [Time-limited test] hbase.ResourceChecker(175): after: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnLargeClusterWithRacks Thread=10 (was 10), OpenFileDescriptor=260 (was 260), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=389 (was 362) - SystemLoadAverage LEAK? -, ProcessCount=168 (was 168), AvailableMemoryMB=7529 (was 8023)
2023-03-27 10:56:01,734 INFO  [Time-limited test] hbase.ResourceChecker(147): before: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnMidClusterWithRacks Thread=10, OpenFileDescriptor=260, MaxFileDescriptor=60000, SystemLoadAverage=389, ProcessCount=168, AvailableMemoryMB=7528
2023-03-27 10:56:01,735 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2023-03-27 10:56:01,735 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=5000, runMaxSteps=true, stepsPerRegion=800, maxRunningTime=120000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 111077.0 etc.
2023-03-27 10:56:01,748 INFO  [Time-limited test] balancer.BalancerTestBase(547): Mock Cluster : { srv1009838059:84 , srv1032538275:84 , srv108833615:84 , srv1109029315:84 , srv1196776690:84 , srv1224861235:84 , srv1243059390:84 , srv1297028698:84 , srv1338197822:84 , srv137545344:84 , srv1418096428:84 , srv144771496:84 , srv1618224189:84 , srv1716042797:84 , srv178792965:84 , srv1832435203:84 , srv1854146137:84 , srv188219198:84 , srv2033633214:84 , srv2063030147:84 , srv2085013897:84 , srv284709756:84 , srv310603330:84 , srv475815506:84 , srv540129860:84 , srv819221202:84 , srv884628463:84 , srv91461170:84 , srv995759656:84 , srv541975602:264 } [srvr=30 rgns=2700 avg=90.0 max=90 min=90]
2023-03-27 10:56:01,750 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-03-27 10:56:01,750 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1618224189=12, srv2033633214=18, srv2063030147=19, srv541975602=25, srv1716042797=13, srv1832435203=15, srv188219198=17, srv108833615=2, srv178792965=14, srv1009838059=0, srv475815506=23, srv819221202=26, srv1196776690=4, srv284709756=21, srv2085013897=20, srv1032538275=1, srv1243059390=6, srv540129860=24, srv1338197822=8, srv1854146137=16, srv144771496=11, srv1109029315=3, srv137545344=9, srv884628463=27, srv995759656=29, srv310603330=22, srv91461170=28, srv1224861235=5, srv1418096428=10, srv1297028698=7} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-03-27 10:56:01,766 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-03-27 10:56:01,766 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-03-27 10:56:01,766 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-03-27 10:56:01,766 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-03-27 10:56:01,766 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-03-27 10:56:01,766 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-03-27 10:56:01,766 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-03-27 10:56:01,766 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-03-27 10:56:01,766 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-03-27 10:56:01,766 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-03-27 10:56:01,767 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-03-27 10:56:01,767 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-03-27 10:56:01,767 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-03-27 10:56:01,767 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-03-27 10:56:01,767 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-03-27 10:56:01,767 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-03-27 10:56:01,767 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-03-27 10:56:01,767 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-03-27 10:56:01,767 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-03-27 10:56:01,767 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-03-27 10:56:01,767 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-03-27 10:56:01,767 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-03-27 10:56:01,767 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-03-27 10:56:01,767 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-03-27 10:56:01,767 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-03-27 10:56:01,768 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-03-27 10:56:01,768 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-03-27 10:56:01,768 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-03-27 10:56:01,768 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-03-27 10:56:01,768 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-03-27 10:56:01,768 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=10, number of hosts=30, number of racks=4
2023-03-27 10:56:01,793 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=1.1703430720668213, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-03-27 10:56:01,794 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.9912729788722149, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=1.1703430720668213, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=64800000
2023-03-27 10:58:01,772 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 120001 ms to try 6336114 different iterations.  Found a solution that moves 1851 regions; Going from a computed imbalance of 0.9912729788722149 to a new imbalance of 4.320326340186438E-5. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); MoveCostFunction : (multiplier=7.0, imbalance=0.6855555555555556, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-03-27 10:58:01,779 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1009838059:90 , srv1032538275:90 , srv108833615:90 , srv1109029315:90 , srv1196776690:90 , srv1224861235:90 , srv1243059390:90 , srv1297028698:90 , srv1338197822:90 , srv137545344:90 , srv1418096428:90 , srv144771496:90 , srv1618224189:90 , srv1716042797:90 , srv178792965:90 , srv1832435203:90 , srv1854146137:90 , srv188219198:90 , srv2033633214:90 , srv2063030147:90 , srv2085013897:90 , srv284709756:90 , srv310603330:90 , srv475815506:90 , srv540129860:90 , srv541975602:90 , srv819221202:90 , srv884628463:90 , srv91461170:90 , srv995759656:90 }
2023-03-27 10:58:01,780 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-03-27 10:58:01,781 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1618224189=12, srv2033633214=18, srv2063030147=19, srv541975602=25, srv1716042797=13, srv1832435203=15, srv188219198=17, srv108833615=2, srv178792965=14, srv1009838059=0, srv475815506=23, srv819221202=26, srv1196776690=4, srv284709756=21, srv2085013897=20, srv1032538275=1, srv1243059390=6, srv540129860=24, srv1338197822=8, srv1854146137=16, srv144771496=11, srv1109029315=3, srv137545344=9, srv884628463=27, srv995759656=29, srv310603330=22, srv91461170=28, srv1224861235=5, srv1418096428=10, srv1297028698=7} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-03-27 10:58:01,785 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-03-27 10:58:01,785 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-03-27 10:58:01,785 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-03-27 10:58:01,785 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-03-27 10:58:01,785 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-03-27 10:58:01,785 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-03-27 10:58:01,785 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-03-27 10:58:01,785 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-03-27 10:58:01,785 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-03-27 10:58:01,785 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-03-27 10:58:01,785 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-03-27 10:58:01,785 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-03-27 10:58:01,785 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-03-27 10:58:01,785 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-03-27 10:58:01,785 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-03-27 10:58:01,785 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-03-27 10:58:01,785 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-03-27 10:58:01,785 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-03-27 10:58:01,785 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-03-27 10:58:01,785 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-03-27 10:58:01,785 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-03-27 10:58:01,785 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-03-27 10:58:01,786 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-03-27 10:58:01,786 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-03-27 10:58:01,786 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-03-27 10:58:01,786 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-03-27 10:58:01,786 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-03-27 10:58:01,786 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-03-27 10:58:01,786 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-03-27 10:58:01,786 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-03-27 10:58:01,786 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=10, number of hosts=30, number of racks=4
2023-03-27 10:58:01,797 INFO  [Time-limited test] balancer.StochasticLoadBalancer(381): Cluster wide - skipping load balancing because weighted average imbalance=0.0 <= threshold(0.025). If you want more aggressive balancing, either lower hbase.master.balancer.stochastic.minCostNeedBalance from 0.025 or increase the relative multiplier(s) of the specific cost function(s). functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-03-27 10:58:01,798 INFO  [Time-limited test] balancer.BalancerTestBase(570): Mock Final balance: { srv1009838059:90 , srv1032538275:90 , srv108833615:90 , srv1109029315:90 , srv1196776690:90 , srv1224861235:90 , srv1243059390:90 , srv1297028698:90 , srv1338197822:90 , srv137545344:90 , srv1418096428:90 , srv144771496:90 , srv1618224189:90 , srv1716042797:90 , srv178792965:90 , srv1832435203:90 , srv1854146137:90 , srv188219198:90 , srv2033633214:90 , srv2063030147:90 , srv2085013897:90 , srv284709756:90 , srv310603330:90 , srv475815506:90 , srv540129860:90 , srv541975602:90 , srv819221202:90 , srv884628463:90 , srv91461170:90 , srv995759656:90 }
2023-03-27 10:58:01,810 INFO  [Time-limited test] hbase.ResourceChecker(175): after: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnMidClusterWithRacks Thread=9 (was 10), OpenFileDescriptor=260 (was 260), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=288 (was 389), ProcessCount=171 (was 168) - ProcessCount LEAK? -, AvailableMemoryMB=7469 (was 7528)