2023-10-28 04:55:31,452 INFO  [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks timeout: 13 mins
2023-10-28 04:55:31,731 WARN  [Time-limited test] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties
2023-10-28 04:55:31,828 INFO  [Time-limited test] metrics.MetricRegistriesLoader(60): Loaded MetricRegistries class org.apache.hadoop.hbase.metrics.impl.MetricRegistriesImpl
2023-10-28 04:55:31,886 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2023-10-28 04:55:31,893 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc.
2023-10-28 04:55:31,905 INFO  [Time-limited test] hbase.ResourceChecker(147): before: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnLargeClusterWithRacks Thread=12, OpenFileDescriptor=263, MaxFileDescriptor=60000, SystemLoadAverage=160, ProcessCount=168, AvailableMemoryMB=4649
2023-10-28 04:55:31,907 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2023-10-28 04:55:31,908 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=5000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=10000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc.
2023-10-28 04:55:32,020 INFO  [Time-limited test] balancer.BalancerTestBase(547): Mock Cluster : { srv1034988355:84 , srv1039963875:84 , srv1071242171:84 , srv1109755074:84 , srv1139313560:84 , srv1152692060:84 , srv1162316816:84 , srv1164782114:84 , srv11705624:84 , srv1181150898:84 , srv129152684:84 , srv1303308311:84 , srv1314102669:84 , srv1351211979:84 , srv1354780479:84 , srv1401776952:84 , srv1416792952:84 , srv1423703091:84 , srv1453414501:84 , srv1465427772:84 , srv1472992195:84 , srv1473880502:84 , srv1487828392:84 , srv1489542011:84 , srv156207708:84 , srv1565141132:84 , srv1613611533:84 , srv1619019455:84 , srv1619507545:84 , srv1630684600:84 , srv1669046820:84 , srv1670359871:84 , srv1704905959:84 , srv1733658980:84 , srv1755813290:84 , srv1765675489:84 , srv1776572949:84 , srv1787340486:84 , srv1796110245:84 , srv1836204964:84 , srv1852796239:84 , srv1870905160:84 , srv1888751973:84 , srv1896263283:84 , srv1902502873:84 , srv1918823707:84 , srv1925360484:84 , srv1932299251:84 , srv1940450690:84 , srv1971284074:84 , srv198891422:84 , srv2019288937:84 , srv2021037588:84 , srv2046880358:84 , srv2051773036:84 , srv2071811731:84 , srv2090627488:84 , srv2124451810:84 , srv2132817026:84 , srv213647002:84 , srv222298571:84 , srv280660181:84 , srv31876344:84 , srv327981056:84 , srv33042570:84 , srv333672464:84 , srv343875199:84 , srv379680004:84 , srv380979490:84 , srv405335381:84 , srv441179061:84 , srv44430480:84 , srv45270388:84 , srv464469433:84 , srv466915874:84 , srv488358012:84 , srv497495353:84 , srv551200460:84 , srv564061159:84 , srv573399441:84 , srv580382246:84 , srv591133738:84 , srv592494693:84 , srv598352237:84 , srv648591419:84 , srv659461193:84 , srv735633899:84 , srv742056716:84 , srv780234987:84 , srv799549499:84 , srv806549682:84 , srv820793515:84 , srv833334824:84 , srv835669181:84 , srv867386253:84 , srv902481716:84 , srv906652420:84 , srv923546538:84 , srv948415511:84 , srv1011032603:684 } [srvr=100 rgns=9000 avg=90.0 max=90 min=90]
2023-10-28 04:55:32,027 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-10-28 04:55:32,034 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1465427772=20, srv1162316816=7, srv1776572949=37, srv45270388=73, srv1619507545=29, srv2071811731=56, srv573399441=80, srv1487828392=23, srv1918823707=46, srv902481716=96, srv333672464=66, srv592494693=83, srv33042570=65, srv1836204964=40, srv1034988355=1, srv1787340486=38, srv1852796239=41, srv1940450690=49, srv1925360484=47, srv466915874=75, srv598352237=84, srv806549682=91, srv2021037588=53, srv948415511=99, srv735633899=87, srv327981056=64, srv591133738=82, srv2051773036=55, srv906652420=97, srv1164782114=8, srv1139313560=5, srv380979490=69, srv379680004=68, srv1351211979=14, srv648591419=85, srv1704905959=33, srv1039963875=2, srv2019288937=52, srv1670359871=32, srv44430480=72, srv1765675489=36, srv1152692060=6, srv820793515=92, srv2090627488=57, srv1613611533=27, srv1011032603=0, srv1401776952=16, srv1354780479=15, srv1630684600=30, srv488358012=76, srv497495353=77, srv1870905160=42, srv1902502873=45, srv742056716=88, srv1472992195=21, srv1888751973=43, srv1181150898=10, srv1565141132=26, srv1314102669=13, srv1932299251=48, srv11705624=9, srv1473880502=22, srv1423703091=18, srv1071242171=3, srv833334824=93, srv1303308311=12, srv1733658980=34, srv564061159=79, srv867386253=95, srv780234987=89, srv1971284074=50, srv31876344=63, srv2046880358=54, srv551200460=78, srv1416792952=17, srv1109755074=4, srv1489542011=24, srv799549499=90, srv923546538=98, srv464469433=74, srv441179061=71, srv1669046820=31, srv835669181=94, srv1796110245=39, srv659461193=86, srv1896263283=44, srv213647002=60, srv222298571=61, srv2132817026=59, srv1755813290=35, srv1453414501=19, srv2124451810=58, srv405335381=70, srv1619019455=28, srv129152684=11, srv280660181=62, srv156207708=25, srv580382246=81, srv198891422=51, srv343875199=67} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-10-28 04:55:32,117 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-10-28 04:55:32,118 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-10-28 04:55:32,118 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-10-28 04:55:32,118 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-10-28 04:55:32,118 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-10-28 04:55:32,118 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-10-28 04:55:32,118 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-10-28 04:55:32,118 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-10-28 04:55:32,118 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-10-28 04:55:32,119 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-10-28 04:55:32,119 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-10-28 04:55:32,119 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-10-28 04:55:32,119 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-10-28 04:55:32,119 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-10-28 04:55:32,119 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-10-28 04:55:32,119 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-10-28 04:55:32,119 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-10-28 04:55:32,119 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-10-28 04:55:32,119 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-10-28 04:55:32,120 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-10-28 04:55:32,120 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-10-28 04:55:32,120 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-10-28 04:55:32,120 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-10-28 04:55:32,120 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-10-28 04:55:32,120 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-10-28 04:55:32,120 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-10-28 04:55:32,120 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-10-28 04:55:32,120 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-10-28 04:55:32,120 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-10-28 04:55:32,120 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-10-28 04:55:32,121 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-10-28 04:55:32,121 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-10-28 04:55:32,121 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-10-28 04:55:32,121 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-10-28 04:55:32,121 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-10-28 04:55:32,121 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-10-28 04:55:32,121 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-10-28 04:55:32,122 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-10-28 04:55:32,122 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-10-28 04:55:32,122 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-10-28 04:55:32,122 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-10-28 04:55:32,122 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-10-28 04:55:32,122 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-10-28 04:55:32,122 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-10-28 04:55:32,123 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-10-28 04:55:32,123 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-10-28 04:55:32,123 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-10-28 04:55:32,123 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-10-28 04:55:32,123 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-10-28 04:55:32,123 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-10-28 04:55:32,123 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-10-28 04:55:32,123 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-10-28 04:55:32,124 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-10-28 04:55:32,124 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-10-28 04:55:32,124 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-10-28 04:55:32,124 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-10-28 04:55:32,124 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-10-28 04:55:32,124 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-10-28 04:55:32,124 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-10-28 04:55:32,124 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-10-28 04:55:32,124 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-10-28 04:55:32,124 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-10-28 04:55:32,125 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-10-28 04:55:32,125 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-10-28 04:55:32,125 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-10-28 04:55:32,125 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-10-28 04:55:32,125 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-10-28 04:55:32,125 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-10-28 04:55:32,126 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-10-28 04:55:32,126 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-10-28 04:55:32,126 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-10-28 04:55:32,126 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-10-28 04:55:32,126 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-10-28 04:55:32,126 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-10-28 04:55:32,126 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-10-28 04:55:32,126 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-10-28 04:55:32,126 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-10-28 04:55:32,127 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-10-28 04:55:32,127 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-10-28 04:55:32,127 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-10-28 04:55:32,127 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-10-28 04:55:32,127 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-10-28 04:55:32,127 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-10-28 04:55:32,127 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-10-28 04:55:32,128 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-10-28 04:55:32,128 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-10-28 04:55:32,128 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-10-28 04:55:32,128 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-10-28 04:55:32,128 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-10-28 04:55:32,128 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-10-28 04:55:32,129 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-10-28 04:55:32,129 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-10-28 04:55:32,129 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-10-28 04:55:32,129 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-10-28 04:55:32,129 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-10-28 04:55:32,129 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-10-28 04:55:32,130 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-10-28 04:55:32,130 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-10-28 04:55:32,130 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-10-28 04:55:32,130 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-10-28 04:55:32,130 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-10-28 04:55:32,292 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.06666666666666667, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-10-28 04:55:32,293 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-10-28 04:55:32,293 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.9909252140407105, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.06666666666666667, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-10-28 04:55:32,661 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 506 ms to try 5000 different iterations.  Found a solution that moves 4657 regions; Going from a computed imbalance of 0.9909252140407105 to a new imbalance of 0.18367145929256296. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0382801482083237, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.05681205354156305, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.5174444444444445, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0382801482083237, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.17933333333333334, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.24158333333333334, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-10-28 04:55:32,676 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1039963875:81 , srv1487828392:82 , srv2090627488:82 , srv405335381:82 , srv1416792952:83 , srv1669046820:83 , srv2021037588:83 , srv2046880358:83 , srv380979490:83 , srv1034988355:84 , srv1139313560:84 , srv129152684:84 , srv1472992195:84 , srv1473880502:84 , srv1755813290:84 , srv1787340486:84 , srv1902502873:84 , srv1925360484:84 , srv1932299251:84 , srv33042570:84 , srv648591419:84 , srv659461193:84 , srv902481716:84 , srv1152692060:85 , srv1162316816:85 , srv1181150898:85 , srv1401776952:85 , srv156207708:85 , srv1870905160:85 , srv1918823707:85 , srv1971284074:85 , srv2051773036:85 , srv2071811731:85 , srv222298571:85 , srv441179061:85 , srv497495353:85 , srv580382246:85 , srv598352237:85 , srv780234987:85 , srv835669181:85 , srv906652420:85 , srv923546538:85 , srv1164782114:86 , srv11705624:86 , srv1453414501:86 , srv1465427772:86 , srv1489542011:86 , srv1565141132:86 , srv1704905959:86 , srv1765675489:86 , srv2132817026:86 , srv280660181:86 , srv551200460:86 , srv592494693:86 , srv1303308311:87 , srv1351211979:87 , srv1619507545:87 , srv1630684600:87 , srv1796110245:87 , srv1836204964:87 , srv1940450690:87 , srv464469433:87 , srv488358012:87 , srv564061159:87 , srv591133738:87 , srv799549499:87 , srv820793515:87 , srv1354780479:88 , srv1613611533:88 , srv1852796239:88 , srv31876344:88 , srv343875199:88 , srv742056716:88 , srv806549682:88 , srv833334824:88 , srv1071242171:89 , srv1109755074:89 , srv1670359871:89 , srv1733658980:89 , srv1888751973:89 , srv198891422:89 , srv2124451810:89 , srv333672464:89 , srv379680004:89 , srv466915874:89 , srv1423703091:90 , srv1619019455:90 , srv213647002:90 , srv45270388:90 , srv1776572949:91 , srv2019288937:91 , srv327981056:91 , srv573399441:91 , srv867386253:91 , srv948415511:91 , srv44430480:92 , srv735633899:93 , srv1314102669:94 , srv1896263283:95 , srv1011032603:430 }
2023-10-28 04:55:32,681 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-10-28 04:55:32,683 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1465427772=20, srv1162316816=7, srv1776572949=37, srv45270388=73, srv1619507545=29, srv2071811731=56, srv573399441=80, srv1487828392=23, srv1918823707=46, srv902481716=96, srv333672464=66, srv592494693=83, srv33042570=65, srv1836204964=40, srv1034988355=1, srv1787340486=38, srv1852796239=41, srv1940450690=49, srv1925360484=47, srv466915874=75, srv598352237=84, srv806549682=91, srv2021037588=53, srv948415511=99, srv735633899=87, srv327981056=64, srv591133738=82, srv2051773036=55, srv906652420=97, srv1164782114=8, srv1139313560=5, srv380979490=69, srv379680004=68, srv1351211979=14, srv648591419=85, srv1704905959=33, srv1039963875=2, srv2019288937=52, srv1670359871=32, srv44430480=72, srv1765675489=36, srv1152692060=6, srv820793515=92, srv2090627488=57, srv1613611533=27, srv1011032603=0, srv1401776952=16, srv1354780479=15, srv1630684600=30, srv488358012=76, srv497495353=77, srv1870905160=42, srv1902502873=45, srv742056716=88, srv1472992195=21, srv1888751973=43, srv1181150898=10, srv1565141132=26, srv1314102669=13, srv1932299251=48, srv11705624=9, srv1473880502=22, srv1423703091=18, srv1071242171=3, srv833334824=93, srv1303308311=12, srv1733658980=34, srv564061159=79, srv867386253=95, srv780234987=89, srv1971284074=50, srv31876344=63, srv2046880358=54, srv551200460=78, srv1416792952=17, srv1109755074=4, srv1489542011=24, srv799549499=90, srv923546538=98, srv464469433=74, srv441179061=71, srv1669046820=31, srv835669181=94, srv1796110245=39, srv659461193=86, srv1896263283=44, srv213647002=60, srv222298571=61, srv2132817026=59, srv1755813290=35, srv1453414501=19, srv2124451810=58, srv405335381=70, srv1619019455=28, srv129152684=11, srv280660181=62, srv156207708=25, srv580382246=81, srv198891422=51, srv343875199=67} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-10-28 04:55:32,705 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-10-28 04:55:32,705 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-10-28 04:55:32,705 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-10-28 04:55:32,705 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-10-28 04:55:32,705 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-10-28 04:55:32,705 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-10-28 04:55:32,706 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-10-28 04:55:32,706 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-10-28 04:55:32,706 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-10-28 04:55:32,706 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-10-28 04:55:32,706 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-10-28 04:55:32,706 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-10-28 04:55:32,706 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-10-28 04:55:32,706 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-10-28 04:55:32,706 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-10-28 04:55:32,707 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-10-28 04:55:32,707 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-10-28 04:55:32,707 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-10-28 04:55:32,707 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-10-28 04:55:32,707 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-10-28 04:55:32,707 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-10-28 04:55:32,707 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-10-28 04:55:32,707 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-10-28 04:55:32,707 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-10-28 04:55:32,708 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-10-28 04:55:32,708 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-10-28 04:55:32,708 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-10-28 04:55:32,708 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-10-28 04:55:32,708 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-10-28 04:55:32,708 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-10-28 04:55:32,708 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-10-28 04:55:32,708 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-10-28 04:55:32,708 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-10-28 04:55:32,708 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-10-28 04:55:32,708 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-10-28 04:55:32,709 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-10-28 04:55:32,709 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-10-28 04:55:32,709 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-10-28 04:55:32,709 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-10-28 04:55:32,709 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-10-28 04:55:32,709 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-10-28 04:55:32,709 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-10-28 04:55:32,709 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-10-28 04:55:32,709 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-10-28 04:55:32,710 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-10-28 04:55:32,710 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-10-28 04:55:32,710 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-10-28 04:55:32,710 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-10-28 04:55:32,710 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-10-28 04:55:32,710 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-10-28 04:55:32,710 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-10-28 04:55:32,710 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-10-28 04:55:32,710 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-10-28 04:55:32,710 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-10-28 04:55:32,710 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-10-28 04:55:32,711 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-10-28 04:55:32,711 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-10-28 04:55:32,711 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-10-28 04:55:32,711 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-10-28 04:55:32,711 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-10-28 04:55:32,711 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-10-28 04:55:32,711 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-10-28 04:55:32,711 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-10-28 04:55:32,711 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-10-28 04:55:32,711 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-10-28 04:55:32,712 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-10-28 04:55:32,712 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-10-28 04:55:32,712 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-10-28 04:55:32,712 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-10-28 04:55:32,712 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-10-28 04:55:32,712 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-10-28 04:55:32,712 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-10-28 04:55:32,712 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-10-28 04:55:32,712 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-10-28 04:55:32,712 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-10-28 04:55:32,712 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-10-28 04:55:32,713 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-10-28 04:55:32,713 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-10-28 04:55:32,713 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-10-28 04:55:32,713 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-10-28 04:55:32,713 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-10-28 04:55:32,713 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-10-28 04:55:32,713 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-10-28 04:55:32,713 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-10-28 04:55:32,713 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-10-28 04:55:32,713 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-10-28 04:55:32,714 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-10-28 04:55:32,714 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-10-28 04:55:32,714 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-10-28 04:55:32,714 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-10-28 04:55:32,714 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-10-28 04:55:32,714 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-10-28 04:55:32,714 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-10-28 04:55:32,714 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-10-28 04:55:32,714 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-10-28 04:55:32,714 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-10-28 04:55:32,714 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-10-28 04:55:32,715 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-10-28 04:55:32,715 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-10-28 04:55:32,715 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-10-28 04:55:32,715 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-10-28 04:55:32,859 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0382801482083237, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.05681205354156305, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0382801482083237, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.17933333333333334, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.24158333333333334, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-10-28 04:55:32,859 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-10-28 04:55:32,859 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.18363885028159657, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0382801482083237, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.05681205354156305, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0382801482083237, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.17933333333333334, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.24158333333333334, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-10-28 04:55:33,090 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 346 ms to try 5000 different iterations.  Found a solution that moves 2620 regions; Going from a computed imbalance of 0.18363885028159657 to a new imbalance of 0.015092072572983155. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0207106563920738); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0331949991500924, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.2911111111111111, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0207106563920738); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.012083333333333333); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.043833333333333335, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-10-28 04:55:33,099 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1896263283:76 , srv1314102669:79 , srv735633899:79 , srv1423703091:81 , srv213647002:81 , srv44430480:81 , srv45270388:81 , srv466915874:81 , srv573399441:81 , srv1619019455:82 , srv1888751973:82 , srv2019288937:82 , srv2124451810:82 , srv327981056:82 , srv948415511:82 , srv1071242171:83 , srv1303308311:83 , srv1354780479:83 , srv1619507545:83 , srv1670359871:83 , srv1796110245:83 , srv333672464:83 , srv591133738:83 , srv867386253:83 , srv1733658980:84 , srv1776572949:84 , srv1852796239:84 , srv198891422:84 , srv31876344:84 , srv379680004:84 , srv806549682:84 , srv833334824:84 , srv1109755074:85 , srv1164782114:85 , srv1351211979:85 , srv1453414501:85 , srv1489542011:85 , srv1565141132:85 , srv1765675489:85 , srv1836204964:85 , srv1940450690:85 , srv222298571:85 , srv343875199:85 , srv551200460:85 , srv742056716:85 , srv820793515:85 , srv906652420:85 , srv923546538:85 , srv1139313560:86 , srv11705624:86 , srv1181150898:86 , srv1472992195:86 , srv1704905959:86 , srv1971284074:86 , srv280660181:86 , srv564061159:86 , srv580382246:86 , srv799549499:86 , srv1162316816:87 , srv129152684:87 , srv1401776952:87 , srv1465427772:87 , srv1630684600:87 , srv1925360484:87 , srv2071811731:87 , srv380979490:87 , srv405335381:87 , srv441179061:87 , srv592494693:87 , srv1034988355:88 , srv1152692060:88 , srv1473880502:88 , srv156207708:88 , srv1613611533:88 , srv1755813290:88 , srv1870905160:88 , srv1918823707:88 , srv2021037588:88 , srv2046880358:88 , srv2051773036:88 , srv2132817026:88 , srv488358012:88 , srv497495353:88 , srv598352237:88 , srv648591419:88 , srv659461193:88 , srv780234987:88 , srv835669181:88 , srv902481716:88 , srv1787340486:89 , srv1932299251:89 , srv464469433:89 , srv1039963875:90 , srv1669046820:90 , srv1902502873:90 , srv1416792952:91 , srv2090627488:91 , srv33042570:92 , srv1487828392:93 , srv1011032603:528 }
2023-10-28 04:55:33,102 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-10-28 04:55:33,103 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1465427772=20, srv1162316816=7, srv1776572949=37, srv45270388=73, srv1619507545=29, srv2071811731=56, srv573399441=80, srv1487828392=23, srv1918823707=46, srv902481716=96, srv333672464=66, srv592494693=83, srv33042570=65, srv1836204964=40, srv1034988355=1, srv1787340486=38, srv1852796239=41, srv1940450690=49, srv1925360484=47, srv466915874=75, srv598352237=84, srv806549682=91, srv2021037588=53, srv948415511=99, srv735633899=87, srv327981056=64, srv591133738=82, srv2051773036=55, srv906652420=97, srv1164782114=8, srv1139313560=5, srv380979490=69, srv379680004=68, srv1351211979=14, srv648591419=85, srv1704905959=33, srv1039963875=2, srv2019288937=52, srv1670359871=32, srv44430480=72, srv1765675489=36, srv1152692060=6, srv820793515=92, srv2090627488=57, srv1613611533=27, srv1011032603=0, srv1401776952=16, srv1354780479=15, srv1630684600=30, srv488358012=76, srv497495353=77, srv1870905160=42, srv1902502873=45, srv742056716=88, srv1472992195=21, srv1888751973=43, srv1181150898=10, srv1565141132=26, srv1314102669=13, srv1932299251=48, srv11705624=9, srv1473880502=22, srv1423703091=18, srv1071242171=3, srv833334824=93, srv1303308311=12, srv1733658980=34, srv564061159=79, srv867386253=95, srv780234987=89, srv1971284074=50, srv31876344=63, srv2046880358=54, srv551200460=78, srv1416792952=17, srv1109755074=4, srv1489542011=24, srv799549499=90, srv923546538=98, srv464469433=74, srv441179061=71, srv1669046820=31, srv835669181=94, srv1796110245=39, srv659461193=86, srv1896263283=44, srv213647002=60, srv222298571=61, srv2132817026=59, srv1755813290=35, srv1453414501=19, srv2124451810=58, srv405335381=70, srv1619019455=28, srv129152684=11, srv280660181=62, srv156207708=25, srv580382246=81, srv198891422=51, srv343875199=67} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-10-28 04:55:33,122 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-10-28 04:55:33,123 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-10-28 04:55:33,123 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-10-28 04:55:33,123 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-10-28 04:55:33,123 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-10-28 04:55:33,123 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-10-28 04:55:33,123 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-10-28 04:55:33,123 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-10-28 04:55:33,123 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-10-28 04:55:33,124 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-10-28 04:55:33,124 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-10-28 04:55:33,124 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-10-28 04:55:33,124 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-10-28 04:55:33,124 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-10-28 04:55:33,124 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-10-28 04:55:33,124 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-10-28 04:55:33,124 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-10-28 04:55:33,124 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-10-28 04:55:33,125 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-10-28 04:55:33,125 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-10-28 04:55:33,125 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-10-28 04:55:33,125 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-10-28 04:55:33,125 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-10-28 04:55:33,125 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-10-28 04:55:33,125 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-10-28 04:55:33,125 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-10-28 04:55:33,126 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-10-28 04:55:33,126 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-10-28 04:55:33,126 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-10-28 04:55:33,126 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-10-28 04:55:33,126 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-10-28 04:55:33,126 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-10-28 04:55:33,126 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-10-28 04:55:33,126 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-10-28 04:55:33,126 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-10-28 04:55:33,127 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-10-28 04:55:33,127 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-10-28 04:55:33,127 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-10-28 04:55:33,127 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-10-28 04:55:33,127 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-10-28 04:55:33,127 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-10-28 04:55:33,127 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-10-28 04:55:33,127 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-10-28 04:55:33,127 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-10-28 04:55:33,128 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-10-28 04:55:33,128 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-10-28 04:55:33,128 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-10-28 04:55:33,128 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-10-28 04:55:33,128 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-10-28 04:55:33,128 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-10-28 04:55:33,128 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-10-28 04:55:33,128 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-10-28 04:55:33,129 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-10-28 04:55:33,129 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-10-28 04:55:33,129 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-10-28 04:55:33,129 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-10-28 04:55:33,129 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-10-28 04:55:33,129 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-10-28 04:55:33,129 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-10-28 04:55:33,129 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-10-28 04:55:33,129 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-10-28 04:55:33,130 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-10-28 04:55:33,130 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-10-28 04:55:33,130 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-10-28 04:55:33,130 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-10-28 04:55:33,130 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-10-28 04:55:33,130 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-10-28 04:55:33,130 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-10-28 04:55:33,130 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-10-28 04:55:33,130 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-10-28 04:55:33,131 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-10-28 04:55:33,131 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-10-28 04:55:33,131 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-10-28 04:55:33,131 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-10-28 04:55:33,131 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-10-28 04:55:33,131 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-10-28 04:55:33,131 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-10-28 04:55:33,131 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-10-28 04:55:33,131 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-10-28 04:55:33,132 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-10-28 04:55:33,132 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-10-28 04:55:33,132 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-10-28 04:55:33,132 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-10-28 04:55:33,132 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-10-28 04:55:33,132 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-10-28 04:55:33,132 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-10-28 04:55:33,132 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-10-28 04:55:33,133 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-10-28 04:55:33,133 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-10-28 04:55:33,133 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-10-28 04:55:33,133 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-10-28 04:55:33,133 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-10-28 04:55:33,133 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-10-28 04:55:33,133 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-10-28 04:55:33,133 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-10-28 04:55:33,134 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-10-28 04:55:33,134 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-10-28 04:55:33,134 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-10-28 04:55:33,134 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-10-28 04:55:33,134 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-10-28 04:55:33,134 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-10-28 04:55:33,257 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0207106563920738); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0331949991500924, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0207106563920738); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.012083333333333333); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.043833333333333335, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-10-28 04:55:33,257 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-10-28 04:55:33,257 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.0150737269408741, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0207106563920738); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0331949991500924, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0207106563920738); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.012083333333333333); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.043833333333333335, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-10-28 04:55:33,604 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 446 ms to try 5000 different iterations.  Found a solution that moves 966 regions; Going from a computed imbalance of 0.0150737269408741 to a new imbalance of 8.198635159502863E-4. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.005654561132722081); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0062495791104072804); MoveCostFunction : (multiplier=7.0, imbalance=0.10733333333333334, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.005654561132722081); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=4.166666666666667E-4); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.00425); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-10-28 04:55:33,607 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv464469433:81 , srv1487828392:82 , srv1613611533:82 , srv33042570:82 , srv1109755074:83 , srv1630684600:83 , srv44430480:83 , srv488358012:83 , srv1314102669:84 , srv1416792952:84 , srv1465427772:84 , srv156207708:84 , srv1669046820:84 , srv1733658980:84 , srv1776572949:84 , srv1787340486:84 , srv1870905160:84 , srv1902502873:84 , srv1918823707:84 , srv2090627488:84 , srv327981056:84 , srv379680004:84 , srv564061159:84 , srv742056716:84 , srv799549499:84 , srv835669181:84 , srv867386253:84 , srv948415511:84 , srv1071242171:85 , srv1152692060:85 , srv1164782114:85 , srv1351211979:85 , srv1401776952:85 , srv1473880502:85 , srv1670359871:85 , srv1704905959:85 , srv1755813290:85 , srv1836204964:85 , srv1932299251:85 , srv1940450690:85 , srv198891422:85 , srv2019288937:85 , srv2051773036:85 , srv2071811731:85 , srv2132817026:85 , srv280660181:85 , srv31876344:85 , srv343875199:85 , srv497495353:85 , srv573399441:85 , srv592494693:85 , srv598352237:85 , srv780234987:85 , srv820793515:85 , srv902481716:85 , srv1034988355:86 , srv1039963875:86 , srv1162316816:86 , srv11705624:86 , srv1354780479:86 , srv1489542011:86 , srv1565141132:86 , srv1619019455:86 , srv1765675489:86 , srv1888751973:86 , srv1896263283:86 , srv1925360484:86 , srv2046880358:86 , srv2124451810:86 , srv213647002:86 , srv333672464:86 , srv441179061:86 , srv580382246:86 , srv648591419:86 , srv659461193:86 , srv806549682:86 , srv833334824:86 , srv1139313560:87 , srv1181150898:87 , srv129152684:87 , srv1423703091:87 , srv1453414501:87 , srv1852796239:87 , srv1971284074:87 , srv2021037588:87 , srv222298571:87 , srv45270388:87 , srv466915874:87 , srv551200460:87 , srv735633899:87 , srv1303308311:88 , srv1472992195:88 , srv1619507545:88 , srv1796110245:88 , srv380979490:88 , srv405335381:88 , srv591133738:88 , srv923546538:88 , srv906652420:89 , srv1011032603:550 }
2023-10-28 04:55:33,613 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-10-28 04:55:33,615 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1465427772=20, srv1162316816=7, srv1776572949=37, srv45270388=73, srv1619507545=29, srv2071811731=56, srv573399441=80, srv1487828392=23, srv1918823707=46, srv902481716=96, srv333672464=66, srv592494693=83, srv33042570=65, srv1836204964=40, srv1034988355=1, srv1787340486=38, srv1852796239=41, srv1940450690=49, srv1925360484=47, srv466915874=75, srv598352237=84, srv806549682=91, srv2021037588=53, srv948415511=99, srv735633899=87, srv327981056=64, srv591133738=82, srv2051773036=55, srv906652420=97, srv1164782114=8, srv1139313560=5, srv380979490=69, srv379680004=68, srv1351211979=14, srv648591419=85, srv1704905959=33, srv1039963875=2, srv2019288937=52, srv1670359871=32, srv44430480=72, srv1765675489=36, srv1152692060=6, srv820793515=92, srv2090627488=57, srv1613611533=27, srv1011032603=0, srv1401776952=16, srv1354780479=15, srv1630684600=30, srv488358012=76, srv497495353=77, srv1870905160=42, srv1902502873=45, srv742056716=88, srv1472992195=21, srv1888751973=43, srv1181150898=10, srv1565141132=26, srv1314102669=13, srv1932299251=48, srv11705624=9, srv1473880502=22, srv1423703091=18, srv1071242171=3, srv833334824=93, srv1303308311=12, srv1733658980=34, srv564061159=79, srv867386253=95, srv780234987=89, srv1971284074=50, srv31876344=63, srv2046880358=54, srv551200460=78, srv1416792952=17, srv1109755074=4, srv1489542011=24, srv799549499=90, srv923546538=98, srv464469433=74, srv441179061=71, srv1669046820=31, srv835669181=94, srv1796110245=39, srv659461193=86, srv1896263283=44, srv213647002=60, srv222298571=61, srv2132817026=59, srv1755813290=35, srv1453414501=19, srv2124451810=58, srv405335381=70, srv1619019455=28, srv129152684=11, srv280660181=62, srv156207708=25, srv580382246=81, srv198891422=51, srv343875199=67} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-10-28 04:55:33,630 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-10-28 04:55:33,630 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-10-28 04:55:33,630 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-10-28 04:55:33,630 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-10-28 04:55:33,630 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-10-28 04:55:33,630 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-10-28 04:55:33,630 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-10-28 04:55:33,630 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-10-28 04:55:33,630 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-10-28 04:55:33,630 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-10-28 04:55:33,630 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-10-28 04:55:33,630 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-10-28 04:55:33,630 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-10-28 04:55:33,631 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-10-28 04:55:33,631 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-10-28 04:55:33,631 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-10-28 04:55:33,631 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-10-28 04:55:33,631 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-10-28 04:55:33,631 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-10-28 04:55:33,631 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-10-28 04:55:33,631 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-10-28 04:55:33,631 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-10-28 04:55:33,631 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-10-28 04:55:33,631 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-10-28 04:55:33,631 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-10-28 04:55:33,631 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-10-28 04:55:33,631 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-10-28 04:55:33,631 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-10-28 04:55:33,631 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-10-28 04:55:33,632 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-10-28 04:55:33,632 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-10-28 04:55:33,632 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-10-28 04:55:33,632 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-10-28 04:55:33,632 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-10-28 04:55:33,632 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-10-28 04:55:33,632 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-10-28 04:55:33,632 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-10-28 04:55:33,632 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-10-28 04:55:33,632 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-10-28 04:55:33,632 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-10-28 04:55:33,632 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-10-28 04:55:33,632 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-10-28 04:55:33,632 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-10-28 04:55:33,632 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-10-28 04:55:33,632 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-10-28 04:55:33,633 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-10-28 04:55:33,633 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-10-28 04:55:33,633 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-10-28 04:55:33,633 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-10-28 04:55:33,633 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-10-28 04:55:33,633 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-10-28 04:55:33,633 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-10-28 04:55:33,633 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-10-28 04:55:33,633 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-10-28 04:55:33,633 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-10-28 04:55:33,633 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-10-28 04:55:33,633 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-10-28 04:55:33,633 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-10-28 04:55:33,633 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-10-28 04:55:33,633 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-10-28 04:55:33,633 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-10-28 04:55:33,634 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-10-28 04:55:33,634 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-10-28 04:55:33,634 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-10-28 04:55:33,634 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-10-28 04:55:33,634 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-10-28 04:55:33,634 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-10-28 04:55:33,634 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-10-28 04:55:33,634 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-10-28 04:55:33,634 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-10-28 04:55:33,634 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-10-28 04:55:33,634 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-10-28 04:55:33,634 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-10-28 04:55:33,634 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-10-28 04:55:33,634 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-10-28 04:55:33,634 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-10-28 04:55:33,634 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-10-28 04:55:33,634 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-10-28 04:55:33,635 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-10-28 04:55:33,635 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-10-28 04:55:33,635 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-10-28 04:55:33,635 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-10-28 04:55:33,635 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-10-28 04:55:33,635 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-10-28 04:55:33,635 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-10-28 04:55:33,635 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-10-28 04:55:33,635 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-10-28 04:55:33,635 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-10-28 04:55:33,635 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-10-28 04:55:33,635 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-10-28 04:55:33,635 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-10-28 04:55:33,635 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-10-28 04:55:33,635 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-10-28 04:55:33,635 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-10-28 04:55:33,635 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-10-28 04:55:33,636 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-10-28 04:55:33,636 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-10-28 04:55:33,636 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-10-28 04:55:33,636 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-10-28 04:55:33,636 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-10-28 04:55:33,636 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-10-28 04:55:33,744 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.005654561132722081); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0062495791104072804); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.005654561132722081); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=4.166666666666667E-4); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.00425); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-10-28 04:55:33,745 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-10-28 04:55:33,745 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=8.13099439378779E-4, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.005654561132722081); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0062495791104072804); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.005654561132722081); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=4.166666666666667E-4); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.00425); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-10-28 04:55:33,983 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 333 ms to try 5000 different iterations.  Found a solution that moves 260 regions; Going from a computed imbalance of 8.13099439378779E-4 to a new imbalance of 2.72363707289162E-5. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=4.4668347344853864E-4); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0018349396085439343); MoveCostFunction : (multiplier=7.0, imbalance=0.028888888888888888, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=4.4668347344853864E-4); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.6666666666666666E-4); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-10-28 04:55:33,984 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1776572949:83 , srv1852796239:83 , srv2019288937:83 , srv2132817026:83 , srv488358012:83 , srv735633899:83 , srv1034988355:84 , srv1152692060:84 , srv1162316816:84 , srv11705624:84 , srv1181150898:84 , srv129152684:84 , srv1303308311:84 , srv1416792952:84 , srv1423703091:84 , srv1453414501:84 , srv1619019455:84 , srv1619507545:84 , srv1796110245:84 , srv1836204964:84 , srv1902502873:84 , srv1932299251:84 , srv1971284074:84 , srv198891422:84 , srv2021037588:84 , srv2051773036:84 , srv33042570:84 , srv343875199:84 , srv380979490:84 , srv441179061:84 , srv45270388:84 , srv466915874:84 , srv551200460:84 , srv591133738:84 , srv592494693:84 , srv598352237:84 , srv648591419:84 , srv659461193:84 , srv742056716:84 , srv799549499:84 , srv806549682:84 , srv833334824:84 , srv867386253:84 , srv902481716:84 , srv906652420:84 , srv923546538:84 , srv1039963875:85 , srv1071242171:85 , srv1109755074:85 , srv1139313560:85 , srv1164782114:85 , srv1314102669:85 , srv1351211979:85 , srv1354780479:85 , srv1401776952:85 , srv1465427772:85 , srv1472992195:85 , srv1473880502:85 , srv1487828392:85 , srv1489542011:85 , srv156207708:85 , srv1565141132:85 , srv1613611533:85 , srv1630684600:85 , srv1669046820:85 , srv1670359871:85 , srv1704905959:85 , srv1733658980:85 , srv1765675489:85 , srv1787340486:85 , srv1870905160:85 , srv1888751973:85 , srv1896263283:85 , srv1918823707:85 , srv1925360484:85 , srv2046880358:85 , srv2071811731:85 , srv2090627488:85 , srv2124451810:85 , srv213647002:85 , srv222298571:85 , srv280660181:85 , srv31876344:85 , srv327981056:85 , srv333672464:85 , srv379680004:85 , srv405335381:85 , srv464469433:85 , srv497495353:85 , srv564061159:85 , srv573399441:85 , srv580382246:85 , srv780234987:85 , srv820793515:85 , srv835669181:85 , srv948415511:85 , srv1755813290:86 , srv1940450690:86 , srv44430480:86 , srv1011032603:634 }
2023-10-28 04:55:33,987 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-10-28 04:55:33,988 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1465427772=20, srv1162316816=7, srv1776572949=37, srv45270388=73, srv1619507545=29, srv2071811731=56, srv573399441=80, srv1487828392=23, srv1918823707=46, srv902481716=96, srv333672464=66, srv592494693=83, srv33042570=65, srv1836204964=40, srv1034988355=1, srv1787340486=38, srv1852796239=41, srv1940450690=49, srv1925360484=47, srv466915874=75, srv598352237=84, srv806549682=91, srv2021037588=53, srv948415511=99, srv735633899=87, srv327981056=64, srv591133738=82, srv2051773036=55, srv906652420=97, srv1164782114=8, srv1139313560=5, srv380979490=69, srv379680004=68, srv1351211979=14, srv648591419=85, srv1704905959=33, srv1039963875=2, srv2019288937=52, srv1670359871=32, srv44430480=72, srv1765675489=36, srv1152692060=6, srv820793515=92, srv2090627488=57, srv1613611533=27, srv1011032603=0, srv1401776952=16, srv1354780479=15, srv1630684600=30, srv488358012=76, srv497495353=77, srv1870905160=42, srv1902502873=45, srv742056716=88, srv1472992195=21, srv1888751973=43, srv1181150898=10, srv1565141132=26, srv1314102669=13, srv1932299251=48, srv11705624=9, srv1473880502=22, srv1423703091=18, srv1071242171=3, srv833334824=93, srv1303308311=12, srv1733658980=34, srv564061159=79, srv867386253=95, srv780234987=89, srv1971284074=50, srv31876344=63, srv2046880358=54, srv551200460=78, srv1416792952=17, srv1109755074=4, srv1489542011=24, srv799549499=90, srv923546538=98, srv464469433=74, srv441179061=71, srv1669046820=31, srv835669181=94, srv1796110245=39, srv659461193=86, srv1896263283=44, srv213647002=60, srv222298571=61, srv2132817026=59, srv1755813290=35, srv1453414501=19, srv2124451810=58, srv405335381=70, srv1619019455=28, srv129152684=11, srv280660181=62, srv156207708=25, srv580382246=81, srv198891422=51, srv343875199=67} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-10-28 04:55:33,998 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-10-28 04:55:33,999 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-10-28 04:55:33,999 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-10-28 04:55:33,999 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-10-28 04:55:33,999 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-10-28 04:55:33,999 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-10-28 04:55:33,999 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-10-28 04:55:33,999 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-10-28 04:55:33,999 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-10-28 04:55:33,999 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-10-28 04:55:33,999 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-10-28 04:55:33,999 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-10-28 04:55:33,999 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-10-28 04:55:33,999 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-10-28 04:55:33,999 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-10-28 04:55:33,999 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-10-28 04:55:33,999 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-10-28 04:55:34,000 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-10-28 04:55:34,000 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-10-28 04:55:34,000 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-10-28 04:55:34,000 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-10-28 04:55:34,000 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-10-28 04:55:34,000 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-10-28 04:55:34,000 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-10-28 04:55:34,000 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-10-28 04:55:34,000 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-10-28 04:55:34,000 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-10-28 04:55:34,000 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-10-28 04:55:34,000 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-10-28 04:55:34,000 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-10-28 04:55:34,000 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-10-28 04:55:34,000 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-10-28 04:55:34,000 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-10-28 04:55:34,000 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-10-28 04:55:34,000 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-10-28 04:55:34,001 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-10-28 04:55:34,001 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-10-28 04:55:34,001 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-10-28 04:55:34,001 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-10-28 04:55:34,001 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-10-28 04:55:34,001 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-10-28 04:55:34,001 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-10-28 04:55:34,001 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-10-28 04:55:34,001 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-10-28 04:55:34,001 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-10-28 04:55:34,001 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-10-28 04:55:34,001 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-10-28 04:55:34,001 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-10-28 04:55:34,001 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-10-28 04:55:34,001 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-10-28 04:55:34,001 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-10-28 04:55:34,001 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-10-28 04:55:34,002 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-10-28 04:55:34,002 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-10-28 04:55:34,002 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-10-28 04:55:34,002 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-10-28 04:55:34,002 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-10-28 04:55:34,002 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-10-28 04:55:34,002 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-10-28 04:55:34,002 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-10-28 04:55:34,002 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-10-28 04:55:34,002 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-10-28 04:55:34,002 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-10-28 04:55:34,002 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-10-28 04:55:34,002 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-10-28 04:55:34,002 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-10-28 04:55:34,002 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-10-28 04:55:34,002 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-10-28 04:55:34,002 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-10-28 04:55:34,002 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-10-28 04:55:34,003 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-10-28 04:55:34,003 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-10-28 04:55:34,003 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-10-28 04:55:34,003 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-10-28 04:55:34,003 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-10-28 04:55:34,003 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-10-28 04:55:34,003 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-10-28 04:55:34,003 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-10-28 04:55:34,003 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-10-28 04:55:34,003 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-10-28 04:55:34,003 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-10-28 04:55:34,003 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-10-28 04:55:34,003 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-10-28 04:55:34,003 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-10-28 04:55:34,003 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-10-28 04:55:34,003 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-10-28 04:55:34,003 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-10-28 04:55:34,003 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-10-28 04:55:34,004 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-10-28 04:55:34,004 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-10-28 04:55:34,004 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-10-28 04:55:34,004 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-10-28 04:55:34,004 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-10-28 04:55:34,004 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-10-28 04:55:34,004 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-10-28 04:55:34,004 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-10-28 04:55:34,004 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-10-28 04:55:34,004 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-10-28 04:55:34,004 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-10-28 04:55:34,004 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-10-28 04:55:34,004 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-10-28 04:55:34,133 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=4.4668347344853864E-4); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0018349396085439343); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=4.4668347344853864E-4); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.6666666666666666E-4); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-10-28 04:55:34,134 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-10-28 04:55:34,134 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=2.5415811817330336E-5, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=4.4668347344853864E-4); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0018349396085439343); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=4.4668347344853864E-4); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.6666666666666666E-4); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-10-28 04:55:34,363 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 344 ms to try 5000 different iterations.  Found a solution that moves 20 regions; Going from a computed imbalance of 2.5415811817330336E-5 to a new imbalance of 7.527800493511471E-6. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0016412198797244363); MoveCostFunction : (multiplier=7.0, imbalance=0.0022222222222222222); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-10-28 04:55:34,363 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1472992195:83 , srv1613611533:83 , srv1755813290:83 , srv1940450690:83 , srv333672464:83 , srv497495353:83 , srv780234987:83 , srv906652420:83 , srv1034988355:84 , srv1039963875:84 , srv1071242171:84 , srv1109755074:84 , srv1139313560:84 , srv1152692060:84 , srv1162316816:84 , srv11705624:84 , srv1181150898:84 , srv129152684:84 , srv1303308311:84 , srv1314102669:84 , srv1351211979:84 , srv1354780479:84 , srv1401776952:84 , srv1416792952:84 , srv1423703091:84 , srv1453414501:84 , srv1465427772:84 , srv1473880502:84 , srv1487828392:84 , srv1489542011:84 , srv156207708:84 , srv1565141132:84 , srv1619019455:84 , srv1619507545:84 , srv1630684600:84 , srv1669046820:84 , srv1670359871:84 , srv1704905959:84 , srv1733658980:84 , srv1765675489:84 , srv1776572949:84 , srv1787340486:84 , srv1796110245:84 , srv1852796239:84 , srv1870905160:84 , srv1888751973:84 , srv1896263283:84 , srv1902502873:84 , srv1918823707:84 , srv1925360484:84 , srv1932299251:84 , srv1971284074:84 , srv198891422:84 , srv2021037588:84 , srv2046880358:84 , srv2051773036:84 , srv2071811731:84 , srv2090627488:84 , srv2124451810:84 , srv2132817026:84 , srv213647002:84 , srv222298571:84 , srv280660181:84 , srv31876344:84 , srv327981056:84 , srv33042570:84 , srv343875199:84 , srv379680004:84 , srv380979490:84 , srv405335381:84 , srv441179061:84 , srv44430480:84 , srv45270388:84 , srv464469433:84 , srv551200460:84 , srv564061159:84 , srv573399441:84 , srv580382246:84 , srv591133738:84 , srv592494693:84 , srv598352237:84 , srv648591419:84 , srv659461193:84 , srv735633899:84 , srv806549682:84 , srv820793515:84 , srv833334824:84 , srv835669181:84 , srv867386253:84 , srv923546538:84 , srv948415511:84 , srv1164782114:85 , srv1836204964:85 , srv2019288937:85 , srv466915874:85 , srv488358012:85 , srv742056716:85 , srv799549499:85 , srv902481716:85 , srv1011032603:684 }
2023-10-28 04:55:34,367 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-10-28 04:55:34,368 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1465427772=20, srv1162316816=7, srv1776572949=37, srv45270388=73, srv1619507545=29, srv2071811731=56, srv573399441=80, srv1487828392=23, srv1918823707=46, srv902481716=96, srv333672464=66, srv592494693=83, srv33042570=65, srv1836204964=40, srv1034988355=1, srv1787340486=38, srv1852796239=41, srv1940450690=49, srv1925360484=47, srv466915874=75, srv598352237=84, srv806549682=91, srv2021037588=53, srv948415511=99, srv735633899=87, srv327981056=64, srv591133738=82, srv2051773036=55, srv906652420=97, srv1164782114=8, srv1139313560=5, srv380979490=69, srv379680004=68, srv1351211979=14, srv648591419=85, srv1704905959=33, srv1039963875=2, srv2019288937=52, srv1670359871=32, srv44430480=72, srv1765675489=36, srv1152692060=6, srv820793515=92, srv2090627488=57, srv1613611533=27, srv1011032603=0, srv1401776952=16, srv1354780479=15, srv1630684600=30, srv488358012=76, srv497495353=77, srv1870905160=42, srv1902502873=45, srv742056716=88, srv1472992195=21, srv1888751973=43, srv1181150898=10, srv1565141132=26, srv1314102669=13, srv1932299251=48, srv11705624=9, srv1473880502=22, srv1423703091=18, srv1071242171=3, srv833334824=93, srv1303308311=12, srv1733658980=34, srv564061159=79, srv867386253=95, srv780234987=89, srv1971284074=50, srv31876344=63, srv2046880358=54, srv551200460=78, srv1416792952=17, srv1109755074=4, srv1489542011=24, srv799549499=90, srv923546538=98, srv464469433=74, srv441179061=71, srv1669046820=31, srv835669181=94, srv1796110245=39, srv659461193=86, srv1896263283=44, srv213647002=60, srv222298571=61, srv2132817026=59, srv1755813290=35, srv1453414501=19, srv2124451810=58, srv405335381=70, srv1619019455=28, srv129152684=11, srv280660181=62, srv156207708=25, srv580382246=81, srv198891422=51, srv343875199=67} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-10-28 04:55:34,384 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-10-28 04:55:34,384 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-10-28 04:55:34,384 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-10-28 04:55:34,384 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-10-28 04:55:34,384 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-10-28 04:55:34,384 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-10-28 04:55:34,384 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-10-28 04:55:34,384 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-10-28 04:55:34,384 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-10-28 04:55:34,384 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-10-28 04:55:34,384 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-10-28 04:55:34,384 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-10-28 04:55:34,385 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-10-28 04:55:34,385 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-10-28 04:55:34,385 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-10-28 04:55:34,385 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-10-28 04:55:34,385 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-10-28 04:55:34,385 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-10-28 04:55:34,385 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-10-28 04:55:34,385 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-10-28 04:55:34,385 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-10-28 04:55:34,385 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-10-28 04:55:34,385 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-10-28 04:55:34,385 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-10-28 04:55:34,385 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-10-28 04:55:34,385 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-10-28 04:55:34,385 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-10-28 04:55:34,385 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-10-28 04:55:34,385 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-10-28 04:55:34,385 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-10-28 04:55:34,385 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-10-28 04:55:34,386 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-10-28 04:55:34,386 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-10-28 04:55:34,386 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-10-28 04:55:34,386 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-10-28 04:55:34,386 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-10-28 04:55:34,386 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-10-28 04:55:34,386 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-10-28 04:55:34,386 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-10-28 04:55:34,386 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-10-28 04:55:34,386 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-10-28 04:55:34,386 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-10-28 04:55:34,386 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-10-28 04:55:34,386 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-10-28 04:55:34,386 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-10-28 04:55:34,386 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-10-28 04:55:34,386 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-10-28 04:55:34,386 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-10-28 04:55:34,386 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-10-28 04:55:34,386 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-10-28 04:55:34,386 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-10-28 04:55:34,387 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-10-28 04:55:34,387 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-10-28 04:55:34,387 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-10-28 04:55:34,387 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-10-28 04:55:34,387 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-10-28 04:55:34,387 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-10-28 04:55:34,387 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-10-28 04:55:34,387 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-10-28 04:55:34,387 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-10-28 04:55:34,387 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-10-28 04:55:34,387 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-10-28 04:55:34,387 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-10-28 04:55:34,387 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-10-28 04:55:34,387 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-10-28 04:55:34,387 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-10-28 04:55:34,387 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-10-28 04:55:34,387 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-10-28 04:55:34,388 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-10-28 04:55:34,388 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-10-28 04:55:34,388 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-10-28 04:55:34,388 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-10-28 04:55:34,388 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-10-28 04:55:34,388 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-10-28 04:55:34,388 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-10-28 04:55:34,388 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-10-28 04:55:34,388 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-10-28 04:55:34,388 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-10-28 04:55:34,388 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-10-28 04:55:34,388 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-10-28 04:55:34,388 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-10-28 04:55:34,388 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-10-28 04:55:34,388 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-10-28 04:55:34,388 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-10-28 04:55:34,388 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-10-28 04:55:34,389 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-10-28 04:55:34,389 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-10-28 04:55:34,389 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-10-28 04:55:34,389 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-10-28 04:55:34,389 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-10-28 04:55:34,389 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-10-28 04:55:34,389 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-10-28 04:55:34,389 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-10-28 04:55:34,389 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-10-28 04:55:34,389 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-10-28 04:55:34,389 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-10-28 04:55:34,389 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-10-28 04:55:34,389 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-10-28 04:55:34,390 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-10-28 04:55:34,390 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-10-28 04:55:34,390 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-10-28 04:55:34,507 INFO  [Time-limited test] balancer.StochasticLoadBalancer(381): Cluster wide - skipping load balancing because weighted average imbalance=7.387757500312559E-6 <= threshold(0.025). If you want more aggressive balancing, either lower hbase.master.balancer.stochastic.minCostNeedBalance from 0.025 or increase the relative multiplier(s) of the specific cost function(s). functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0016412198797244363); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-10-28 04:55:34,507 INFO  [Time-limited test] balancer.BalancerTestBase(570): Mock Final balance: { srv1472992195:83 , srv1613611533:83 , srv1755813290:83 , srv1940450690:83 , srv333672464:83 , srv497495353:83 , srv780234987:83 , srv906652420:83 , srv1034988355:84 , srv1039963875:84 , srv1071242171:84 , srv1109755074:84 , srv1139313560:84 , srv1152692060:84 , srv1162316816:84 , srv11705624:84 , srv1181150898:84 , srv129152684:84 , srv1303308311:84 , srv1314102669:84 , srv1351211979:84 , srv1354780479:84 , srv1401776952:84 , srv1416792952:84 , srv1423703091:84 , srv1453414501:84 , srv1465427772:84 , srv1473880502:84 , srv1487828392:84 , srv1489542011:84 , srv156207708:84 , srv1565141132:84 , srv1619019455:84 , srv1619507545:84 , srv1630684600:84 , srv1669046820:84 , srv1670359871:84 , srv1704905959:84 , srv1733658980:84 , srv1765675489:84 , srv1776572949:84 , srv1787340486:84 , srv1796110245:84 , srv1852796239:84 , srv1870905160:84 , srv1888751973:84 , srv1896263283:84 , srv1902502873:84 , srv1918823707:84 , srv1925360484:84 , srv1932299251:84 , srv1971284074:84 , srv198891422:84 , srv2021037588:84 , srv2046880358:84 , srv2051773036:84 , srv2071811731:84 , srv2090627488:84 , srv2124451810:84 , srv2132817026:84 , srv213647002:84 , srv222298571:84 , srv280660181:84 , srv31876344:84 , srv327981056:84 , srv33042570:84 , srv343875199:84 , srv379680004:84 , srv380979490:84 , srv405335381:84 , srv441179061:84 , srv44430480:84 , srv45270388:84 , srv464469433:84 , srv551200460:84 , srv564061159:84 , srv573399441:84 , srv580382246:84 , srv591133738:84 , srv592494693:84 , srv598352237:84 , srv648591419:84 , srv659461193:84 , srv735633899:84 , srv806549682:84 , srv820793515:84 , srv833334824:84 , srv835669181:84 , srv867386253:84 , srv923546538:84 , srv948415511:84 , srv1164782114:85 , srv1836204964:85 , srv2019288937:85 , srv466915874:85 , srv488358012:85 , srv742056716:85 , srv799549499:85 , srv902481716:85 , srv1011032603:684 }
2023-10-28 04:55:34,537 INFO  [Time-limited test] hbase.ResourceChecker(175): after: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnLargeClusterWithRacks Thread=12 (was 12), OpenFileDescriptor=263 (was 263), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=188 (was 160) - SystemLoadAverage LEAK? -, ProcessCount=168 (was 168), AvailableMemoryMB=4100 (was 4649)
2023-10-28 04:55:34,547 INFO  [Time-limited test] hbase.ResourceChecker(147): before: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnMidClusterWithRacks Thread=12, OpenFileDescriptor=263, MaxFileDescriptor=60000, SystemLoadAverage=188, ProcessCount=168, AvailableMemoryMB=4100
2023-10-28 04:55:34,548 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2023-10-28 04:55:34,548 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=5000, runMaxSteps=true, stepsPerRegion=800, maxRunningTime=120000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 111077.0 etc.
2023-10-28 04:55:34,562 INFO  [Time-limited test] balancer.BalancerTestBase(547): Mock Cluster : { srv102023646:84 , srv1064593155:84 , srv1162772190:84 , srv1338888753:84 , srv135741165:84 , srv1391786706:84 , srv1470484450:84 , srv1518549223:84 , srv1556280573:84 , srv1630316695:84 , srv172162756:84 , srv1927784097:84 , srv1940213810:84 , srv2029440074:84 , srv360598184:84 , srv361692371:84 , srv379643536:84 , srv44515224:84 , srv47001663:84 , srv534480718:84 , srv542001103:84 , srv553774193:84 , srv598983968:84 , srv611910594:84 , srv749629518:84 , srv841112613:84 , srv891183654:84 , srv932528587:84 , srv949875691:84 , srv399444026:264 } [srvr=30 rgns=2700 avg=90.0 max=90 min=90]
2023-10-28 04:55:34,563 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-10-28 04:55:34,564 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv534480718=20, srv932528587=28, srv1518549223=7, srv1064593155=1, srv399444026=17, srv1391786706=5, srv1630316695=9, srv841112613=26, srv102023646=0, srv44515224=18, srv47001663=19, srv749629518=25, srv1338888753=3, srv611910594=24, srv553774193=22, srv135741165=4, srv891183654=27, srv360598184=14, srv1470484450=6, srv172162756=10, srv379643536=16, srv598983968=23, srv2029440074=13, srv361692371=15, srv1556280573=8, srv1940213810=12, srv1162772190=2, srv949875691=29, srv1927784097=11, srv542001103=21} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-10-28 04:55:34,579 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-10-28 04:55:34,579 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-10-28 04:55:34,579 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-10-28 04:55:34,579 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-10-28 04:55:34,579 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-10-28 04:55:34,580 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-10-28 04:55:34,580 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-10-28 04:55:34,580 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-10-28 04:55:34,581 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-10-28 04:55:34,581 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-10-28 04:55:34,581 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-10-28 04:55:34,581 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-10-28 04:55:34,581 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-10-28 04:55:34,581 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-10-28 04:55:34,581 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-10-28 04:55:34,581 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-10-28 04:55:34,581 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-10-28 04:55:34,581 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-10-28 04:55:34,581 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-10-28 04:55:34,582 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-10-28 04:55:34,582 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-10-28 04:55:34,582 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-10-28 04:55:34,582 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-10-28 04:55:34,582 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-10-28 04:55:34,582 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-10-28 04:55:34,582 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-10-28 04:55:34,582 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-10-28 04:55:34,582 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-10-28 04:55:34,582 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-10-28 04:55:34,582 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-10-28 04:55:34,583 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=10, number of hosts=30, number of racks=4
2023-10-28 04:55:34,609 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=1.1915221393848474, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-10-28 04:55:34,610 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.9912796523271707, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=1.1915221393848474, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=64800000
2023-10-28 04:57:34,588 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 120001 ms to try 6129186 different iterations.  Found a solution that moves 1864 regions; Going from a computed imbalance of 0.9912796523271707 to a new imbalance of 4.3506689887128686E-5. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); MoveCostFunction : (multiplier=7.0, imbalance=0.6903703703703704, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-10-28 04:57:34,596 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv102023646:90 , srv1064593155:90 , srv1162772190:90 , srv1338888753:90 , srv135741165:90 , srv1391786706:90 , srv1470484450:90 , srv1518549223:90 , srv1556280573:90 , srv1630316695:90 , srv172162756:90 , srv1927784097:90 , srv1940213810:90 , srv2029440074:90 , srv360598184:90 , srv361692371:90 , srv379643536:90 , srv399444026:90 , srv44515224:90 , srv47001663:90 , srv534480718:90 , srv542001103:90 , srv553774193:90 , srv598983968:90 , srv611910594:90 , srv749629518:90 , srv841112613:90 , srv891183654:90 , srv932528587:90 , srv949875691:90 }
2023-10-28 04:57:34,597 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-10-28 04:57:34,598 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv534480718=20, srv932528587=28, srv1518549223=7, srv1064593155=1, srv399444026=17, srv1391786706=5, srv1630316695=9, srv841112613=26, srv102023646=0, srv44515224=18, srv47001663=19, srv749629518=25, srv1338888753=3, srv611910594=24, srv553774193=22, srv135741165=4, srv891183654=27, srv360598184=14, srv1470484450=6, srv172162756=10, srv379643536=16, srv598983968=23, srv2029440074=13, srv361692371=15, srv1556280573=8, srv1940213810=12, srv1162772190=2, srv949875691=29, srv1927784097=11, srv542001103=21} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-10-28 04:57:34,601 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-10-28 04:57:34,601 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-10-28 04:57:34,601 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-10-28 04:57:34,601 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-10-28 04:57:34,601 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-10-28 04:57:34,601 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-10-28 04:57:34,601 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-10-28 04:57:34,601 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-10-28 04:57:34,601 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-10-28 04:57:34,601 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-10-28 04:57:34,601 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-10-28 04:57:34,602 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-10-28 04:57:34,602 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-10-28 04:57:34,602 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-10-28 04:57:34,602 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-10-28 04:57:34,602 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-10-28 04:57:34,602 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-10-28 04:57:34,602 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-10-28 04:57:34,602 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-10-28 04:57:34,602 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-10-28 04:57:34,602 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-10-28 04:57:34,602 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-10-28 04:57:34,602 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-10-28 04:57:34,602 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-10-28 04:57:34,602 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-10-28 04:57:34,602 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-10-28 04:57:34,602 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-10-28 04:57:34,602 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-10-28 04:57:34,602 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-10-28 04:57:34,602 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-10-28 04:57:34,602 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=10, number of hosts=30, number of racks=4
2023-10-28 04:57:34,616 INFO  [Time-limited test] balancer.StochasticLoadBalancer(381): Cluster wide - skipping load balancing because weighted average imbalance=0.0 <= threshold(0.025). If you want more aggressive balancing, either lower hbase.master.balancer.stochastic.minCostNeedBalance from 0.025 or increase the relative multiplier(s) of the specific cost function(s). functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-10-28 04:57:34,616 INFO  [Time-limited test] balancer.BalancerTestBase(570): Mock Final balance: { srv102023646:90 , srv1064593155:90 , srv1162772190:90 , srv1338888753:90 , srv135741165:90 , srv1391786706:90 , srv1470484450:90 , srv1518549223:90 , srv1556280573:90 , srv1630316695:90 , srv172162756:90 , srv1927784097:90 , srv1940213810:90 , srv2029440074:90 , srv360598184:90 , srv361692371:90 , srv379643536:90 , srv399444026:90 , srv44515224:90 , srv47001663:90 , srv534480718:90 , srv542001103:90 , srv553774193:90 , srv598983968:90 , srv611910594:90 , srv749629518:90 , srv841112613:90 , srv891183654:90 , srv932528587:90 , srv949875691:90 }
2023-10-28 04:57:34,629 INFO  [Time-limited test] hbase.ResourceChecker(175): after: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnMidClusterWithRacks Thread=11 (was 12), OpenFileDescriptor=263 (was 263), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=167 (was 188), ProcessCount=167 (was 168), AvailableMemoryMB=4094 (was 4100)