2023-10-30 13:55:31,190 INFO  [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks timeout: 13 mins
2023-10-30 13:55:31,479 WARN  [Time-limited test] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties
2023-10-30 13:55:31,578 INFO  [Time-limited test] metrics.MetricRegistriesLoader(60): Loaded MetricRegistries class org.apache.hadoop.hbase.metrics.impl.MetricRegistriesImpl
2023-10-30 13:55:31,638 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2023-10-30 13:55:31,645 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc.
2023-10-30 13:55:31,658 INFO  [Time-limited test] hbase.ResourceChecker(147): before: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnLargeClusterWithRacks Thread=12, OpenFileDescriptor=263, MaxFileDescriptor=60000, SystemLoadAverage=127, ProcessCount=167, AvailableMemoryMB=14905
2023-10-30 13:55:31,660 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2023-10-30 13:55:31,660 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=5000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=10000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc.
2023-10-30 13:55:31,775 INFO  [Time-limited test] balancer.BalancerTestBase(547): Mock Cluster : { srv1018491321:84 , srv1052465277:84 , srv1080047166:84 , srv1094676822:84 , srv1102022882:84 , srv1114487489:84 , srv1119379566:84 , srv1155564532:84 , srv1157255827:84 , srv1172386061:84 , srv1207817012:84 , srv1263022586:84 , srv1267554071:84 , srv1269161572:84 , srv1312659402:84 , srv13389652:84 , srv1346374431:84 , srv1373004204:84 , srv1404757856:84 , srv1457041652:84 , srv1516758624:84 , srv152783102:84 , srv1581817203:84 , srv1607005709:84 , srv1607878405:84 , srv1624326902:84 , srv1655625212:84 , srv1665760427:84 , srv1695382029:84 , srv1708543985:84 , srv1728563667:84 , srv1737642098:84 , srv1773034212:84 , srv1785038249:84 , srv1794042876:84 , srv1809415012:84 , srv1840033350:84 , srv1879091016:84 , srv1882014882:84 , srv1882291701:84 , srv1885506464:84 , srv188592436:84 , srv191627948:84 , srv1916938312:84 , srv1928204272:84 , srv1950423185:84 , srv1971462082:84 , srv1976159278:84 , srv1977015570:84 , srv200051377:84 , srv2023788058:84 , srv2026609122:84 , srv2036238761:84 , srv2065513019:84 , srv208778731:84 , srv21048502:84 , srv2138602578:84 , srv22296001:84 , srv244357929:84 , srv245161231:84 , srv248201913:84 , srv269422630:84 , srv281905235:84 , srv285164878:84 , srv290870061:84 , srv309403256:84 , srv311288100:84 , srv325564722:84 , srv327212451:84 , srv337173318:84 , srv368353876:84 , srv373850182:84 , srv408827657:84 , srv425240519:84 , srv460668580:84 , srv489267466:84 , srv492650726:84 , srv559600445:84 , srv588383700:84 , srv591430911:84 , srv597191745:84 , srv59733181:84 , srv604850943:84 , srv609857545:84 , srv62487433:84 , srv642756499:84 , srv661723966:84 , srv67667356:84 , srv725571704:84 , srv759166648:84 , srv778401819:84 , srv801130766:84 , srv84522234:84 , srv862237105:84 , srv87932774:84 , srv890411016:84 , srv902536970:84 , srv937201799:84 , srv939152579:84 , srv832620682:684 } [srvr=100 rgns=9000 avg=90.0 max=90 min=90]
2023-10-30 13:55:31,783 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-10-30 13:55:31,789 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv188592436=41, srv1977015570=48, srv200051377=49, srv1794042876=34, srv725571704=88, srv325564722=67, srv152783102=21, srv1114487489=5, srv327212451=68, srv597191745=80, srv1655625212=26, srv285164878=63, srv191627948=42, srv1950423185=45, srv1971462082=46, srv1312659402=14, srv588383700=78, srv1346374431=16, srv337173318=69, srv425240519=73, srv67667356=87, srv248201913=60, srv778401819=90, srv2065513019=53, srv1928204272=44, srv1885506464=40, srv245161231=59, srv890411016=96, srv1263022586=11, srv309403256=65, srv2026609122=51, srv609857545=83, srv832620682=92, srv1269161572=13, srv22296001=57, srv1457041652=19, srv1404757856=18, srv1728563667=30, srv902536970=97, srv1052465277=1, srv21048502=55, srv1581817203=22, srv591430911=79, srv2036238761=52, srv1882291701=39, srv62487433=84, srv759166648=89, srv87932774=95, srv559600445=77, srv1665760427=27, srv1267554071=12, srv1708543985=29, srv1840033350=36, srv1516758624=20, srv1607005709=23, srv1624326902=25, srv1882014882=38, srv1695382029=28, srv2023788058=50, srv408827657=72, srv460668580=74, srv1094676822=3, srv1207817012=10, srv269422630=61, srv1157255827=8, srv1018491321=0, srv604850943=82, srv937201799=98, srv281905235=62, srv1607878405=24, srv1976159278=47, srv661723966=86, srv1119379566=6, srv489267466=75, srv1916938312=43, srv373850182=71, srv1373004204=17, srv368353876=70, srv801130766=91, srv1809415012=35, srv1737642098=31, srv208778731=54, srv244357929=58, srv59733181=81, srv13389652=15, srv2138602578=56, srv862237105=94, srv642756499=85, srv1172386061=9, srv1102022882=4, srv1879091016=37, srv492650726=76, srv1773034212=32, srv939152579=99, srv1155564532=7, srv311288100=66, srv290870061=64, srv84522234=93, srv1080047166=2, srv1785038249=33} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-10-30 13:55:31,867 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-10-30 13:55:31,867 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-10-30 13:55:31,867 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-10-30 13:55:31,867 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-10-30 13:55:31,868 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-10-30 13:55:31,868 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-10-30 13:55:31,868 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-10-30 13:55:31,868 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-10-30 13:55:31,868 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-10-30 13:55:31,868 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-10-30 13:55:31,868 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-10-30 13:55:31,868 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-10-30 13:55:31,868 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-10-30 13:55:31,868 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-10-30 13:55:31,869 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-10-30 13:55:31,869 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-10-30 13:55:31,869 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-10-30 13:55:31,869 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-10-30 13:55:31,869 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-10-30 13:55:31,869 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-10-30 13:55:31,869 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-10-30 13:55:31,869 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-10-30 13:55:31,869 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-10-30 13:55:31,869 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-10-30 13:55:31,869 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-10-30 13:55:31,870 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-10-30 13:55:31,870 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-10-30 13:55:31,870 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-10-30 13:55:31,870 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-10-30 13:55:31,870 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-10-30 13:55:31,870 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-10-30 13:55:31,870 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-10-30 13:55:31,870 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-10-30 13:55:31,870 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-10-30 13:55:31,870 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-10-30 13:55:31,870 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-10-30 13:55:31,871 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-10-30 13:55:31,871 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-10-30 13:55:31,871 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-10-30 13:55:31,871 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-10-30 13:55:31,871 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-10-30 13:55:31,871 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-10-30 13:55:31,871 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-10-30 13:55:31,871 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-10-30 13:55:31,871 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-10-30 13:55:31,871 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-10-30 13:55:31,871 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-10-30 13:55:31,872 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-10-30 13:55:31,872 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-10-30 13:55:31,872 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-10-30 13:55:31,872 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-10-30 13:55:31,872 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-10-30 13:55:31,872 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-10-30 13:55:31,872 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-10-30 13:55:31,872 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-10-30 13:55:31,872 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-10-30 13:55:31,872 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-10-30 13:55:31,872 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-10-30 13:55:31,872 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-10-30 13:55:31,873 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-10-30 13:55:31,873 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-10-30 13:55:31,873 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-10-30 13:55:31,873 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-10-30 13:55:31,873 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-10-30 13:55:31,873 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-10-30 13:55:31,873 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-10-30 13:55:31,873 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-10-30 13:55:31,873 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-10-30 13:55:31,873 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-10-30 13:55:31,873 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-10-30 13:55:31,874 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-10-30 13:55:31,874 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-10-30 13:55:31,874 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-10-30 13:55:31,874 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-10-30 13:55:31,874 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-10-30 13:55:31,874 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-10-30 13:55:31,874 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-10-30 13:55:31,874 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-10-30 13:55:31,874 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-10-30 13:55:31,874 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-10-30 13:55:31,874 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-10-30 13:55:31,875 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-10-30 13:55:31,875 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-10-30 13:55:31,875 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-10-30 13:55:31,875 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-10-30 13:55:31,875 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-10-30 13:55:31,875 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-10-30 13:55:31,875 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-10-30 13:55:31,875 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-10-30 13:55:31,875 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-10-30 13:55:31,875 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-10-30 13:55:31,875 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-10-30 13:55:31,875 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-10-30 13:55:31,876 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-10-30 13:55:31,876 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-10-30 13:55:31,876 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-10-30 13:55:31,876 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-10-30 13:55:31,876 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-10-30 13:55:31,876 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-10-30 13:55:31,876 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-10-30 13:55:31,876 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-10-30 13:55:32,179 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.06666666666666667, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-10-30 13:55:32,179 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-10-30 13:55:32,179 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.9909252140407105, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.06666666666666667, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-10-30 13:55:32,792 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 894 ms to try 5000 different iterations.  Found a solution that moves 4685 regions; Going from a computed imbalance of 0.9909252140407105 to a new imbalance of 0.1793777856640881. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.038516575967593024, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.04932541569005408, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.5205555555555555, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.038516575967593024, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.17491666666666666, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.23841666666666667, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-10-30 13:55:32,814 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1018491321:82 , srv1052465277:82 , srv1269161572:82 , srv1794042876:82 , srv425240519:82 , srv1094676822:83 , srv1155564532:83 , srv1840033350:83 , srv1882014882:83 , srv191627948:83 , srv311288100:83 , srv460668580:83 , srv801130766:83 , srv87932774:83 , srv1080047166:84 , srv1119379566:84 , srv1516758624:84 , srv1655625212:84 , srv1708543985:84 , srv1976159278:84 , srv21048502:84 , srv309403256:84 , srv588383700:84 , srv604850943:84 , srv939152579:84 , srv1114487489:85 , srv1457041652:85 , srv1607005709:85 , srv1728563667:85 , srv1737642098:85 , srv1879091016:85 , srv2026609122:85 , srv208778731:85 , srv2138602578:85 , srv281905235:85 , srv337173318:85 , srv62487433:85 , srv642756499:85 , srv725571704:85 , srv1207817012:86 , srv1312659402:86 , srv1624326902:86 , srv1928204272:86 , srv1950423185:86 , srv2023788058:86 , srv22296001:86 , srv245161231:86 , srv248201913:86 , srv285164878:86 , srv327212451:86 , srv489267466:86 , srv609857545:86 , srv902536970:86 , srv13389652:87 , srv1346374431:87 , srv1373004204:87 , srv152783102:87 , srv1581817203:87 , srv1665760427:87 , srv188592436:87 , srv1916938312:87 , srv1977015570:87 , srv200051377:87 , srv244357929:87 , srv290870061:87 , srv661723966:87 , srv890411016:87 , srv1263022586:88 , srv1773034212:88 , srv1785038249:88 , srv2036238761:88 , srv373850182:88 , srv492650726:88 , srv559600445:88 , srv59733181:88 , srv84522234:88 , srv862237105:88 , srv1157255827:89 , srv1172386061:89 , srv1404757856:89 , srv1809415012:89 , srv2065513019:89 , srv408827657:89 , srv597191745:89 , srv759166648:89 , srv1102022882:90 , srv1885506464:90 , srv1971462082:90 , srv325564722:90 , srv937201799:90 , srv1267554071:91 , srv1882291701:91 , srv269422630:91 , srv778401819:91 , srv368353876:92 , srv67667356:92 , srv1607878405:93 , srv591430911:95 , srv1695382029:97 , srv832620682:432 }
2023-10-30 13:55:32,818 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-10-30 13:55:32,818 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv188592436=41, srv1977015570=48, srv200051377=49, srv1794042876=34, srv725571704=88, srv325564722=67, srv152783102=21, srv1114487489=5, srv327212451=68, srv597191745=80, srv1655625212=26, srv285164878=63, srv191627948=42, srv1950423185=45, srv1971462082=46, srv1312659402=14, srv588383700=78, srv1346374431=16, srv337173318=69, srv425240519=73, srv67667356=87, srv248201913=60, srv778401819=90, srv2065513019=53, srv1928204272=44, srv1885506464=40, srv245161231=59, srv890411016=96, srv1263022586=11, srv309403256=65, srv2026609122=51, srv609857545=83, srv832620682=92, srv1269161572=13, srv22296001=57, srv1457041652=19, srv1404757856=18, srv1728563667=30, srv902536970=97, srv1052465277=1, srv21048502=55, srv1581817203=22, srv591430911=79, srv2036238761=52, srv1882291701=39, srv62487433=84, srv759166648=89, srv87932774=95, srv559600445=77, srv1665760427=27, srv1267554071=12, srv1708543985=29, srv1840033350=36, srv1516758624=20, srv1607005709=23, srv1624326902=25, srv1882014882=38, srv1695382029=28, srv2023788058=50, srv408827657=72, srv460668580=74, srv1094676822=3, srv1207817012=10, srv269422630=61, srv1157255827=8, srv1018491321=0, srv604850943=82, srv937201799=98, srv281905235=62, srv1607878405=24, srv1976159278=47, srv661723966=86, srv1119379566=6, srv489267466=75, srv1916938312=43, srv373850182=71, srv1373004204=17, srv368353876=70, srv801130766=91, srv1809415012=35, srv1737642098=31, srv208778731=54, srv244357929=58, srv59733181=81, srv13389652=15, srv2138602578=56, srv862237105=94, srv642756499=85, srv1172386061=9, srv1102022882=4, srv1879091016=37, srv492650726=76, srv1773034212=32, srv939152579=99, srv1155564532=7, srv311288100=66, srv290870061=64, srv84522234=93, srv1080047166=2, srv1785038249=33} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-10-30 13:55:32,841 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-10-30 13:55:32,841 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-10-30 13:55:32,841 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-10-30 13:55:32,841 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-10-30 13:55:32,841 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-10-30 13:55:32,841 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-10-30 13:55:32,841 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-10-30 13:55:32,841 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-10-30 13:55:32,841 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-10-30 13:55:32,841 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-10-30 13:55:32,842 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-10-30 13:55:32,842 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-10-30 13:55:32,842 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-10-30 13:55:32,842 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-10-30 13:55:32,842 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-10-30 13:55:32,842 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-10-30 13:55:32,842 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-10-30 13:55:32,842 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-10-30 13:55:32,842 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-10-30 13:55:32,842 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-10-30 13:55:32,842 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-10-30 13:55:32,842 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-10-30 13:55:32,842 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-10-30 13:55:32,843 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-10-30 13:55:32,843 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-10-30 13:55:32,843 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-10-30 13:55:32,843 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-10-30 13:55:32,843 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-10-30 13:55:32,843 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-10-30 13:55:32,843 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-10-30 13:55:32,843 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-10-30 13:55:32,843 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-10-30 13:55:32,843 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-10-30 13:55:32,843 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-10-30 13:55:32,843 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-10-30 13:55:32,843 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-10-30 13:55:32,843 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-10-30 13:55:32,844 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-10-30 13:55:32,844 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-10-30 13:55:32,844 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-10-30 13:55:32,844 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-10-30 13:55:32,844 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-10-30 13:55:32,844 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-10-30 13:55:32,844 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-10-30 13:55:32,844 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-10-30 13:55:32,844 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-10-30 13:55:32,844 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-10-30 13:55:32,844 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-10-30 13:55:32,844 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-10-30 13:55:32,845 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-10-30 13:55:32,845 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-10-30 13:55:32,845 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-10-30 13:55:32,845 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-10-30 13:55:32,845 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-10-30 13:55:32,845 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-10-30 13:55:32,845 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-10-30 13:55:32,845 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-10-30 13:55:32,845 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-10-30 13:55:32,845 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-10-30 13:55:32,845 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-10-30 13:55:32,845 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-10-30 13:55:32,845 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-10-30 13:55:32,845 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-10-30 13:55:32,846 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-10-30 13:55:32,846 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-10-30 13:55:32,846 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-10-30 13:55:32,846 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-10-30 13:55:32,846 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-10-30 13:55:32,846 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-10-30 13:55:32,846 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-10-30 13:55:32,846 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-10-30 13:55:32,846 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-10-30 13:55:32,846 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-10-30 13:55:32,846 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-10-30 13:55:32,846 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-10-30 13:55:32,846 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-10-30 13:55:32,846 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-10-30 13:55:32,846 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-10-30 13:55:32,847 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-10-30 13:55:32,847 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-10-30 13:55:32,847 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-10-30 13:55:32,847 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-10-30 13:55:32,847 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-10-30 13:55:32,847 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-10-30 13:55:32,847 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-10-30 13:55:32,847 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-10-30 13:55:32,847 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-10-30 13:55:32,847 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-10-30 13:55:32,847 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-10-30 13:55:32,847 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-10-30 13:55:32,847 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-10-30 13:55:32,847 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-10-30 13:55:32,847 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-10-30 13:55:32,848 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-10-30 13:55:32,848 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-10-30 13:55:32,848 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-10-30 13:55:32,848 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-10-30 13:55:32,848 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-10-30 13:55:32,848 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-10-30 13:55:32,848 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-10-30 13:55:32,848 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-10-30 13:55:32,986 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.038516575967593024, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.04932541569005408, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.038516575967593024, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.17491666666666666, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.23841666666666667, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-10-30 13:55:32,987 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-10-30 13:55:32,987 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.17934498059293125, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.038516575967593024, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.04932541569005408, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.038516575967593024, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.17491666666666666, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.23841666666666667, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-10-30 13:55:33,225 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 355 ms to try 5000 different iterations.  Found a solution that moves 2703 regions; Going from a computed imbalance of 0.17934498059293125 to a new imbalance of 0.014507787854208799. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.021273813340739255); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0309954560226435, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.30033333333333334, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.021273813340739255); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.01125); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.04575, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-10-30 13:55:33,234 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1695382029:73 , srv591430911:77 , srv1267554071:81 , srv1404757856:81 , srv1607878405:81 , srv1882291701:81 , srv1885506464:81 , srv597191745:81 , srv67667356:81 , srv1157255827:82 , srv1373004204:82 , srv1971462082:82 , srv269422630:82 , srv368353876:82 , srv59733181:82 , srv759166648:82 , srv937201799:82 , srv1102022882:83 , srv1581817203:83 , srv1773034212:83 , srv492650726:83 , srv778401819:83 , srv890411016:83 , srv1207817012:84 , srv1263022586:84 , srv1346374431:84 , srv1624326902:84 , srv1785038249:84 , srv188592436:84 , srv200051377:84 , srv285164878:84 , srv325564722:84 , srv559600445:84 , srv1312659402:85 , srv1607005709:85 , srv1665760427:85 , srv1809415012:85 , srv1977015570:85 , srv2026609122:85 , srv2036238761:85 , srv2065513019:85 , srv244357929:85 , srv373850182:85 , srv84522234:85 , srv1080047166:86 , srv1114487489:86 , srv1172386061:86 , srv152783102:86 , srv1728563667:86 , srv1928204272:86 , srv1950423185:86 , srv2023788058:86 , srv208778731:86 , srv245161231:86 , srv248201913:86 , srv290870061:86 , srv327212451:86 , srv408827657:86 , srv489267466:86 , srv62487433:86 , srv661723966:86 , srv862237105:86 , srv1119379566:87 , srv13389652:87 , srv1457041652:87 , srv1916938312:87 , srv281905235:87 , srv588383700:87 , srv609857545:87 , srv801130766:87 , srv939152579:87 , srv1516758624:88 , srv1655625212:88 , srv1708543985:88 , srv1737642098:88 , srv1794042876:88 , srv1840033350:88 , srv1882014882:88 , srv2138602578:88 , srv337173318:88 , srv425240519:88 , srv725571704:88 , srv902536970:88 , srv1018491321:89 , srv191627948:89 , srv1976159278:89 , srv21048502:89 , srv22296001:89 , srv309403256:89 , srv460668580:89 , srv604850943:89 , srv642756499:89 , srv1052465277:90 , srv1269161572:90 , srv311288100:90 , srv1094676822:91 , srv1879091016:91 , srv87932774:91 , srv1155564532:92 , srv832620682:531 }
2023-10-30 13:55:33,238 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-10-30 13:55:33,238 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv188592436=41, srv1977015570=48, srv200051377=49, srv1794042876=34, srv725571704=88, srv325564722=67, srv152783102=21, srv1114487489=5, srv327212451=68, srv597191745=80, srv1655625212=26, srv285164878=63, srv191627948=42, srv1950423185=45, srv1971462082=46, srv1312659402=14, srv588383700=78, srv1346374431=16, srv337173318=69, srv425240519=73, srv67667356=87, srv248201913=60, srv778401819=90, srv2065513019=53, srv1928204272=44, srv1885506464=40, srv245161231=59, srv890411016=96, srv1263022586=11, srv309403256=65, srv2026609122=51, srv609857545=83, srv832620682=92, srv1269161572=13, srv22296001=57, srv1457041652=19, srv1404757856=18, srv1728563667=30, srv902536970=97, srv1052465277=1, srv21048502=55, srv1581817203=22, srv591430911=79, srv2036238761=52, srv1882291701=39, srv62487433=84, srv759166648=89, srv87932774=95, srv559600445=77, srv1665760427=27, srv1267554071=12, srv1708543985=29, srv1840033350=36, srv1516758624=20, srv1607005709=23, srv1624326902=25, srv1882014882=38, srv1695382029=28, srv2023788058=50, srv408827657=72, srv460668580=74, srv1094676822=3, srv1207817012=10, srv269422630=61, srv1157255827=8, srv1018491321=0, srv604850943=82, srv937201799=98, srv281905235=62, srv1607878405=24, srv1976159278=47, srv661723966=86, srv1119379566=6, srv489267466=75, srv1916938312=43, srv373850182=71, srv1373004204=17, srv368353876=70, srv801130766=91, srv1809415012=35, srv1737642098=31, srv208778731=54, srv244357929=58, srv59733181=81, srv13389652=15, srv2138602578=56, srv862237105=94, srv642756499=85, srv1172386061=9, srv1102022882=4, srv1879091016=37, srv492650726=76, srv1773034212=32, srv939152579=99, srv1155564532=7, srv311288100=66, srv290870061=64, srv84522234=93, srv1080047166=2, srv1785038249=33} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-10-30 13:55:33,259 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-10-30 13:55:33,259 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-10-30 13:55:33,259 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-10-30 13:55:33,259 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-10-30 13:55:33,259 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-10-30 13:55:33,259 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-10-30 13:55:33,259 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-10-30 13:55:33,259 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-10-30 13:55:33,259 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-10-30 13:55:33,259 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-10-30 13:55:33,259 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-10-30 13:55:33,259 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-10-30 13:55:33,259 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-10-30 13:55:33,260 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-10-30 13:55:33,260 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-10-30 13:55:33,260 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-10-30 13:55:33,260 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-10-30 13:55:33,260 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-10-30 13:55:33,260 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-10-30 13:55:33,260 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-10-30 13:55:33,260 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-10-30 13:55:33,260 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-10-30 13:55:33,260 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-10-30 13:55:33,260 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-10-30 13:55:33,260 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-10-30 13:55:33,260 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-10-30 13:55:33,260 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-10-30 13:55:33,260 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-10-30 13:55:33,260 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-10-30 13:55:33,261 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-10-30 13:55:33,261 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-10-30 13:55:33,261 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-10-30 13:55:33,261 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-10-30 13:55:33,261 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-10-30 13:55:33,261 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-10-30 13:55:33,261 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-10-30 13:55:33,261 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-10-30 13:55:33,261 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-10-30 13:55:33,261 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-10-30 13:55:33,261 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-10-30 13:55:33,261 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-10-30 13:55:33,261 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-10-30 13:55:33,261 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-10-30 13:55:33,262 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-10-30 13:55:33,262 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-10-30 13:55:33,262 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-10-30 13:55:33,262 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-10-30 13:55:33,262 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-10-30 13:55:33,262 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-10-30 13:55:33,262 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-10-30 13:55:33,262 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-10-30 13:55:33,262 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-10-30 13:55:33,262 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-10-30 13:55:33,262 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-10-30 13:55:33,262 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-10-30 13:55:33,262 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-10-30 13:55:33,262 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-10-30 13:55:33,262 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-10-30 13:55:33,262 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-10-30 13:55:33,263 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-10-30 13:55:33,263 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-10-30 13:55:33,263 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-10-30 13:55:33,263 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-10-30 13:55:33,263 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-10-30 13:55:33,263 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-10-30 13:55:33,263 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-10-30 13:55:33,263 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-10-30 13:55:33,263 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-10-30 13:55:33,263 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-10-30 13:55:33,263 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-10-30 13:55:33,263 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-10-30 13:55:33,263 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-10-30 13:55:33,263 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-10-30 13:55:33,263 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-10-30 13:55:33,263 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-10-30 13:55:33,263 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-10-30 13:55:33,264 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-10-30 13:55:33,264 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-10-30 13:55:33,264 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-10-30 13:55:33,264 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-10-30 13:55:33,264 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-10-30 13:55:33,264 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-10-30 13:55:33,264 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-10-30 13:55:33,264 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-10-30 13:55:33,264 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-10-30 13:55:33,264 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-10-30 13:55:33,264 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-10-30 13:55:33,264 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-10-30 13:55:33,264 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-10-30 13:55:33,264 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-10-30 13:55:33,264 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-10-30 13:55:33,264 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-10-30 13:55:33,264 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-10-30 13:55:33,265 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-10-30 13:55:33,265 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-10-30 13:55:33,265 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-10-30 13:55:33,265 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-10-30 13:55:33,265 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-10-30 13:55:33,265 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-10-30 13:55:33,265 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-10-30 13:55:33,265 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-10-30 13:55:33,379 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.021273813340739255); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0309954560226435, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.021273813340739255); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.01125); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.04575, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-10-30 13:55:33,379 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-10-30 13:55:33,379 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.014488861043677963, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.021273813340739255); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0309954560226435, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.021273813340739255); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.01125); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.04575, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-10-30 13:55:33,597 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 317 ms to try 5000 different iterations.  Found a solution that moves 998 regions; Going from a computed imbalance of 0.014488861043677963 to a new imbalance of 5.880749055177935E-4. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.006453764691102064); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0071852198964762574); MoveCostFunction : (multiplier=7.0, imbalance=0.11088888888888888, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.006453764691102064); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.6666666666666666E-4); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.004083333333333333); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-10-30 13:55:33,598 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1172386061:82 , srv1879091016:82 , srv1094676822:83 , srv1155564532:83 , srv13389652:83 , srv22296001:83 , srv325564722:83 , srv368353876:83 , srv408827657:83 , srv778401819:83 , srv862237105:83 , srv87932774:83 , srv902536970:83 , srv1102022882:84 , srv1607878405:84 , srv1737642098:84 , srv1809415012:84 , srv1916938312:84 , srv1976159278:84 , srv1977015570:84 , srv2036238761:84 , srv2065513019:84 , srv2138602578:84 , srv337173318:84 , srv373850182:84 , srv604850943:84 , srv642756499:84 , srv661723966:84 , srv1263022586:85 , srv1269161572:85 , srv1516758624:85 , srv152783102:85 , srv1655625212:85 , srv1665760427:85 , srv1773034212:85 , srv1785038249:85 , srv1882291701:85 , srv1885506464:85 , srv1928204272:85 , srv1971462082:85 , srv21048502:85 , srv244357929:85 , srv245161231:85 , srv248201913:85 , srv269422630:85 , srv281905235:85 , srv309403256:85 , srv311288100:85 , srv559600445:85 , srv591430911:85 , srv609857545:85 , srv62487433:85 , srv67667356:85 , srv725571704:85 , srv84522234:85 , srv937201799:85 , srv1018491321:86 , srv1052465277:86 , srv1114487489:86 , srv1267554071:86 , srv1346374431:86 , srv1404757856:86 , srv1457041652:86 , srv1624326902:86 , srv1695382029:86 , srv1708543985:86 , srv1794042876:86 , srv188592436:86 , srv1950423185:86 , srv200051377:86 , srv208778731:86 , srv290870061:86 , srv327212451:86 , srv460668580:86 , srv588383700:86 , srv1080047166:87 , srv1119379566:87 , srv1157255827:87 , srv1207817012:87 , srv1581817203:87 , srv1728563667:87 , srv1840033350:87 , srv1882014882:87 , srv191627948:87 , srv285164878:87 , srv492650726:87 , srv597191745:87 , srv759166648:87 , srv801130766:87 , srv939152579:87 , srv1312659402:88 , srv1373004204:88 , srv1607005709:88 , srv2023788058:88 , srv2026609122:88 , srv425240519:88 , srv489267466:88 , srv59733181:88 , srv890411016:88 , srv832620682:552 }
2023-10-30 13:55:33,602 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-10-30 13:55:33,603 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv188592436=41, srv1977015570=48, srv200051377=49, srv1794042876=34, srv725571704=88, srv325564722=67, srv152783102=21, srv1114487489=5, srv327212451=68, srv597191745=80, srv1655625212=26, srv285164878=63, srv191627948=42, srv1950423185=45, srv1971462082=46, srv1312659402=14, srv588383700=78, srv1346374431=16, srv337173318=69, srv425240519=73, srv67667356=87, srv248201913=60, srv778401819=90, srv2065513019=53, srv1928204272=44, srv1885506464=40, srv245161231=59, srv890411016=96, srv1263022586=11, srv309403256=65, srv2026609122=51, srv609857545=83, srv832620682=92, srv1269161572=13, srv22296001=57, srv1457041652=19, srv1404757856=18, srv1728563667=30, srv902536970=97, srv1052465277=1, srv21048502=55, srv1581817203=22, srv591430911=79, srv2036238761=52, srv1882291701=39, srv62487433=84, srv759166648=89, srv87932774=95, srv559600445=77, srv1665760427=27, srv1267554071=12, srv1708543985=29, srv1840033350=36, srv1516758624=20, srv1607005709=23, srv1624326902=25, srv1882014882=38, srv1695382029=28, srv2023788058=50, srv408827657=72, srv460668580=74, srv1094676822=3, srv1207817012=10, srv269422630=61, srv1157255827=8, srv1018491321=0, srv604850943=82, srv937201799=98, srv281905235=62, srv1607878405=24, srv1976159278=47, srv661723966=86, srv1119379566=6, srv489267466=75, srv1916938312=43, srv373850182=71, srv1373004204=17, srv368353876=70, srv801130766=91, srv1809415012=35, srv1737642098=31, srv208778731=54, srv244357929=58, srv59733181=81, srv13389652=15, srv2138602578=56, srv862237105=94, srv642756499=85, srv1172386061=9, srv1102022882=4, srv1879091016=37, srv492650726=76, srv1773034212=32, srv939152579=99, srv1155564532=7, srv311288100=66, srv290870061=64, srv84522234=93, srv1080047166=2, srv1785038249=33} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-10-30 13:55:33,621 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-10-30 13:55:33,621 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-10-30 13:55:33,621 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-10-30 13:55:33,621 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-10-30 13:55:33,621 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-10-30 13:55:33,621 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-10-30 13:55:33,621 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-10-30 13:55:33,621 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-10-30 13:55:33,621 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-10-30 13:55:33,621 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-10-30 13:55:33,621 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-10-30 13:55:33,621 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-10-30 13:55:33,621 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-10-30 13:55:33,621 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-10-30 13:55:33,622 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-10-30 13:55:33,622 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-10-30 13:55:33,622 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-10-30 13:55:33,622 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-10-30 13:55:33,622 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-10-30 13:55:33,622 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-10-30 13:55:33,622 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-10-30 13:55:33,622 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-10-30 13:55:33,622 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-10-30 13:55:33,622 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-10-30 13:55:33,622 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-10-30 13:55:33,622 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-10-30 13:55:33,622 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-10-30 13:55:33,623 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-10-30 13:55:33,623 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-10-30 13:55:33,623 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-10-30 13:55:33,623 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-10-30 13:55:33,623 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-10-30 13:55:33,623 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-10-30 13:55:33,623 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-10-30 13:55:33,623 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-10-30 13:55:33,623 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-10-30 13:55:33,623 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-10-30 13:55:33,623 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-10-30 13:55:33,623 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-10-30 13:55:33,624 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-10-30 13:55:33,624 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-10-30 13:55:33,624 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-10-30 13:55:33,624 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-10-30 13:55:33,624 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-10-30 13:55:33,624 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-10-30 13:55:33,624 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-10-30 13:55:33,624 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-10-30 13:55:33,624 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-10-30 13:55:33,624 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-10-30 13:55:33,624 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-10-30 13:55:33,625 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-10-30 13:55:33,625 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-10-30 13:55:33,625 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-10-30 13:55:33,625 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-10-30 13:55:33,625 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-10-30 13:55:33,625 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-10-30 13:55:33,625 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-10-30 13:55:33,625 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-10-30 13:55:33,625 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-10-30 13:55:33,625 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-10-30 13:55:33,626 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-10-30 13:55:33,626 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-10-30 13:55:33,626 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-10-30 13:55:33,626 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-10-30 13:55:33,626 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-10-30 13:55:33,626 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-10-30 13:55:33,626 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-10-30 13:55:33,626 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-10-30 13:55:33,626 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-10-30 13:55:33,626 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-10-30 13:55:33,626 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-10-30 13:55:33,627 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-10-30 13:55:33,627 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-10-30 13:55:33,627 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-10-30 13:55:33,627 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-10-30 13:55:33,627 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-10-30 13:55:33,627 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-10-30 13:55:33,627 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-10-30 13:55:33,627 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-10-30 13:55:33,627 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-10-30 13:55:33,627 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-10-30 13:55:33,628 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-10-30 13:55:33,628 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-10-30 13:55:33,628 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-10-30 13:55:33,628 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-10-30 13:55:33,628 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-10-30 13:55:33,628 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-10-30 13:55:33,628 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-10-30 13:55:33,628 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-10-30 13:55:33,628 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-10-30 13:55:33,628 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-10-30 13:55:33,628 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-10-30 13:55:33,628 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-10-30 13:55:33,629 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-10-30 13:55:33,629 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-10-30 13:55:33,629 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-10-30 13:55:33,629 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-10-30 13:55:33,629 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-10-30 13:55:33,629 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-10-30 13:55:33,629 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-10-30 13:55:33,629 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-10-30 13:55:33,736 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.006453764691102064); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0071852198964762574); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.006453764691102064); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.6666666666666666E-4); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.004083333333333333); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-10-30 13:55:33,736 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-10-30 13:55:33,737 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=5.810867601571678E-4, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.006453764691102064); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0071852198964762574); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.006453764691102064); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.6666666666666666E-4); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.004083333333333333); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-10-30 13:55:34,081 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 443 ms to try 5000 different iterations.  Found a solution that moves 242 regions; Going from a computed imbalance of 5.810867601571678E-4 to a new imbalance of 2.7504806038885962E-5. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=4.178341294946416E-4); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0019534423844256277); MoveCostFunction : (multiplier=7.0, imbalance=0.02688888888888889, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=4.178341294946416E-4); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.6666666666666666E-4); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-10-30 13:55:34,082 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv2023788058:82 , srv1267554071:83 , srv1312659402:83 , srv191627948:83 , srv290870061:83 , srv489267466:83 , srv1052465277:84 , srv1119379566:84 , srv1155564532:84 , srv1346374431:84 , srv152783102:84 , srv1581817203:84 , srv1607005709:84 , srv1607878405:84 , srv1708543985:84 , srv1728563667:84 , srv1737642098:84 , srv1809415012:84 , srv1840033350:84 , srv1879091016:84 , srv1882014882:84 , srv1916938312:84 , srv1950423185:84 , srv2026609122:84 , srv2065513019:84 , srv21048502:84 , srv22296001:84 , srv309403256:84 , srv311288100:84 , srv325564722:84 , srv327212451:84 , srv408827657:84 , srv425240519:84 , srv460668580:84 , srv492650726:84 , srv59733181:84 , srv609857545:84 , srv642756499:84 , srv67667356:84 , srv725571704:84 , srv759166648:84 , srv84522234:84 , srv87932774:84 , srv890411016:84 , srv937201799:84 , srv939152579:84 , srv1018491321:85 , srv1080047166:85 , srv1094676822:85 , srv1102022882:85 , srv1114487489:85 , srv1157255827:85 , srv1172386061:85 , srv1207817012:85 , srv1263022586:85 , srv1269161572:85 , srv13389652:85 , srv1457041652:85 , srv1516758624:85 , srv1655625212:85 , srv1665760427:85 , srv1785038249:85 , srv1882291701:85 , srv188592436:85 , srv1928204272:85 , srv1971462082:85 , srv1976159278:85 , srv200051377:85 , srv2036238761:85 , srv208778731:85 , srv2138602578:85 , srv244357929:85 , srv245161231:85 , srv248201913:85 , srv269422630:85 , srv281905235:85 , srv285164878:85 , srv337173318:85 , srv368353876:85 , srv559600445:85 , srv588383700:85 , srv591430911:85 , srv597191745:85 , srv604850943:85 , srv661723966:85 , srv778401819:85 , srv801130766:85 , srv862237105:85 , srv902536970:85 , srv1373004204:86 , srv1624326902:86 , srv1695382029:86 , srv1773034212:86 , srv1794042876:86 , srv1885506464:86 , srv1977015570:86 , srv373850182:86 , srv62487433:86 , srv1404757856:87 , srv832620682:627 }
2023-10-30 13:55:34,086 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-10-30 13:55:34,087 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv188592436=41, srv1977015570=48, srv200051377=49, srv1794042876=34, srv725571704=88, srv325564722=67, srv152783102=21, srv1114487489=5, srv327212451=68, srv597191745=80, srv1655625212=26, srv285164878=63, srv191627948=42, srv1950423185=45, srv1971462082=46, srv1312659402=14, srv588383700=78, srv1346374431=16, srv337173318=69, srv425240519=73, srv67667356=87, srv248201913=60, srv778401819=90, srv2065513019=53, srv1928204272=44, srv1885506464=40, srv245161231=59, srv890411016=96, srv1263022586=11, srv309403256=65, srv2026609122=51, srv609857545=83, srv832620682=92, srv1269161572=13, srv22296001=57, srv1457041652=19, srv1404757856=18, srv1728563667=30, srv902536970=97, srv1052465277=1, srv21048502=55, srv1581817203=22, srv591430911=79, srv2036238761=52, srv1882291701=39, srv62487433=84, srv759166648=89, srv87932774=95, srv559600445=77, srv1665760427=27, srv1267554071=12, srv1708543985=29, srv1840033350=36, srv1516758624=20, srv1607005709=23, srv1624326902=25, srv1882014882=38, srv1695382029=28, srv2023788058=50, srv408827657=72, srv460668580=74, srv1094676822=3, srv1207817012=10, srv269422630=61, srv1157255827=8, srv1018491321=0, srv604850943=82, srv937201799=98, srv281905235=62, srv1607878405=24, srv1976159278=47, srv661723966=86, srv1119379566=6, srv489267466=75, srv1916938312=43, srv373850182=71, srv1373004204=17, srv368353876=70, srv801130766=91, srv1809415012=35, srv1737642098=31, srv208778731=54, srv244357929=58, srv59733181=81, srv13389652=15, srv2138602578=56, srv862237105=94, srv642756499=85, srv1172386061=9, srv1102022882=4, srv1879091016=37, srv492650726=76, srv1773034212=32, srv939152579=99, srv1155564532=7, srv311288100=66, srv290870061=64, srv84522234=93, srv1080047166=2, srv1785038249=33} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-10-30 13:55:34,097 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-10-30 13:55:34,097 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-10-30 13:55:34,097 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-10-30 13:55:34,097 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-10-30 13:55:34,097 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-10-30 13:55:34,097 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-10-30 13:55:34,097 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-10-30 13:55:34,097 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-10-30 13:55:34,097 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-10-30 13:55:34,098 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-10-30 13:55:34,098 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-10-30 13:55:34,098 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-10-30 13:55:34,098 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-10-30 13:55:34,098 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-10-30 13:55:34,098 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-10-30 13:55:34,098 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-10-30 13:55:34,098 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-10-30 13:55:34,098 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-10-30 13:55:34,098 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-10-30 13:55:34,098 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-10-30 13:55:34,098 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-10-30 13:55:34,098 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-10-30 13:55:34,098 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-10-30 13:55:34,098 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-10-30 13:55:34,098 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-10-30 13:55:34,098 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-10-30 13:55:34,098 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-10-30 13:55:34,098 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-10-30 13:55:34,098 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-10-30 13:55:34,098 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-10-30 13:55:34,099 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-10-30 13:55:34,099 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-10-30 13:55:34,099 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-10-30 13:55:34,099 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-10-30 13:55:34,099 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-10-30 13:55:34,099 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-10-30 13:55:34,099 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-10-30 13:55:34,099 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-10-30 13:55:34,099 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-10-30 13:55:34,099 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-10-30 13:55:34,099 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-10-30 13:55:34,099 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-10-30 13:55:34,099 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-10-30 13:55:34,099 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-10-30 13:55:34,099 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-10-30 13:55:34,099 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-10-30 13:55:34,099 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-10-30 13:55:34,099 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-10-30 13:55:34,099 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-10-30 13:55:34,099 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-10-30 13:55:34,100 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-10-30 13:55:34,100 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-10-30 13:55:34,100 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-10-30 13:55:34,100 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-10-30 13:55:34,100 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-10-30 13:55:34,100 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-10-30 13:55:34,100 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-10-30 13:55:34,100 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-10-30 13:55:34,100 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-10-30 13:55:34,100 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-10-30 13:55:34,100 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-10-30 13:55:34,100 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-10-30 13:55:34,100 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-10-30 13:55:34,100 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-10-30 13:55:34,100 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-10-30 13:55:34,100 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-10-30 13:55:34,100 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-10-30 13:55:34,100 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-10-30 13:55:34,100 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-10-30 13:55:34,101 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-10-30 13:55:34,101 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-10-30 13:55:34,101 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-10-30 13:55:34,101 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-10-30 13:55:34,101 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-10-30 13:55:34,101 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-10-30 13:55:34,101 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-10-30 13:55:34,101 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-10-30 13:55:34,101 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-10-30 13:55:34,101 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-10-30 13:55:34,101 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-10-30 13:55:34,101 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-10-30 13:55:34,101 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-10-30 13:55:34,101 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-10-30 13:55:34,101 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-10-30 13:55:34,101 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-10-30 13:55:34,102 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-10-30 13:55:34,102 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-10-30 13:55:34,102 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-10-30 13:55:34,102 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-10-30 13:55:34,102 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-10-30 13:55:34,102 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-10-30 13:55:34,102 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-10-30 13:55:34,102 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-10-30 13:55:34,102 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-10-30 13:55:34,102 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-10-30 13:55:34,102 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-10-30 13:55:34,102 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-10-30 13:55:34,102 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-10-30 13:55:34,102 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-10-30 13:55:34,102 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-10-30 13:55:34,102 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-10-30 13:55:34,208 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=4.178341294946416E-4); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0019534423844256277); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=4.178341294946416E-4); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.6666666666666666E-4); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-10-30 13:55:34,208 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-10-30 13:55:34,208 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=2.581028582117912E-5, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=4.178341294946416E-4); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0019534423844256277); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=4.178341294946416E-4); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.6666666666666666E-4); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-10-30 13:55:34,413 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 303 ms to try 5000 different iterations.  Found a solution that moves 17 regions; Going from a computed imbalance of 2.581028582117912E-5 to a new imbalance of 8.649684107245343E-6. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0018951174787165373); MoveCostFunction : (multiplier=7.0, imbalance=0.001888888888888889); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-10-30 13:55:34,414 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1157255827:83 , srv1373004204:83 , srv1404757856:83 , srv1457041652:83 , srv269422630:83 , srv373850182:83 , srv489267466:83 , srv1018491321:84 , srv1052465277:84 , srv1080047166:84 , srv1094676822:84 , srv1102022882:84 , srv1114487489:84 , srv1119379566:84 , srv1155564532:84 , srv1172386061:84 , srv1207817012:84 , srv1263022586:84 , srv1269161572:84 , srv1312659402:84 , srv13389652:84 , srv1516758624:84 , srv152783102:84 , srv1607005709:84 , srv1607878405:84 , srv1624326902:84 , srv1655625212:84 , srv1665760427:84 , srv1695382029:84 , srv1708543985:84 , srv1728563667:84 , srv1773034212:84 , srv1785038249:84 , srv1794042876:84 , srv1809415012:84 , srv1840033350:84 , srv1879091016:84 , srv1882014882:84 , srv1882291701:84 , srv1885506464:84 , srv188592436:84 , srv191627948:84 , srv1916938312:84 , srv1928204272:84 , srv1950423185:84 , srv1971462082:84 , srv1976159278:84 , srv1977015570:84 , srv200051377:84 , srv2023788058:84 , srv2026609122:84 , srv2036238761:84 , srv2065513019:84 , srv208778731:84 , srv21048502:84 , srv2138602578:84 , srv22296001:84 , srv244357929:84 , srv245161231:84 , srv248201913:84 , srv281905235:84 , srv285164878:84 , srv290870061:84 , srv309403256:84 , srv311288100:84 , srv327212451:84 , srv337173318:84 , srv368353876:84 , srv408827657:84 , srv425240519:84 , srv460668580:84 , srv492650726:84 , srv559600445:84 , srv588383700:84 , srv591430911:84 , srv597191745:84 , srv59733181:84 , srv604850943:84 , srv609857545:84 , srv62487433:84 , srv642756499:84 , srv661723966:84 , srv67667356:84 , srv725571704:84 , srv759166648:84 , srv778401819:84 , srv801130766:84 , srv84522234:84 , srv862237105:84 , srv890411016:84 , srv902536970:84 , srv939152579:84 , srv1267554071:85 , srv1346374431:85 , srv1581817203:85 , srv1737642098:85 , srv325564722:85 , srv87932774:85 , srv937201799:85 , srv832620682:684 }
2023-10-30 13:55:34,417 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-10-30 13:55:34,418 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv188592436=41, srv1977015570=48, srv200051377=49, srv1794042876=34, srv725571704=88, srv325564722=67, srv152783102=21, srv1114487489=5, srv327212451=68, srv597191745=80, srv1655625212=26, srv285164878=63, srv191627948=42, srv1950423185=45, srv1971462082=46, srv1312659402=14, srv588383700=78, srv1346374431=16, srv337173318=69, srv425240519=73, srv67667356=87, srv248201913=60, srv778401819=90, srv2065513019=53, srv1928204272=44, srv1885506464=40, srv245161231=59, srv890411016=96, srv1263022586=11, srv309403256=65, srv2026609122=51, srv609857545=83, srv832620682=92, srv1269161572=13, srv22296001=57, srv1457041652=19, srv1404757856=18, srv1728563667=30, srv902536970=97, srv1052465277=1, srv21048502=55, srv1581817203=22, srv591430911=79, srv2036238761=52, srv1882291701=39, srv62487433=84, srv759166648=89, srv87932774=95, srv559600445=77, srv1665760427=27, srv1267554071=12, srv1708543985=29, srv1840033350=36, srv1516758624=20, srv1607005709=23, srv1624326902=25, srv1882014882=38, srv1695382029=28, srv2023788058=50, srv408827657=72, srv460668580=74, srv1094676822=3, srv1207817012=10, srv269422630=61, srv1157255827=8, srv1018491321=0, srv604850943=82, srv937201799=98, srv281905235=62, srv1607878405=24, srv1976159278=47, srv661723966=86, srv1119379566=6, srv489267466=75, srv1916938312=43, srv373850182=71, srv1373004204=17, srv368353876=70, srv801130766=91, srv1809415012=35, srv1737642098=31, srv208778731=54, srv244357929=58, srv59733181=81, srv13389652=15, srv2138602578=56, srv862237105=94, srv642756499=85, srv1172386061=9, srv1102022882=4, srv1879091016=37, srv492650726=76, srv1773034212=32, srv939152579=99, srv1155564532=7, srv311288100=66, srv290870061=64, srv84522234=93, srv1080047166=2, srv1785038249=33} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-10-30 13:55:34,435 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-10-30 13:55:34,435 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-10-30 13:55:34,435 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-10-30 13:55:34,435 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-10-30 13:55:34,435 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-10-30 13:55:34,435 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-10-30 13:55:34,435 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-10-30 13:55:34,436 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-10-30 13:55:34,436 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-10-30 13:55:34,436 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-10-30 13:55:34,436 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-10-30 13:55:34,436 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-10-30 13:55:34,436 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-10-30 13:55:34,436 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-10-30 13:55:34,436 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-10-30 13:55:34,436 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-10-30 13:55:34,436 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-10-30 13:55:34,436 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-10-30 13:55:34,436 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-10-30 13:55:34,436 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-10-30 13:55:34,436 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-10-30 13:55:34,436 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-10-30 13:55:34,436 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-10-30 13:55:34,436 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-10-30 13:55:34,436 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-10-30 13:55:34,436 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-10-30 13:55:34,436 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-10-30 13:55:34,436 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-10-30 13:55:34,436 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-10-30 13:55:34,437 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-10-30 13:55:34,437 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-10-30 13:55:34,437 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-10-30 13:55:34,437 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-10-30 13:55:34,437 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-10-30 13:55:34,437 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-10-30 13:55:34,437 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-10-30 13:55:34,437 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-10-30 13:55:34,437 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-10-30 13:55:34,437 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-10-30 13:55:34,437 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-10-30 13:55:34,437 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-10-30 13:55:34,437 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-10-30 13:55:34,437 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-10-30 13:55:34,437 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-10-30 13:55:34,437 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-10-30 13:55:34,437 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-10-30 13:55:34,437 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-10-30 13:55:34,437 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-10-30 13:55:34,437 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-10-30 13:55:34,437 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-10-30 13:55:34,437 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-10-30 13:55:34,438 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-10-30 13:55:34,438 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-10-30 13:55:34,438 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-10-30 13:55:34,438 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-10-30 13:55:34,438 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-10-30 13:55:34,438 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-10-30 13:55:34,438 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-10-30 13:55:34,438 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-10-30 13:55:34,438 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-10-30 13:55:34,438 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-10-30 13:55:34,438 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-10-30 13:55:34,438 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-10-30 13:55:34,438 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-10-30 13:55:34,438 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-10-30 13:55:34,438 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-10-30 13:55:34,438 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-10-30 13:55:34,438 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-10-30 13:55:34,438 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-10-30 13:55:34,438 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-10-30 13:55:34,438 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-10-30 13:55:34,438 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-10-30 13:55:34,438 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-10-30 13:55:34,439 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-10-30 13:55:34,439 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-10-30 13:55:34,439 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-10-30 13:55:34,439 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-10-30 13:55:34,439 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-10-30 13:55:34,439 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-10-30 13:55:34,439 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-10-30 13:55:34,439 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-10-30 13:55:34,439 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-10-30 13:55:34,439 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-10-30 13:55:34,439 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-10-30 13:55:34,439 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-10-30 13:55:34,439 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-10-30 13:55:34,439 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-10-30 13:55:34,439 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-10-30 13:55:34,439 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-10-30 13:55:34,439 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-10-30 13:55:34,439 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-10-30 13:55:34,439 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-10-30 13:55:34,439 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-10-30 13:55:34,439 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-10-30 13:55:34,439 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-10-30 13:55:34,440 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-10-30 13:55:34,440 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-10-30 13:55:34,440 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-10-30 13:55:34,440 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-10-30 13:55:34,440 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-10-30 13:55:34,440 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-10-30 13:55:34,540 INFO  [Time-limited test] balancer.StochasticLoadBalancer(381): Cluster wide - skipping load balancing because weighted average imbalance=8.530647563026267E-6 <= threshold(0.025). If you want more aggressive balancing, either lower hbase.master.balancer.stochastic.minCostNeedBalance from 0.025 or increase the relative multiplier(s) of the specific cost function(s). functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0018951174787165373); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-10-30 13:55:34,540 INFO  [Time-limited test] balancer.BalancerTestBase(570): Mock Final balance: { srv1157255827:83 , srv1373004204:83 , srv1404757856:83 , srv1457041652:83 , srv269422630:83 , srv373850182:83 , srv489267466:83 , srv1018491321:84 , srv1052465277:84 , srv1080047166:84 , srv1094676822:84 , srv1102022882:84 , srv1114487489:84 , srv1119379566:84 , srv1155564532:84 , srv1172386061:84 , srv1207817012:84 , srv1263022586:84 , srv1269161572:84 , srv1312659402:84 , srv13389652:84 , srv1516758624:84 , srv152783102:84 , srv1607005709:84 , srv1607878405:84 , srv1624326902:84 , srv1655625212:84 , srv1665760427:84 , srv1695382029:84 , srv1708543985:84 , srv1728563667:84 , srv1773034212:84 , srv1785038249:84 , srv1794042876:84 , srv1809415012:84 , srv1840033350:84 , srv1879091016:84 , srv1882014882:84 , srv1882291701:84 , srv1885506464:84 , srv188592436:84 , srv191627948:84 , srv1916938312:84 , srv1928204272:84 , srv1950423185:84 , srv1971462082:84 , srv1976159278:84 , srv1977015570:84 , srv200051377:84 , srv2023788058:84 , srv2026609122:84 , srv2036238761:84 , srv2065513019:84 , srv208778731:84 , srv21048502:84 , srv2138602578:84 , srv22296001:84 , srv244357929:84 , srv245161231:84 , srv248201913:84 , srv281905235:84 , srv285164878:84 , srv290870061:84 , srv309403256:84 , srv311288100:84 , srv327212451:84 , srv337173318:84 , srv368353876:84 , srv408827657:84 , srv425240519:84 , srv460668580:84 , srv492650726:84 , srv559600445:84 , srv588383700:84 , srv591430911:84 , srv597191745:84 , srv59733181:84 , srv604850943:84 , srv609857545:84 , srv62487433:84 , srv642756499:84 , srv661723966:84 , srv67667356:84 , srv725571704:84 , srv759166648:84 , srv778401819:84 , srv801130766:84 , srv84522234:84 , srv862237105:84 , srv890411016:84 , srv902536970:84 , srv939152579:84 , srv1267554071:85 , srv1346374431:85 , srv1581817203:85 , srv1737642098:85 , srv325564722:85 , srv87932774:85 , srv937201799:85 , srv832620682:684 }
2023-10-30 13:55:34,563 INFO  [Time-limited test] hbase.ResourceChecker(175): after: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnLargeClusterWithRacks Thread=12 (was 12), OpenFileDescriptor=263 (was 263), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=127 (was 127), ProcessCount=167 (was 167), AvailableMemoryMB=14408 (was 14905)
2023-10-30 13:55:34,571 INFO  [Time-limited test] hbase.ResourceChecker(147): before: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnMidClusterWithRacks Thread=12, OpenFileDescriptor=263, MaxFileDescriptor=60000, SystemLoadAverage=127, ProcessCount=167, AvailableMemoryMB=14407
2023-10-30 13:55:34,571 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2023-10-30 13:55:34,571 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=5000, runMaxSteps=true, stepsPerRegion=800, maxRunningTime=120000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 111077.0 etc.
2023-10-30 13:55:34,581 INFO  [Time-limited test] balancer.BalancerTestBase(547): Mock Cluster : { srv1079083152:84 , srv1148462992:84 , srv1195181698:84 , srv1328887962:84 , srv1404295118:84 , srv1440059707:84 , srv1478178676:84 , srv1508460463:84 , srv1516399906:84 , srv1565907575:84 , srv1586646475:84 , srv1740568433:84 , srv1832926260:84 , srv1900666759:84 , srv1915985542:84 , srv1962014461:84 , srv1987763059:84 , srv231426874:84 , srv337038389:84 , srv358000539:84 , srv45136570:84 , srv604315443:84 , srv645429574:84 , srv652192718:84 , srv706082502:84 , srv751032548:84 , srv930732545:84 , srv946864267:84 , srv996836273:84 , srv1060350937:264 } [srvr=30 rgns=2700 avg=90.0 max=90 min=90]
2023-10-30 13:55:34,582 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-10-30 13:55:34,582 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1962014461=16, srv1079083152=1, srv1516399906=9, srv1740568433=12, srv1404295118=5, srv231426874=18, srv946864267=28, srv1900666759=14, srv652192718=24, srv1148462992=2, srv1328887962=4, srv1832926260=13, srv1508460463=8, srv45136570=21, srv930732545=27, srv604315443=22, srv706082502=25, srv1915985542=15, srv1060350937=0, srv1565907575=10, srv358000539=20, srv1440059707=6, srv1478178676=7, srv1987763059=17, srv996836273=29, srv751032548=26, srv1586646475=11, srv337038389=19, srv645429574=23, srv1195181698=3} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-10-30 13:55:34,590 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-10-30 13:55:34,590 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-10-30 13:55:34,590 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-10-30 13:55:34,590 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-10-30 13:55:34,591 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-10-30 13:55:34,591 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-10-30 13:55:34,591 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-10-30 13:55:34,591 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-10-30 13:55:34,591 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-10-30 13:55:34,591 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-10-30 13:55:34,591 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-10-30 13:55:34,591 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-10-30 13:55:34,591 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-10-30 13:55:34,591 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-10-30 13:55:34,591 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-10-30 13:55:34,591 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-10-30 13:55:34,591 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-10-30 13:55:34,591 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-10-30 13:55:34,591 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-10-30 13:55:34,591 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-10-30 13:55:34,591 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-10-30 13:55:34,591 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-10-30 13:55:34,591 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-10-30 13:55:34,591 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-10-30 13:55:34,591 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-10-30 13:55:34,591 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-10-30 13:55:34,591 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-10-30 13:55:34,591 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-10-30 13:55:34,592 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-10-30 13:55:34,592 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-10-30 13:55:34,592 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=10, number of hosts=30, number of racks=4
2023-10-30 13:55:34,607 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=1.0983654871498214, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-10-30 13:55:34,607 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.991250298970236, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=1.0983654871498214, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=64800000
2023-10-30 13:57:34,595 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 120001 ms to try 6377475 different iterations.  Found a solution that moves 1855 regions; Going from a computed imbalance of 0.991250298970236 to a new imbalance of 4.329662539733032E-5. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); MoveCostFunction : (multiplier=7.0, imbalance=0.687037037037037, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-10-30 13:57:34,602 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1060350937:90 , srv1079083152:90 , srv1148462992:90 , srv1195181698:90 , srv1328887962:90 , srv1404295118:90 , srv1440059707:90 , srv1478178676:90 , srv1508460463:90 , srv1516399906:90 , srv1565907575:90 , srv1586646475:90 , srv1740568433:90 , srv1832926260:90 , srv1900666759:90 , srv1915985542:90 , srv1962014461:90 , srv1987763059:90 , srv231426874:90 , srv337038389:90 , srv358000539:90 , srv45136570:90 , srv604315443:90 , srv645429574:90 , srv652192718:90 , srv706082502:90 , srv751032548:90 , srv930732545:90 , srv946864267:90 , srv996836273:90 }
2023-10-30 13:57:34,604 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-10-30 13:57:34,604 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1962014461=16, srv1079083152=1, srv1516399906=9, srv1740568433=12, srv1404295118=5, srv231426874=18, srv946864267=28, srv1900666759=14, srv652192718=24, srv1148462992=2, srv1328887962=4, srv1832926260=13, srv1508460463=8, srv45136570=21, srv930732545=27, srv604315443=22, srv706082502=25, srv1915985542=15, srv1060350937=0, srv1565907575=10, srv358000539=20, srv1440059707=6, srv1478178676=7, srv1987763059=17, srv996836273=29, srv751032548=26, srv1586646475=11, srv337038389=19, srv645429574=23, srv1195181698=3} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-10-30 13:57:34,607 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-10-30 13:57:34,607 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-10-30 13:57:34,607 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-10-30 13:57:34,607 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-10-30 13:57:34,607 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-10-30 13:57:34,607 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-10-30 13:57:34,607 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-10-30 13:57:34,608 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-10-30 13:57:34,608 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-10-30 13:57:34,608 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-10-30 13:57:34,608 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-10-30 13:57:34,608 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-10-30 13:57:34,608 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-10-30 13:57:34,608 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-10-30 13:57:34,608 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-10-30 13:57:34,608 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-10-30 13:57:34,608 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-10-30 13:57:34,608 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-10-30 13:57:34,608 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-10-30 13:57:34,608 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-10-30 13:57:34,608 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-10-30 13:57:34,608 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-10-30 13:57:34,608 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-10-30 13:57:34,608 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-10-30 13:57:34,608 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-10-30 13:57:34,608 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-10-30 13:57:34,608 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-10-30 13:57:34,608 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-10-30 13:57:34,608 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-10-30 13:57:34,608 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-10-30 13:57:34,609 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=10, number of hosts=30, number of racks=4
2023-10-30 13:57:34,620 INFO  [Time-limited test] balancer.StochasticLoadBalancer(381): Cluster wide - skipping load balancing because weighted average imbalance=0.0 <= threshold(0.025). If you want more aggressive balancing, either lower hbase.master.balancer.stochastic.minCostNeedBalance from 0.025 or increase the relative multiplier(s) of the specific cost function(s). functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-10-30 13:57:34,620 INFO  [Time-limited test] balancer.BalancerTestBase(570): Mock Final balance: { srv1060350937:90 , srv1079083152:90 , srv1148462992:90 , srv1195181698:90 , srv1328887962:90 , srv1404295118:90 , srv1440059707:90 , srv1478178676:90 , srv1508460463:90 , srv1516399906:90 , srv1565907575:90 , srv1586646475:90 , srv1740568433:90 , srv1832926260:90 , srv1900666759:90 , srv1915985542:90 , srv1962014461:90 , srv1987763059:90 , srv231426874:90 , srv337038389:90 , srv358000539:90 , srv45136570:90 , srv604315443:90 , srv645429574:90 , srv652192718:90 , srv706082502:90 , srv751032548:90 , srv930732545:90 , srv946864267:90 , srv996836273:90 }
2023-10-30 13:57:34,635 INFO  [Time-limited test] hbase.ResourceChecker(175): after: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnMidClusterWithRacks Thread=11 (was 12), OpenFileDescriptor=263 (was 263), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=181 (was 127) - SystemLoadAverage LEAK? -, ProcessCount=167 (was 167), AvailableMemoryMB=14327 (was 14407)