2023-11-28 22:58:22,612 INFO  [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks timeout: 13 mins
2023-11-28 22:58:22,907 WARN  [Time-limited test] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties
2023-11-28 22:58:22,999 INFO  [Time-limited test] metrics.MetricRegistriesLoader(60): Loaded MetricRegistries class org.apache.hadoop.hbase.metrics.impl.MetricRegistriesImpl
2023-11-28 22:58:23,065 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2023-11-28 22:58:23,073 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc.
2023-11-28 22:58:23,088 INFO  [Time-limited test] hbase.ResourceChecker(147): before: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnLargeClusterWithRacks Thread=12, OpenFileDescriptor=290, MaxFileDescriptor=60000, SystemLoadAverage=322, ProcessCount=166, AvailableMemoryMB=8552
2023-11-28 22:58:23,090 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2023-11-28 22:58:23,091 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=5000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=10000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc.
2023-11-28 22:58:23,251 INFO  [Time-limited test] balancer.BalancerTestBase(547): Mock Cluster : { srv1009324943:84 , srv1015027905:84 , srv1050077095:84 , srv1098613360:84 , srv1112339471:84 , srv111560627:84 , srv1118172049:84 , srv1123284436:84 , srv1172029163:84 , srv1174689267:84 , srv1206224740:84 , srv1218483565:84 , srv122347778:84 , srv1311211410:84 , srv132324678:84 , srv1336860288:84 , srv1368103569:84 , srv1388146748:84 , srv142019527:84 , srv143131915:84 , srv144575183:84 , srv1483226535:84 , srv149528166:84 , srv1507590824:84 , srv1560134722:84 , srv1564149669:84 , srv1591325933:84 , srv1677703217:84 , srv1717581245:84 , srv1725566751:84 , srv1741825471:84 , srv1753025013:84 , srv1779418163:84 , srv1784908056:84 , srv1789621876:84 , srv1813944137:84 , srv1821193071:84 , srv1828306834:84 , srv1833724336:84 , srv1859614070:84 , srv1910348091:84 , srv1927696113:84 , srv1931940723:84 , srv1960762182:84 , srv1968684918:84 , srv1975164341:84 , srv1989588121:84 , srv2000305611:84 , srv2035041794:84 , srv2036095422:84 , srv2039090355:84 , srv2050377124:84 , srv2057053144:84 , srv2057156638:84 , srv2063333663:84 , srv2092491625:84 , srv2095944288:84 , srv2103421536:84 , srv21634164:84 , srv244463370:84 , srv249131939:84 , srv300408457:84 , srv327107346:84 , srv357515772:84 , srv359080265:84 , srv395873994:84 , srv404485950:84 , srv424476457:84 , srv426853090:84 , srv431773673:84 , srv462004443:84 , srv545730180:84 , srv550257935:84 , srv563774003:84 , srv563808794:84 , srv564352320:84 , srv567610290:84 , srv567890808:84 , srv634078591:84 , srv665819434:84 , srv669963573:84 , srv6905183:84 , srv714020564:84 , srv728113765:84 , srv729288353:84 , srv75161856:84 , srv75631789:84 , srv778710730:84 , srv843976620:84 , srv879911:84 , srv891366372:84 , srv891424277:84 , srv892300082:84 , srv900853165:84 , srv901316497:84 , srv904872113:84 , srv935315719:84 , srv94264785:84 , srv998309069:84 , srv1955248030:684 } [srvr=100 rgns=9000 avg=90.0 max=90 min=90]
2023-11-28 22:58:23,263 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-11-28 22:58:23,274 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv892300082=93, srv1789621876=34, srv564352320=76, srv843976620=89, srv1968684918=45, srv1677703217=27, srv1483226535=21, srv431773673=70, srv2039090355=51, srv1753025013=31, srv1118172049=6, srv359080265=65, srv904872113=96, srv1828306834=37, srv395873994=66, srv75631789=87, srv778710730=88, srv1015027905=1, srv1821193071=36, srv1960762182=44, srv563808794=75, srv21634164=59, srv1098613360=3, srv2103421536=58, srv1388146748=17, srv1218483565=11, srv2050377124=52, srv714020564=83, srv462004443=71, srv2036095422=50, srv1779418163=32, srv2092491625=56, srv111560627=5, srv2000305611=48, srv1989588121=47, srv1172029163=8, srv1560134722=24, srv327107346=63, srv143131915=19, srv122347778=12, srv144575183=20, srv563774003=74, srv244463370=60, srv567610290=77, srv634078591=79, srv900853165=94, srv94264785=98, srv149528166=22, srv426853090=69, srv1368103569=16, srv1741825471=30, srv1206224740=10, srv879911=90, srv1784908056=33, srv1813944137=35, srv2057156638=54, srv357515772=64, srv545730180=72, srv665819434=80, srv1564149669=25, srv1859614070=39, srv404485950=67, srv1955248030=43, srv132324678=14, srv891366372=91, srv1931940723=42, srv729288353=85, srv75161856=86, srv935315719=97, srv2095944288=57, srv424476457=68, srv1927696113=41, srv901316497=95, srv1112339471=4, srv300408457=62, srv550257935=73, srv1725566751=29, srv1174689267=9, srv891424277=92, srv1717581245=28, srv567890808=78, srv728113765=84, srv6905183=82, srv1910348091=40, srv1336860288=15, srv1009324943=0, srv1123284436=7, srv1311211410=13, srv1507590824=23, srv1591325933=26, srv2063333663=55, srv1833724336=38, srv2035041794=49, srv249131939=61, srv1050077095=2, srv2057053144=53, srv142019527=18, srv1975164341=46, srv998309069=99, srv669963573=81} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-11-28 22:58:23,375 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-11-28 22:58:23,376 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-11-28 22:58:23,376 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-11-28 22:58:23,376 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-11-28 22:58:23,376 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-11-28 22:58:23,376 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-11-28 22:58:23,376 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-11-28 22:58:23,377 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-11-28 22:58:23,377 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-11-28 22:58:23,377 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-11-28 22:58:23,377 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-11-28 22:58:23,377 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-11-28 22:58:23,378 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-11-28 22:58:23,378 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-11-28 22:58:23,378 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-11-28 22:58:23,382 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-11-28 22:58:23,383 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-11-28 22:58:23,383 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-11-28 22:58:23,383 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-11-28 22:58:23,383 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-11-28 22:58:23,384 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-11-28 22:58:23,384 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-11-28 22:58:23,384 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-11-28 22:58:23,384 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-11-28 22:58:23,384 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-11-28 22:58:23,384 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-11-28 22:58:23,384 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-11-28 22:58:23,385 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-11-28 22:58:23,385 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-11-28 22:58:23,385 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-11-28 22:58:23,385 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-11-28 22:58:23,385 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-11-28 22:58:23,387 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-11-28 22:58:23,387 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-11-28 22:58:23,387 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-11-28 22:58:23,387 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-11-28 22:58:23,387 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-11-28 22:58:23,387 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-11-28 22:58:23,387 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-11-28 22:58:23,388 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-11-28 22:58:23,388 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-11-28 22:58:23,388 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-11-28 22:58:23,388 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-11-28 22:58:23,388 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-11-28 22:58:23,388 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-11-28 22:58:23,388 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-11-28 22:58:23,389 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-11-28 22:58:23,389 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-11-28 22:58:23,389 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-11-28 22:58:23,389 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-11-28 22:58:23,389 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-11-28 22:58:23,389 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-11-28 22:58:23,389 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-11-28 22:58:23,390 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-11-28 22:58:23,391 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-11-28 22:58:23,391 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-11-28 22:58:23,391 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-11-28 22:58:23,391 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-11-28 22:58:23,392 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-11-28 22:58:23,392 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-11-28 22:58:23,392 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-11-28 22:58:23,392 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-11-28 22:58:23,392 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-11-28 22:58:23,392 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-11-28 22:58:23,392 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-11-28 22:58:23,393 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-11-28 22:58:23,393 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-11-28 22:58:23,393 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-11-28 22:58:23,393 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-11-28 22:58:23,393 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-11-28 22:58:23,394 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-11-28 22:58:23,394 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-11-28 22:58:23,394 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-11-28 22:58:23,395 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-11-28 22:58:23,396 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-11-28 22:58:23,396 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-11-28 22:58:23,396 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-11-28 22:58:23,396 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-11-28 22:58:23,396 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-11-28 22:58:23,396 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-11-28 22:58:23,396 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-11-28 22:58:23,397 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-11-28 22:58:23,397 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-11-28 22:58:23,397 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-11-28 22:58:23,397 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-11-28 22:58:23,397 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-11-28 22:58:23,397 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-11-28 22:58:23,397 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-11-28 22:58:23,397 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-11-28 22:58:23,398 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-11-28 22:58:23,398 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-11-28 22:58:23,398 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-11-28 22:58:23,398 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-11-28 22:58:23,398 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-11-28 22:58:23,398 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-11-28 22:58:23,398 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-11-28 22:58:23,398 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-11-28 22:58:23,399 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-11-28 22:58:23,399 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-11-28 22:58:23,399 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-11-28 22:58:23,399 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-11-28 22:58:23,629 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.06666666666666667, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-11-28 22:58:23,629 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-11-28 22:58:23,629 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.9909252140407105, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.06666666666666667, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-11-28 22:58:23,999 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 558 ms to try 5000 different iterations.  Found a solution that moves 4695 regions; Going from a computed imbalance of 0.9909252140407105 to a new imbalance of 0.17855033248808433. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.038389124805790154, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.055624200015685264, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.5216666666666666, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.038389124805790154, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.17383333333333334, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.23975, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-11-28 22:58:24,039 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1821193071:80 , srv2057156638:80 , srv111560627:81 , srv1725566751:82 , srv1784908056:82 , srv1975164341:82 , srv564352320:82 , srv892300082:82 , srv1015027905:83 , srv1989588121:83 , srv567610290:83 , srv6905183:83 , srv891424277:83 , srv1050077095:84 , srv1483226535:84 , srv1753025013:84 , srv1789621876:84 , srv2050377124:84 , srv2092491625:84 , srv426853090:84 , srv550257935:84 , srv728113765:84 , srv1118172049:85 , srv144575183:85 , srv1741825471:85 , srv1828306834:85 , srv1927696113:85 , srv1960762182:85 , srv1968684918:85 , srv357515772:85 , srv545730180:85 , srv563774003:85 , srv729288353:85 , srv1009324943:86 , srv1098613360:86 , srv122347778:86 , srv1336860288:86 , srv1560134722:86 , srv1717581245:86 , srv1910348091:86 , srv1931940723:86 , srv249131939:86 , srv404485950:86 , srv563808794:86 , srv567890808:86 , srv634078591:86 , srv843976620:86 , srv891366372:86 , srv901316497:86 , srv1172029163:87 , srv1174689267:87 , srv1368103569:87 , srv1507590824:87 , srv1564149669:87 , srv2000305611:87 , srv21634164:87 , srv327107346:87 , srv424476457:87 , srv665819434:87 , srv714020564:87 , srv75161856:87 , srv75631789:87 , srv132324678:88 , srv142019527:88 , srv1813944137:88 , srv2035041794:88 , srv2036095422:88 , srv2095944288:88 , srv359080265:88 , srv395873994:88 , srv431773673:88 , srv669963573:88 , srv778710730:88 , srv879911:88 , srv904872113:88 , srv1123284436:89 , srv1206224740:89 , srv1311211410:89 , srv2039090355:89 , srv2103421536:89 , srv244463370:89 , srv300408457:89 , srv462004443:89 , srv935315719:89 , srv1388146748:90 , srv149528166:90 , srv1779418163:90 , srv1833724336:90 , srv1859614070:90 , srv2057053144:90 , srv900853165:90 , srv94264785:90 , srv998309069:90 , srv1112339471:91 , srv1591325933:91 , srv1218483565:92 , srv143131915:92 , srv1677703217:92 , srv2063333663:92 , srv1955248030:431 }
2023-11-28 22:58:24,046 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-11-28 22:58:24,047 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv892300082=93, srv1789621876=34, srv564352320=76, srv843976620=89, srv1968684918=45, srv1677703217=27, srv1483226535=21, srv431773673=70, srv2039090355=51, srv1753025013=31, srv1118172049=6, srv359080265=65, srv904872113=96, srv1828306834=37, srv395873994=66, srv75631789=87, srv778710730=88, srv1015027905=1, srv1821193071=36, srv1960762182=44, srv563808794=75, srv21634164=59, srv1098613360=3, srv2103421536=58, srv1388146748=17, srv1218483565=11, srv2050377124=52, srv714020564=83, srv462004443=71, srv2036095422=50, srv1779418163=32, srv2092491625=56, srv111560627=5, srv2000305611=48, srv1989588121=47, srv1172029163=8, srv1560134722=24, srv327107346=63, srv143131915=19, srv122347778=12, srv144575183=20, srv563774003=74, srv244463370=60, srv567610290=77, srv634078591=79, srv900853165=94, srv94264785=98, srv149528166=22, srv426853090=69, srv1368103569=16, srv1741825471=30, srv1206224740=10, srv879911=90, srv1784908056=33, srv1813944137=35, srv2057156638=54, srv357515772=64, srv545730180=72, srv665819434=80, srv1564149669=25, srv1859614070=39, srv404485950=67, srv1955248030=43, srv132324678=14, srv891366372=91, srv1931940723=42, srv729288353=85, srv75161856=86, srv935315719=97, srv2095944288=57, srv424476457=68, srv1927696113=41, srv901316497=95, srv1112339471=4, srv300408457=62, srv550257935=73, srv1725566751=29, srv1174689267=9, srv891424277=92, srv1717581245=28, srv567890808=78, srv728113765=84, srv6905183=82, srv1910348091=40, srv1336860288=15, srv1009324943=0, srv1123284436=7, srv1311211410=13, srv1507590824=23, srv1591325933=26, srv2063333663=55, srv1833724336=38, srv2035041794=49, srv249131939=61, srv1050077095=2, srv2057053144=53, srv142019527=18, srv1975164341=46, srv998309069=99, srv669963573=81} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-11-28 22:58:24,068 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-11-28 22:58:24,069 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-11-28 22:58:24,070 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-11-28 22:58:24,070 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-11-28 22:58:24,071 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-11-28 22:58:24,071 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-11-28 22:58:24,071 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-11-28 22:58:24,071 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-11-28 22:58:24,072 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-11-28 22:58:24,075 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-11-28 22:58:24,075 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-11-28 22:58:24,075 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-11-28 22:58:24,075 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-11-28 22:58:24,075 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-11-28 22:58:24,075 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-11-28 22:58:24,076 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-11-28 22:58:24,077 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-11-28 22:58:24,077 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-11-28 22:58:24,077 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-11-28 22:58:24,077 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-11-28 22:58:24,078 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-11-28 22:58:24,078 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-11-28 22:58:24,078 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-11-28 22:58:24,078 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-11-28 22:58:24,078 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-11-28 22:58:24,078 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-11-28 22:58:24,078 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-11-28 22:58:24,078 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-11-28 22:58:24,078 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-11-28 22:58:24,078 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-11-28 22:58:24,079 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-11-28 22:58:24,079 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-11-28 22:58:24,079 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-11-28 22:58:24,079 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-11-28 22:58:24,079 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-11-28 22:58:24,079 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-11-28 22:58:24,079 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-11-28 22:58:24,079 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-11-28 22:58:24,080 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-11-28 22:58:24,080 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-11-28 22:58:24,080 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-11-28 22:58:24,080 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-11-28 22:58:24,080 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-11-28 22:58:24,080 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-11-28 22:58:24,080 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-11-28 22:58:24,080 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-11-28 22:58:24,080 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-11-28 22:58:24,080 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-11-28 22:58:24,080 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-11-28 22:58:24,081 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-11-28 22:58:24,081 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-11-28 22:58:24,081 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-11-28 22:58:24,082 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-11-28 22:58:24,082 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-11-28 22:58:24,082 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-11-28 22:58:24,082 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-11-28 22:58:24,082 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-11-28 22:58:24,083 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-11-28 22:58:24,083 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-11-28 22:58:24,083 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-11-28 22:58:24,083 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-11-28 22:58:24,083 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-11-28 22:58:24,083 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-11-28 22:58:24,083 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-11-28 22:58:24,083 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-11-28 22:58:24,083 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-11-28 22:58:24,083 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-11-28 22:58:24,083 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-11-28 22:58:24,084 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-11-28 22:58:24,084 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-11-28 22:58:24,084 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-11-28 22:58:24,084 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-11-28 22:58:24,086 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-11-28 22:58:24,086 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-11-28 22:58:24,086 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-11-28 22:58:24,086 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-11-28 22:58:24,087 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-11-28 22:58:24,087 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-11-28 22:58:24,088 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-11-28 22:58:24,088 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-11-28 22:58:24,088 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-11-28 22:58:24,088 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-11-28 22:58:24,088 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-11-28 22:58:24,088 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-11-28 22:58:24,088 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-11-28 22:58:24,088 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-11-28 22:58:24,088 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-11-28 22:58:24,088 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-11-28 22:58:24,089 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-11-28 22:58:24,089 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-11-28 22:58:24,089 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-11-28 22:58:24,089 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-11-28 22:58:24,089 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-11-28 22:58:24,089 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-11-28 22:58:24,089 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-11-28 22:58:24,089 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-11-28 22:58:24,089 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-11-28 22:58:24,089 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-11-28 22:58:24,090 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-11-28 22:58:24,090 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-11-28 22:58:24,090 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-11-28 22:58:24,258 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.038389124805790154, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.055624200015685264, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.038389124805790154, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.17383333333333334, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.23975, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-11-28 22:58:24,259 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-11-28 22:58:24,259 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.1785174573954309, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.038389124805790154, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.055624200015685264, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.038389124805790154, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.17383333333333334, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.23975, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-11-28 22:58:24,495 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 350 ms to try 5000 different iterations.  Found a solution that moves 2596 regions; Going from a computed imbalance of 0.1785174573954309 to a new imbalance of 0.01613232969990724. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0224905239775918); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.03909182260828038, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.28844444444444445, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0224905239775918); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.012916666666666667); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.04666666666666667, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-11-28 22:58:24,516 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv2063333663:79 , srv1218483565:80 , srv1591325933:80 , srv1833724336:80 , srv1677703217:81 , srv1112339471:82 , srv1123284436:82 , srv1206224740:82 , srv1388146748:82 , srv143131915:82 , srv149528166:82 , srv2035041794:82 , srv2036095422:82 , srv2057053144:82 , srv2095944288:82 , srv300408457:82 , srv900853165:82 , srv998309069:82 , srv1311211410:83 , srv1813944137:83 , srv1859614070:83 , srv2039090355:83 , srv2103421536:83 , srv244463370:83 , srv395873994:83 , srv431773673:83 , srv462004443:83 , srv778710730:83 , srv904872113:83 , srv132324678:84 , srv1368103569:84 , srv1564149669:84 , srv1779418163:84 , srv634078591:84 , srv665819434:84 , srv714020564:84 , srv75161856:84 , srv75631789:84 , srv935315719:84 , srv1118172049:85 , srv1174689267:85 , srv1927696113:85 , srv1931940723:85 , srv21634164:85 , srv359080265:85 , srv567890808:85 , srv879911:85 , srv891366372:85 , srv1009324943:86 , srv1050077095:86 , srv1098613360:86 , srv1172029163:86 , srv142019527:86 , srv1507590824:86 , srv1560134722:86 , srv1717581245:86 , srv1960762182:86 , srv1968684918:86 , srv249131939:86 , srv327107346:86 , srv404485950:86 , srv545730180:86 , srv563808794:86 , srv669963573:86 , srv94264785:86 , srv122347778:87 , srv1336860288:87 , srv144575183:87 , srv1483226535:87 , srv1741825471:87 , srv1910348091:87 , srv2000305611:87 , srv728113765:87 , srv843976620:87 , srv901316497:87 , srv1725566751:88 , srv1828306834:88 , srv1975164341:88 , srv2092491625:88 , srv424476457:88 , srv426853090:88 , srv550257935:88 , srv563774003:88 , srv567610290:88 , srv729288353:88 , srv892300082:88 , srv1789621876:89 , srv1989588121:89 , srv357515772:89 , srv891424277:89 , srv1015027905:90 , srv2050377124:90 , srv564352320:90 , srv6905183:90 , srv1753025013:91 , srv1784908056:91 , srv1821193071:91 , srv2057156638:91 , srv111560627:93 , srv1955248030:543 }
2023-11-28 22:58:24,522 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-11-28 22:58:24,524 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv892300082=93, srv1789621876=34, srv564352320=76, srv843976620=89, srv1968684918=45, srv1677703217=27, srv1483226535=21, srv431773673=70, srv2039090355=51, srv1753025013=31, srv1118172049=6, srv359080265=65, srv904872113=96, srv1828306834=37, srv395873994=66, srv75631789=87, srv778710730=88, srv1015027905=1, srv1821193071=36, srv1960762182=44, srv563808794=75, srv21634164=59, srv1098613360=3, srv2103421536=58, srv1388146748=17, srv1218483565=11, srv2050377124=52, srv714020564=83, srv462004443=71, srv2036095422=50, srv1779418163=32, srv2092491625=56, srv111560627=5, srv2000305611=48, srv1989588121=47, srv1172029163=8, srv1560134722=24, srv327107346=63, srv143131915=19, srv122347778=12, srv144575183=20, srv563774003=74, srv244463370=60, srv567610290=77, srv634078591=79, srv900853165=94, srv94264785=98, srv149528166=22, srv426853090=69, srv1368103569=16, srv1741825471=30, srv1206224740=10, srv879911=90, srv1784908056=33, srv1813944137=35, srv2057156638=54, srv357515772=64, srv545730180=72, srv665819434=80, srv1564149669=25, srv1859614070=39, srv404485950=67, srv1955248030=43, srv132324678=14, srv891366372=91, srv1931940723=42, srv729288353=85, srv75161856=86, srv935315719=97, srv2095944288=57, srv424476457=68, srv1927696113=41, srv901316497=95, srv1112339471=4, srv300408457=62, srv550257935=73, srv1725566751=29, srv1174689267=9, srv891424277=92, srv1717581245=28, srv567890808=78, srv728113765=84, srv6905183=82, srv1910348091=40, srv1336860288=15, srv1009324943=0, srv1123284436=7, srv1311211410=13, srv1507590824=23, srv1591325933=26, srv2063333663=55, srv1833724336=38, srv2035041794=49, srv249131939=61, srv1050077095=2, srv2057053144=53, srv142019527=18, srv1975164341=46, srv998309069=99, srv669963573=81} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-11-28 22:58:24,541 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-11-28 22:58:24,542 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-11-28 22:58:24,542 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-11-28 22:58:24,542 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-11-28 22:58:24,542 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-11-28 22:58:24,543 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-11-28 22:58:24,543 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-11-28 22:58:24,543 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-11-28 22:58:24,543 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-11-28 22:58:24,543 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-11-28 22:58:24,543 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-11-28 22:58:24,543 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-11-28 22:58:24,544 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-11-28 22:58:24,544 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-11-28 22:58:24,544 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-11-28 22:58:24,544 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-11-28 22:58:24,544 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-11-28 22:58:24,544 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-11-28 22:58:24,544 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-11-28 22:58:24,544 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-11-28 22:58:24,544 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-11-28 22:58:24,545 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-11-28 22:58:24,545 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-11-28 22:58:24,545 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-11-28 22:58:24,545 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-11-28 22:58:24,545 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-11-28 22:58:24,545 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-11-28 22:58:24,545 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-11-28 22:58:24,545 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-11-28 22:58:24,545 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-11-28 22:58:24,546 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-11-28 22:58:24,546 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-11-28 22:58:24,546 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-11-28 22:58:24,546 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-11-28 22:58:24,546 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-11-28 22:58:24,546 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-11-28 22:58:24,546 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-11-28 22:58:24,546 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-11-28 22:58:24,546 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-11-28 22:58:24,547 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-11-28 22:58:24,547 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-11-28 22:58:24,547 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-11-28 22:58:24,547 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-11-28 22:58:24,547 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-11-28 22:58:24,547 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-11-28 22:58:24,547 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-11-28 22:58:24,547 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-11-28 22:58:24,547 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-11-28 22:58:24,548 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-11-28 22:58:24,548 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-11-28 22:58:24,548 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-11-28 22:58:24,548 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-11-28 22:58:24,548 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-11-28 22:58:24,548 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-11-28 22:58:24,548 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-11-28 22:58:24,548 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-11-28 22:58:24,548 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-11-28 22:58:24,548 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-11-28 22:58:24,549 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-11-28 22:58:24,549 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-11-28 22:58:24,549 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-11-28 22:58:24,549 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-11-28 22:58:24,549 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-11-28 22:58:24,549 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-11-28 22:58:24,549 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-11-28 22:58:24,549 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-11-28 22:58:24,549 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-11-28 22:58:24,549 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-11-28 22:58:24,549 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-11-28 22:58:24,550 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-11-28 22:58:24,550 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-11-28 22:58:24,550 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-11-28 22:58:24,550 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-11-28 22:58:24,550 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-11-28 22:58:24,550 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-11-28 22:58:24,550 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-11-28 22:58:24,550 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-11-28 22:58:24,550 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-11-28 22:58:24,550 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-11-28 22:58:24,551 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-11-28 22:58:24,551 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-11-28 22:58:24,551 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-11-28 22:58:24,551 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-11-28 22:58:24,551 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-11-28 22:58:24,551 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-11-28 22:58:24,551 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-11-28 22:58:24,551 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-11-28 22:58:24,551 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-11-28 22:58:24,551 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-11-28 22:58:24,551 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-11-28 22:58:24,552 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-11-28 22:58:24,552 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-11-28 22:58:24,552 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-11-28 22:58:24,552 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-11-28 22:58:24,552 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-11-28 22:58:24,552 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-11-28 22:58:24,552 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-11-28 22:58:24,552 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-11-28 22:58:24,552 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-11-28 22:58:24,552 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-11-28 22:58:24,553 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-11-28 22:58:24,683 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0224905239775918); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.03909182260828038, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0224905239775918); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.012916666666666667); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.04666666666666667, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-11-28 22:58:24,684 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-11-28 22:58:24,684 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.01611415211939002, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0224905239775918); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.03909182260828038, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0224905239775918); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.012916666666666667); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.04666666666666667, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-11-28 22:58:24,925 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 356 ms to try 5000 different iterations.  Found a solution that moves 981 regions; Going from a computed imbalance of 0.01611415211939002 to a new imbalance of 8.006655590535778E-4. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.005763774795025093); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.011844484241978358); MoveCostFunction : (multiplier=7.0, imbalance=0.109, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.005763774795025093); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=3.333333333333333E-4); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.004583333333333333); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-11-28 22:58:24,927 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv94264785:81 , srv424476457:82 , srv142019527:83 , srv1753025013:83 , srv2050377124:83 , srv357515772:83 , srv1112339471:84 , srv111560627:84 , srv1172029163:84 , srv1507590824:84 , srv1677703217:84 , srv1779418163:84 , srv1784908056:84 , srv1789621876:84 , srv1828306834:84 , srv1859614070:84 , srv1910348091:84 , srv2000305611:84 , srv327107346:84 , srv563774003:84 , srv729288353:84 , srv843976620:84 , srv901316497:84 , srv1015027905:85 , srv1098613360:85 , srv1174689267:85 , srv122347778:85 , srv132324678:85 , srv1336860288:85 , srv143131915:85 , srv144575183:85 , srv1989588121:85 , srv2092491625:85 , srv2103421536:85 , srv21634164:85 , srv244463370:85 , srv249131939:85 , srv359080265:85 , srv462004443:85 , srv563808794:85 , srv564352320:85 , srv669963573:85 , srv879911:85 , srv891424277:85 , srv935315719:85 , srv1009324943:86 , srv1123284436:86 , srv1206224740:86 , srv1218483565:86 , srv1311211410:86 , srv1368103569:86 , srv1388146748:86 , srv1483226535:86 , srv1560134722:86 , srv1564149669:86 , srv1717581245:86 , srv1741825471:86 , srv1813944137:86 , srv1821193071:86 , srv1931940723:86 , srv1960762182:86 , srv2039090355:86 , srv2057053144:86 , srv2057156638:86 , srv2063333663:86 , srv395873994:86 , srv404485950:86 , srv426853090:86 , srv431773673:86 , srv545730180:86 , srv550257935:86 , srv665819434:86 , srv6905183:86 , srv714020564:86 , srv728113765:86 , srv75631789:86 , srv778710730:86 , srv900853165:86 , srv904872113:86 , srv998309069:86 , srv1118172049:87 , srv149528166:87 , srv1591325933:87 , srv1833724336:87 , srv1968684918:87 , srv1975164341:87 , srv300408457:87 , srv567610290:87 , srv567890808:87 , srv634078591:87 , srv891366372:87 , srv1050077095:88 , srv1725566751:88 , srv1927696113:88 , srv2035041794:88 , srv2036095422:88 , srv75161856:88 , srv892300082:88 , srv2095944288:89 , srv1955248030:535 }
2023-11-28 22:58:24,931 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-11-28 22:58:24,932 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv892300082=93, srv1789621876=34, srv564352320=76, srv843976620=89, srv1968684918=45, srv1677703217=27, srv1483226535=21, srv431773673=70, srv2039090355=51, srv1753025013=31, srv1118172049=6, srv359080265=65, srv904872113=96, srv1828306834=37, srv395873994=66, srv75631789=87, srv778710730=88, srv1015027905=1, srv1821193071=36, srv1960762182=44, srv563808794=75, srv21634164=59, srv1098613360=3, srv2103421536=58, srv1388146748=17, srv1218483565=11, srv2050377124=52, srv714020564=83, srv462004443=71, srv2036095422=50, srv1779418163=32, srv2092491625=56, srv111560627=5, srv2000305611=48, srv1989588121=47, srv1172029163=8, srv1560134722=24, srv327107346=63, srv143131915=19, srv122347778=12, srv144575183=20, srv563774003=74, srv244463370=60, srv567610290=77, srv634078591=79, srv900853165=94, srv94264785=98, srv149528166=22, srv426853090=69, srv1368103569=16, srv1741825471=30, srv1206224740=10, srv879911=90, srv1784908056=33, srv1813944137=35, srv2057156638=54, srv357515772=64, srv545730180=72, srv665819434=80, srv1564149669=25, srv1859614070=39, srv404485950=67, srv1955248030=43, srv132324678=14, srv891366372=91, srv1931940723=42, srv729288353=85, srv75161856=86, srv935315719=97, srv2095944288=57, srv424476457=68, srv1927696113=41, srv901316497=95, srv1112339471=4, srv300408457=62, srv550257935=73, srv1725566751=29, srv1174689267=9, srv891424277=92, srv1717581245=28, srv567890808=78, srv728113765=84, srv6905183=82, srv1910348091=40, srv1336860288=15, srv1009324943=0, srv1123284436=7, srv1311211410=13, srv1507590824=23, srv1591325933=26, srv2063333663=55, srv1833724336=38, srv2035041794=49, srv249131939=61, srv1050077095=2, srv2057053144=53, srv142019527=18, srv1975164341=46, srv998309069=99, srv669963573=81} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-11-28 22:58:24,944 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-11-28 22:58:24,945 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-11-28 22:58:24,945 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-11-28 22:58:24,945 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-11-28 22:58:24,945 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-11-28 22:58:24,945 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-11-28 22:58:24,945 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-11-28 22:58:24,945 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-11-28 22:58:24,945 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-11-28 22:58:24,945 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-11-28 22:58:24,945 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-11-28 22:58:24,945 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-11-28 22:58:24,946 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-11-28 22:58:24,946 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-11-28 22:58:24,946 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-11-28 22:58:24,946 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-11-28 22:58:24,946 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-11-28 22:58:24,946 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-11-28 22:58:24,946 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-11-28 22:58:24,946 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-11-28 22:58:24,946 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-11-28 22:58:24,946 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-11-28 22:58:24,947 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-11-28 22:58:24,947 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-11-28 22:58:24,947 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-11-28 22:58:24,947 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-11-28 22:58:24,947 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-11-28 22:58:24,947 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-11-28 22:58:24,947 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-11-28 22:58:24,947 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-11-28 22:58:24,947 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-11-28 22:58:24,948 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-11-28 22:58:24,948 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-11-28 22:58:24,948 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-11-28 22:58:24,948 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-11-28 22:58:24,948 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-11-28 22:58:24,948 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-11-28 22:58:24,948 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-11-28 22:58:24,948 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-11-28 22:58:24,948 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-11-28 22:58:24,948 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-11-28 22:58:24,949 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-11-28 22:58:24,949 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-11-28 22:58:24,949 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-11-28 22:58:24,949 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-11-28 22:58:24,949 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-11-28 22:58:24,949 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-11-28 22:58:24,949 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-11-28 22:58:24,949 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-11-28 22:58:24,949 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-11-28 22:58:24,950 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-11-28 22:58:24,950 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-11-28 22:58:24,950 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-11-28 22:58:24,950 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-11-28 22:58:24,950 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-11-28 22:58:24,950 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-11-28 22:58:24,950 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-11-28 22:58:24,950 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-11-28 22:58:24,950 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-11-28 22:58:24,950 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-11-28 22:58:24,951 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-11-28 22:58:24,951 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-11-28 22:58:24,951 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-11-28 22:58:24,951 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-11-28 22:58:24,951 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-11-28 22:58:24,951 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-11-28 22:58:24,951 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-11-28 22:58:24,951 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-11-28 22:58:24,951 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-11-28 22:58:24,952 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-11-28 22:58:24,952 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-11-28 22:58:24,952 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-11-28 22:58:24,952 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-11-28 22:58:24,952 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-11-28 22:58:24,952 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-11-28 22:58:24,952 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-11-28 22:58:24,952 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-11-28 22:58:24,952 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-11-28 22:58:24,952 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-11-28 22:58:24,952 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-11-28 22:58:24,952 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-11-28 22:58:24,953 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-11-28 22:58:24,953 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-11-28 22:58:24,953 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-11-28 22:58:24,953 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-11-28 22:58:24,953 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-11-28 22:58:24,953 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-11-28 22:58:24,953 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-11-28 22:58:24,953 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-11-28 22:58:24,953 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-11-28 22:58:24,953 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-11-28 22:58:24,953 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-11-28 22:58:24,954 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-11-28 22:58:24,954 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-11-28 22:58:24,954 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-11-28 22:58:24,954 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-11-28 22:58:24,954 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-11-28 22:58:24,954 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-11-28 22:58:24,954 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-11-28 22:58:24,954 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-11-28 22:58:24,954 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-11-28 22:58:25,062 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.005763774795025093); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.011844484241978358); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.005763774795025093); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=3.333333333333333E-4); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.004583333333333333); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-11-28 22:58:25,062 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-11-28 22:58:25,062 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=7.937964502371712E-4, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.005763774795025093); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.011844484241978358); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.005763774795025093); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=3.333333333333333E-4); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.004583333333333333); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-11-28 22:58:25,335 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 374 ms to try 5000 different iterations.  Found a solution that moves 278 regions; Going from a computed imbalance of 7.937964502371712E-4 to a new imbalance of 5.091161637968037E-5. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=4.994073055283275E-4); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.002010075630518424); MoveCostFunction : (multiplier=7.0, imbalance=0.03088888888888889, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=4.994073055283275E-4); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=4.166666666666667E-4); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-11-28 22:58:25,336 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv143131915:82 , srv149528166:83 , srv404485950:83 , srv669963573:83 , srv75161856:83 , srv998309069:83 , srv1009324943:84 , srv1015027905:84 , srv1050077095:84 , srv1098613360:84 , srv111560627:84 , srv1206224740:84 , srv1218483565:84 , srv122347778:84 , srv1311211410:84 , srv1336860288:84 , srv1388146748:84 , srv1560134722:84 , srv1717581245:84 , srv1725566751:84 , srv1741825471:84 , srv1753025013:84 , srv1779418163:84 , srv1968684918:84 , srv2000305611:84 , srv2035041794:84 , srv2039090355:84 , srv2057053144:84 , srv2063333663:84 , srv2095944288:84 , srv300408457:84 , srv327107346:84 , srv359080265:84 , srv426853090:84 , srv550257935:84 , srv563808794:84 , srv567610290:84 , srv634078591:84 , srv6905183:84 , srv879911:84 , srv891366372:84 , srv892300082:84 , srv935315719:84 , srv1112339471:85 , srv1118172049:85 , srv1123284436:85 , srv1172029163:85 , srv1174689267:85 , srv132324678:85 , srv1368103569:85 , srv142019527:85 , srv144575183:85 , srv1507590824:85 , srv1564149669:85 , srv1591325933:85 , srv1677703217:85 , srv1784908056:85 , srv1789621876:85 , srv1813944137:85 , srv1821193071:85 , srv1828306834:85 , srv1833724336:85 , srv1859614070:85 , srv1910348091:85 , srv1927696113:85 , srv1960762182:85 , srv1975164341:85 , srv1989588121:85 , srv2036095422:85 , srv2050377124:85 , srv2057156638:85 , srv2092491625:85 , srv2103421536:85 , srv21634164:85 , srv244463370:85 , srv249131939:85 , srv357515772:85 , srv395873994:85 , srv424476457:85 , srv431773673:85 , srv462004443:85 , srv545730180:85 , srv563774003:85 , srv567890808:85 , srv665819434:85 , srv714020564:85 , srv728113765:85 , srv729288353:85 , srv75631789:85 , srv778710730:85 , srv843976620:85 , srv891424277:85 , srv900853165:85 , srv901316497:85 , srv904872113:85 , srv94264785:85 , srv1483226535:86 , srv1931940723:86 , srv564352320:86 , srv1955248030:632 }
2023-11-28 22:58:25,340 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-11-28 22:58:25,341 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv892300082=93, srv1789621876=34, srv564352320=76, srv843976620=89, srv1968684918=45, srv1677703217=27, srv1483226535=21, srv431773673=70, srv2039090355=51, srv1753025013=31, srv1118172049=6, srv359080265=65, srv904872113=96, srv1828306834=37, srv395873994=66, srv75631789=87, srv778710730=88, srv1015027905=1, srv1821193071=36, srv1960762182=44, srv563808794=75, srv21634164=59, srv1098613360=3, srv2103421536=58, srv1388146748=17, srv1218483565=11, srv2050377124=52, srv714020564=83, srv462004443=71, srv2036095422=50, srv1779418163=32, srv2092491625=56, srv111560627=5, srv2000305611=48, srv1989588121=47, srv1172029163=8, srv1560134722=24, srv327107346=63, srv143131915=19, srv122347778=12, srv144575183=20, srv563774003=74, srv244463370=60, srv567610290=77, srv634078591=79, srv900853165=94, srv94264785=98, srv149528166=22, srv426853090=69, srv1368103569=16, srv1741825471=30, srv1206224740=10, srv879911=90, srv1784908056=33, srv1813944137=35, srv2057156638=54, srv357515772=64, srv545730180=72, srv665819434=80, srv1564149669=25, srv1859614070=39, srv404485950=67, srv1955248030=43, srv132324678=14, srv891366372=91, srv1931940723=42, srv729288353=85, srv75161856=86, srv935315719=97, srv2095944288=57, srv424476457=68, srv1927696113=41, srv901316497=95, srv1112339471=4, srv300408457=62, srv550257935=73, srv1725566751=29, srv1174689267=9, srv891424277=92, srv1717581245=28, srv567890808=78, srv728113765=84, srv6905183=82, srv1910348091=40, srv1336860288=15, srv1009324943=0, srv1123284436=7, srv1311211410=13, srv1507590824=23, srv1591325933=26, srv2063333663=55, srv1833724336=38, srv2035041794=49, srv249131939=61, srv1050077095=2, srv2057053144=53, srv142019527=18, srv1975164341=46, srv998309069=99, srv669963573=81} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-11-28 22:58:25,370 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-11-28 22:58:25,370 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-11-28 22:58:25,370 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-11-28 22:58:25,370 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-11-28 22:58:25,370 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-11-28 22:58:25,370 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-11-28 22:58:25,371 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-11-28 22:58:25,371 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-11-28 22:58:25,371 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-11-28 22:58:25,371 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-11-28 22:58:25,371 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-11-28 22:58:25,371 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-11-28 22:58:25,371 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-11-28 22:58:25,371 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-11-28 22:58:25,371 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-11-28 22:58:25,371 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-11-28 22:58:25,371 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-11-28 22:58:25,371 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-11-28 22:58:25,372 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-11-28 22:58:25,372 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-11-28 22:58:25,372 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-11-28 22:58:25,372 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-11-28 22:58:25,372 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-11-28 22:58:25,372 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-11-28 22:58:25,372 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-11-28 22:58:25,372 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-11-28 22:58:25,372 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-11-28 22:58:25,372 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-11-28 22:58:25,372 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-11-28 22:58:25,373 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-11-28 22:58:25,373 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-11-28 22:58:25,373 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-11-28 22:58:25,373 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-11-28 22:58:25,373 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-11-28 22:58:25,373 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-11-28 22:58:25,373 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-11-28 22:58:25,373 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-11-28 22:58:25,373 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-11-28 22:58:25,373 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-11-28 22:58:25,373 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-11-28 22:58:25,374 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-11-28 22:58:25,374 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-11-28 22:58:25,374 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-11-28 22:58:25,374 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-11-28 22:58:25,374 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-11-28 22:58:25,374 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-11-28 22:58:25,374 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-11-28 22:58:25,374 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-11-28 22:58:25,374 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-11-28 22:58:25,374 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-11-28 22:58:25,374 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-11-28 22:58:25,375 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-11-28 22:58:25,375 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-11-28 22:58:25,375 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-11-28 22:58:25,375 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-11-28 22:58:25,375 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-11-28 22:58:25,375 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-11-28 22:58:25,375 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-11-28 22:58:25,375 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-11-28 22:58:25,375 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-11-28 22:58:25,375 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-11-28 22:58:25,375 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-11-28 22:58:25,375 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-11-28 22:58:25,376 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-11-28 22:58:25,376 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-11-28 22:58:25,376 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-11-28 22:58:25,376 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-11-28 22:58:25,376 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-11-28 22:58:25,376 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-11-28 22:58:25,384 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-11-28 22:58:25,384 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-11-28 22:58:25,384 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-11-28 22:58:25,385 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-11-28 22:58:25,385 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-11-28 22:58:25,385 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-11-28 22:58:25,385 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-11-28 22:58:25,385 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-11-28 22:58:25,385 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-11-28 22:58:25,385 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-11-28 22:58:25,385 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-11-28 22:58:25,385 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-11-28 22:58:25,385 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-11-28 22:58:25,386 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-11-28 22:58:25,386 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-11-28 22:58:25,386 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-11-28 22:58:25,386 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-11-28 22:58:25,386 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-11-28 22:58:25,386 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-11-28 22:58:25,386 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-11-28 22:58:25,386 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-11-28 22:58:25,386 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-11-28 22:58:25,386 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-11-28 22:58:25,386 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-11-28 22:58:25,387 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-11-28 22:58:25,387 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-11-28 22:58:25,387 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-11-28 22:58:25,387 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-11-28 22:58:25,387 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-11-28 22:58:25,387 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-11-28 22:58:25,387 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-11-28 22:58:25,387 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-11-28 22:58:25,515 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=4.994073055283275E-4); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.002010075630518424); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=4.994073055283275E-4); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=4.166666666666667E-4); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-11-28 22:58:25,515 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-11-28 22:58:25,516 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=4.8965018774215495E-5, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=4.994073055283275E-4); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.002010075630518424); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=4.994073055283275E-4); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=4.166666666666667E-4); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-11-28 22:58:25,757 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 359 ms to try 5000 different iterations.  Found a solution that moves 32 regions; Going from a computed imbalance of 4.8965018774215495E-5 to a new imbalance of 7.297308085447707E-6. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0015713484026367722); MoveCostFunction : (multiplier=7.0, imbalance=0.0035555555555555557); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-11-28 22:58:25,758 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1483226535:83 , srv1591325933:83 , srv1927696113:83 , srv1931940723:83 , srv2036095422:83 , srv2095944288:83 , srv564352320:83 , srv567890808:83 , srv6905183:83 , srv900853165:83 , srv1009324943:84 , srv1015027905:84 , srv1050077095:84 , srv1112339471:84 , srv111560627:84 , srv1118172049:84 , srv1123284436:84 , srv1172029163:84 , srv1174689267:84 , srv1218483565:84 , srv122347778:84 , srv1311211410:84 , srv132324678:84 , srv1336860288:84 , srv1368103569:84 , srv1388146748:84 , srv142019527:84 , srv144575183:84 , srv149528166:84 , srv1507590824:84 , srv1560134722:84 , srv1564149669:84 , srv1677703217:84 , srv1717581245:84 , srv1725566751:84 , srv1741825471:84 , srv1753025013:84 , srv1779418163:84 , srv1784908056:84 , srv1789621876:84 , srv1813944137:84 , srv1821193071:84 , srv1828306834:84 , srv1833724336:84 , srv1859614070:84 , srv1910348091:84 , srv1960762182:84 , srv1968684918:84 , srv1975164341:84 , srv1989588121:84 , srv2000305611:84 , srv2035041794:84 , srv2039090355:84 , srv2050377124:84 , srv2057053144:84 , srv2057156638:84 , srv2092491625:84 , srv2103421536:84 , srv21634164:84 , srv244463370:84 , srv249131939:84 , srv300408457:84 , srv357515772:84 , srv359080265:84 , srv395873994:84 , srv424476457:84 , srv426853090:84 , srv431773673:84 , srv462004443:84 , srv545730180:84 , srv550257935:84 , srv563774003:84 , srv567610290:84 , srv665819434:84 , srv669963573:84 , srv714020564:84 , srv728113765:84 , srv729288353:84 , srv75161856:84 , srv75631789:84 , srv778710730:84 , srv843976620:84 , srv879911:84 , srv891366372:84 , srv891424277:84 , srv892300082:84 , srv901316497:84 , srv904872113:84 , srv935315719:84 , srv94264785:84 , srv1098613360:85 , srv1206224740:85 , srv143131915:85 , srv2063333663:85 , srv327107346:85 , srv404485950:85 , srv563808794:85 , srv634078591:85 , srv998309069:85 , srv1955248030:685 }
2023-11-28 22:58:25,764 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-11-28 22:58:25,765 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv892300082=93, srv1789621876=34, srv564352320=76, srv843976620=89, srv1968684918=45, srv1677703217=27, srv1483226535=21, srv431773673=70, srv2039090355=51, srv1753025013=31, srv1118172049=6, srv359080265=65, srv904872113=96, srv1828306834=37, srv395873994=66, srv75631789=87, srv778710730=88, srv1015027905=1, srv1821193071=36, srv1960762182=44, srv563808794=75, srv21634164=59, srv1098613360=3, srv2103421536=58, srv1388146748=17, srv1218483565=11, srv2050377124=52, srv714020564=83, srv462004443=71, srv2036095422=50, srv1779418163=32, srv2092491625=56, srv111560627=5, srv2000305611=48, srv1989588121=47, srv1172029163=8, srv1560134722=24, srv327107346=63, srv143131915=19, srv122347778=12, srv144575183=20, srv563774003=74, srv244463370=60, srv567610290=77, srv634078591=79, srv900853165=94, srv94264785=98, srv149528166=22, srv426853090=69, srv1368103569=16, srv1741825471=30, srv1206224740=10, srv879911=90, srv1784908056=33, srv1813944137=35, srv2057156638=54, srv357515772=64, srv545730180=72, srv665819434=80, srv1564149669=25, srv1859614070=39, srv404485950=67, srv1955248030=43, srv132324678=14, srv891366372=91, srv1931940723=42, srv729288353=85, srv75161856=86, srv935315719=97, srv2095944288=57, srv424476457=68, srv1927696113=41, srv901316497=95, srv1112339471=4, srv300408457=62, srv550257935=73, srv1725566751=29, srv1174689267=9, srv891424277=92, srv1717581245=28, srv567890808=78, srv728113765=84, srv6905183=82, srv1910348091=40, srv1336860288=15, srv1009324943=0, srv1123284436=7, srv1311211410=13, srv1507590824=23, srv1591325933=26, srv2063333663=55, srv1833724336=38, srv2035041794=49, srv249131939=61, srv1050077095=2, srv2057053144=53, srv142019527=18, srv1975164341=46, srv998309069=99, srv669963573=81} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-11-28 22:58:25,785 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-11-28 22:58:25,785 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-11-28 22:58:25,785 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-11-28 22:58:25,785 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-11-28 22:58:25,786 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-11-28 22:58:25,786 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-11-28 22:58:25,786 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-11-28 22:58:25,786 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-11-28 22:58:25,786 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-11-28 22:58:25,786 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-11-28 22:58:25,786 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-11-28 22:58:25,786 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-11-28 22:58:25,786 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-11-28 22:58:25,786 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-11-28 22:58:25,786 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-11-28 22:58:25,786 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-11-28 22:58:25,786 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-11-28 22:58:25,787 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-11-28 22:58:25,787 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-11-28 22:58:25,787 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-11-28 22:58:25,787 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-11-28 22:58:25,787 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-11-28 22:58:25,787 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-11-28 22:58:25,787 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-11-28 22:58:25,787 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-11-28 22:58:25,787 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-11-28 22:58:25,787 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-11-28 22:58:25,787 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-11-28 22:58:25,787 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-11-28 22:58:25,787 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-11-28 22:58:25,787 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-11-28 22:58:25,787 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-11-28 22:58:25,787 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-11-28 22:58:25,787 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-11-28 22:58:25,787 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-11-28 22:58:25,787 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-11-28 22:58:25,787 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-11-28 22:58:25,787 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-11-28 22:58:25,787 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-11-28 22:58:25,788 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-11-28 22:58:25,788 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-11-28 22:58:25,788 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-11-28 22:58:25,788 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-11-28 22:58:25,788 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-11-28 22:58:25,788 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-11-28 22:58:25,788 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-11-28 22:58:25,788 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-11-28 22:58:25,788 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-11-28 22:58:25,788 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-11-28 22:58:25,788 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-11-28 22:58:25,788 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-11-28 22:58:25,788 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-11-28 22:58:25,788 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-11-28 22:58:25,788 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-11-28 22:58:25,788 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-11-28 22:58:25,788 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-11-28 22:58:25,788 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-11-28 22:58:25,788 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-11-28 22:58:25,788 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-11-28 22:58:25,788 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-11-28 22:58:25,788 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-11-28 22:58:25,788 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-11-28 22:58:25,789 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-11-28 22:58:25,789 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-11-28 22:58:25,789 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-11-28 22:58:25,789 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-11-28 22:58:25,789 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-11-28 22:58:25,789 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-11-28 22:58:25,789 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-11-28 22:58:25,789 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-11-28 22:58:25,789 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-11-28 22:58:25,789 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-11-28 22:58:25,789 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-11-28 22:58:25,789 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-11-28 22:58:25,789 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-11-28 22:58:25,789 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-11-28 22:58:25,789 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-11-28 22:58:25,789 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-11-28 22:58:25,789 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-11-28 22:58:25,789 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-11-28 22:58:25,789 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-11-28 22:58:25,789 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-11-28 22:58:25,789 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-11-28 22:58:25,789 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-11-28 22:58:25,789 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-11-28 22:58:25,790 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-11-28 22:58:25,790 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-11-28 22:58:25,790 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-11-28 22:58:25,790 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-11-28 22:58:25,790 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-11-28 22:58:25,790 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-11-28 22:58:25,790 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-11-28 22:58:25,790 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-11-28 22:58:25,790 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-11-28 22:58:25,790 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-11-28 22:58:25,790 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-11-28 22:58:25,790 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-11-28 22:58:25,790 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-11-28 22:58:25,790 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-11-28 22:58:25,790 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-11-28 22:58:25,790 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-11-28 22:58:25,886 INFO  [Time-limited test] balancer.StochasticLoadBalancer(381): Cluster wide - skipping load balancing because weighted average imbalance=7.073239296329447E-6 <= threshold(0.025). If you want more aggressive balancing, either lower hbase.master.balancer.stochastic.minCostNeedBalance from 0.025 or increase the relative multiplier(s) of the specific cost function(s). functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0015713484026367722); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-11-28 22:58:25,886 INFO  [Time-limited test] balancer.BalancerTestBase(570): Mock Final balance: { srv1483226535:83 , srv1591325933:83 , srv1927696113:83 , srv1931940723:83 , srv2036095422:83 , srv2095944288:83 , srv564352320:83 , srv567890808:83 , srv6905183:83 , srv900853165:83 , srv1009324943:84 , srv1015027905:84 , srv1050077095:84 , srv1112339471:84 , srv111560627:84 , srv1118172049:84 , srv1123284436:84 , srv1172029163:84 , srv1174689267:84 , srv1218483565:84 , srv122347778:84 , srv1311211410:84 , srv132324678:84 , srv1336860288:84 , srv1368103569:84 , srv1388146748:84 , srv142019527:84 , srv144575183:84 , srv149528166:84 , srv1507590824:84 , srv1560134722:84 , srv1564149669:84 , srv1677703217:84 , srv1717581245:84 , srv1725566751:84 , srv1741825471:84 , srv1753025013:84 , srv1779418163:84 , srv1784908056:84 , srv1789621876:84 , srv1813944137:84 , srv1821193071:84 , srv1828306834:84 , srv1833724336:84 , srv1859614070:84 , srv1910348091:84 , srv1960762182:84 , srv1968684918:84 , srv1975164341:84 , srv1989588121:84 , srv2000305611:84 , srv2035041794:84 , srv2039090355:84 , srv2050377124:84 , srv2057053144:84 , srv2057156638:84 , srv2092491625:84 , srv2103421536:84 , srv21634164:84 , srv244463370:84 , srv249131939:84 , srv300408457:84 , srv357515772:84 , srv359080265:84 , srv395873994:84 , srv424476457:84 , srv426853090:84 , srv431773673:84 , srv462004443:84 , srv545730180:84 , srv550257935:84 , srv563774003:84 , srv567610290:84 , srv665819434:84 , srv669963573:84 , srv714020564:84 , srv728113765:84 , srv729288353:84 , srv75161856:84 , srv75631789:84 , srv778710730:84 , srv843976620:84 , srv879911:84 , srv891366372:84 , srv891424277:84 , srv892300082:84 , srv901316497:84 , srv904872113:84 , srv935315719:84 , srv94264785:84 , srv1098613360:85 , srv1206224740:85 , srv143131915:85 , srv2063333663:85 , srv327107346:85 , srv404485950:85 , srv563808794:85 , srv634078591:85 , srv998309069:85 , srv1955248030:685 }
2023-11-28 22:58:25,913 INFO  [Time-limited test] hbase.ResourceChecker(175): after: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnLargeClusterWithRacks Thread=12 (was 12), OpenFileDescriptor=290 (was 290), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=393 (was 322) - SystemLoadAverage LEAK? -, ProcessCount=166 (was 166), AvailableMemoryMB=8059 (was 8552)
2023-11-28 22:58:25,920 INFO  [Time-limited test] hbase.ResourceChecker(147): before: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnMidClusterWithRacks Thread=12, OpenFileDescriptor=290, MaxFileDescriptor=60000, SystemLoadAverage=393, ProcessCount=166, AvailableMemoryMB=8059
2023-11-28 22:58:25,920 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2023-11-28 22:58:25,921 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=5000, runMaxSteps=true, stepsPerRegion=800, maxRunningTime=120000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 111077.0 etc.
2023-11-28 22:58:25,933 INFO  [Time-limited test] balancer.BalancerTestBase(547): Mock Cluster : { srv100151337:84 , srv1013921767:84 , srv1023256664:84 , srv1250555624:84 , srv1361889279:84 , srv136485135:84 , srv1399133553:84 , srv1548986273:84 , srv1663391592:84 , srv1727399141:84 , srv1827685891:84 , srv1889656516:84 , srv1892494845:84 , srv2101443504:84 , srv2122394475:84 , srv286086717:84 , srv305368850:84 , srv474305407:84 , srv478317990:84 , srv581849157:84 , srv590799527:84 , srv632057707:84 , srv637030929:84 , srv664840503:84 , srv6682617:84 , srv769414771:84 , srv78065519:84 , srv918115946:84 , srv984108567:84 , srv1247451297:264 } [srvr=30 rgns=2700 avg=90.0 max=90 min=90]
2023-11-28 22:58:25,935 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-11-28 22:58:25,935 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv305368850=17, srv769414771=26, srv1663391592=9, srv632057707=22, srv1727399141=10, srv1827685891=11, srv286086717=16, srv581849157=20, srv2101443504=14, srv136485135=6, srv918115946=28, srv1889656516=12, srv664840503=24, srv78065519=27, srv637030929=23, srv1247451297=3, srv100151337=0, srv1013921767=1, srv478317990=19, srv1399133553=7, srv984108567=29, srv590799527=21, srv1023256664=2, srv1361889279=5, srv6682617=25, srv2122394475=15, srv474305407=18, srv1250555624=4, srv1892494845=13, srv1548986273=8} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-11-28 22:58:25,948 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-11-28 22:58:25,948 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-11-28 22:58:25,948 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-11-28 22:58:25,948 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-11-28 22:58:25,948 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-11-28 22:58:25,948 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-11-28 22:58:25,948 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-11-28 22:58:25,948 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-11-28 22:58:25,949 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-11-28 22:58:25,949 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-11-28 22:58:25,949 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-11-28 22:58:25,949 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-11-28 22:58:25,949 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-11-28 22:58:25,949 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-11-28 22:58:25,949 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-11-28 22:58:25,949 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-11-28 22:58:25,949 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-11-28 22:58:25,949 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-11-28 22:58:25,949 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-11-28 22:58:25,949 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-11-28 22:58:25,950 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-11-28 22:58:25,950 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-11-28 22:58:25,950 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-11-28 22:58:25,950 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-11-28 22:58:25,950 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-11-28 22:58:25,950 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-11-28 22:58:25,950 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-11-28 22:58:25,950 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-11-28 22:58:25,950 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-11-28 22:58:25,950 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-11-28 22:58:25,950 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=10, number of hosts=30, number of racks=4
2023-11-28 22:58:25,976 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=1.1454915639644507, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-11-28 22:58:25,976 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.9912651482431595, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=1.1454915639644507, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=64800000
2023-11-28 23:00:25,955 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 120001 ms to try 9636331 different iterations.  Found a solution that moves 1840 regions; Going from a computed imbalance of 0.9912651482431595 to a new imbalance of 4.2946517914333035E-5. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); MoveCostFunction : (multiplier=7.0, imbalance=0.6814814814814815, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-11-28 23:00:25,960 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv100151337:90 , srv1013921767:90 , srv1023256664:90 , srv1247451297:90 , srv1250555624:90 , srv1361889279:90 , srv136485135:90 , srv1399133553:90 , srv1548986273:90 , srv1663391592:90 , srv1727399141:90 , srv1827685891:90 , srv1889656516:90 , srv1892494845:90 , srv2101443504:90 , srv2122394475:90 , srv286086717:90 , srv305368850:90 , srv474305407:90 , srv478317990:90 , srv581849157:90 , srv590799527:90 , srv632057707:90 , srv637030929:90 , srv664840503:90 , srv6682617:90 , srv769414771:90 , srv78065519:90 , srv918115946:90 , srv984108567:90 }
2023-11-28 23:00:25,961 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-11-28 23:00:25,962 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv305368850=17, srv769414771=26, srv1663391592=9, srv632057707=22, srv1727399141=10, srv1827685891=11, srv286086717=16, srv581849157=20, srv2101443504=14, srv136485135=6, srv918115946=28, srv1889656516=12, srv664840503=24, srv78065519=27, srv637030929=23, srv1247451297=3, srv100151337=0, srv1013921767=1, srv478317990=19, srv1399133553=7, srv984108567=29, srv590799527=21, srv1023256664=2, srv1361889279=5, srv6682617=25, srv2122394475=15, srv474305407=18, srv1250555624=4, srv1892494845=13, srv1548986273=8} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-11-28 23:00:25,964 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-11-28 23:00:25,964 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-11-28 23:00:25,964 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-11-28 23:00:25,964 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-11-28 23:00:25,964 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-11-28 23:00:25,965 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-11-28 23:00:25,965 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-11-28 23:00:25,965 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-11-28 23:00:25,965 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-11-28 23:00:25,965 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-11-28 23:00:25,965 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-11-28 23:00:25,965 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-11-28 23:00:25,965 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-11-28 23:00:25,965 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-11-28 23:00:25,965 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-11-28 23:00:25,965 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-11-28 23:00:25,965 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-11-28 23:00:25,965 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-11-28 23:00:25,965 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-11-28 23:00:25,965 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-11-28 23:00:25,965 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-11-28 23:00:25,965 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-11-28 23:00:25,965 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-11-28 23:00:25,965 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-11-28 23:00:25,965 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-11-28 23:00:25,965 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-11-28 23:00:25,965 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-11-28 23:00:25,965 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-11-28 23:00:25,965 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-11-28 23:00:25,965 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-11-28 23:00:25,966 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=10, number of hosts=30, number of racks=4
2023-11-28 23:00:25,974 INFO  [Time-limited test] balancer.StochasticLoadBalancer(381): Cluster wide - skipping load balancing because weighted average imbalance=0.0 <= threshold(0.025). If you want more aggressive balancing, either lower hbase.master.balancer.stochastic.minCostNeedBalance from 0.025 or increase the relative multiplier(s) of the specific cost function(s). functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-11-28 23:00:25,975 INFO  [Time-limited test] balancer.BalancerTestBase(570): Mock Final balance: { srv100151337:90 , srv1013921767:90 , srv1023256664:90 , srv1247451297:90 , srv1250555624:90 , srv1361889279:90 , srv136485135:90 , srv1399133553:90 , srv1548986273:90 , srv1663391592:90 , srv1727399141:90 , srv1827685891:90 , srv1889656516:90 , srv1892494845:90 , srv2101443504:90 , srv2122394475:90 , srv286086717:90 , srv305368850:90 , srv474305407:90 , srv478317990:90 , srv581849157:90 , srv590799527:90 , srv632057707:90 , srv637030929:90 , srv664840503:90 , srv6682617:90 , srv769414771:90 , srv78065519:90 , srv918115946:90 , srv984108567:90 }
2023-11-28 23:00:25,985 INFO  [Time-limited test] hbase.ResourceChecker(175): after: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnMidClusterWithRacks Thread=11 (was 12), OpenFileDescriptor=290 (was 290), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=172 (was 393), ProcessCount=164 (was 166), AvailableMemoryMB=9256 (was 8059) - AvailableMemoryMB LEAK? -