2023-03-09 02:54:15,972 INFO  [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks timeout: 13 mins
2023-03-09 02:54:16,291 WARN  [Time-limited test] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties
2023-03-09 02:54:16,399 INFO  [Time-limited test] metrics.MetricRegistriesLoader(60): Loaded MetricRegistries class org.apache.hadoop.hbase.metrics.impl.MetricRegistriesImpl
2023-03-09 02:54:16,460 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2023-03-09 02:54:16,467 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc.
2023-03-09 02:54:16,480 INFO  [Time-limited test] hbase.ResourceChecker(147): before: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnLargeClusterWithRacks Thread=10, OpenFileDescriptor=260, MaxFileDescriptor=60000, SystemLoadAverage=229, ProcessCount=170, AvailableMemoryMB=8664
2023-03-09 02:54:16,482 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2023-03-09 02:54:16,483 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=5000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=10000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc.
2023-03-09 02:54:16,598 INFO  [Time-limited test] balancer.BalancerTestBase(547): Mock Cluster : { srv1065384999:84 , srv1086895547:84 , srv1097393055:84 , srv1113261741:84 , srv1120228803:84 , srv1139713341:84 , srv1196928609:84 , srv1208341365:84 , srv1237550018:84 , srv1245725080:84 , srv1260709075:84 , srv1308032390:84 , srv1338570410:84 , srv1385550112:84 , srv1396530796:84 , srv1403592511:84 , srv1419914714:84 , srv1434804939:84 , srv1475924226:84 , srv1475924294:84 , srv1479784923:84 , srv1494852839:84 , srv1507061149:84 , srv1528887026:84 , srv1535812545:84 , srv1618167815:84 , srv1620988909:84 , srv163564562:84 , srv1638336985:84 , srv1707163072:84 , srv1730746937:84 , srv1731488730:84 , srv1748573312:84 , srv1750502382:84 , srv175549774:84 , srv1774692784:84 , srv1782321795:84 , srv1822888274:84 , srv1847500203:84 , srv1851191636:84 , srv186693342:84 , srv1881717793:84 , srv1881766413:84 , srv1932285388:84 , srv1932311606:84 , srv1935781753:84 , srv19568506:84 , srv1964206291:84 , srv2036987720:84 , srv2126030071:84 , srv2129321447:84 , srv2131762973:84 , srv249750495:84 , srv273685937:84 , srv277635583:84 , srv283443678:84 , srv304380689:84 , srv360403099:84 , srv376058526:84 , srv397794243:84 , srv41016420:84 , srv419168885:84 , srv445256740:84 , srv453647957:84 , srv466525365:84 , srv469938811:84 , srv487033530:84 , srv502461941:84 , srv518441575:84 , srv53874893:84 , srv587084973:84 , srv618926517:84 , srv631643299:84 , srv645583976:84 , srv645944183:84 , srv671657405:84 , srv674475007:84 , srv695338135:84 , srv696411608:84 , srv696779422:84 , srv715179852:84 , srv728575001:84 , srv7987622:84 , srv804818020:84 , srv813575300:84 , srv819554017:84 , srv848100288:84 , srv862994250:84 , srv863020154:84 , srv882041561:84 , srv883013909:84 , srv886558675:84 , srv89016197:84 , srv895477553:84 , srv911759818:84 , srv9215639:84 , srv928124675:84 , srv957416749:84 , srv975649873:84 , srv1125095527:684 } [srvr=100 rgns=9000 avg=90.0 max=90 min=90]
2023-03-09 02:54:16,606 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-03-09 02:54:16,612 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv453647957=64, srv883013909=91, srv1881717793=42, srv1494852839=22, srv1237550018=9, srv277635583=55, srv53874893=70, srv863020154=89, srv1475924294=20, srv1774692784=36, srv1338570410=13, srv175549774=35, srv804818020=84, srv695338135=78, srv895477553=94, srv957416749=98, srv886558675=92, srv848100288=87, srv1260709075=11, srv7987622=83, srv1097393055=2, srv2036987720=49, srv2126030071=50, srv645583976=74, srv645944183=75, srv1707163072=30, srv376058526=59, srv696411608=79, srv163564562=28, srv1730746937=31, srv1419914714=17, srv1782321795=37, srv618926517=72, srv360403099=58, srv1528887026=24, srv518441575=69, srv911759818=95, srv502461941=68, srv249750495=53, srv466525365=65, srv1385550112=14, srv1638336985=29, srv696779422=80, srv186693342=41, srv487033530=67, srv283443678=56, srv1403592511=16, srv813575300=85, srv587084973=71, srv728575001=82, srv1113261741=3, srv1120228803=4, srv1196928609=7, srv1847500203=39, srv1308032390=12, srv9215639=96, srv631643299=73, srv1507061149=23, srv469938811=66, srv419168885=62, srv1932311606=45, srv1851191636=40, srv975649873=99, srv1086895547=1, srv1125095527=5, srv1479784923=21, srv1396530796=15, srv1731488730=32, srv1618167815=26, srv1245725080=10, srv1964206291=48, srv273685937=54, srv2129321447=51, srv1139713341=6, srv1065384999=0, srv2131762973=52, srv445256740=63, srv1535812545=25, srv819554017=86, srv397794243=60, srv1748573312=33, srv41016420=61, srv674475007=77, srv671657405=76, srv715179852=81, srv1750502382=34, srv1935781753=46, srv304380689=57, srv1434804939=18, srv19568506=47, srv928124675=97, srv1932285388=44, srv89016197=93, srv1475924226=19, srv1822888274=38, srv882041561=90, srv862994250=88, srv1620988909=27, srv1208341365=8, srv1881766413=43} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-03-09 02:54:16,705 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-03-09 02:54:16,706 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-03-09 02:54:16,706 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-03-09 02:54:16,706 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-03-09 02:54:16,706 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-03-09 02:54:16,707 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-03-09 02:54:16,707 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-03-09 02:54:16,707 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-03-09 02:54:16,707 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-03-09 02:54:16,707 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-03-09 02:54:16,707 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-03-09 02:54:16,708 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-03-09 02:54:16,708 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-03-09 02:54:16,708 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-03-09 02:54:16,708 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-03-09 02:54:16,708 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-03-09 02:54:16,708 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-03-09 02:54:16,709 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-03-09 02:54:16,709 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-03-09 02:54:16,709 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-03-09 02:54:16,709 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-03-09 02:54:16,709 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-03-09 02:54:16,709 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-03-09 02:54:16,710 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-03-09 02:54:16,710 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-03-09 02:54:16,710 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-03-09 02:54:16,710 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-03-09 02:54:16,710 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-03-09 02:54:16,710 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-03-09 02:54:16,711 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-03-09 02:54:16,711 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-03-09 02:54:16,711 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-03-09 02:54:16,711 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-03-09 02:54:16,711 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-03-09 02:54:16,711 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-03-09 02:54:16,711 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-03-09 02:54:16,712 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-03-09 02:54:16,712 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-03-09 02:54:16,712 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-03-09 02:54:16,712 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-03-09 02:54:16,712 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-03-09 02:54:16,712 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-03-09 02:54:16,713 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-03-09 02:54:16,713 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-03-09 02:54:16,713 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-03-09 02:54:16,713 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-03-09 02:54:16,713 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-03-09 02:54:16,713 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-03-09 02:54:16,713 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-03-09 02:54:16,714 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-03-09 02:54:16,714 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-03-09 02:54:16,714 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-03-09 02:54:16,714 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-03-09 02:54:16,714 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-03-09 02:54:16,714 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-03-09 02:54:16,715 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-03-09 02:54:16,715 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-03-09 02:54:16,715 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-03-09 02:54:16,715 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-03-09 02:54:16,715 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-03-09 02:54:16,715 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-03-09 02:54:16,715 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-03-09 02:54:16,716 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-03-09 02:54:16,716 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-03-09 02:54:16,716 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-03-09 02:54:16,716 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-03-09 02:54:16,716 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-03-09 02:54:16,716 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-03-09 02:54:16,716 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-03-09 02:54:16,716 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-03-09 02:54:16,716 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-03-09 02:54:16,716 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-03-09 02:54:16,717 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-03-09 02:54:16,717 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-03-09 02:54:16,717 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-03-09 02:54:16,717 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-03-09 02:54:16,717 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-03-09 02:54:16,717 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-03-09 02:54:16,717 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-03-09 02:54:16,717 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-03-09 02:54:16,717 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-03-09 02:54:16,717 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-03-09 02:54:16,717 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-03-09 02:54:16,717 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-03-09 02:54:16,718 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-03-09 02:54:16,718 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-03-09 02:54:16,718 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-03-09 02:54:16,718 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-03-09 02:54:16,718 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-03-09 02:54:16,718 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-03-09 02:54:16,718 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-03-09 02:54:16,718 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-03-09 02:54:16,718 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-03-09 02:54:16,718 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-03-09 02:54:16,718 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-03-09 02:54:16,718 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-03-09 02:54:16,718 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-03-09 02:54:16,719 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-03-09 02:54:16,719 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-03-09 02:54:16,719 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-03-09 02:54:16,719 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-03-09 02:54:16,890 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.06666666666666667, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-03-09 02:54:16,890 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-03-09 02:54:16,890 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.9909252140407105, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.06666666666666667, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-03-09 02:54:17,197 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 454 ms to try 5000 different iterations.  Found a solution that moves 4698 regions; Going from a computed imbalance of 0.9909252140407105 to a new imbalance of 0.17740155482776726. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.03865973853331489, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.05012442431048871, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.522, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.03865973853331489, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.17216666666666666, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.24391666666666667, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-03-09 02:54:17,216 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1308032390:80 , srv1396530796:81 , srv1528887026:81 , srv1730746937:81 , srv1475924294:82 , srv862994250:82 , srv1208341365:83 , srv1475924226:83 , srv1851191636:83 , srv1881717793:83 , srv19568506:83 , srv2126030071:83 , srv283443678:83 , srv53874893:83 , srv618926517:83 , srv696411608:83 , srv1065384999:84 , srv163564562:84 , srv1750502382:84 , srv2129321447:84 , srv273685937:84 , srv397794243:84 , srv696779422:84 , srv1097393055:85 , srv1113261741:85 , srv1237550018:85 , srv1385550112:85 , srv1535812545:85 , srv1618167815:85 , srv1620988909:85 , srv1707163072:85 , srv1731488730:85 , srv1847500203:85 , srv186693342:85 , srv1935781753:85 , srv2036987720:85 , srv277635583:85 , srv360403099:85 , srv674475007:85 , srv728575001:85 , srv804818020:85 , srv848100288:85 , srv886558675:85 , srv1196928609:86 , srv1419914714:86 , srv1479784923:86 , srv1507061149:86 , srv175549774:86 , srv1822888274:86 , srv453647957:86 , srv587084973:86 , srv645944183:86 , srv813575300:86 , srv89016197:86 , srv928124675:86 , srv1120228803:87 , srv1139713341:87 , srv1245725080:87 , srv1494852839:87 , srv1748573312:87 , srv1774692784:87 , srv1932311606:87 , srv2131762973:87 , srv445256740:87 , srv469938811:87 , srv518441575:87 , srv671657405:87 , srv975649873:87 , srv1260709075:88 , srv1434804939:88 , srv1881766413:88 , srv419168885:88 , srv645583976:88 , srv695338135:88 , srv819554017:88 , srv895477553:88 , srv9215639:88 , srv1403592511:89 , srv1964206291:89 , srv502461941:89 , srv957416749:89 , srv1338570410:90 , srv249750495:90 , srv376058526:90 , srv7987622:90 , srv882041561:90 , srv883013909:90 , srv911759818:90 , srv41016420:91 , srv466525365:91 , srv631643299:91 , srv715179852:91 , srv1782321795:92 , srv304380689:92 , srv863020154:92 , srv1932285388:93 , srv1638336985:95 , srv487033530:95 , srv1086895547:98 , srv1125095527:433 }
2023-03-09 02:54:17,222 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-03-09 02:54:17,224 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv453647957=64, srv883013909=91, srv1881717793=42, srv1494852839=22, srv1237550018=9, srv277635583=55, srv53874893=70, srv863020154=89, srv1475924294=20, srv1774692784=36, srv1338570410=13, srv175549774=35, srv804818020=84, srv695338135=78, srv895477553=94, srv957416749=98, srv886558675=92, srv848100288=87, srv1260709075=11, srv7987622=83, srv1097393055=2, srv2036987720=49, srv2126030071=50, srv645583976=74, srv645944183=75, srv1707163072=30, srv376058526=59, srv696411608=79, srv163564562=28, srv1730746937=31, srv1419914714=17, srv1782321795=37, srv618926517=72, srv360403099=58, srv1528887026=24, srv518441575=69, srv911759818=95, srv502461941=68, srv249750495=53, srv466525365=65, srv1385550112=14, srv1638336985=29, srv696779422=80, srv186693342=41, srv487033530=67, srv283443678=56, srv1403592511=16, srv813575300=85, srv587084973=71, srv728575001=82, srv1113261741=3, srv1120228803=4, srv1196928609=7, srv1847500203=39, srv1308032390=12, srv9215639=96, srv631643299=73, srv1507061149=23, srv469938811=66, srv419168885=62, srv1932311606=45, srv1851191636=40, srv975649873=99, srv1086895547=1, srv1125095527=5, srv1479784923=21, srv1396530796=15, srv1731488730=32, srv1618167815=26, srv1245725080=10, srv1964206291=48, srv273685937=54, srv2129321447=51, srv1139713341=6, srv1065384999=0, srv2131762973=52, srv445256740=63, srv1535812545=25, srv819554017=86, srv397794243=60, srv1748573312=33, srv41016420=61, srv674475007=77, srv671657405=76, srv715179852=81, srv1750502382=34, srv1935781753=46, srv304380689=57, srv1434804939=18, srv19568506=47, srv928124675=97, srv1932285388=44, srv89016197=93, srv1475924226=19, srv1822888274=38, srv882041561=90, srv862994250=88, srv1620988909=27, srv1208341365=8, srv1881766413=43} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-03-09 02:54:17,245 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-03-09 02:54:17,245 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-03-09 02:54:17,245 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-03-09 02:54:17,245 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-03-09 02:54:17,245 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-03-09 02:54:17,246 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-03-09 02:54:17,246 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-03-09 02:54:17,246 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-03-09 02:54:17,246 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-03-09 02:54:17,246 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-03-09 02:54:17,246 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-03-09 02:54:17,246 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-03-09 02:54:17,246 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-03-09 02:54:17,247 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-03-09 02:54:17,247 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-03-09 02:54:17,247 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-03-09 02:54:17,247 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-03-09 02:54:17,247 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-03-09 02:54:17,247 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-03-09 02:54:17,247 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-03-09 02:54:17,247 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-03-09 02:54:17,247 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-03-09 02:54:17,247 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-03-09 02:54:17,248 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-03-09 02:54:17,248 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-03-09 02:54:17,248 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-03-09 02:54:17,248 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-03-09 02:54:17,248 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-03-09 02:54:17,248 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-03-09 02:54:17,248 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-03-09 02:54:17,248 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-03-09 02:54:17,248 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-03-09 02:54:17,249 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-03-09 02:54:17,249 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-03-09 02:54:17,249 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-03-09 02:54:17,249 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-03-09 02:54:17,249 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-03-09 02:54:17,249 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-03-09 02:54:17,249 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-03-09 02:54:17,249 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-03-09 02:54:17,249 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-03-09 02:54:17,249 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-03-09 02:54:17,250 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-03-09 02:54:17,250 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-03-09 02:54:17,250 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-03-09 02:54:17,250 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-03-09 02:54:17,250 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-03-09 02:54:17,250 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-03-09 02:54:17,250 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-03-09 02:54:17,250 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-03-09 02:54:17,250 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-03-09 02:54:17,250 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-03-09 02:54:17,251 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-03-09 02:54:17,251 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-03-09 02:54:17,251 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-03-09 02:54:17,251 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-03-09 02:54:17,251 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-03-09 02:54:17,251 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-03-09 02:54:17,251 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-03-09 02:54:17,251 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-03-09 02:54:17,251 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-03-09 02:54:17,252 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-03-09 02:54:17,252 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-03-09 02:54:17,252 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-03-09 02:54:17,252 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-03-09 02:54:17,252 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-03-09 02:54:17,252 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-03-09 02:54:17,252 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-03-09 02:54:17,252 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-03-09 02:54:17,252 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-03-09 02:54:17,253 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-03-09 02:54:17,253 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-03-09 02:54:17,253 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-03-09 02:54:17,253 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-03-09 02:54:17,253 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-03-09 02:54:17,253 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-03-09 02:54:17,253 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-03-09 02:54:17,253 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-03-09 02:54:17,253 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-03-09 02:54:17,253 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-03-09 02:54:17,253 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-03-09 02:54:17,254 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-03-09 02:54:17,254 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-03-09 02:54:17,254 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-03-09 02:54:17,254 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-03-09 02:54:17,254 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-03-09 02:54:17,254 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-03-09 02:54:17,254 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-03-09 02:54:17,254 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-03-09 02:54:17,254 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-03-09 02:54:17,254 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-03-09 02:54:17,254 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-03-09 02:54:17,255 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-03-09 02:54:17,255 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-03-09 02:54:17,255 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-03-09 02:54:17,255 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-03-09 02:54:17,255 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-03-09 02:54:17,255 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-03-09 02:54:17,255 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-03-09 02:54:17,255 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-03-09 02:54:17,255 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-03-09 02:54:17,389 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.03865973853331489, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.05012442431048871, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.03865973853331489, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.17216666666666666, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.24391666666666667, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-03-09 02:54:17,389 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-03-09 02:54:17,389 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.1773686587286648, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.03865973853331489, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.05012442431048871, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.03865973853331489, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.17216666666666666, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.24391666666666667, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-03-09 02:54:17,664 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 389 ms to try 5000 different iterations.  Found a solution that moves 2677 regions; Going from a computed imbalance of 0.1773686587286648 to a new imbalance of 0.013483039190148528. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.021255047154847887); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.03340396557034682, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.29744444444444446, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.021255047154847887); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0105); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.04175, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-03-09 02:54:17,674 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1086895547:74 , srv1638336985:78 , srv487033530:78 , srv466525365:79 , srv1932285388:80 , srv304380689:80 , srv7987622:80 , srv1338570410:81 , srv1782321795:81 , srv41016420:81 , srv631643299:81 , srv957416749:81 , srv1964206291:82 , srv376058526:82 , srv715179852:82 , srv863020154:82 , srv911759818:82 , srv1403592511:83 , srv671657405:83 , srv975649873:83 , srv1196928609:84 , srv1260709075:84 , srv1881766413:84 , srv249750495:84 , srv445256740:84 , srv502461941:84 , srv645583976:84 , srv645944183:84 , srv819554017:84 , srv882041561:84 , srv883013909:84 , srv1120228803:85 , srv1139713341:85 , srv1419914714:85 , srv1434804939:85 , srv1494852839:85 , srv1748573312:85 , srv175549774:85 , srv2131762973:85 , srv419168885:85 , srv518441575:85 , srv813575300:85 , srv89016197:85 , srv9215639:85 , srv1113261741:86 , srv1237550018:86 , srv1245725080:86 , srv1535812545:86 , srv1750502382:86 , srv1774692784:86 , srv186693342:86 , srv1932311606:86 , srv453647957:86 , srv695338135:86 , srv895477553:86 , srv1097393055:87 , srv1475924226:87 , srv1479784923:87 , srv1507061149:87 , srv163564562:87 , srv1707163072:87 , srv1731488730:87 , srv1847500203:87 , srv273685937:87 , srv360403099:87 , srv397794243:87 , srv469938811:87 , srv587084973:87 , srv674475007:87 , srv728575001:87 , srv804818020:87 , srv848100288:87 , srv928124675:87 , srv1065384999:88 , srv1385550112:88 , srv1528887026:88 , srv1618167815:88 , srv1620988909:88 , srv1935781753:88 , srv2036987720:88 , srv277635583:88 , srv53874893:88 , srv1208341365:89 , srv1396530796:89 , srv1730746937:89 , srv1822888274:89 , srv1851191636:89 , srv1881717793:89 , srv2129321447:89 , srv696411608:89 , srv696779422:89 , srv862994250:89 , srv19568506:90 , srv2126030071:90 , srv283443678:90 , srv886558675:90 , srv1475924294:91 , srv618926517:91 , srv1308032390:92 , srv1125095527:530 }
2023-03-09 02:54:17,678 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-03-09 02:54:17,679 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv453647957=64, srv883013909=91, srv1881717793=42, srv1494852839=22, srv1237550018=9, srv277635583=55, srv53874893=70, srv863020154=89, srv1475924294=20, srv1774692784=36, srv1338570410=13, srv175549774=35, srv804818020=84, srv695338135=78, srv895477553=94, srv957416749=98, srv886558675=92, srv848100288=87, srv1260709075=11, srv7987622=83, srv1097393055=2, srv2036987720=49, srv2126030071=50, srv645583976=74, srv645944183=75, srv1707163072=30, srv376058526=59, srv696411608=79, srv163564562=28, srv1730746937=31, srv1419914714=17, srv1782321795=37, srv618926517=72, srv360403099=58, srv1528887026=24, srv518441575=69, srv911759818=95, srv502461941=68, srv249750495=53, srv466525365=65, srv1385550112=14, srv1638336985=29, srv696779422=80, srv186693342=41, srv487033530=67, srv283443678=56, srv1403592511=16, srv813575300=85, srv587084973=71, srv728575001=82, srv1113261741=3, srv1120228803=4, srv1196928609=7, srv1847500203=39, srv1308032390=12, srv9215639=96, srv631643299=73, srv1507061149=23, srv469938811=66, srv419168885=62, srv1932311606=45, srv1851191636=40, srv975649873=99, srv1086895547=1, srv1125095527=5, srv1479784923=21, srv1396530796=15, srv1731488730=32, srv1618167815=26, srv1245725080=10, srv1964206291=48, srv273685937=54, srv2129321447=51, srv1139713341=6, srv1065384999=0, srv2131762973=52, srv445256740=63, srv1535812545=25, srv819554017=86, srv397794243=60, srv1748573312=33, srv41016420=61, srv674475007=77, srv671657405=76, srv715179852=81, srv1750502382=34, srv1935781753=46, srv304380689=57, srv1434804939=18, srv19568506=47, srv928124675=97, srv1932285388=44, srv89016197=93, srv1475924226=19, srv1822888274=38, srv882041561=90, srv862994250=88, srv1620988909=27, srv1208341365=8, srv1881766413=43} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-03-09 02:54:17,700 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-03-09 02:54:17,700 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-03-09 02:54:17,700 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-03-09 02:54:17,700 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-03-09 02:54:17,700 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-03-09 02:54:17,701 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-03-09 02:54:17,701 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-03-09 02:54:17,701 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-03-09 02:54:17,701 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-03-09 02:54:17,701 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-03-09 02:54:17,701 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-03-09 02:54:17,701 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-03-09 02:54:17,701 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-03-09 02:54:17,701 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-03-09 02:54:17,701 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-03-09 02:54:17,701 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-03-09 02:54:17,701 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-03-09 02:54:17,701 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-03-09 02:54:17,701 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-03-09 02:54:17,701 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-03-09 02:54:17,702 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-03-09 02:54:17,702 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-03-09 02:54:17,702 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-03-09 02:54:17,702 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-03-09 02:54:17,702 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-03-09 02:54:17,702 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-03-09 02:54:17,702 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-03-09 02:54:17,702 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-03-09 02:54:17,702 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-03-09 02:54:17,702 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-03-09 02:54:17,702 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-03-09 02:54:17,702 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-03-09 02:54:17,702 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-03-09 02:54:17,702 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-03-09 02:54:17,702 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-03-09 02:54:17,703 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-03-09 02:54:17,703 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-03-09 02:54:17,703 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-03-09 02:54:17,703 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-03-09 02:54:17,703 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-03-09 02:54:17,703 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-03-09 02:54:17,703 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-03-09 02:54:17,703 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-03-09 02:54:17,703 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-03-09 02:54:17,703 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-03-09 02:54:17,703 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-03-09 02:54:17,703 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-03-09 02:54:17,703 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-03-09 02:54:17,703 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-03-09 02:54:17,703 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-03-09 02:54:17,704 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-03-09 02:54:17,704 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-03-09 02:54:17,704 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-03-09 02:54:17,704 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-03-09 02:54:17,704 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-03-09 02:54:17,704 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-03-09 02:54:17,704 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-03-09 02:54:17,704 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-03-09 02:54:17,704 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-03-09 02:54:17,704 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-03-09 02:54:17,704 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-03-09 02:54:17,704 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-03-09 02:54:17,704 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-03-09 02:54:17,704 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-03-09 02:54:17,704 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-03-09 02:54:17,705 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-03-09 02:54:17,705 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-03-09 02:54:17,705 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-03-09 02:54:17,705 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-03-09 02:54:17,705 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-03-09 02:54:17,705 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-03-09 02:54:17,705 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-03-09 02:54:17,705 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-03-09 02:54:17,705 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-03-09 02:54:17,705 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-03-09 02:54:17,705 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-03-09 02:54:17,705 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-03-09 02:54:17,705 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-03-09 02:54:17,705 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-03-09 02:54:17,705 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-03-09 02:54:17,706 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-03-09 02:54:17,706 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-03-09 02:54:17,706 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-03-09 02:54:17,706 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-03-09 02:54:17,706 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-03-09 02:54:17,706 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-03-09 02:54:17,706 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-03-09 02:54:17,706 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-03-09 02:54:17,706 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-03-09 02:54:17,706 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-03-09 02:54:17,706 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-03-09 02:54:17,706 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-03-09 02:54:17,706 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-03-09 02:54:17,706 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-03-09 02:54:17,706 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-03-09 02:54:17,707 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-03-09 02:54:17,707 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-03-09 02:54:17,707 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-03-09 02:54:17,707 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-03-09 02:54:17,707 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-03-09 02:54:17,707 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-03-09 02:54:17,820 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.021255047154847887); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.03340396557034682, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.021255047154847887); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0105); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.04175, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-03-09 02:54:17,821 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-03-09 02:54:17,821 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.013464294435508853, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.021255047154847887); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.03340396557034682, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.021255047154847887); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0105); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.04175, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-03-09 02:54:18,081 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 357 ms to try 5000 different iterations.  Found a solution that moves 956 regions; Going from a computed imbalance of 0.013464294435508853 to a new imbalance of 5.388115675279377E-4. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.005984558423028655); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.008475223015516377); MoveCostFunction : (multiplier=7.0, imbalance=0.10622222222222222, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.005984558423028655); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=8.333333333333333E-5); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.004333333333333333); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-03-09 02:54:18,085 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1822888274:83 , srv419168885:83 , srv618926517:83 , srv863020154:83 , srv886558675:83 , srv1245725080:84 , srv1434804939:84 , srv1475924294:84 , srv1479784923:84 , srv1618167815:84 , srv1620988909:84 , srv1774692784:84 , srv1932285388:84 , srv1932311606:84 , srv19568506:84 , srv2126030071:84 , srv249750495:84 , srv277635583:84 , srv469938811:84 , srv487033530:84 , srv695338135:84 , srv696779422:84 , srv715179852:84 , srv882041561:84 , srv883013909:84 , srv895477553:84 , srv9215639:84 , srv1086895547:85 , srv1097393055:85 , srv1308032390:85 , srv1385550112:85 , srv1403592511:85 , srv1507061149:85 , srv1638336985:85 , srv1707163072:85 , srv1782321795:85 , srv1851191636:85 , srv1881717793:85 , srv1881766413:85 , srv1935781753:85 , srv2036987720:85 , srv2129321447:85 , srv283443678:85 , srv304380689:85 , srv360403099:85 , srv397794243:85 , srv502461941:85 , srv518441575:85 , srv587084973:85 , srv631643299:85 , srv696411608:85 , srv804818020:85 , srv819554017:85 , srv911759818:85 , srv928124675:85 , srv1065384999:86 , srv1113261741:86 , srv1120228803:86 , srv1139713341:86 , srv1208341365:86 , srv1260709075:86 , srv1338570410:86 , srv1419914714:86 , srv1494852839:86 , srv1535812545:86 , srv1731488730:86 , srv1748573312:86 , srv175549774:86 , srv1847500203:86 , srv186693342:86 , srv2131762973:86 , srv273685937:86 , srv376058526:86 , srv41016420:86 , srv445256740:86 , srv453647957:86 , srv53874893:86 , srv645583976:86 , srv674475007:86 , srv728575001:86 , srv813575300:86 , srv862994250:86 , srv89016197:86 , srv1237550018:87 , srv1396530796:87 , srv1475924226:87 , srv163564562:87 , srv1730746937:87 , srv1750502382:87 , srv1964206291:87 , srv671657405:87 , srv7987622:87 , srv848100288:87 , srv1196928609:88 , srv645944183:88 , srv957416749:88 , srv975649873:88 , srv466525365:89 , srv1528887026:90 , srv1125095527:548 }
2023-03-09 02:54:18,088 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-03-09 02:54:18,089 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv453647957=64, srv883013909=91, srv1881717793=42, srv1494852839=22, srv1237550018=9, srv277635583=55, srv53874893=70, srv863020154=89, srv1475924294=20, srv1774692784=36, srv1338570410=13, srv175549774=35, srv804818020=84, srv695338135=78, srv895477553=94, srv957416749=98, srv886558675=92, srv848100288=87, srv1260709075=11, srv7987622=83, srv1097393055=2, srv2036987720=49, srv2126030071=50, srv645583976=74, srv645944183=75, srv1707163072=30, srv376058526=59, srv696411608=79, srv163564562=28, srv1730746937=31, srv1419914714=17, srv1782321795=37, srv618926517=72, srv360403099=58, srv1528887026=24, srv518441575=69, srv911759818=95, srv502461941=68, srv249750495=53, srv466525365=65, srv1385550112=14, srv1638336985=29, srv696779422=80, srv186693342=41, srv487033530=67, srv283443678=56, srv1403592511=16, srv813575300=85, srv587084973=71, srv728575001=82, srv1113261741=3, srv1120228803=4, srv1196928609=7, srv1847500203=39, srv1308032390=12, srv9215639=96, srv631643299=73, srv1507061149=23, srv469938811=66, srv419168885=62, srv1932311606=45, srv1851191636=40, srv975649873=99, srv1086895547=1, srv1125095527=5, srv1479784923=21, srv1396530796=15, srv1731488730=32, srv1618167815=26, srv1245725080=10, srv1964206291=48, srv273685937=54, srv2129321447=51, srv1139713341=6, srv1065384999=0, srv2131762973=52, srv445256740=63, srv1535812545=25, srv819554017=86, srv397794243=60, srv1748573312=33, srv41016420=61, srv674475007=77, srv671657405=76, srv715179852=81, srv1750502382=34, srv1935781753=46, srv304380689=57, srv1434804939=18, srv19568506=47, srv928124675=97, srv1932285388=44, srv89016197=93, srv1475924226=19, srv1822888274=38, srv882041561=90, srv862994250=88, srv1620988909=27, srv1208341365=8, srv1881766413=43} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-03-09 02:54:18,100 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-03-09 02:54:18,100 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-03-09 02:54:18,100 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-03-09 02:54:18,100 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-03-09 02:54:18,100 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-03-09 02:54:18,100 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-03-09 02:54:18,100 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-03-09 02:54:18,100 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-03-09 02:54:18,100 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-03-09 02:54:18,101 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-03-09 02:54:18,101 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-03-09 02:54:18,101 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-03-09 02:54:18,101 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-03-09 02:54:18,101 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-03-09 02:54:18,101 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-03-09 02:54:18,101 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-03-09 02:54:18,101 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-03-09 02:54:18,101 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-03-09 02:54:18,101 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-03-09 02:54:18,101 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-03-09 02:54:18,101 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-03-09 02:54:18,101 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-03-09 02:54:18,101 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-03-09 02:54:18,101 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-03-09 02:54:18,101 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-03-09 02:54:18,102 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-03-09 02:54:18,102 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-03-09 02:54:18,102 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-03-09 02:54:18,102 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-03-09 02:54:18,102 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-03-09 02:54:18,102 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-03-09 02:54:18,102 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-03-09 02:54:18,102 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-03-09 02:54:18,102 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-03-09 02:54:18,102 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-03-09 02:54:18,102 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-03-09 02:54:18,102 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-03-09 02:54:18,102 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-03-09 02:54:18,102 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-03-09 02:54:18,102 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-03-09 02:54:18,102 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-03-09 02:54:18,103 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-03-09 02:54:18,103 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-03-09 02:54:18,103 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-03-09 02:54:18,103 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-03-09 02:54:18,103 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-03-09 02:54:18,103 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-03-09 02:54:18,103 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-03-09 02:54:18,103 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-03-09 02:54:18,103 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-03-09 02:54:18,103 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-03-09 02:54:18,103 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-03-09 02:54:18,103 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-03-09 02:54:18,103 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-03-09 02:54:18,103 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-03-09 02:54:18,103 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-03-09 02:54:18,103 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-03-09 02:54:18,104 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-03-09 02:54:18,104 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-03-09 02:54:18,104 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-03-09 02:54:18,104 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-03-09 02:54:18,104 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-03-09 02:54:18,104 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-03-09 02:54:18,104 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-03-09 02:54:18,104 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-03-09 02:54:18,104 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-03-09 02:54:18,104 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-03-09 02:54:18,104 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-03-09 02:54:18,104 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-03-09 02:54:18,104 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-03-09 02:54:18,104 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-03-09 02:54:18,104 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-03-09 02:54:18,104 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-03-09 02:54:18,104 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-03-09 02:54:18,105 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-03-09 02:54:18,105 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-03-09 02:54:18,105 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-03-09 02:54:18,105 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-03-09 02:54:18,105 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-03-09 02:54:18,105 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-03-09 02:54:18,105 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-03-09 02:54:18,105 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-03-09 02:54:18,105 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-03-09 02:54:18,105 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-03-09 02:54:18,105 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-03-09 02:54:18,105 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-03-09 02:54:18,105 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-03-09 02:54:18,105 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-03-09 02:54:18,105 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-03-09 02:54:18,105 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-03-09 02:54:18,105 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-03-09 02:54:18,106 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-03-09 02:54:18,106 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-03-09 02:54:18,106 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-03-09 02:54:18,106 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-03-09 02:54:18,106 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-03-09 02:54:18,106 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-03-09 02:54:18,106 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-03-09 02:54:18,106 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-03-09 02:54:18,106 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-03-09 02:54:18,106 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-03-09 02:54:18,211 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.005984558423028655); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.008475223015516377); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.005984558423028655); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=8.333333333333333E-5); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.004333333333333333); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-03-09 02:54:18,211 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-03-09 02:54:18,211 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=5.321175124530297E-4, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.005984558423028655); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.008475223015516377); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.005984558423028655); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=8.333333333333333E-5); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.004333333333333333); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-03-09 02:54:18,555 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 437 ms to try 5000 different iterations.  Found a solution that moves 265 regions; Going from a computed imbalance of 5.321175124530297E-4 to a new imbalance of 2.633879999958424E-5. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=4.994073055283275E-4); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0015713484026367722); MoveCostFunction : (multiplier=7.0, imbalance=0.029444444444444443, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=4.994073055283275E-4); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.6666666666666666E-4); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-03-09 02:54:18,556 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1237550018:83 , srv1528887026:83 , srv466525365:83 , srv1065384999:84 , srv1120228803:84 , srv1196928609:84 , srv1208341365:84 , srv1260709075:84 , srv1385550112:84 , srv1419914714:84 , srv1494852839:84 , srv1507061149:84 , srv163564562:84 , srv1638336985:84 , srv1731488730:84 , srv1748573312:84 , srv1782321795:84 , srv1822888274:84 , srv1847500203:84 , srv186693342:84 , srv1932285388:84 , srv19568506:84 , srv1964206291:84 , srv2036987720:84 , srv2129321447:84 , srv2131762973:84 , srv249750495:84 , srv283443678:84 , srv304380689:84 , srv376058526:84 , srv41016420:84 , srv453647957:84 , srv469938811:84 , srv502461941:84 , srv518441575:84 , srv587084973:84 , srv645583976:84 , srv645944183:84 , srv674475007:84 , srv728575001:84 , srv813575300:84 , srv848100288:84 , srv882041561:84 , srv883013909:84 , srv886558675:84 , srv89016197:84 , srv895477553:84 , srv928124675:84 , srv957416749:84 , srv1086895547:85 , srv1097393055:85 , srv1113261741:85 , srv1139713341:85 , srv1245725080:85 , srv1308032390:85 , srv1338570410:85 , srv1396530796:85 , srv1403592511:85 , srv1434804939:85 , srv1475924226:85 , srv1475924294:85 , srv1479784923:85 , srv1535812545:85 , srv1618167815:85 , srv1620988909:85 , srv1707163072:85 , srv1730746937:85 , srv1750502382:85 , srv1774692784:85 , srv1851191636:85 , srv1881766413:85 , srv1932311606:85 , srv1935781753:85 , srv2126030071:85 , srv273685937:85 , srv277635583:85 , srv360403099:85 , srv445256740:85 , srv487033530:85 , srv53874893:85 , srv618926517:85 , srv631643299:85 , srv671657405:85 , srv695338135:85 , srv696411608:85 , srv696779422:85 , srv715179852:85 , srv7987622:85 , srv804818020:85 , srv819554017:85 , srv862994250:85 , srv863020154:85 , srv911759818:85 , srv9215639:85 , srv975649873:85 , srv175549774:86 , srv397794243:86 , srv419168885:86 , srv1881717793:87 , srv1125095527:632 }
2023-03-09 02:54:18,560 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-03-09 02:54:18,561 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv453647957=64, srv883013909=91, srv1881717793=42, srv1494852839=22, srv1237550018=9, srv277635583=55, srv53874893=70, srv863020154=89, srv1475924294=20, srv1774692784=36, srv1338570410=13, srv175549774=35, srv804818020=84, srv695338135=78, srv895477553=94, srv957416749=98, srv886558675=92, srv848100288=87, srv1260709075=11, srv7987622=83, srv1097393055=2, srv2036987720=49, srv2126030071=50, srv645583976=74, srv645944183=75, srv1707163072=30, srv376058526=59, srv696411608=79, srv163564562=28, srv1730746937=31, srv1419914714=17, srv1782321795=37, srv618926517=72, srv360403099=58, srv1528887026=24, srv518441575=69, srv911759818=95, srv502461941=68, srv249750495=53, srv466525365=65, srv1385550112=14, srv1638336985=29, srv696779422=80, srv186693342=41, srv487033530=67, srv283443678=56, srv1403592511=16, srv813575300=85, srv587084973=71, srv728575001=82, srv1113261741=3, srv1120228803=4, srv1196928609=7, srv1847500203=39, srv1308032390=12, srv9215639=96, srv631643299=73, srv1507061149=23, srv469938811=66, srv419168885=62, srv1932311606=45, srv1851191636=40, srv975649873=99, srv1086895547=1, srv1125095527=5, srv1479784923=21, srv1396530796=15, srv1731488730=32, srv1618167815=26, srv1245725080=10, srv1964206291=48, srv273685937=54, srv2129321447=51, srv1139713341=6, srv1065384999=0, srv2131762973=52, srv445256740=63, srv1535812545=25, srv819554017=86, srv397794243=60, srv1748573312=33, srv41016420=61, srv674475007=77, srv671657405=76, srv715179852=81, srv1750502382=34, srv1935781753=46, srv304380689=57, srv1434804939=18, srv19568506=47, srv928124675=97, srv1932285388=44, srv89016197=93, srv1475924226=19, srv1822888274=38, srv882041561=90, srv862994250=88, srv1620988909=27, srv1208341365=8, srv1881766413=43} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-03-09 02:54:18,571 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-03-09 02:54:18,571 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-03-09 02:54:18,572 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-03-09 02:54:18,572 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-03-09 02:54:18,572 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-03-09 02:54:18,572 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-03-09 02:54:18,572 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-03-09 02:54:18,572 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-03-09 02:54:18,572 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-03-09 02:54:18,572 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-03-09 02:54:18,572 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-03-09 02:54:18,572 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-03-09 02:54:18,572 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-03-09 02:54:18,572 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-03-09 02:54:18,572 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-03-09 02:54:18,572 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-03-09 02:54:18,572 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-03-09 02:54:18,572 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-03-09 02:54:18,573 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-03-09 02:54:18,573 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-03-09 02:54:18,573 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-03-09 02:54:18,573 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-03-09 02:54:18,573 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-03-09 02:54:18,573 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-03-09 02:54:18,573 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-03-09 02:54:18,573 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-03-09 02:54:18,573 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-03-09 02:54:18,573 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-03-09 02:54:18,573 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-03-09 02:54:18,573 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-03-09 02:54:18,573 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-03-09 02:54:18,573 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-03-09 02:54:18,573 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-03-09 02:54:18,573 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-03-09 02:54:18,573 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-03-09 02:54:18,573 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-03-09 02:54:18,573 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-03-09 02:54:18,574 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-03-09 02:54:18,574 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-03-09 02:54:18,574 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-03-09 02:54:18,574 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-03-09 02:54:18,574 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-03-09 02:54:18,574 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-03-09 02:54:18,574 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-03-09 02:54:18,574 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-03-09 02:54:18,574 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-03-09 02:54:18,574 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-03-09 02:54:18,574 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-03-09 02:54:18,574 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-03-09 02:54:18,574 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-03-09 02:54:18,574 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-03-09 02:54:18,574 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-03-09 02:54:18,574 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-03-09 02:54:18,574 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-03-09 02:54:18,574 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-03-09 02:54:18,575 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-03-09 02:54:18,575 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-03-09 02:54:18,575 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-03-09 02:54:18,575 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-03-09 02:54:18,575 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-03-09 02:54:18,575 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-03-09 02:54:18,575 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-03-09 02:54:18,575 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-03-09 02:54:18,575 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-03-09 02:54:18,575 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-03-09 02:54:18,575 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-03-09 02:54:18,575 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-03-09 02:54:18,575 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-03-09 02:54:18,575 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-03-09 02:54:18,576 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-03-09 02:54:18,576 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-03-09 02:54:18,576 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-03-09 02:54:18,576 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-03-09 02:54:18,576 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-03-09 02:54:18,576 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-03-09 02:54:18,576 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-03-09 02:54:18,576 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-03-09 02:54:18,576 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-03-09 02:54:18,576 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-03-09 02:54:18,576 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-03-09 02:54:18,576 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-03-09 02:54:18,576 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-03-09 02:54:18,576 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-03-09 02:54:18,576 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-03-09 02:54:18,577 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-03-09 02:54:18,577 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-03-09 02:54:18,577 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-03-09 02:54:18,577 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-03-09 02:54:18,577 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-03-09 02:54:18,577 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-03-09 02:54:18,577 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-03-09 02:54:18,577 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-03-09 02:54:18,577 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-03-09 02:54:18,577 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-03-09 02:54:18,577 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-03-09 02:54:18,577 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-03-09 02:54:18,577 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-03-09 02:54:18,577 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-03-09 02:54:18,577 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-03-09 02:54:18,577 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-03-09 02:54:18,577 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-03-09 02:54:18,687 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=4.994073055283275E-4); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0015713484026367722); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=4.994073055283275E-4); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.6666666666666666E-4); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-03-09 02:54:18,687 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-03-09 02:54:18,687 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=2.448323033969866E-5, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=4.994073055283275E-4); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0015713484026367722); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=4.994073055283275E-4); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.6666666666666666E-4); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-03-09 02:54:18,928 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 339 ms to try 5000 different iterations.  Found a solution that moves 21 regions; Going from a computed imbalance of 2.448323033969866E-5 to a new imbalance of 5.789538136385531E-6. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0012535023884839248); MoveCostFunction : (multiplier=7.0, imbalance=0.0023333333333333335); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-03-09 02:54:18,928 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1881717793:82 , srv1139713341:83 , srv175549774:83 , srv1935781753:83 , srv695338135:83 , srv848100288:83 , srv975649873:83 , srv1065384999:84 , srv1086895547:84 , srv1097393055:84 , srv1113261741:84 , srv1120228803:84 , srv1196928609:84 , srv1208341365:84 , srv1245725080:84 , srv1260709075:84 , srv1308032390:84 , srv1338570410:84 , srv1385550112:84 , srv1396530796:84 , srv1403592511:84 , srv1434804939:84 , srv1475924226:84 , srv1475924294:84 , srv1479784923:84 , srv1494852839:84 , srv1507061149:84 , srv1528887026:84 , srv1535812545:84 , srv1618167815:84 , srv1620988909:84 , srv163564562:84 , srv1638336985:84 , srv1707163072:84 , srv1730746937:84 , srv1731488730:84 , srv1748573312:84 , srv1750502382:84 , srv1774692784:84 , srv1782321795:84 , srv1822888274:84 , srv1847500203:84 , srv1851191636:84 , srv1881766413:84 , srv1932311606:84 , srv1964206291:84 , srv2036987720:84 , srv2126030071:84 , srv2129321447:84 , srv2131762973:84 , srv249750495:84 , srv273685937:84 , srv277635583:84 , srv283443678:84 , srv360403099:84 , srv376058526:84 , srv397794243:84 , srv41016420:84 , srv419168885:84 , srv445256740:84 , srv453647957:84 , srv466525365:84 , srv469938811:84 , srv487033530:84 , srv502461941:84 , srv53874893:84 , srv587084973:84 , srv618926517:84 , srv631643299:84 , srv645583976:84 , srv645944183:84 , srv671657405:84 , srv674475007:84 , srv696411608:84 , srv696779422:84 , srv715179852:84 , srv728575001:84 , srv7987622:84 , srv804818020:84 , srv819554017:84 , srv862994250:84 , srv863020154:84 , srv882041561:84 , srv883013909:84 , srv886558675:84 , srv895477553:84 , srv911759818:84 , srv9215639:84 , srv928124675:84 , srv957416749:84 , srv1237550018:85 , srv1419914714:85 , srv186693342:85 , srv1932285388:85 , srv19568506:85 , srv304380689:85 , srv518441575:85 , srv813575300:85 , srv89016197:85 , srv1125095527:683 }
2023-03-09 02:54:18,932 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-03-09 02:54:18,932 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv453647957=64, srv883013909=91, srv1881717793=42, srv1494852839=22, srv1237550018=9, srv277635583=55, srv53874893=70, srv863020154=89, srv1475924294=20, srv1774692784=36, srv1338570410=13, srv175549774=35, srv804818020=84, srv695338135=78, srv895477553=94, srv957416749=98, srv886558675=92, srv848100288=87, srv1260709075=11, srv7987622=83, srv1097393055=2, srv2036987720=49, srv2126030071=50, srv645583976=74, srv645944183=75, srv1707163072=30, srv376058526=59, srv696411608=79, srv163564562=28, srv1730746937=31, srv1419914714=17, srv1782321795=37, srv618926517=72, srv360403099=58, srv1528887026=24, srv518441575=69, srv911759818=95, srv502461941=68, srv249750495=53, srv466525365=65, srv1385550112=14, srv1638336985=29, srv696779422=80, srv186693342=41, srv487033530=67, srv283443678=56, srv1403592511=16, srv813575300=85, srv587084973=71, srv728575001=82, srv1113261741=3, srv1120228803=4, srv1196928609=7, srv1847500203=39, srv1308032390=12, srv9215639=96, srv631643299=73, srv1507061149=23, srv469938811=66, srv419168885=62, srv1932311606=45, srv1851191636=40, srv975649873=99, srv1086895547=1, srv1125095527=5, srv1479784923=21, srv1396530796=15, srv1731488730=32, srv1618167815=26, srv1245725080=10, srv1964206291=48, srv273685937=54, srv2129321447=51, srv1139713341=6, srv1065384999=0, srv2131762973=52, srv445256740=63, srv1535812545=25, srv819554017=86, srv397794243=60, srv1748573312=33, srv41016420=61, srv674475007=77, srv671657405=76, srv715179852=81, srv1750502382=34, srv1935781753=46, srv304380689=57, srv1434804939=18, srv19568506=47, srv928124675=97, srv1932285388=44, srv89016197=93, srv1475924226=19, srv1822888274=38, srv882041561=90, srv862994250=88, srv1620988909=27, srv1208341365=8, srv1881766413=43} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-03-09 02:54:18,946 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-03-09 02:54:18,946 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-03-09 02:54:18,946 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-03-09 02:54:18,946 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-03-09 02:54:18,946 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-03-09 02:54:18,946 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-03-09 02:54:18,946 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-03-09 02:54:18,946 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-03-09 02:54:18,946 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-03-09 02:54:18,946 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-03-09 02:54:18,946 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-03-09 02:54:18,946 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-03-09 02:54:18,946 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-03-09 02:54:18,946 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-03-09 02:54:18,946 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-03-09 02:54:18,946 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-03-09 02:54:18,947 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-03-09 02:54:18,947 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-03-09 02:54:18,947 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-03-09 02:54:18,947 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-03-09 02:54:18,947 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-03-09 02:54:18,947 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-03-09 02:54:18,947 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-03-09 02:54:18,947 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-03-09 02:54:18,947 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-03-09 02:54:18,947 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-03-09 02:54:18,947 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-03-09 02:54:18,947 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-03-09 02:54:18,947 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-03-09 02:54:18,947 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-03-09 02:54:18,947 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-03-09 02:54:18,947 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-03-09 02:54:18,947 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-03-09 02:54:18,947 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-03-09 02:54:18,947 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-03-09 02:54:18,947 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-03-09 02:54:18,947 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-03-09 02:54:18,947 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-03-09 02:54:18,947 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-03-09 02:54:18,948 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-03-09 02:54:18,948 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-03-09 02:54:18,948 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-03-09 02:54:18,948 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-03-09 02:54:18,948 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-03-09 02:54:18,948 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-03-09 02:54:18,948 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-03-09 02:54:18,948 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-03-09 02:54:18,948 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-03-09 02:54:18,948 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-03-09 02:54:18,948 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-03-09 02:54:18,948 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-03-09 02:54:18,948 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-03-09 02:54:18,948 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-03-09 02:54:18,948 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-03-09 02:54:18,948 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-03-09 02:54:18,948 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-03-09 02:54:18,948 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-03-09 02:54:18,948 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-03-09 02:54:18,948 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-03-09 02:54:18,948 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-03-09 02:54:18,949 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-03-09 02:54:18,949 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-03-09 02:54:18,949 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-03-09 02:54:18,949 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-03-09 02:54:18,949 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-03-09 02:54:18,949 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-03-09 02:54:18,949 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-03-09 02:54:18,949 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-03-09 02:54:18,949 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-03-09 02:54:18,949 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-03-09 02:54:18,949 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-03-09 02:54:18,949 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-03-09 02:54:18,949 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-03-09 02:54:18,949 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-03-09 02:54:18,949 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-03-09 02:54:18,949 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-03-09 02:54:18,949 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-03-09 02:54:18,949 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-03-09 02:54:18,949 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-03-09 02:54:18,949 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-03-09 02:54:18,949 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-03-09 02:54:18,949 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-03-09 02:54:18,950 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-03-09 02:54:18,950 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-03-09 02:54:18,950 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-03-09 02:54:18,950 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-03-09 02:54:18,950 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-03-09 02:54:18,950 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-03-09 02:54:18,950 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-03-09 02:54:18,950 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-03-09 02:54:18,950 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-03-09 02:54:18,950 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-03-09 02:54:18,950 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-03-09 02:54:18,950 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-03-09 02:54:18,950 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-03-09 02:54:18,950 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-03-09 02:54:18,950 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-03-09 02:54:18,950 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-03-09 02:54:18,950 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-03-09 02:54:18,950 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-03-09 02:54:18,950 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-03-09 02:54:19,071 INFO  [Time-limited test] balancer.StochasticLoadBalancer(381): Cluster wide - skipping load balancing because weighted average imbalance=5.642492993526674E-6 <= threshold(0.025). If you want more aggressive balancing, either lower hbase.master.balancer.stochastic.minCostNeedBalance from 0.025 or increase the relative multiplier(s) of the specific cost function(s). functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0012535023884839248); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-03-09 02:54:19,072 INFO  [Time-limited test] balancer.BalancerTestBase(570): Mock Final balance: { srv1881717793:82 , srv1139713341:83 , srv175549774:83 , srv1935781753:83 , srv695338135:83 , srv848100288:83 , srv975649873:83 , srv1065384999:84 , srv1086895547:84 , srv1097393055:84 , srv1113261741:84 , srv1120228803:84 , srv1196928609:84 , srv1208341365:84 , srv1245725080:84 , srv1260709075:84 , srv1308032390:84 , srv1338570410:84 , srv1385550112:84 , srv1396530796:84 , srv1403592511:84 , srv1434804939:84 , srv1475924226:84 , srv1475924294:84 , srv1479784923:84 , srv1494852839:84 , srv1507061149:84 , srv1528887026:84 , srv1535812545:84 , srv1618167815:84 , srv1620988909:84 , srv163564562:84 , srv1638336985:84 , srv1707163072:84 , srv1730746937:84 , srv1731488730:84 , srv1748573312:84 , srv1750502382:84 , srv1774692784:84 , srv1782321795:84 , srv1822888274:84 , srv1847500203:84 , srv1851191636:84 , srv1881766413:84 , srv1932311606:84 , srv1964206291:84 , srv2036987720:84 , srv2126030071:84 , srv2129321447:84 , srv2131762973:84 , srv249750495:84 , srv273685937:84 , srv277635583:84 , srv283443678:84 , srv360403099:84 , srv376058526:84 , srv397794243:84 , srv41016420:84 , srv419168885:84 , srv445256740:84 , srv453647957:84 , srv466525365:84 , srv469938811:84 , srv487033530:84 , srv502461941:84 , srv53874893:84 , srv587084973:84 , srv618926517:84 , srv631643299:84 , srv645583976:84 , srv645944183:84 , srv671657405:84 , srv674475007:84 , srv696411608:84 , srv696779422:84 , srv715179852:84 , srv728575001:84 , srv7987622:84 , srv804818020:84 , srv819554017:84 , srv862994250:84 , srv863020154:84 , srv882041561:84 , srv883013909:84 , srv886558675:84 , srv895477553:84 , srv911759818:84 , srv9215639:84 , srv928124675:84 , srv957416749:84 , srv1237550018:85 , srv1419914714:85 , srv186693342:85 , srv1932285388:85 , srv19568506:85 , srv304380689:85 , srv518441575:85 , srv813575300:85 , srv89016197:85 , srv1125095527:683 }
2023-03-09 02:54:19,095 INFO  [Time-limited test] hbase.ResourceChecker(175): after: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnLargeClusterWithRacks Thread=10 (was 10), OpenFileDescriptor=260 (was 260), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=267 (was 229) - SystemLoadAverage LEAK? -, ProcessCount=170 (was 170), AvailableMemoryMB=8168 (was 8664)
2023-03-09 02:54:19,103 INFO  [Time-limited test] hbase.ResourceChecker(147): before: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnMidClusterWithRacks Thread=10, OpenFileDescriptor=260, MaxFileDescriptor=60000, SystemLoadAverage=267, ProcessCount=170, AvailableMemoryMB=8168
2023-03-09 02:54:19,104 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2023-03-09 02:54:19,104 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=5000, runMaxSteps=true, stepsPerRegion=800, maxRunningTime=120000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 111077.0 etc.
2023-03-09 02:54:19,112 INFO  [Time-limited test] balancer.BalancerTestBase(547): Mock Cluster : { srv100754238:84 , srv112080966:84 , srv1173592507:84 , srv1233614220:84 , srv1233806237:84 , srv1267909055:84 , srv1371193395:84 , srv1468384624:84 , srv1524647497:84 , srv1710984457:84 , srv1805182455:84 , srv1832881122:84 , srv1868965753:84 , srv1902497320:84 , srv2019666108:84 , srv2021270422:84 , srv2087111761:84 , srv245013285:84 , srv321401707:84 , srv346128929:84 , srv399066265:84 , srv421907978:84 , srv492389856:84 , srv612704384:84 , srv617805291:84 , srv638771341:84 , srv796911188:84 , srv824968459:84 , srv948119581:84 , srv925654729:264 } [srvr=30 rgns=2700 avg=90.0 max=90 min=90]
2023-03-09 02:54:19,113 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-03-09 02:54:19,113 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv796911188=26, srv100754238=0, srv421907978=21, srv612704384=23, srv2019666108=14, srv1233806237=4, srv1371193395=6, srv245013285=17, srv1173592507=2, srv1902497320=13, srv1233614220=3, srv2087111761=16, srv948119581=29, srv638771341=25, srv1267909055=5, srv1524647497=8, srv321401707=18, srv346128929=19, srv1868965753=12, srv1710984457=9, srv925654729=28, srv1832881122=11, srv492389856=22, srv1468384624=7, srv824968459=27, srv112080966=1, srv2021270422=15, srv1805182455=10, srv617805291=24, srv399066265=20} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-03-09 02:54:19,121 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-03-09 02:54:19,122 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-03-09 02:54:19,122 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-03-09 02:54:19,122 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-03-09 02:54:19,122 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-03-09 02:54:19,122 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-03-09 02:54:19,122 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-03-09 02:54:19,122 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-03-09 02:54:19,122 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-03-09 02:54:19,122 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-03-09 02:54:19,122 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-03-09 02:54:19,122 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-03-09 02:54:19,122 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-03-09 02:54:19,122 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-03-09 02:54:19,122 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-03-09 02:54:19,122 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-03-09 02:54:19,122 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-03-09 02:54:19,122 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-03-09 02:54:19,122 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-03-09 02:54:19,122 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-03-09 02:54:19,122 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-03-09 02:54:19,122 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-03-09 02:54:19,122 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-03-09 02:54:19,123 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-03-09 02:54:19,123 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-03-09 02:54:19,123 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-03-09 02:54:19,123 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-03-09 02:54:19,123 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-03-09 02:54:19,123 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-03-09 02:54:19,123 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-03-09 02:54:19,123 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=10, number of hosts=30, number of racks=4
2023-03-09 02:54:19,140 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=1.0891855182776582, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-03-09 02:54:19,140 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.9912474063920198, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=1.0891855182776582, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=64800000
2023-03-09 02:56:19,127 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 120001 ms to try 6047984 different iterations.  Found a solution that moves 1854 regions; Going from a computed imbalance of 0.9912474063920198 to a new imbalance of 4.3273284898463826E-5. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); MoveCostFunction : (multiplier=7.0, imbalance=0.6866666666666666, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-03-09 02:56:19,132 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv100754238:90 , srv112080966:90 , srv1173592507:90 , srv1233614220:90 , srv1233806237:90 , srv1267909055:90 , srv1371193395:90 , srv1468384624:90 , srv1524647497:90 , srv1710984457:90 , srv1805182455:90 , srv1832881122:90 , srv1868965753:90 , srv1902497320:90 , srv2019666108:90 , srv2021270422:90 , srv2087111761:90 , srv245013285:90 , srv321401707:90 , srv346128929:90 , srv399066265:90 , srv421907978:90 , srv492389856:90 , srv612704384:90 , srv617805291:90 , srv638771341:90 , srv796911188:90 , srv824968459:90 , srv925654729:90 , srv948119581:90 }
2023-03-09 02:56:19,133 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-03-09 02:56:19,134 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv796911188=26, srv100754238=0, srv421907978=21, srv612704384=23, srv2019666108=14, srv1233806237=4, srv1371193395=6, srv245013285=17, srv1173592507=2, srv1902497320=13, srv1233614220=3, srv2087111761=16, srv948119581=29, srv638771341=25, srv1267909055=5, srv1524647497=8, srv321401707=18, srv346128929=19, srv1868965753=12, srv1710984457=9, srv925654729=28, srv1832881122=11, srv492389856=22, srv1468384624=7, srv824968459=27, srv112080966=1, srv2021270422=15, srv1805182455=10, srv617805291=24, srv399066265=20} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-03-09 02:56:19,137 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-03-09 02:56:19,137 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-03-09 02:56:19,137 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-03-09 02:56:19,138 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-03-09 02:56:19,138 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-03-09 02:56:19,138 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-03-09 02:56:19,138 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-03-09 02:56:19,138 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-03-09 02:56:19,138 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-03-09 02:56:19,138 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-03-09 02:56:19,138 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-03-09 02:56:19,138 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-03-09 02:56:19,138 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-03-09 02:56:19,138 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-03-09 02:56:19,138 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-03-09 02:56:19,138 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-03-09 02:56:19,138 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-03-09 02:56:19,138 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-03-09 02:56:19,138 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-03-09 02:56:19,138 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-03-09 02:56:19,138 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-03-09 02:56:19,138 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-03-09 02:56:19,138 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-03-09 02:56:19,138 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-03-09 02:56:19,138 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-03-09 02:56:19,138 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-03-09 02:56:19,139 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-03-09 02:56:19,139 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-03-09 02:56:19,139 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-03-09 02:56:19,139 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-03-09 02:56:19,139 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=10, number of hosts=30, number of racks=4
2023-03-09 02:56:19,150 INFO  [Time-limited test] balancer.StochasticLoadBalancer(381): Cluster wide - skipping load balancing because weighted average imbalance=0.0 <= threshold(0.025). If you want more aggressive balancing, either lower hbase.master.balancer.stochastic.minCostNeedBalance from 0.025 or increase the relative multiplier(s) of the specific cost function(s). functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-03-09 02:56:19,150 INFO  [Time-limited test] balancer.BalancerTestBase(570): Mock Final balance: { srv100754238:90 , srv112080966:90 , srv1173592507:90 , srv1233614220:90 , srv1233806237:90 , srv1267909055:90 , srv1371193395:90 , srv1468384624:90 , srv1524647497:90 , srv1710984457:90 , srv1805182455:90 , srv1832881122:90 , srv1868965753:90 , srv1902497320:90 , srv2019666108:90 , srv2021270422:90 , srv2087111761:90 , srv245013285:90 , srv321401707:90 , srv346128929:90 , srv399066265:90 , srv421907978:90 , srv492389856:90 , srv612704384:90 , srv617805291:90 , srv638771341:90 , srv796911188:90 , srv824968459:90 , srv925654729:90 , srv948119581:90 }
2023-03-09 02:56:19,163 INFO  [Time-limited test] hbase.ResourceChecker(175): after: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnMidClusterWithRacks Thread=9 (was 10), OpenFileDescriptor=260 (was 260), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=185 (was 267), ProcessCount=170 (was 170), AvailableMemoryMB=7777 (was 8168)