2023-12-31 15:53:14,893 INFO  [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks timeout: 13 mins
2023-12-31 15:53:15,240 WARN  [Time-limited test] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties
2023-12-31 15:53:15,362 INFO  [Time-limited test] metrics.MetricRegistriesLoader(60): Loaded MetricRegistries class org.apache.hadoop.hbase.metrics.impl.MetricRegistriesImpl
2023-12-31 15:53:15,441 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2023-12-31 15:53:15,448 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc.
2023-12-31 15:53:15,462 INFO  [Time-limited test] hbase.ResourceChecker(147): before: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnLargeClusterWithRacks Thread=12, OpenFileDescriptor=290, MaxFileDescriptor=60000, SystemLoadAverage=271, ProcessCount=167, AvailableMemoryMB=4747
2023-12-31 15:53:15,464 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2023-12-31 15:53:15,465 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=5000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=10000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc.
2023-12-31 15:53:15,592 INFO  [Time-limited test] balancer.BalancerTestBase(547): Mock Cluster : { srv1011101746:84 , srv1016438329:84 , srv1019757193:84 , srv1028392791:84 , srv1043173567:84 , srv1053753159:84 , srv1054363777:84 , srv1076389780:84 , srv1116934178:84 , srv1134197769:84 , srv1144398911:84 , srv1163942539:84 , srv1217850865:84 , srv1223501099:84 , srv1248623533:84 , srv1290862691:84 , srv1307101201:84 , srv1345872747:84 , srv135964569:84 , srv1386370208:84 , srv1387824346:84 , srv1410074939:84 , srv1411484496:84 , srv1437868135:84 , srv144771853:84 , srv1489876147:84 , srv149511875:84 , srv1502964458:84 , srv1537653498:84 , srv1540069009:84 , srv1541330652:84 , srv1542176148:84 , srv1630616779:84 , srv1647316481:84 , srv1654523131:84 , srv1687659448:84 , srv1695046601:84 , srv1700727703:84 , srv1705957090:84 , srv1740517912:84 , srv1792666360:84 , srv1817639204:84 , srv1839627253:84 , srv1884114667:84 , srv1892510591:84 , srv19363278:84 , srv1956976959:84 , srv195840642:84 , srv1980990024:84 , srv2000731247:84 , srv2003833536:84 , srv2005279019:84 , srv201613089:84 , srv2021269008:84 , srv2023402801:84 , srv204400513:84 , srv2053424814:84 , srv2098328080:84 , srv2109108955:84 , srv2147161230:84 , srv263530008:84 , srv269385954:84 , srv276790860:84 , srv318704950:84 , srv339923568:84 , srv3411476:84 , srv376010619:84 , srv378005182:84 , srv380740681:84 , srv384515913:84 , srv403329167:84 , srv430273153:84 , srv432028311:84 , srv466761755:84 , srv469176388:84 , srv472707824:84 , srv480706782:84 , srv505864233:84 , srv527146063:84 , srv539553305:84 , srv561060243:84 , srv596847009:84 , srv629935155:84 , srv637751034:84 , srv696783186:84 , srv703994956:84 , srv747319130:84 , srv75502729:84 , srv807806281:84 , srv827595189:84 , srv830164273:84 , srv844914040:84 , srv857806519:84 , srv941014918:84 , srv952277263:84 , srv958449006:84 , srv959631670:84 , srv968254887:84 , srv994063337:84 , srv1380928095:684 } [srvr=100 rgns=9000 avg=90.0 max=90 min=90]
2023-12-31 15:53:15,601 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-12-31 15:53:15,608 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv2000731247=50, srv958449006=96, srv1345872747=17, srv747319130=87, srv696783186=85, srv830164273=91, srv269385954=62, srv1489876147=26, srv149511875=27, srv318704950=64, srv2109108955=59, srv1817639204=42, srv2021269008=54, srv2053424814=57, srv384515913=70, srv2005279019=52, srv1076389780=7, srv703994956=86, srv1705957090=39, srv1980990024=49, srv629935155=83, srv430273153=72, srv1537653498=29, srv2147161230=60, srv263530008=61, srv376010619=67, srv1839627253=43, srv1290862691=15, srv539553305=80, srv1248623533=14, srv637751034=84, srv1028392791=3, srv1956976959=47, srv968254887=98, srv1053753159=5, srv1630616779=33, srv1019757193=2, srv1144398911=10, srv378005182=68, srv952277263=95, srv994063337=99, srv1380928095=19, srv1387824346=21, srv339923568=65, srv1054363777=6, srv432028311=73, srv959631670=97, srv144771853=25, srv827595189=90, srv480706782=77, srv1892510591=45, srv75502729=88, srv505864233=78, srv527146063=79, srv561060243=81, srv1437868135=24, srv1654523131=35, srv1223501099=13, srv472707824=76, srv201613089=53, srv469176388=75, srv1700727703=38, srv1016438329=1, srv1116934178=8, srv380740681=69, srv1217850865=12, srv1695046601=37, srv1740517912=40, srv844914040=92, srv1307101201=16, srv857806519=93, srv1502964458=28, srv276790860=63, srv1540069009=30, srv1043173567=4, srv403329167=71, srv1134197769=9, srv1163942539=11, srv1386370208=20, srv1541330652=31, srv1410074939=22, srv1647316481=34, srv204400513=56, srv2098328080=58, srv1792666360=41, srv195840642=48, srv466761755=74, srv2003833536=51, srv2023402801=55, srv807806281=89, srv135964569=18, srv1884114667=44, srv1411484496=23, srv1542176148=32, srv941014918=94, srv19363278=46, srv1011101746=0, srv1687659448=36, srv596847009=82, srv3411476=66} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-12-31 15:53:15,686 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-12-31 15:53:15,687 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-12-31 15:53:15,687 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-12-31 15:53:15,687 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-12-31 15:53:15,687 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-12-31 15:53:15,687 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-12-31 15:53:15,687 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-12-31 15:53:15,688 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-12-31 15:53:15,688 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-12-31 15:53:15,688 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-12-31 15:53:15,688 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-12-31 15:53:15,688 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-12-31 15:53:15,689 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-12-31 15:53:15,689 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-12-31 15:53:15,689 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-12-31 15:53:15,689 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-12-31 15:53:15,689 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-12-31 15:53:15,689 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-12-31 15:53:15,689 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-12-31 15:53:15,690 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-12-31 15:53:15,690 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-12-31 15:53:15,690 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-12-31 15:53:15,690 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-12-31 15:53:15,690 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-12-31 15:53:15,690 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-12-31 15:53:15,691 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-12-31 15:53:15,691 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-12-31 15:53:15,691 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-12-31 15:53:15,691 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-12-31 15:53:15,691 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-12-31 15:53:15,691 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-12-31 15:53:15,691 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-12-31 15:53:15,692 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-12-31 15:53:15,692 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-12-31 15:53:15,692 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-12-31 15:53:15,692 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-12-31 15:53:15,692 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-12-31 15:53:15,692 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-12-31 15:53:15,693 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-12-31 15:53:15,693 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-12-31 15:53:15,693 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-12-31 15:53:15,693 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-12-31 15:53:15,693 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-12-31 15:53:15,693 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-12-31 15:53:15,693 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-12-31 15:53:15,694 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-12-31 15:53:15,694 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-12-31 15:53:15,694 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-12-31 15:53:15,694 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-12-31 15:53:15,694 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-12-31 15:53:15,694 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-12-31 15:53:15,695 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-12-31 15:53:15,695 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-12-31 15:53:15,695 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-12-31 15:53:15,695 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-12-31 15:53:15,695 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-12-31 15:53:15,695 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-12-31 15:53:15,696 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-12-31 15:53:15,696 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-12-31 15:53:15,696 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-12-31 15:53:15,696 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-12-31 15:53:15,696 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-12-31 15:53:15,696 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-12-31 15:53:15,697 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-12-31 15:53:15,697 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-12-31 15:53:15,697 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-12-31 15:53:15,697 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-12-31 15:53:15,697 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-12-31 15:53:15,697 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-12-31 15:53:15,697 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-12-31 15:53:15,698 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-12-31 15:53:15,698 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-12-31 15:53:15,698 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-12-31 15:53:15,698 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-12-31 15:53:15,698 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-12-31 15:53:15,698 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-12-31 15:53:15,698 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-12-31 15:53:15,699 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-12-31 15:53:15,699 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-12-31 15:53:15,699 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-12-31 15:53:15,699 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-12-31 15:53:15,699 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-12-31 15:53:15,699 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-12-31 15:53:15,699 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-12-31 15:53:15,700 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-12-31 15:53:15,700 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-12-31 15:53:15,700 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-12-31 15:53:15,700 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-12-31 15:53:15,700 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-12-31 15:53:15,700 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-12-31 15:53:15,700 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-12-31 15:53:15,701 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-12-31 15:53:15,701 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-12-31 15:53:15,701 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-12-31 15:53:15,701 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-12-31 15:53:15,702 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-12-31 15:53:15,702 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-12-31 15:53:15,702 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-12-31 15:53:15,702 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-12-31 15:53:15,702 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-12-31 15:53:15,702 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-12-31 15:53:16,026 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.06666666666666667, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-12-31 15:53:16,027 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-12-31 15:53:16,027 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.9909252140407105, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.06666666666666667, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-12-31 15:53:16,454 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 720 ms to try 5000 different iterations.  Found a solution that moves 4708 regions; Going from a computed imbalance of 0.9909252140407105 to a new imbalance of 0.17535032774822118. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.04015557723207018, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.05448668738446516, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.5231111111111111, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.04015557723207018, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.17016666666666666, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.24083333333333334, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-12-31 15:53:16,470 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv807806281:81 , srv466761755:82 , srv1223501099:83 , srv1345872747:83 , srv1740517912:83 , srv1892510591:83 , srv941014918:83 , srv1134197769:84 , srv1217850865:84 , srv1307101201:84 , srv135964569:84 , srv1386370208:84 , srv1705957090:84 , srv19363278:84 , srv2000731247:84 , srv2005279019:84 , srv201613089:84 , srv2021269008:84 , srv204400513:84 , srv339923568:84 , srv561060243:84 , srv968254887:84 , srv1016438329:85 , srv1043173567:85 , srv1053753159:85 , srv1248623533:85 , srv1817639204:85 , srv195840642:85 , srv1980990024:85 , srv2003833536:85 , srv2147161230:85 , srv318704950:85 , srv378005182:85 , srv384515913:85 , srv432028311:85 , srv472707824:85 , srv480706782:85 , srv857806519:85 , srv952277263:85 , srv958449006:85 , srv994063337:85 , srv1144398911:86 , srv144771853:86 , srv1502964458:86 , srv1537653498:86 , srv1542176148:86 , srv1654523131:86 , srv1695046601:86 , srv1700727703:86 , srv2098328080:86 , srv269385954:86 , srv637751034:86 , srv75502729:86 , srv830164273:86 , srv959631670:86 , srv1011101746:87 , srv1019757193:87 , srv1076389780:87 , srv1387824346:87 , srv1489876147:87 , srv1540069009:87 , srv1541330652:87 , srv1630616779:87 , srv1792666360:87 , srv1839627253:87 , srv2053424814:87 , srv276790860:87 , srv380740681:87 , srv430273153:87 , srv505864233:87 , srv539553305:87 , srv596847009:87 , srv696783186:87 , srv827595189:87 , srv1054363777:88 , srv403329167:88 , srv629935155:88 , srv703994956:88 , srv747319130:88 , srv1411484496:89 , srv1647316481:89 , srv1687659448:89 , srv1884114667:89 , srv1956976959:89 , srv2023402801:89 , srv2109108955:89 , srv3411476:89 , srv527146063:89 , srv149511875:90 , srv263530008:90 , srv376010619:90 , srv1028392791:91 , srv1116934178:91 , srv1163942539:91 , srv1290862691:91 , srv1410074939:91 , srv844914040:91 , srv1437868135:92 , srv469176388:94 , srv1380928095:447 }
2023-12-31 15:53:16,475 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-12-31 15:53:16,475 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv2000731247=50, srv958449006=96, srv1345872747=17, srv747319130=87, srv696783186=85, srv830164273=91, srv269385954=62, srv1489876147=26, srv149511875=27, srv318704950=64, srv2109108955=59, srv1817639204=42, srv2021269008=54, srv2053424814=57, srv384515913=70, srv2005279019=52, srv1076389780=7, srv703994956=86, srv1705957090=39, srv1980990024=49, srv629935155=83, srv430273153=72, srv1537653498=29, srv2147161230=60, srv263530008=61, srv376010619=67, srv1839627253=43, srv1290862691=15, srv539553305=80, srv1248623533=14, srv637751034=84, srv1028392791=3, srv1956976959=47, srv968254887=98, srv1053753159=5, srv1630616779=33, srv1019757193=2, srv1144398911=10, srv378005182=68, srv952277263=95, srv994063337=99, srv1380928095=19, srv1387824346=21, srv339923568=65, srv1054363777=6, srv432028311=73, srv959631670=97, srv144771853=25, srv827595189=90, srv480706782=77, srv1892510591=45, srv75502729=88, srv505864233=78, srv527146063=79, srv561060243=81, srv1437868135=24, srv1654523131=35, srv1223501099=13, srv472707824=76, srv201613089=53, srv469176388=75, srv1700727703=38, srv1016438329=1, srv1116934178=8, srv380740681=69, srv1217850865=12, srv1695046601=37, srv1740517912=40, srv844914040=92, srv1307101201=16, srv857806519=93, srv1502964458=28, srv276790860=63, srv1540069009=30, srv1043173567=4, srv403329167=71, srv1134197769=9, srv1163942539=11, srv1386370208=20, srv1541330652=31, srv1410074939=22, srv1647316481=34, srv204400513=56, srv2098328080=58, srv1792666360=41, srv195840642=48, srv466761755=74, srv2003833536=51, srv2023402801=55, srv807806281=89, srv135964569=18, srv1884114667=44, srv1411484496=23, srv1542176148=32, srv941014918=94, srv19363278=46, srv1011101746=0, srv1687659448=36, srv596847009=82, srv3411476=66} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-12-31 15:53:16,490 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-12-31 15:53:16,491 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-12-31 15:53:16,491 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-12-31 15:53:16,491 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-12-31 15:53:16,491 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-12-31 15:53:16,491 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-12-31 15:53:16,491 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-12-31 15:53:16,491 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-12-31 15:53:16,491 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-12-31 15:53:16,492 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-12-31 15:53:16,492 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-12-31 15:53:16,492 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-12-31 15:53:16,492 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-12-31 15:53:16,492 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-12-31 15:53:16,492 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-12-31 15:53:16,492 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-12-31 15:53:16,492 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-12-31 15:53:16,493 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-12-31 15:53:16,493 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-12-31 15:53:16,493 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-12-31 15:53:16,493 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-12-31 15:53:16,493 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-12-31 15:53:16,493 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-12-31 15:53:16,493 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-12-31 15:53:16,493 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-12-31 15:53:16,493 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-12-31 15:53:16,494 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-12-31 15:53:16,494 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-12-31 15:53:16,494 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-12-31 15:53:16,494 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-12-31 15:53:16,494 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-12-31 15:53:16,494 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-12-31 15:53:16,494 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-12-31 15:53:16,494 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-12-31 15:53:16,494 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-12-31 15:53:16,495 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-12-31 15:53:16,495 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-12-31 15:53:16,495 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-12-31 15:53:16,495 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-12-31 15:53:16,495 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-12-31 15:53:16,495 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-12-31 15:53:16,495 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-12-31 15:53:16,495 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-12-31 15:53:16,495 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-12-31 15:53:16,495 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-12-31 15:53:16,495 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-12-31 15:53:16,496 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-12-31 15:53:16,496 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-12-31 15:53:16,496 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-12-31 15:53:16,496 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-12-31 15:53:16,496 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-12-31 15:53:16,496 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-12-31 15:53:16,496 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-12-31 15:53:16,496 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-12-31 15:53:16,496 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-12-31 15:53:16,497 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-12-31 15:53:16,497 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-12-31 15:53:16,497 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-12-31 15:53:16,497 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-12-31 15:53:16,497 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-12-31 15:53:16,497 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-12-31 15:53:16,497 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-12-31 15:53:16,497 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-12-31 15:53:16,498 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-12-31 15:53:16,498 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-12-31 15:53:16,498 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-12-31 15:53:16,498 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-12-31 15:53:16,498 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-12-31 15:53:16,498 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-12-31 15:53:16,498 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-12-31 15:53:16,498 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-12-31 15:53:16,498 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-12-31 15:53:16,499 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-12-31 15:53:16,499 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-12-31 15:53:16,499 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-12-31 15:53:16,499 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-12-31 15:53:16,499 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-12-31 15:53:16,499 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-12-31 15:53:16,499 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-12-31 15:53:16,499 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-12-31 15:53:16,499 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-12-31 15:53:16,500 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-12-31 15:53:16,500 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-12-31 15:53:16,500 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-12-31 15:53:16,500 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-12-31 15:53:16,500 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-12-31 15:53:16,500 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-12-31 15:53:16,500 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-12-31 15:53:16,500 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-12-31 15:53:16,500 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-12-31 15:53:16,501 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-12-31 15:53:16,501 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-12-31 15:53:16,501 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-12-31 15:53:16,501 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-12-31 15:53:16,501 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-12-31 15:53:16,501 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-12-31 15:53:16,501 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-12-31 15:53:16,501 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-12-31 15:53:16,501 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-12-31 15:53:16,502 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-12-31 15:53:16,502 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-12-31 15:53:16,632 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.04015557723207018, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.05448668738446516, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.04015557723207018, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.17016666666666666, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.24083333333333334, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-12-31 15:53:16,633 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-12-31 15:53:16,633 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.17531736162762215, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.04015557723207018, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.05448668738446516, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.04015557723207018, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.17016666666666666, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.24083333333333334, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-12-31 15:53:16,957 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 431 ms to try 5000 different iterations.  Found a solution that moves 2690 regions; Going from a computed imbalance of 0.17531736162762215 to a new imbalance of 0.012845081701336983. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.021513386268826082); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.028049179193393878, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.29888888888888887, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.021513386268826082); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.009416666666666667); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.04575, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-12-31 15:53:16,970 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv469176388:77 , srv1437868135:79 , srv1116934178:81 , srv149511875:81 , srv527146063:81 , srv1054363777:82 , srv1163942539:82 , srv1290862691:82 , srv1410074939:82 , srv1411484496:82 , srv1687659448:82 , srv2109108955:82 , srv263530008:82 , srv376010619:82 , srv703994956:82 , srv1028392791:83 , srv2023402801:83 , srv505864233:83 , srv696783186:83 , srv1019757193:84 , srv1076389780:84 , srv1387824346:84 , srv1647316481:84 , srv1695046601:84 , srv1817639204:84 , srv1884114667:84 , srv1956976959:84 , srv629935155:84 , srv827595189:84 , srv844914040:84 , srv959631670:84 , srv1537653498:85 , srv1542176148:85 , srv1792666360:85 , srv1839627253:85 , srv195840642:85 , srv1980990024:85 , srv2005279019:85 , srv269385954:85 , srv276790860:85 , srv430273153:85 , srv539553305:85 , srv75502729:85 , srv830164273:85 , srv994063337:85 , srv1011101746:86 , srv1016438329:86 , srv1345872747:86 , srv1489876147:86 , srv1502964458:86 , srv1541330652:86 , srv2147161230:86 , srv318704950:86 , srv380740681:86 , srv403329167:86 , srv472707824:86 , srv596847009:86 , srv637751034:86 , srv747319130:86 , srv857806519:86 , srv952277263:86 , srv1144398911:87 , srv144771853:87 , srv1540069009:87 , srv2003833536:87 , srv2021269008:87 , srv339923568:87 , srv378005182:87 , srv384515913:87 , srv561060243:87 , srv958449006:87 , srv1043173567:88 , srv1053753159:88 , srv1134197769:88 , srv1217850865:88 , srv135964569:88 , srv1654523131:88 , srv1892510591:88 , srv19363278:88 , srv2000731247:88 , srv201613089:88 , srv2053424814:88 , srv3411476:88 , srv807806281:88 , srv941014918:88 , srv968254887:88 , srv1307101201:89 , srv1386370208:89 , srv1630616779:89 , srv1700727703:89 , srv1705957090:89 , srv1740517912:89 , srv432028311:89 , srv480706782:89 , srv204400513:90 , srv2098328080:90 , srv1223501099:91 , srv1248623533:91 , srv466761755:93 , srv1380928095:518 }
2023-12-31 15:53:16,973 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-12-31 15:53:16,974 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv2000731247=50, srv958449006=96, srv1345872747=17, srv747319130=87, srv696783186=85, srv830164273=91, srv269385954=62, srv1489876147=26, srv149511875=27, srv318704950=64, srv2109108955=59, srv1817639204=42, srv2021269008=54, srv2053424814=57, srv384515913=70, srv2005279019=52, srv1076389780=7, srv703994956=86, srv1705957090=39, srv1980990024=49, srv629935155=83, srv430273153=72, srv1537653498=29, srv2147161230=60, srv263530008=61, srv376010619=67, srv1839627253=43, srv1290862691=15, srv539553305=80, srv1248623533=14, srv637751034=84, srv1028392791=3, srv1956976959=47, srv968254887=98, srv1053753159=5, srv1630616779=33, srv1019757193=2, srv1144398911=10, srv378005182=68, srv952277263=95, srv994063337=99, srv1380928095=19, srv1387824346=21, srv339923568=65, srv1054363777=6, srv432028311=73, srv959631670=97, srv144771853=25, srv827595189=90, srv480706782=77, srv1892510591=45, srv75502729=88, srv505864233=78, srv527146063=79, srv561060243=81, srv1437868135=24, srv1654523131=35, srv1223501099=13, srv472707824=76, srv201613089=53, srv469176388=75, srv1700727703=38, srv1016438329=1, srv1116934178=8, srv380740681=69, srv1217850865=12, srv1695046601=37, srv1740517912=40, srv844914040=92, srv1307101201=16, srv857806519=93, srv1502964458=28, srv276790860=63, srv1540069009=30, srv1043173567=4, srv403329167=71, srv1134197769=9, srv1163942539=11, srv1386370208=20, srv1541330652=31, srv1410074939=22, srv1647316481=34, srv204400513=56, srv2098328080=58, srv1792666360=41, srv195840642=48, srv466761755=74, srv2003833536=51, srv2023402801=55, srv807806281=89, srv135964569=18, srv1884114667=44, srv1411484496=23, srv1542176148=32, srv941014918=94, srv19363278=46, srv1011101746=0, srv1687659448=36, srv596847009=82, srv3411476=66} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-12-31 15:53:17,009 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-12-31 15:53:17,010 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-12-31 15:53:17,010 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-12-31 15:53:17,010 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-12-31 15:53:17,010 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-12-31 15:53:17,010 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-12-31 15:53:17,010 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-12-31 15:53:17,010 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-12-31 15:53:17,010 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-12-31 15:53:17,011 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-12-31 15:53:17,011 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-12-31 15:53:17,011 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-12-31 15:53:17,011 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-12-31 15:53:17,011 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-12-31 15:53:17,011 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-12-31 15:53:17,011 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-12-31 15:53:17,011 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-12-31 15:53:17,011 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-12-31 15:53:17,011 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-12-31 15:53:17,012 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-12-31 15:53:17,012 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-12-31 15:53:17,012 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-12-31 15:53:17,012 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-12-31 15:53:17,012 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-12-31 15:53:17,012 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-12-31 15:53:17,012 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-12-31 15:53:17,012 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-12-31 15:53:17,013 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-12-31 15:53:17,013 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-12-31 15:53:17,013 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-12-31 15:53:17,013 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-12-31 15:53:17,013 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-12-31 15:53:17,013 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-12-31 15:53:17,013 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-12-31 15:53:17,013 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-12-31 15:53:17,013 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-12-31 15:53:17,014 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-12-31 15:53:17,014 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-12-31 15:53:17,014 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-12-31 15:53:17,014 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-12-31 15:53:17,014 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-12-31 15:53:17,014 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-12-31 15:53:17,014 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-12-31 15:53:17,014 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-12-31 15:53:17,014 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-12-31 15:53:17,014 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-12-31 15:53:17,015 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-12-31 15:53:17,015 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-12-31 15:53:17,015 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-12-31 15:53:17,015 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-12-31 15:53:17,015 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-12-31 15:53:17,015 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-12-31 15:53:17,015 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-12-31 15:53:17,015 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-12-31 15:53:17,015 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-12-31 15:53:17,016 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-12-31 15:53:17,016 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-12-31 15:53:17,016 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-12-31 15:53:17,016 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-12-31 15:53:17,016 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-12-31 15:53:17,016 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-12-31 15:53:17,016 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-12-31 15:53:17,016 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-12-31 15:53:17,016 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-12-31 15:53:17,017 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-12-31 15:53:17,017 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-12-31 15:53:17,017 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-12-31 15:53:17,017 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-12-31 15:53:17,017 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-12-31 15:53:17,017 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-12-31 15:53:17,017 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-12-31 15:53:17,017 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-12-31 15:53:17,017 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-12-31 15:53:17,018 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-12-31 15:53:17,018 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-12-31 15:53:17,018 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-12-31 15:53:17,018 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-12-31 15:53:17,018 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-12-31 15:53:17,018 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-12-31 15:53:17,018 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-12-31 15:53:17,018 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-12-31 15:53:17,018 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-12-31 15:53:17,018 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-12-31 15:53:17,018 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-12-31 15:53:17,019 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-12-31 15:53:17,019 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-12-31 15:53:17,019 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-12-31 15:53:17,019 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-12-31 15:53:17,019 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-12-31 15:53:17,019 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-12-31 15:53:17,019 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-12-31 15:53:17,019 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-12-31 15:53:17,019 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-12-31 15:53:17,020 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-12-31 15:53:17,020 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-12-31 15:53:17,020 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-12-31 15:53:17,020 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-12-31 15:53:17,020 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-12-31 15:53:17,020 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-12-31 15:53:17,020 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-12-31 15:53:17,020 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-12-31 15:53:17,140 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.021513386268826082); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.028049179193393878, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.021513386268826082); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.009416666666666667); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.04575, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-12-31 15:53:17,140 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-12-31 15:53:17,140 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.012826245918751726, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.021513386268826082); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.028049179193393878, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.021513386268826082); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.009416666666666667); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.04575, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-12-31 15:53:17,380 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 338 ms to try 5000 different iterations.  Found a solution that moves 993 regions; Going from a computed imbalance of 0.012826245918751726 to a new imbalance of 3.7756641923948907E-4. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.005978303874979817); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.005936438486834389); MoveCostFunction : (multiplier=7.0, imbalance=0.11033333333333334, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.005978303874979817); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0035); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-12-31 15:53:17,381 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1248623533:81 , srv2098328080:81 , srv3411476:81 , srv1630616779:82 , srv2053424814:82 , srv466761755:82 , srv844914040:82 , srv1028392791:83 , srv1654523131:83 , srv1700727703:83 , srv204400513:83 , srv403329167:83 , srv480706782:83 , srv1011101746:84 , srv1043173567:84 , srv1053753159:84 , srv1163942539:84 , srv1223501099:84 , srv1290862691:84 , srv1410074939:84 , srv1489876147:84 , srv1540069009:84 , srv1541330652:84 , srv1647316481:84 , srv1705957090:84 , srv1956976959:84 , srv380740681:84 , srv747319130:84 , srv1134197769:85 , srv1144398911:85 , srv1217850865:85 , srv135964569:85 , srv1386370208:85 , srv144771853:85 , srv1502964458:85 , srv1740517912:85 , srv1792666360:85 , srv1884114667:85 , srv2003833536:85 , srv2023402801:85 , srv376010619:85 , srv432028311:85 , srv596847009:85 , srv629935155:85 , srv637751034:85 , srv1019757193:86 , srv1116934178:86 , srv1307101201:86 , srv1387824346:86 , srv1411484496:86 , srv1437868135:86 , srv149511875:86 , srv1537653498:86 , srv1839627253:86 , srv1892510591:86 , srv19363278:86 , srv2000731247:86 , srv201613089:86 , srv263530008:86 , srv276790860:86 , srv318704950:86 , srv378005182:86 , srv384515913:86 , srv430273153:86 , srv472707824:86 , srv539553305:86 , srv561060243:86 , srv75502729:86 , srv827595189:86 , srv830164273:86 , srv857806519:86 , srv941014918:86 , srv958449006:86 , srv968254887:86 , srv1016438329:87 , srv1076389780:87 , srv1542176148:87 , srv1687659448:87 , srv195840642:87 , srv2021269008:87 , srv2109108955:87 , srv2147161230:87 , srv269385954:87 , srv339923568:87 , srv469176388:87 , srv505864233:87 , srv527146063:87 , srv696783186:87 , srv703994956:87 , srv952277263:87 , srv1054363777:88 , srv1345872747:88 , srv1695046601:88 , srv1980990024:88 , srv2005279019:88 , srv959631670:88 , srv994063337:88 , srv1817639204:89 , srv807806281:89 , srv1380928095:546 }
2023-12-31 15:53:17,385 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-12-31 15:53:17,386 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv2000731247=50, srv958449006=96, srv1345872747=17, srv747319130=87, srv696783186=85, srv830164273=91, srv269385954=62, srv1489876147=26, srv149511875=27, srv318704950=64, srv2109108955=59, srv1817639204=42, srv2021269008=54, srv2053424814=57, srv384515913=70, srv2005279019=52, srv1076389780=7, srv703994956=86, srv1705957090=39, srv1980990024=49, srv629935155=83, srv430273153=72, srv1537653498=29, srv2147161230=60, srv263530008=61, srv376010619=67, srv1839627253=43, srv1290862691=15, srv539553305=80, srv1248623533=14, srv637751034=84, srv1028392791=3, srv1956976959=47, srv968254887=98, srv1053753159=5, srv1630616779=33, srv1019757193=2, srv1144398911=10, srv378005182=68, srv952277263=95, srv994063337=99, srv1380928095=19, srv1387824346=21, srv339923568=65, srv1054363777=6, srv432028311=73, srv959631670=97, srv144771853=25, srv827595189=90, srv480706782=77, srv1892510591=45, srv75502729=88, srv505864233=78, srv527146063=79, srv561060243=81, srv1437868135=24, srv1654523131=35, srv1223501099=13, srv472707824=76, srv201613089=53, srv469176388=75, srv1700727703=38, srv1016438329=1, srv1116934178=8, srv380740681=69, srv1217850865=12, srv1695046601=37, srv1740517912=40, srv844914040=92, srv1307101201=16, srv857806519=93, srv1502964458=28, srv276790860=63, srv1540069009=30, srv1043173567=4, srv403329167=71, srv1134197769=9, srv1163942539=11, srv1386370208=20, srv1541330652=31, srv1410074939=22, srv1647316481=34, srv204400513=56, srv2098328080=58, srv1792666360=41, srv195840642=48, srv466761755=74, srv2003833536=51, srv2023402801=55, srv807806281=89, srv135964569=18, srv1884114667=44, srv1411484496=23, srv1542176148=32, srv941014918=94, srv19363278=46, srv1011101746=0, srv1687659448=36, srv596847009=82, srv3411476=66} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-12-31 15:53:17,397 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-12-31 15:53:17,397 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-12-31 15:53:17,397 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-12-31 15:53:17,397 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-12-31 15:53:17,397 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-12-31 15:53:17,397 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-12-31 15:53:17,397 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-12-31 15:53:17,397 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-12-31 15:53:17,397 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-12-31 15:53:17,398 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-12-31 15:53:17,398 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-12-31 15:53:17,398 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-12-31 15:53:17,398 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-12-31 15:53:17,398 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-12-31 15:53:17,398 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-12-31 15:53:17,398 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-12-31 15:53:17,398 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-12-31 15:53:17,398 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-12-31 15:53:17,398 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-12-31 15:53:17,398 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-12-31 15:53:17,398 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-12-31 15:53:17,398 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-12-31 15:53:17,398 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-12-31 15:53:17,398 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-12-31 15:53:17,398 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-12-31 15:53:17,399 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-12-31 15:53:17,399 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-12-31 15:53:17,399 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-12-31 15:53:17,399 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-12-31 15:53:17,399 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-12-31 15:53:17,399 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-12-31 15:53:17,399 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-12-31 15:53:17,399 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-12-31 15:53:17,399 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-12-31 15:53:17,399 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-12-31 15:53:17,399 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-12-31 15:53:17,399 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-12-31 15:53:17,399 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-12-31 15:53:17,399 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-12-31 15:53:17,399 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-12-31 15:53:17,400 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-12-31 15:53:17,400 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-12-31 15:53:17,400 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-12-31 15:53:17,400 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-12-31 15:53:17,400 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-12-31 15:53:17,400 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-12-31 15:53:17,400 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-12-31 15:53:17,400 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-12-31 15:53:17,400 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-12-31 15:53:17,400 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-12-31 15:53:17,400 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-12-31 15:53:17,400 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-12-31 15:53:17,400 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-12-31 15:53:17,400 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-12-31 15:53:17,400 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-12-31 15:53:17,401 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-12-31 15:53:17,401 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-12-31 15:53:17,401 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-12-31 15:53:17,401 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-12-31 15:53:17,401 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-12-31 15:53:17,401 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-12-31 15:53:17,401 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-12-31 15:53:17,401 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-12-31 15:53:17,401 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-12-31 15:53:17,401 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-12-31 15:53:17,401 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-12-31 15:53:17,401 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-12-31 15:53:17,401 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-12-31 15:53:17,401 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-12-31 15:53:17,401 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-12-31 15:53:17,401 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-12-31 15:53:17,401 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-12-31 15:53:17,402 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-12-31 15:53:17,402 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-12-31 15:53:17,402 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-12-31 15:53:17,402 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-12-31 15:53:17,402 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-12-31 15:53:17,402 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-12-31 15:53:17,402 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-12-31 15:53:17,402 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-12-31 15:53:17,402 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-12-31 15:53:17,402 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-12-31 15:53:17,402 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-12-31 15:53:17,402 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-12-31 15:53:17,402 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-12-31 15:53:17,402 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-12-31 15:53:17,402 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-12-31 15:53:17,402 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-12-31 15:53:17,402 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-12-31 15:53:17,402 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-12-31 15:53:17,403 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-12-31 15:53:17,403 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-12-31 15:53:17,403 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-12-31 15:53:17,403 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-12-31 15:53:17,403 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-12-31 15:53:17,403 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-12-31 15:53:17,403 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-12-31 15:53:17,403 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-12-31 15:53:17,403 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-12-31 15:53:17,403 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-12-31 15:53:17,403 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-12-31 15:53:17,508 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.005978303874979817); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.005936438486834389); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.005978303874979817); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0035); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-12-31 15:53:17,508 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-12-31 15:53:17,508 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=3.7061328462716314E-4, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.005978303874979817); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.005936438486834389); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.005978303874979817); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0035); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-12-31 15:53:17,854 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 442 ms to try 5000 different iterations.  Found a solution that moves 224 regions; Going from a computed imbalance of 3.7061328462716314E-4 to a new imbalance of 2.518035991385194E-5. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=3.868392354571063E-4); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0014982219165849825); MoveCostFunction : (multiplier=7.0, imbalance=0.024888888888888887); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=3.868392354571063E-4); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.6666666666666666E-4); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-12-31 15:53:17,855 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1307101201:83 , srv1839627253:83 , srv432028311:83 , srv1054363777:84 , srv1076389780:84 , srv1116934178:84 , srv1144398911:84 , srv1223501099:84 , srv1248623533:84 , srv1345872747:84 , srv1386370208:84 , srv1410074939:84 , srv144771853:84 , srv1540069009:84 , srv1542176148:84 , srv1630616779:84 , srv1687659448:84 , srv1695046601:84 , srv1884114667:84 , srv1892510591:84 , srv19363278:84 , srv1956976959:84 , srv1980990024:84 , srv2000731247:84 , srv201613089:84 , srv2021269008:84 , srv2109108955:84 , srv2147161230:84 , srv263530008:84 , srv269385954:84 , srv339923568:84 , srv3411476:84 , srv378005182:84 , srv384515913:84 , srv430273153:84 , srv469176388:84 , srv539553305:84 , srv596847009:84 , srv747319130:84 , srv807806281:84 , srv952277263:84 , srv958449006:84 , srv959631670:84 , srv968254887:84 , srv994063337:84 , srv1011101746:85 , srv1016438329:85 , srv1019757193:85 , srv1028392791:85 , srv1043173567:85 , srv1053753159:85 , srv1134197769:85 , srv1163942539:85 , srv1217850865:85 , srv1290862691:85 , srv135964569:85 , srv1387824346:85 , srv1411484496:85 , srv1489876147:85 , srv149511875:85 , srv1537653498:85 , srv1541330652:85 , srv1647316481:85 , srv1654523131:85 , srv1700727703:85 , srv1705957090:85 , srv1740517912:85 , srv1792666360:85 , srv1817639204:85 , srv195840642:85 , srv2003833536:85 , srv2005279019:85 , srv2023402801:85 , srv204400513:85 , srv2053424814:85 , srv2098328080:85 , srv276790860:85 , srv318704950:85 , srv376010619:85 , srv380740681:85 , srv403329167:85 , srv466761755:85 , srv472707824:85 , srv480706782:85 , srv505864233:85 , srv527146063:85 , srv561060243:85 , srv629935155:85 , srv637751034:85 , srv696783186:85 , srv703994956:85 , srv75502729:85 , srv827595189:85 , srv830164273:85 , srv844914040:85 , srv857806519:85 , srv941014918:85 , srv1437868135:86 , srv1502964458:86 , srv1380928095:631 }
2023-12-31 15:53:17,859 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-12-31 15:53:17,859 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv2000731247=50, srv958449006=96, srv1345872747=17, srv747319130=87, srv696783186=85, srv830164273=91, srv269385954=62, srv1489876147=26, srv149511875=27, srv318704950=64, srv2109108955=59, srv1817639204=42, srv2021269008=54, srv2053424814=57, srv384515913=70, srv2005279019=52, srv1076389780=7, srv703994956=86, srv1705957090=39, srv1980990024=49, srv629935155=83, srv430273153=72, srv1537653498=29, srv2147161230=60, srv263530008=61, srv376010619=67, srv1839627253=43, srv1290862691=15, srv539553305=80, srv1248623533=14, srv637751034=84, srv1028392791=3, srv1956976959=47, srv968254887=98, srv1053753159=5, srv1630616779=33, srv1019757193=2, srv1144398911=10, srv378005182=68, srv952277263=95, srv994063337=99, srv1380928095=19, srv1387824346=21, srv339923568=65, srv1054363777=6, srv432028311=73, srv959631670=97, srv144771853=25, srv827595189=90, srv480706782=77, srv1892510591=45, srv75502729=88, srv505864233=78, srv527146063=79, srv561060243=81, srv1437868135=24, srv1654523131=35, srv1223501099=13, srv472707824=76, srv201613089=53, srv469176388=75, srv1700727703=38, srv1016438329=1, srv1116934178=8, srv380740681=69, srv1217850865=12, srv1695046601=37, srv1740517912=40, srv844914040=92, srv1307101201=16, srv857806519=93, srv1502964458=28, srv276790860=63, srv1540069009=30, srv1043173567=4, srv403329167=71, srv1134197769=9, srv1163942539=11, srv1386370208=20, srv1541330652=31, srv1410074939=22, srv1647316481=34, srv204400513=56, srv2098328080=58, srv1792666360=41, srv195840642=48, srv466761755=74, srv2003833536=51, srv2023402801=55, srv807806281=89, srv135964569=18, srv1884114667=44, srv1411484496=23, srv1542176148=32, srv941014918=94, srv19363278=46, srv1011101746=0, srv1687659448=36, srv596847009=82, srv3411476=66} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-12-31 15:53:17,870 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-12-31 15:53:17,870 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-12-31 15:53:17,870 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-12-31 15:53:17,870 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-12-31 15:53:17,870 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-12-31 15:53:17,870 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-12-31 15:53:17,870 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-12-31 15:53:17,870 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-12-31 15:53:17,870 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-12-31 15:53:17,870 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-12-31 15:53:17,870 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-12-31 15:53:17,870 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-12-31 15:53:17,870 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-12-31 15:53:17,870 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-12-31 15:53:17,870 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-12-31 15:53:17,870 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-12-31 15:53:17,871 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-12-31 15:53:17,871 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-12-31 15:53:17,871 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-12-31 15:53:17,871 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-12-31 15:53:17,871 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-12-31 15:53:17,871 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-12-31 15:53:17,871 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-12-31 15:53:17,871 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-12-31 15:53:17,871 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-12-31 15:53:17,871 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-12-31 15:53:17,871 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-12-31 15:53:17,871 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-12-31 15:53:17,871 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-12-31 15:53:17,871 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-12-31 15:53:17,871 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-12-31 15:53:17,871 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-12-31 15:53:17,871 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-12-31 15:53:17,871 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-12-31 15:53:17,871 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-12-31 15:53:17,872 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-12-31 15:53:17,872 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-12-31 15:53:17,872 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-12-31 15:53:17,872 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-12-31 15:53:17,872 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-12-31 15:53:17,872 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-12-31 15:53:17,872 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-12-31 15:53:17,872 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-12-31 15:53:17,872 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-12-31 15:53:17,872 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-12-31 15:53:17,872 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-12-31 15:53:17,872 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-12-31 15:53:17,872 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-12-31 15:53:17,872 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-12-31 15:53:17,872 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-12-31 15:53:17,872 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-12-31 15:53:17,872 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-12-31 15:53:17,872 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-12-31 15:53:17,873 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-12-31 15:53:17,873 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-12-31 15:53:17,873 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-12-31 15:53:17,873 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-12-31 15:53:17,873 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-12-31 15:53:17,873 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-12-31 15:53:17,873 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-12-31 15:53:17,873 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-12-31 15:53:17,873 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-12-31 15:53:17,873 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-12-31 15:53:17,874 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-12-31 15:53:17,874 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-12-31 15:53:17,874 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-12-31 15:53:17,874 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-12-31 15:53:17,874 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-12-31 15:53:17,874 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-12-31 15:53:17,874 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-12-31 15:53:17,874 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-12-31 15:53:17,875 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-12-31 15:53:17,875 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-12-31 15:53:17,875 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-12-31 15:53:17,875 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-12-31 15:53:17,875 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-12-31 15:53:17,875 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-12-31 15:53:17,875 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-12-31 15:53:17,875 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-12-31 15:53:17,875 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-12-31 15:53:17,875 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-12-31 15:53:17,876 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-12-31 15:53:17,876 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-12-31 15:53:17,876 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-12-31 15:53:17,876 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-12-31 15:53:17,876 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-12-31 15:53:17,876 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-12-31 15:53:17,876 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-12-31 15:53:17,876 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-12-31 15:53:17,876 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-12-31 15:53:17,877 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-12-31 15:53:17,877 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-12-31 15:53:17,877 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-12-31 15:53:17,877 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-12-31 15:53:17,877 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-12-31 15:53:17,877 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-12-31 15:53:17,877 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-12-31 15:53:17,877 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-12-31 15:53:17,877 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-12-31 15:53:17,877 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-12-31 15:53:17,877 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-12-31 15:53:17,982 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=3.868392354571063E-4); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0014982219165849825); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=3.868392354571063E-4); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.6666666666666666E-4); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-12-31 15:53:17,982 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-12-31 15:53:17,982 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=2.3611878390024123E-5, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=3.868392354571063E-4); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0014982219165849825); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=3.868392354571063E-4); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.6666666666666666E-4); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-12-31 15:53:18,220 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 334 ms to try 5000 different iterations.  Found a solution that moves 12 regions; Going from a computed imbalance of 2.3611878390024123E-5 to a new imbalance of 6.4820114681890455E-6. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0014213381090374027); MoveCostFunction : (multiplier=7.0, imbalance=0.0013333333333333333); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-12-31 15:53:18,220 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1016438329:83 , srv1437868135:83 , srv1502964458:83 , srv1700727703:83 , srv1817639204:83 , srv276790860:83 , srv1011101746:84 , srv1019757193:84 , srv1028392791:84 , srv1043173567:84 , srv1053753159:84 , srv1054363777:84 , srv1076389780:84 , srv1116934178:84 , srv1134197769:84 , srv1144398911:84 , srv1163942539:84 , srv1217850865:84 , srv1223501099:84 , srv1290862691:84 , srv1307101201:84 , srv135964569:84 , srv1386370208:84 , srv1387824346:84 , srv1411484496:84 , srv144771853:84 , srv1489876147:84 , srv149511875:84 , srv1537653498:84 , srv1540069009:84 , srv1541330652:84 , srv1542176148:84 , srv1630616779:84 , srv1647316481:84 , srv1654523131:84 , srv1687659448:84 , srv1695046601:84 , srv1705957090:84 , srv1740517912:84 , srv1792666360:84 , srv1884114667:84 , srv19363278:84 , srv195840642:84 , srv1980990024:84 , srv2000731247:84 , srv2003833536:84 , srv2005279019:84 , srv201613089:84 , srv2021269008:84 , srv2023402801:84 , srv204400513:84 , srv2053424814:84 , srv2098328080:84 , srv2109108955:84 , srv2147161230:84 , srv263530008:84 , srv269385954:84 , srv318704950:84 , srv339923568:84 , srv3411476:84 , srv376010619:84 , srv378005182:84 , srv380740681:84 , srv384515913:84 , srv403329167:84 , srv430273153:84 , srv432028311:84 , srv466761755:84 , srv469176388:84 , srv472707824:84 , srv480706782:84 , srv505864233:84 , srv527146063:84 , srv539553305:84 , srv561060243:84 , srv596847009:84 , srv629935155:84 , srv637751034:84 , srv696783186:84 , srv703994956:84 , srv747319130:84 , srv75502729:84 , srv807806281:84 , srv827595189:84 , srv830164273:84 , srv844914040:84 , srv857806519:84 , srv941014918:84 , srv952277263:84 , srv958449006:84 , srv959631670:84 , srv968254887:84 , srv994063337:84 , srv1248623533:85 , srv1345872747:85 , srv1410074939:85 , srv1839627253:85 , srv1892510591:85 , srv1956976959:85 , srv1380928095:684 }
2023-12-31 15:53:18,223 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-12-31 15:53:18,224 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv2000731247=50, srv958449006=96, srv1345872747=17, srv747319130=87, srv696783186=85, srv830164273=91, srv269385954=62, srv1489876147=26, srv149511875=27, srv318704950=64, srv2109108955=59, srv1817639204=42, srv2021269008=54, srv2053424814=57, srv384515913=70, srv2005279019=52, srv1076389780=7, srv703994956=86, srv1705957090=39, srv1980990024=49, srv629935155=83, srv430273153=72, srv1537653498=29, srv2147161230=60, srv263530008=61, srv376010619=67, srv1839627253=43, srv1290862691=15, srv539553305=80, srv1248623533=14, srv637751034=84, srv1028392791=3, srv1956976959=47, srv968254887=98, srv1053753159=5, srv1630616779=33, srv1019757193=2, srv1144398911=10, srv378005182=68, srv952277263=95, srv994063337=99, srv1380928095=19, srv1387824346=21, srv339923568=65, srv1054363777=6, srv432028311=73, srv959631670=97, srv144771853=25, srv827595189=90, srv480706782=77, srv1892510591=45, srv75502729=88, srv505864233=78, srv527146063=79, srv561060243=81, srv1437868135=24, srv1654523131=35, srv1223501099=13, srv472707824=76, srv201613089=53, srv469176388=75, srv1700727703=38, srv1016438329=1, srv1116934178=8, srv380740681=69, srv1217850865=12, srv1695046601=37, srv1740517912=40, srv844914040=92, srv1307101201=16, srv857806519=93, srv1502964458=28, srv276790860=63, srv1540069009=30, srv1043173567=4, srv403329167=71, srv1134197769=9, srv1163942539=11, srv1386370208=20, srv1541330652=31, srv1410074939=22, srv1647316481=34, srv204400513=56, srv2098328080=58, srv1792666360=41, srv195840642=48, srv466761755=74, srv2003833536=51, srv2023402801=55, srv807806281=89, srv135964569=18, srv1884114667=44, srv1411484496=23, srv1542176148=32, srv941014918=94, srv19363278=46, srv1011101746=0, srv1687659448=36, srv596847009=82, srv3411476=66} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-12-31 15:53:18,234 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-12-31 15:53:18,234 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-12-31 15:53:18,234 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-12-31 15:53:18,234 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-12-31 15:53:18,234 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-12-31 15:53:18,234 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-12-31 15:53:18,234 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-12-31 15:53:18,235 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-12-31 15:53:18,235 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-12-31 15:53:18,235 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-12-31 15:53:18,235 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-12-31 15:53:18,235 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-12-31 15:53:18,235 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-12-31 15:53:18,235 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-12-31 15:53:18,235 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-12-31 15:53:18,235 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-12-31 15:53:18,235 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-12-31 15:53:18,235 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-12-31 15:53:18,235 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-12-31 15:53:18,235 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-12-31 15:53:18,235 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-12-31 15:53:18,235 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-12-31 15:53:18,235 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-12-31 15:53:18,235 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-12-31 15:53:18,235 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-12-31 15:53:18,235 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-12-31 15:53:18,235 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-12-31 15:53:18,235 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-12-31 15:53:18,236 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-12-31 15:53:18,236 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-12-31 15:53:18,236 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-12-31 15:53:18,236 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-12-31 15:53:18,236 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-12-31 15:53:18,236 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-12-31 15:53:18,236 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-12-31 15:53:18,236 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-12-31 15:53:18,236 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-12-31 15:53:18,236 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-12-31 15:53:18,236 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-12-31 15:53:18,236 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-12-31 15:53:18,236 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-12-31 15:53:18,236 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-12-31 15:53:18,236 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-12-31 15:53:18,236 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-12-31 15:53:18,236 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-12-31 15:53:18,236 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-12-31 15:53:18,236 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-12-31 15:53:18,236 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-12-31 15:53:18,236 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-12-31 15:53:18,236 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-12-31 15:53:18,237 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-12-31 15:53:18,237 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-12-31 15:53:18,237 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-12-31 15:53:18,237 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-12-31 15:53:18,237 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-12-31 15:53:18,237 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-12-31 15:53:18,237 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-12-31 15:53:18,237 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-12-31 15:53:18,237 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-12-31 15:53:18,237 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-12-31 15:53:18,237 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-12-31 15:53:18,237 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-12-31 15:53:18,237 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-12-31 15:53:18,237 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-12-31 15:53:18,237 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-12-31 15:53:18,237 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-12-31 15:53:18,237 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-12-31 15:53:18,237 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-12-31 15:53:18,237 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-12-31 15:53:18,237 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-12-31 15:53:18,237 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-12-31 15:53:18,237 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-12-31 15:53:18,237 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-12-31 15:53:18,238 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-12-31 15:53:18,238 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-12-31 15:53:18,238 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-12-31 15:53:18,238 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-12-31 15:53:18,238 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-12-31 15:53:18,238 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-12-31 15:53:18,238 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-12-31 15:53:18,238 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-12-31 15:53:18,238 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-12-31 15:53:18,238 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-12-31 15:53:18,238 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-12-31 15:53:18,238 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-12-31 15:53:18,238 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-12-31 15:53:18,238 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-12-31 15:53:18,238 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-12-31 15:53:18,238 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-12-31 15:53:18,238 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-12-31 15:53:18,238 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-12-31 15:53:18,238 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-12-31 15:53:18,238 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-12-31 15:53:18,238 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-12-31 15:53:18,239 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-12-31 15:53:18,239 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-12-31 15:53:18,239 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-12-31 15:53:18,239 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-12-31 15:53:18,239 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-12-31 15:53:18,239 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-12-31 15:53:18,239 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-12-31 15:53:18,344 INFO  [Time-limited test] balancer.StochasticLoadBalancer(381): Cluster wide - skipping load balancing because weighted average imbalance=6.397985672269699E-6 <= threshold(0.025). If you want more aggressive balancing, either lower hbase.master.balancer.stochastic.minCostNeedBalance from 0.025 or increase the relative multiplier(s) of the specific cost function(s). functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0014213381090374027); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-12-31 15:53:18,345 INFO  [Time-limited test] balancer.BalancerTestBase(570): Mock Final balance: { srv1016438329:83 , srv1437868135:83 , srv1502964458:83 , srv1700727703:83 , srv1817639204:83 , srv276790860:83 , srv1011101746:84 , srv1019757193:84 , srv1028392791:84 , srv1043173567:84 , srv1053753159:84 , srv1054363777:84 , srv1076389780:84 , srv1116934178:84 , srv1134197769:84 , srv1144398911:84 , srv1163942539:84 , srv1217850865:84 , srv1223501099:84 , srv1290862691:84 , srv1307101201:84 , srv135964569:84 , srv1386370208:84 , srv1387824346:84 , srv1411484496:84 , srv144771853:84 , srv1489876147:84 , srv149511875:84 , srv1537653498:84 , srv1540069009:84 , srv1541330652:84 , srv1542176148:84 , srv1630616779:84 , srv1647316481:84 , srv1654523131:84 , srv1687659448:84 , srv1695046601:84 , srv1705957090:84 , srv1740517912:84 , srv1792666360:84 , srv1884114667:84 , srv19363278:84 , srv195840642:84 , srv1980990024:84 , srv2000731247:84 , srv2003833536:84 , srv2005279019:84 , srv201613089:84 , srv2021269008:84 , srv2023402801:84 , srv204400513:84 , srv2053424814:84 , srv2098328080:84 , srv2109108955:84 , srv2147161230:84 , srv263530008:84 , srv269385954:84 , srv318704950:84 , srv339923568:84 , srv3411476:84 , srv376010619:84 , srv378005182:84 , srv380740681:84 , srv384515913:84 , srv403329167:84 , srv430273153:84 , srv432028311:84 , srv466761755:84 , srv469176388:84 , srv472707824:84 , srv480706782:84 , srv505864233:84 , srv527146063:84 , srv539553305:84 , srv561060243:84 , srv596847009:84 , srv629935155:84 , srv637751034:84 , srv696783186:84 , srv703994956:84 , srv747319130:84 , srv75502729:84 , srv807806281:84 , srv827595189:84 , srv830164273:84 , srv844914040:84 , srv857806519:84 , srv941014918:84 , srv952277263:84 , srv958449006:84 , srv959631670:84 , srv968254887:84 , srv994063337:84 , srv1248623533:85 , srv1345872747:85 , srv1410074939:85 , srv1839627253:85 , srv1892510591:85 , srv1956976959:85 , srv1380928095:684 }
2023-12-31 15:53:18,371 INFO  [Time-limited test] hbase.ResourceChecker(175): after: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnLargeClusterWithRacks Thread=12 (was 12), OpenFileDescriptor=290 (was 290), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=265 (was 271), ProcessCount=167 (was 167), AvailableMemoryMB=4138 (was 4747)
2023-12-31 15:53:18,379 INFO  [Time-limited test] hbase.ResourceChecker(147): before: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnMidClusterWithRacks Thread=12, OpenFileDescriptor=290, MaxFileDescriptor=60000, SystemLoadAverage=265, ProcessCount=167, AvailableMemoryMB=4137
2023-12-31 15:53:18,380 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2023-12-31 15:53:18,380 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=5000, runMaxSteps=true, stepsPerRegion=800, maxRunningTime=120000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 111077.0 etc.
2023-12-31 15:53:18,388 INFO  [Time-limited test] balancer.BalancerTestBase(547): Mock Cluster : { srv108633503:84 , srv1165100332:84 , srv1165263641:84 , srv117587398:84 , srv1195768664:84 , srv1292963821:84 , srv1339348380:84 , srv1382774392:84 , srv1389681340:84 , srv1417338793:84 , srv150095125:84 , srv1758805612:84 , srv1838667860:84 , srv1867869147:84 , srv205416862:84 , srv222844595:84 , srv364218730:84 , srv431398893:84 , srv462213328:84 , srv537280365:84 , srv610991944:84 , srv635921831:84 , srv734720086:84 , srv803275654:84 , srv838457961:84 , srv858502075:84 , srv903665296:84 , srv924426808:84 , srv974894960:84 , srv1848255857:264 } [srvr=30 rgns=2700 avg=90.0 max=90 min=90]
2023-12-31 15:53:18,390 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-12-31 15:53:18,390 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1838667860=12, srv462213328=19, srv1195768664=4, srv1292963821=5, srv1382774392=7, srv635921831=22, srv1389681340=8, srv838457961=25, srv974894960=29, srv117587398=3, srv1758805612=11, srv803275654=24, srv903665296=27, srv1165100332=1, srv150095125=10, srv205416862=15, srv734720086=23, srv1339348380=6, srv858502075=26, srv222844595=16, srv1165263641=2, srv431398893=18, srv1417338793=9, srv537280365=20, srv1848255857=13, srv364218730=17, srv610991944=21, srv1867869147=14, srv924426808=28, srv108633503=0} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-12-31 15:53:18,398 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-12-31 15:53:18,398 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-12-31 15:53:18,398 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-12-31 15:53:18,398 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-12-31 15:53:18,398 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-12-31 15:53:18,398 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-12-31 15:53:18,398 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-12-31 15:53:18,398 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-12-31 15:53:18,398 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-12-31 15:53:18,398 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-12-31 15:53:18,398 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-12-31 15:53:18,398 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-12-31 15:53:18,398 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-12-31 15:53:18,399 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-12-31 15:53:18,399 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-12-31 15:53:18,399 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-12-31 15:53:18,399 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-12-31 15:53:18,399 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-12-31 15:53:18,399 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-12-31 15:53:18,399 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-12-31 15:53:18,399 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-12-31 15:53:18,399 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-12-31 15:53:18,399 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-12-31 15:53:18,399 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-12-31 15:53:18,399 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-12-31 15:53:18,399 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-12-31 15:53:18,399 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-12-31 15:53:18,399 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-12-31 15:53:18,399 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-12-31 15:53:18,399 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-12-31 15:53:18,399 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=10, number of hosts=30, number of racks=4
2023-12-31 15:53:18,414 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=1.1169938511012616, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-12-31 15:53:18,414 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.9912561687068899, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=1.1169938511012616, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=64800000
2023-12-31 15:55:18,402 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 120001 ms to try 5750191 different iterations.  Found a solution that moves 1856 regions; Going from a computed imbalance of 0.9912561687068899 to a new imbalance of 4.3319965896196796E-5. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); MoveCostFunction : (multiplier=7.0, imbalance=0.6874074074074074, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-12-31 15:55:18,410 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv108633503:90 , srv1165100332:90 , srv1165263641:90 , srv117587398:90 , srv1195768664:90 , srv1292963821:90 , srv1339348380:90 , srv1382774392:90 , srv1389681340:90 , srv1417338793:90 , srv150095125:90 , srv1758805612:90 , srv1838667860:90 , srv1848255857:90 , srv1867869147:90 , srv205416862:90 , srv222844595:90 , srv364218730:90 , srv431398893:90 , srv462213328:90 , srv537280365:90 , srv610991944:90 , srv635921831:90 , srv734720086:90 , srv803275654:90 , srv838457961:90 , srv858502075:90 , srv903665296:90 , srv924426808:90 , srv974894960:90 }
2023-12-31 15:55:18,411 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-12-31 15:55:18,412 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1838667860=12, srv462213328=19, srv1195768664=4, srv1292963821=5, srv1382774392=7, srv635921831=22, srv1389681340=8, srv838457961=25, srv974894960=29, srv117587398=3, srv1758805612=11, srv803275654=24, srv903665296=27, srv1165100332=1, srv150095125=10, srv205416862=15, srv734720086=23, srv1339348380=6, srv858502075=26, srv222844595=16, srv1165263641=2, srv431398893=18, srv1417338793=9, srv537280365=20, srv1848255857=13, srv364218730=17, srv610991944=21, srv1867869147=14, srv924426808=28, srv108633503=0} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-12-31 15:55:18,415 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-12-31 15:55:18,415 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-12-31 15:55:18,415 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-12-31 15:55:18,415 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-12-31 15:55:18,415 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-12-31 15:55:18,415 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-12-31 15:55:18,415 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-12-31 15:55:18,415 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-12-31 15:55:18,415 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-12-31 15:55:18,415 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-12-31 15:55:18,415 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-12-31 15:55:18,415 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-12-31 15:55:18,415 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-12-31 15:55:18,416 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-12-31 15:55:18,416 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-12-31 15:55:18,416 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-12-31 15:55:18,416 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-12-31 15:55:18,416 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-12-31 15:55:18,416 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-12-31 15:55:18,416 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-12-31 15:55:18,416 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-12-31 15:55:18,416 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-12-31 15:55:18,416 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-12-31 15:55:18,416 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-12-31 15:55:18,416 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-12-31 15:55:18,416 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-12-31 15:55:18,416 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-12-31 15:55:18,416 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-12-31 15:55:18,416 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-12-31 15:55:18,416 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-12-31 15:55:18,416 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=10, number of hosts=30, number of racks=4
2023-12-31 15:55:18,430 INFO  [Time-limited test] balancer.StochasticLoadBalancer(381): Cluster wide - skipping load balancing because weighted average imbalance=0.0 <= threshold(0.025). If you want more aggressive balancing, either lower hbase.master.balancer.stochastic.minCostNeedBalance from 0.025 or increase the relative multiplier(s) of the specific cost function(s). functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-12-31 15:55:18,430 INFO  [Time-limited test] balancer.BalancerTestBase(570): Mock Final balance: { srv108633503:90 , srv1165100332:90 , srv1165263641:90 , srv117587398:90 , srv1195768664:90 , srv1292963821:90 , srv1339348380:90 , srv1382774392:90 , srv1389681340:90 , srv1417338793:90 , srv150095125:90 , srv1758805612:90 , srv1838667860:90 , srv1848255857:90 , srv1867869147:90 , srv205416862:90 , srv222844595:90 , srv364218730:90 , srv431398893:90 , srv462213328:90 , srv537280365:90 , srv610991944:90 , srv635921831:90 , srv734720086:90 , srv803275654:90 , srv838457961:90 , srv858502075:90 , srv903665296:90 , srv924426808:90 , srv974894960:90 }
2023-12-31 15:55:18,445 INFO  [Time-limited test] hbase.ResourceChecker(175): after: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnMidClusterWithRacks Thread=11 (was 12), OpenFileDescriptor=290 (was 290), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=198 (was 265), ProcessCount=167 (was 167), AvailableMemoryMB=3464 (was 4137)