2023-12-16 22:53:24,531 INFO  [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks timeout: 13 mins
2023-12-16 22:53:24,756 WARN  [Time-limited test] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties
2023-12-16 22:53:24,845 INFO  [Time-limited test] metrics.MetricRegistriesLoader(60): Loaded MetricRegistries class org.apache.hadoop.hbase.metrics.impl.MetricRegistriesImpl
2023-12-16 22:53:24,902 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2023-12-16 22:53:24,908 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc.
2023-12-16 22:53:24,918 INFO  [Time-limited test] hbase.ResourceChecker(147): before: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnLargeClusterWithRacks Thread=12, OpenFileDescriptor=290, MaxFileDescriptor=60000, SystemLoadAverage=281, ProcessCount=170, AvailableMemoryMB=4640
2023-12-16 22:53:24,920 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2023-12-16 22:53:24,921 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=5000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=10000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc.
2023-12-16 22:53:25,024 INFO  [Time-limited test] balancer.BalancerTestBase(547): Mock Cluster : { srv1013501623:84 , srv1033624506:84 , srv1058796516:84 , srv1092576470:84 , srv1129212:84 , srv1135505301:84 , srv1140824639:84 , srv1166473453:84 , srv121167382:84 , srv1215749524:84 , srv1220263546:84 , srv1245932139:84 , srv1250780439:84 , srv1251999457:84 , srv1303979075:84 , srv1339216511:84 , srv1350336571:84 , srv1354501786:84 , srv1356233687:84 , srv1406445834:84 , srv1407565835:84 , srv1412268181:84 , srv142902439:84 , srv1444754019:84 , srv1473629223:84 , srv1498105542:84 , srv1519645024:84 , srv1549405934:84 , srv1595791723:84 , srv1601705550:84 , srv1623698829:84 , srv1631445294:84 , srv1647278100:84 , srv1675016281:84 , srv1688125381:84 , srv1696487604:84 , srv1754789233:84 , srv1754853790:84 , srv1777161585:84 , srv1779115759:84 , srv17866649:84 , srv1866360385:84 , srv1867440550:84 , srv1879565413:84 , srv1888393280:84 , srv1894778436:84 , srv1894889473:84 , srv1915675420:84 , srv1920207566:84 , srv1994887084:84 , srv2009639989:84 , srv2064046396:84 , srv2080956415:84 , srv2101859891:84 , srv2107023488:84 , srv2120167762:84 , srv2123996119:84 , srv268412351:84 , srv278534926:84 , srv338769136:84 , srv381289730:84 , srv403858197:84 , srv419997687:84 , srv47716955:84 , srv479019302:84 , srv487054749:84 , srv488156568:84 , srv542488819:84 , srv571036030:84 , srv572063390:84 , srv582965651:84 , srv622968995:84 , srv62530350:84 , srv642467262:84 , srv690650967:84 , srv711994360:84 , srv731852413:84 , srv765508513:84 , srv778114381:84 , srv789283053:84 , srv853140311:84 , srv855891613:84 , srv86026589:84 , srv870214628:84 , srv878952308:84 , srv887297652:84 , srv893575915:84 , srv89751287:84 , srv902228695:84 , srv902238319:84 , srv915757839:84 , srv926402388:84 , srv945555243:84 , srv953653527:84 , srv977580725:84 , srv978606025:84 , srv984806824:84 , srv994147446:84 , srv996240035:84 , srv258987439:684 } [srvr=100 rgns=9000 avg=90.0 max=90 min=90]
2023-12-16 22:53:25,031 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-12-16 22:53:25,037 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv711994360=76, srv2009639989=50, srv642467262=74, srv582965651=71, srv1407565835=20, srv1251999457=13, srv1888393280=44, srv765508513=78, srv2123996119=56, srv2101859891=53, srv878952308=85, srv1696487604=35, srv2107023488=54, srv479019302=65, srv403858197=62, srv1350336571=16, srv978606025=96, srv893575915=87, srv1867440550=42, srv1894778436=45, srv1595791723=28, srv778114381=79, srv1033624506=1, srv1631445294=31, srv1135505301=5, srv1339216511=15, srv1519645024=26, srv1013501623=0, srv1215749524=9, srv789283053=80, srv1915675420=47, srv926402388=92, srv381289730=61, srv47716955=64, srv870214628=84, srv902228695=89, srv258987439=57, srv1879565413=43, srv1675016281=33, srv1406445834=19, srv915757839=91, srv1245932139=11, srv1412268181=21, srv1623698829=30, srv571036030=69, srv1894889473=46, srv977580725=95, srv542488819=68, srv994147446=98, srv278534926=59, srv1779115759=39, srv984806824=97, srv996240035=99, srv1092576470=3, srv142902439=22, srv1473629223=24, srv1647278100=32, srv1920207566=48, srv1994887084=49, srv487054749=66, srv488156568=67, srv1777161585=38, srv89751287=88, srv1166473453=7, srv1754853790=37, srv2080956415=52, srv1549405934=27, srv121167382=8, srv419997687=63, srv855891613=82, srv853140311=81, srv953653527=94, srv1498105542=25, srv1754789233=36, srv268412351=58, srv945555243=93, srv17866649=40, srv572063390=70, srv1866360385=41, srv338769136=60, srv1354501786=17, srv2120167762=55, srv690650967=75, srv887297652=86, srv2064046396=51, srv1303979075=14, srv1688125381=34, srv622968995=72, srv1250780439=12, srv62530350=73, srv1356233687=18, srv86026589=83, srv1058796516=2, srv1220263546=10, srv1444754019=23, srv731852413=77, srv902238319=90, srv1140824639=6, srv1601705550=29, srv1129212=4} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-12-16 22:53:25,100 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-12-16 22:53:25,100 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-12-16 22:53:25,100 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-12-16 22:53:25,101 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-12-16 22:53:25,101 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-12-16 22:53:25,101 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-12-16 22:53:25,101 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-12-16 22:53:25,101 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-12-16 22:53:25,101 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-12-16 22:53:25,101 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-12-16 22:53:25,101 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-12-16 22:53:25,101 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-12-16 22:53:25,102 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-12-16 22:53:25,102 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-12-16 22:53:25,102 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-12-16 22:53:25,102 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-12-16 22:53:25,102 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-12-16 22:53:25,102 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-12-16 22:53:25,102 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-12-16 22:53:25,102 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-12-16 22:53:25,102 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-12-16 22:53:25,102 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-12-16 22:53:25,103 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-12-16 22:53:25,103 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-12-16 22:53:25,103 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-12-16 22:53:25,103 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-12-16 22:53:25,103 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-12-16 22:53:25,103 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-12-16 22:53:25,103 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-12-16 22:53:25,103 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-12-16 22:53:25,103 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-12-16 22:53:25,103 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-12-16 22:53:25,103 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-12-16 22:53:25,104 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-12-16 22:53:25,104 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-12-16 22:53:25,104 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-12-16 22:53:25,104 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-12-16 22:53:25,104 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-12-16 22:53:25,104 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-12-16 22:53:25,104 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-12-16 22:53:25,104 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-12-16 22:53:25,104 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-12-16 22:53:25,104 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-12-16 22:53:25,105 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-12-16 22:53:25,105 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-12-16 22:53:25,105 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-12-16 22:53:25,105 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-12-16 22:53:25,105 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-12-16 22:53:25,105 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-12-16 22:53:25,105 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-12-16 22:53:25,105 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-12-16 22:53:25,105 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-12-16 22:53:25,105 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-12-16 22:53:25,105 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-12-16 22:53:25,106 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-12-16 22:53:25,106 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-12-16 22:53:25,106 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-12-16 22:53:25,106 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-12-16 22:53:25,106 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-12-16 22:53:25,106 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-12-16 22:53:25,106 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-12-16 22:53:25,106 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-12-16 22:53:25,106 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-12-16 22:53:25,106 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-12-16 22:53:25,106 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-12-16 22:53:25,107 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-12-16 22:53:25,107 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-12-16 22:53:25,107 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-12-16 22:53:25,107 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-12-16 22:53:25,107 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-12-16 22:53:25,107 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-12-16 22:53:25,107 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-12-16 22:53:25,107 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-12-16 22:53:25,107 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-12-16 22:53:25,107 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-12-16 22:53:25,107 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-12-16 22:53:25,108 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-12-16 22:53:25,108 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-12-16 22:53:25,108 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-12-16 22:53:25,108 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-12-16 22:53:25,108 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-12-16 22:53:25,108 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-12-16 22:53:25,108 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-12-16 22:53:25,108 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-12-16 22:53:25,108 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-12-16 22:53:25,108 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-12-16 22:53:25,109 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-12-16 22:53:25,109 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-12-16 22:53:25,109 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-12-16 22:53:25,109 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-12-16 22:53:25,109 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-12-16 22:53:25,109 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-12-16 22:53:25,109 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-12-16 22:53:25,109 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-12-16 22:53:25,109 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-12-16 22:53:25,109 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-12-16 22:53:25,109 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-12-16 22:53:25,109 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-12-16 22:53:25,110 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-12-16 22:53:25,110 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-12-16 22:53:25,110 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-12-16 22:53:25,336 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.06666666666666667, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-12-16 22:53:25,336 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-12-16 22:53:25,337 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.9909252140407105, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.06666666666666667, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-12-16 22:53:25,596 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 467 ms to try 5000 different iterations.  Found a solution that moves 4685 regions; Going from a computed imbalance of 0.9909252140407105 to a new imbalance of 0.17850001825941542. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.04239494472306903, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.05850935443737086, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.5205555555555555, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.04239494472306903, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.17383333333333334, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.23883333333333334, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-12-16 22:53:25,606 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1166473453:80 , srv121167382:82 , srv1245932139:82 , srv1473629223:82 , srv1647278100:82 , srv2080956415:82 , srv642467262:82 , srv902228695:82 , srv915757839:82 , srv994147446:82 , srv1129212:83 , srv926402388:83 , srv1092576470:84 , srv1220263546:84 , srv1407565835:84 , srv1623698829:84 , srv1754853790:84 , srv1777161585:84 , srv1779115759:84 , srv2009639989:84 , srv487054749:84 , srv571036030:84 , srv789283053:84 , srv1215749524:85 , srv1303979075:85 , srv1339216511:85 , srv1406445834:85 , srv1444754019:85 , srv1498105542:85 , srv1519645024:85 , srv1631445294:85 , srv268412351:85 , srv381289730:85 , srv488156568:85 , srv542488819:85 , srv1058796516:86 , srv1140824639:86 , srv1350336571:86 , srv1412268181:86 , srv142902439:86 , srv1601705550:86 , srv1688125381:86 , srv1696487604:86 , srv1867440550:86 , srv1879565413:86 , srv1888393280:86 , srv2101859891:86 , srv47716955:86 , srv870214628:86 , srv887297652:86 , srv902238319:86 , srv996240035:86 , srv1250780439:87 , srv1251999457:87 , srv1354501786:87 , srv1894778436:87 , srv1894889473:87 , srv1920207566:87 , srv2107023488:87 , srv338769136:87 , srv403858197:87 , srv479019302:87 , srv582965651:87 , srv62530350:87 , srv765508513:87 , srv855891613:87 , srv86026589:87 , srv878952308:87 , srv89751287:87 , srv953653527:87 , srv977580725:87 , srv1013501623:88 , srv1033624506:88 , srv1135505301:88 , srv1356233687:88 , srv1549405934:88 , srv1675016281:88 , srv1754789233:88 , srv1915675420:88 , srv2064046396:88 , srv2120167762:88 , srv278534926:88 , srv731852413:88 , srv893575915:88 , srv978606025:88 , srv17866649:89 , srv1866360385:89 , srv1994887084:89 , srv2123996119:89 , srv572063390:89 , srv622968995:89 , srv690650967:89 , srv711994360:89 , srv984806824:89 , srv1595791723:90 , srv778114381:90 , srv945555243:91 , srv853140311:92 , srv419997687:94 , srv258987439:467 }
2023-12-16 22:53:25,609 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-12-16 22:53:25,610 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv711994360=76, srv2009639989=50, srv642467262=74, srv582965651=71, srv1407565835=20, srv1251999457=13, srv1888393280=44, srv765508513=78, srv2123996119=56, srv2101859891=53, srv878952308=85, srv1696487604=35, srv2107023488=54, srv479019302=65, srv403858197=62, srv1350336571=16, srv978606025=96, srv893575915=87, srv1867440550=42, srv1894778436=45, srv1595791723=28, srv778114381=79, srv1033624506=1, srv1631445294=31, srv1135505301=5, srv1339216511=15, srv1519645024=26, srv1013501623=0, srv1215749524=9, srv789283053=80, srv1915675420=47, srv926402388=92, srv381289730=61, srv47716955=64, srv870214628=84, srv902228695=89, srv258987439=57, srv1879565413=43, srv1675016281=33, srv1406445834=19, srv915757839=91, srv1245932139=11, srv1412268181=21, srv1623698829=30, srv571036030=69, srv1894889473=46, srv977580725=95, srv542488819=68, srv994147446=98, srv278534926=59, srv1779115759=39, srv984806824=97, srv996240035=99, srv1092576470=3, srv142902439=22, srv1473629223=24, srv1647278100=32, srv1920207566=48, srv1994887084=49, srv487054749=66, srv488156568=67, srv1777161585=38, srv89751287=88, srv1166473453=7, srv1754853790=37, srv2080956415=52, srv1549405934=27, srv121167382=8, srv419997687=63, srv855891613=82, srv853140311=81, srv953653527=94, srv1498105542=25, srv1754789233=36, srv268412351=58, srv945555243=93, srv17866649=40, srv572063390=70, srv1866360385=41, srv338769136=60, srv1354501786=17, srv2120167762=55, srv690650967=75, srv887297652=86, srv2064046396=51, srv1303979075=14, srv1688125381=34, srv622968995=72, srv1250780439=12, srv62530350=73, srv1356233687=18, srv86026589=83, srv1058796516=2, srv1220263546=10, srv1444754019=23, srv731852413=77, srv902238319=90, srv1140824639=6, srv1601705550=29, srv1129212=4} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-12-16 22:53:25,624 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-12-16 22:53:25,625 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-12-16 22:53:25,625 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-12-16 22:53:25,625 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-12-16 22:53:25,625 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-12-16 22:53:25,625 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-12-16 22:53:25,625 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-12-16 22:53:25,625 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-12-16 22:53:25,625 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-12-16 22:53:25,625 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-12-16 22:53:25,625 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-12-16 22:53:25,626 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-12-16 22:53:25,626 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-12-16 22:53:25,626 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-12-16 22:53:25,626 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-12-16 22:53:25,626 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-12-16 22:53:25,626 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-12-16 22:53:25,626 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-12-16 22:53:25,626 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-12-16 22:53:25,626 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-12-16 22:53:25,626 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-12-16 22:53:25,626 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-12-16 22:53:25,626 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-12-16 22:53:25,626 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-12-16 22:53:25,627 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-12-16 22:53:25,627 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-12-16 22:53:25,627 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-12-16 22:53:25,627 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-12-16 22:53:25,627 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-12-16 22:53:25,627 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-12-16 22:53:25,627 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-12-16 22:53:25,627 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-12-16 22:53:25,627 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-12-16 22:53:25,627 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-12-16 22:53:25,627 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-12-16 22:53:25,627 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-12-16 22:53:25,627 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-12-16 22:53:25,627 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-12-16 22:53:25,628 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-12-16 22:53:25,628 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-12-16 22:53:25,628 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-12-16 22:53:25,628 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-12-16 22:53:25,628 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-12-16 22:53:25,628 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-12-16 22:53:25,628 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-12-16 22:53:25,628 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-12-16 22:53:25,628 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-12-16 22:53:25,628 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-12-16 22:53:25,628 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-12-16 22:53:25,628 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-12-16 22:53:25,628 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-12-16 22:53:25,628 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-12-16 22:53:25,629 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-12-16 22:53:25,629 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-12-16 22:53:25,629 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-12-16 22:53:25,629 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-12-16 22:53:25,629 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-12-16 22:53:25,629 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-12-16 22:53:25,629 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-12-16 22:53:25,629 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-12-16 22:53:25,629 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-12-16 22:53:25,629 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-12-16 22:53:25,629 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-12-16 22:53:25,629 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-12-16 22:53:25,629 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-12-16 22:53:25,629 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-12-16 22:53:25,630 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-12-16 22:53:25,630 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-12-16 22:53:25,630 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-12-16 22:53:25,630 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-12-16 22:53:25,630 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-12-16 22:53:25,630 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-12-16 22:53:25,630 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-12-16 22:53:25,630 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-12-16 22:53:25,630 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-12-16 22:53:25,630 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-12-16 22:53:25,630 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-12-16 22:53:25,630 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-12-16 22:53:25,630 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-12-16 22:53:25,630 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-12-16 22:53:25,630 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-12-16 22:53:25,631 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-12-16 22:53:25,631 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-12-16 22:53:25,631 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-12-16 22:53:25,631 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-12-16 22:53:25,631 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-12-16 22:53:25,631 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-12-16 22:53:25,631 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-12-16 22:53:25,631 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-12-16 22:53:25,631 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-12-16 22:53:25,631 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-12-16 22:53:25,631 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-12-16 22:53:25,631 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-12-16 22:53:25,631 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-12-16 22:53:25,631 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-12-16 22:53:25,631 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-12-16 22:53:25,632 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-12-16 22:53:25,632 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-12-16 22:53:25,632 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-12-16 22:53:25,632 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-12-16 22:53:25,632 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-12-16 22:53:25,758 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.04239494472306903, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.05850935443737086, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.04239494472306903, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.17383333333333334, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.23883333333333334, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-12-16 22:53:25,758 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-12-16 22:53:25,759 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.17846721318825853, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.04239494472306903, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.05850935443737086, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.04239494472306903, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.17383333333333334, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.23883333333333334, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-12-16 22:53:25,930 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 276 ms to try 5000 different iterations.  Found a solution that moves 2577 regions; Going from a computed imbalance of 0.17846721318825853 to a new imbalance of 0.015047021345510891. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.022720562670757515); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.032769644599582405, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.28633333333333333, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.022720562670757515); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.012); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.044083333333333335, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-12-16 22:53:25,938 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv419997687:77 , srv853140311:80 , srv1866360385:81 , srv1994887084:81 , srv711994360:81 , srv778114381:81 , srv1549405934:82 , srv17866649:82 , srv2123996119:82 , srv278534926:82 , srv945555243:82 , srv1013501623:83 , srv1250780439:83 , srv1675016281:83 , srv1754789233:83 , srv1920207566:83 , srv2064046396:83 , srv2120167762:83 , srv731852413:83 , srv878952308:83 , srv1354501786:84 , srv1356233687:84 , srv1595791723:84 , srv1696487604:84 , srv1867440550:84 , srv1894889473:84 , srv1915675420:84 , srv479019302:84 , srv690650967:84 , srv855891613:84 , srv1033624506:85 , srv1135505301:85 , srv1406445834:85 , srv1888393280:85 , srv1894778436:85 , srv403858197:85 , srv572063390:85 , srv622968995:85 , srv765508513:85 , srv870214628:85 , srv893575915:85 , srv89751287:85 , srv977580725:85 , srv978606025:85 , srv984806824:85 , srv996240035:85 , srv1303979075:86 , srv1498105542:86 , srv1631445294:86 , srv1688125381:86 , srv1777161585:86 , srv1879565413:86 , srv268412351:86 , srv47716955:86 , srv542488819:86 , srv62530350:86 , srv887297652:86 , srv1058796516:87 , srv1092576470:87 , srv1140824639:87 , srv1215749524:87 , srv1251999457:87 , srv1350336571:87 , srv1407565835:87 , srv1412268181:87 , srv142902439:87 , srv1754853790:87 , srv2009639989:87 , srv338769136:87 , srv571036030:87 , srv582965651:87 , srv953653527:87 , srv1339216511:88 , srv1444754019:88 , srv1473629223:88 , srv1519645024:88 , srv1601705550:88 , srv1623698829:88 , srv2101859891:88 , srv2107023488:88 , srv488156568:88 , srv789283053:88 , srv86026589:88 , srv1220263546:89 , srv1647278100:89 , srv1779115759:89 , srv487054749:89 , srv642467262:89 , srv902238319:89 , srv915757839:89 , srv926402388:89 , srv1129212:90 , srv121167382:90 , srv2080956415:90 , srv381289730:90 , srv902228695:90 , srv994147446:90 , srv1166473453:91 , srv1245932139:91 , srv258987439:509 }
2023-12-16 22:53:25,941 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-12-16 22:53:25,942 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv711994360=76, srv2009639989=50, srv642467262=74, srv582965651=71, srv1407565835=20, srv1251999457=13, srv1888393280=44, srv765508513=78, srv2123996119=56, srv2101859891=53, srv878952308=85, srv1696487604=35, srv2107023488=54, srv479019302=65, srv403858197=62, srv1350336571=16, srv978606025=96, srv893575915=87, srv1867440550=42, srv1894778436=45, srv1595791723=28, srv778114381=79, srv1033624506=1, srv1631445294=31, srv1135505301=5, srv1339216511=15, srv1519645024=26, srv1013501623=0, srv1215749524=9, srv789283053=80, srv1915675420=47, srv926402388=92, srv381289730=61, srv47716955=64, srv870214628=84, srv902228695=89, srv258987439=57, srv1879565413=43, srv1675016281=33, srv1406445834=19, srv915757839=91, srv1245932139=11, srv1412268181=21, srv1623698829=30, srv571036030=69, srv1894889473=46, srv977580725=95, srv542488819=68, srv994147446=98, srv278534926=59, srv1779115759=39, srv984806824=97, srv996240035=99, srv1092576470=3, srv142902439=22, srv1473629223=24, srv1647278100=32, srv1920207566=48, srv1994887084=49, srv487054749=66, srv488156568=67, srv1777161585=38, srv89751287=88, srv1166473453=7, srv1754853790=37, srv2080956415=52, srv1549405934=27, srv121167382=8, srv419997687=63, srv855891613=82, srv853140311=81, srv953653527=94, srv1498105542=25, srv1754789233=36, srv268412351=58, srv945555243=93, srv17866649=40, srv572063390=70, srv1866360385=41, srv338769136=60, srv1354501786=17, srv2120167762=55, srv690650967=75, srv887297652=86, srv2064046396=51, srv1303979075=14, srv1688125381=34, srv622968995=72, srv1250780439=12, srv62530350=73, srv1356233687=18, srv86026589=83, srv1058796516=2, srv1220263546=10, srv1444754019=23, srv731852413=77, srv902238319=90, srv1140824639=6, srv1601705550=29, srv1129212=4} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-12-16 22:53:25,962 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-12-16 22:53:25,962 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-12-16 22:53:25,962 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-12-16 22:53:25,962 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-12-16 22:53:25,963 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-12-16 22:53:25,963 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-12-16 22:53:25,963 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-12-16 22:53:25,963 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-12-16 22:53:25,963 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-12-16 22:53:25,963 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-12-16 22:53:25,963 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-12-16 22:53:25,963 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-12-16 22:53:25,963 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-12-16 22:53:25,964 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-12-16 22:53:25,964 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-12-16 22:53:25,964 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-12-16 22:53:25,964 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-12-16 22:53:25,964 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-12-16 22:53:25,964 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-12-16 22:53:25,964 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-12-16 22:53:25,964 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-12-16 22:53:25,964 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-12-16 22:53:25,964 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-12-16 22:53:25,965 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-12-16 22:53:25,965 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-12-16 22:53:25,965 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-12-16 22:53:25,965 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-12-16 22:53:25,965 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-12-16 22:53:25,965 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-12-16 22:53:25,965 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-12-16 22:53:25,965 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-12-16 22:53:25,965 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-12-16 22:53:25,966 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-12-16 22:53:25,966 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-12-16 22:53:25,966 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-12-16 22:53:25,966 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-12-16 22:53:25,966 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-12-16 22:53:25,966 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-12-16 22:53:25,966 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-12-16 22:53:25,966 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-12-16 22:53:25,966 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-12-16 22:53:25,967 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-12-16 22:53:25,967 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-12-16 22:53:25,967 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-12-16 22:53:25,967 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-12-16 22:53:25,967 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-12-16 22:53:25,967 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-12-16 22:53:25,967 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-12-16 22:53:25,967 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-12-16 22:53:25,967 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-12-16 22:53:25,968 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-12-16 22:53:25,968 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-12-16 22:53:25,968 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-12-16 22:53:25,968 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-12-16 22:53:25,968 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-12-16 22:53:25,968 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-12-16 22:53:25,969 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-12-16 22:53:25,969 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-12-16 22:53:25,969 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-12-16 22:53:25,969 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-12-16 22:53:25,969 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-12-16 22:53:25,969 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-12-16 22:53:25,969 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-12-16 22:53:25,969 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-12-16 22:53:25,969 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-12-16 22:53:25,970 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-12-16 22:53:25,970 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-12-16 22:53:25,970 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-12-16 22:53:25,970 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-12-16 22:53:25,970 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-12-16 22:53:25,970 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-12-16 22:53:25,970 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-12-16 22:53:25,970 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-12-16 22:53:25,970 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-12-16 22:53:25,970 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-12-16 22:53:25,970 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-12-16 22:53:25,971 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-12-16 22:53:25,971 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-12-16 22:53:25,971 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-12-16 22:53:25,971 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-12-16 22:53:25,971 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-12-16 22:53:25,971 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-12-16 22:53:25,971 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-12-16 22:53:25,971 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-12-16 22:53:25,971 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-12-16 22:53:25,971 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-12-16 22:53:25,971 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-12-16 22:53:25,971 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-12-16 22:53:25,971 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-12-16 22:53:25,971 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-12-16 22:53:25,971 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-12-16 22:53:25,972 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-12-16 22:53:25,972 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-12-16 22:53:25,972 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-12-16 22:53:25,972 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-12-16 22:53:25,972 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-12-16 22:53:25,972 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-12-16 22:53:25,972 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-12-16 22:53:25,972 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-12-16 22:53:25,972 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-12-16 22:53:25,972 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-12-16 22:53:26,060 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.022720562670757515); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.032769644599582405, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.022720562670757515); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.012); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.044083333333333335, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-12-16 22:53:26,060 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-12-16 22:53:26,060 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.015028976805837212, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.022720562670757515); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.032769644599582405, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.022720562670757515); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.012); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.044083333333333335, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-12-16 22:53:26,211 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 219 ms to try 5000 different iterations.  Found a solution that moves 1016 regions; Going from a computed imbalance of 0.015028976805837212 to a new imbalance of 5.392225661901371E-4. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.006102176919959719); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.005014009553935699); MoveCostFunction : (multiplier=7.0, imbalance=0.11288888888888889, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.006102176919959719); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.6666666666666666E-4); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0036666666666666666); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-12-16 22:53:26,213 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv902238319:82 , srv1779115759:83 , srv2107023488:83 , srv338769136:83 , srv381289730:83 , srv572063390:83 , srv582965651:83 , srv622968995:83 , srv1058796516:84 , srv1129212:84 , srv1220263546:84 , srv1251999457:84 , srv142902439:84 , srv1444754019:84 , srv1519645024:84 , srv1595791723:84 , srv1601705550:84 , srv2101859891:84 , srv487054749:84 , srv62530350:84 , srv86026589:84 , srv893575915:84 , srv945555243:84 , srv953653527:84 , srv978606025:84 , srv984806824:84 , srv1033624506:85 , srv1135505301:85 , srv1140824639:85 , srv1215749524:85 , srv1245932139:85 , srv1339216511:85 , srv1350336571:85 , srv1356233687:85 , srv1407565835:85 , srv1688125381:85 , srv1879565413:85 , srv1894778436:85 , srv1915675420:85 , srv2080956415:85 , srv47716955:85 , srv690650967:85 , srv789283053:85 , srv887297652:85 , srv977580725:85 , srv1013501623:86 , srv1092576470:86 , srv121167382:86 , srv1303979075:86 , srv1354501786:86 , srv1412268181:86 , srv1623698829:86 , srv1631445294:86 , srv1647278100:86 , srv1675016281:86 , srv1754789233:86 , srv1754853790:86 , srv1894889473:86 , srv2120167762:86 , srv403858197:86 , srv479019302:86 , srv488156568:86 , srv542488819:86 , srv571036030:86 , srv778114381:86 , srv853140311:86 , srv855891613:86 , srv870214628:86 , srv902228695:86 , srv926402388:86 , srv994147446:86 , srv996240035:86 , srv1166473453:87 , srv1406445834:87 , srv1473629223:87 , srv1498105542:87 , srv1549405934:87 , srv1696487604:87 , srv1777161585:87 , srv17866649:87 , srv1866360385:87 , srv1867440550:87 , srv1888393280:87 , srv1920207566:87 , srv1994887084:87 , srv2009639989:87 , srv2064046396:87 , srv2123996119:87 , srv268412351:87 , srv278534926:87 , srv419997687:87 , srv711994360:87 , srv731852413:87 , srv765508513:87 , srv89751287:87 , srv915757839:87 , srv1250780439:88 , srv642467262:88 , srv878952308:88 , srv258987439:536 }
2023-12-16 22:53:26,215 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-12-16 22:53:26,216 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv711994360=76, srv2009639989=50, srv642467262=74, srv582965651=71, srv1407565835=20, srv1251999457=13, srv1888393280=44, srv765508513=78, srv2123996119=56, srv2101859891=53, srv878952308=85, srv1696487604=35, srv2107023488=54, srv479019302=65, srv403858197=62, srv1350336571=16, srv978606025=96, srv893575915=87, srv1867440550=42, srv1894778436=45, srv1595791723=28, srv778114381=79, srv1033624506=1, srv1631445294=31, srv1135505301=5, srv1339216511=15, srv1519645024=26, srv1013501623=0, srv1215749524=9, srv789283053=80, srv1915675420=47, srv926402388=92, srv381289730=61, srv47716955=64, srv870214628=84, srv902228695=89, srv258987439=57, srv1879565413=43, srv1675016281=33, srv1406445834=19, srv915757839=91, srv1245932139=11, srv1412268181=21, srv1623698829=30, srv571036030=69, srv1894889473=46, srv977580725=95, srv542488819=68, srv994147446=98, srv278534926=59, srv1779115759=39, srv984806824=97, srv996240035=99, srv1092576470=3, srv142902439=22, srv1473629223=24, srv1647278100=32, srv1920207566=48, srv1994887084=49, srv487054749=66, srv488156568=67, srv1777161585=38, srv89751287=88, srv1166473453=7, srv1754853790=37, srv2080956415=52, srv1549405934=27, srv121167382=8, srv419997687=63, srv855891613=82, srv853140311=81, srv953653527=94, srv1498105542=25, srv1754789233=36, srv268412351=58, srv945555243=93, srv17866649=40, srv572063390=70, srv1866360385=41, srv338769136=60, srv1354501786=17, srv2120167762=55, srv690650967=75, srv887297652=86, srv2064046396=51, srv1303979075=14, srv1688125381=34, srv622968995=72, srv1250780439=12, srv62530350=73, srv1356233687=18, srv86026589=83, srv1058796516=2, srv1220263546=10, srv1444754019=23, srv731852413=77, srv902238319=90, srv1140824639=6, srv1601705550=29, srv1129212=4} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-12-16 22:53:26,225 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-12-16 22:53:26,225 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-12-16 22:53:26,225 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-12-16 22:53:26,225 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-12-16 22:53:26,225 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-12-16 22:53:26,225 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-12-16 22:53:26,225 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-12-16 22:53:26,225 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-12-16 22:53:26,225 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-12-16 22:53:26,225 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-12-16 22:53:26,225 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-12-16 22:53:26,225 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-12-16 22:53:26,226 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-12-16 22:53:26,226 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-12-16 22:53:26,226 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-12-16 22:53:26,226 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-12-16 22:53:26,226 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-12-16 22:53:26,226 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-12-16 22:53:26,226 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-12-16 22:53:26,226 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-12-16 22:53:26,226 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-12-16 22:53:26,226 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-12-16 22:53:26,226 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-12-16 22:53:26,226 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-12-16 22:53:26,226 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-12-16 22:53:26,226 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-12-16 22:53:26,226 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-12-16 22:53:26,226 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-12-16 22:53:26,226 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-12-16 22:53:26,227 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-12-16 22:53:26,227 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-12-16 22:53:26,227 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-12-16 22:53:26,227 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-12-16 22:53:26,227 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-12-16 22:53:26,227 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-12-16 22:53:26,227 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-12-16 22:53:26,227 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-12-16 22:53:26,227 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-12-16 22:53:26,227 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-12-16 22:53:26,227 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-12-16 22:53:26,227 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-12-16 22:53:26,227 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-12-16 22:53:26,227 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-12-16 22:53:26,227 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-12-16 22:53:26,227 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-12-16 22:53:26,227 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-12-16 22:53:26,228 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-12-16 22:53:26,228 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-12-16 22:53:26,228 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-12-16 22:53:26,228 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-12-16 22:53:26,228 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-12-16 22:53:26,228 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-12-16 22:53:26,228 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-12-16 22:53:26,228 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-12-16 22:53:26,228 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-12-16 22:53:26,228 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-12-16 22:53:26,228 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-12-16 22:53:26,228 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-12-16 22:53:26,228 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-12-16 22:53:26,228 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-12-16 22:53:26,229 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-12-16 22:53:26,229 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-12-16 22:53:26,229 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-12-16 22:53:26,229 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-12-16 22:53:26,229 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-12-16 22:53:26,229 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-12-16 22:53:26,229 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-12-16 22:53:26,229 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-12-16 22:53:26,229 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-12-16 22:53:26,229 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-12-16 22:53:26,229 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-12-16 22:53:26,229 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-12-16 22:53:26,229 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-12-16 22:53:26,229 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-12-16 22:53:26,229 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-12-16 22:53:26,230 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-12-16 22:53:26,230 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-12-16 22:53:26,230 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-12-16 22:53:26,230 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-12-16 22:53:26,230 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-12-16 22:53:26,230 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-12-16 22:53:26,230 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-12-16 22:53:26,230 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-12-16 22:53:26,230 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-12-16 22:53:26,230 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-12-16 22:53:26,230 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-12-16 22:53:26,230 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-12-16 22:53:26,230 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-12-16 22:53:26,230 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-12-16 22:53:26,230 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-12-16 22:53:26,230 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-12-16 22:53:26,230 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-12-16 22:53:26,231 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-12-16 22:53:26,231 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-12-16 22:53:26,231 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-12-16 22:53:26,231 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-12-16 22:53:26,231 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-12-16 22:53:26,231 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-12-16 22:53:26,231 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-12-16 22:53:26,231 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-12-16 22:53:26,231 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-12-16 22:53:26,310 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.006102176919959719); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.005014009553935699); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.006102176919959719); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.6666666666666666E-4); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0036666666666666666); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-12-16 22:53:26,310 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-12-16 22:53:26,310 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=5.321083821356323E-4, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.006102176919959719); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.005014009553935699); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.006102176919959719); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.6666666666666666E-4); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0036666666666666666); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-12-16 22:53:26,528 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 291 ms to try 5000 different iterations.  Found a solution that moves 239 regions; Going from a computed imbalance of 5.321083821356323E-4 to a new imbalance of 1.382224440386183E-5. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=3.5313429231318235E-4); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0023210354127426377); MoveCostFunction : (multiplier=7.0, imbalance=0.026555555555555554, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=3.5313429231318235E-4); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-12-16 22:53:26,529 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1412268181:83 , srv642467262:83 , srv765508513:83 , srv89751287:83 , srv1033624506:84 , srv1135505301:84 , srv1140824639:84 , srv1166473453:84 , srv121167382:84 , srv1215749524:84 , srv1245932139:84 , srv1250780439:84 , srv1251999457:84 , srv1303979075:84 , srv1339216511:84 , srv1350336571:84 , srv1498105542:84 , srv1595791723:84 , srv1601705550:84 , srv1623698829:84 , srv1754853790:84 , srv17866649:84 , srv1888393280:84 , srv2009639989:84 , srv2101859891:84 , srv2107023488:84 , srv2123996119:84 , srv268412351:84 , srv381289730:84 , srv403858197:84 , srv419997687:84 , srv488156568:84 , srv690650967:84 , srv711994360:84 , srv731852413:84 , srv853140311:84 , srv855891613:84 , srv86026589:84 , srv878952308:84 , srv902228695:84 , srv915757839:84 , srv926402388:84 , srv953653527:84 , srv984806824:84 , srv994147446:84 , srv1013501623:85 , srv1058796516:85 , srv1092576470:85 , srv1220263546:85 , srv1354501786:85 , srv1356233687:85 , srv1406445834:85 , srv142902439:85 , srv1444754019:85 , srv1473629223:85 , srv1519645024:85 , srv1549405934:85 , srv1647278100:85 , srv1675016281:85 , srv1688125381:85 , srv1696487604:85 , srv1754789233:85 , srv1777161585:85 , srv1866360385:85 , srv1867440550:85 , srv1879565413:85 , srv1894778436:85 , srv1894889473:85 , srv1915675420:85 , srv1920207566:85 , srv1994887084:85 , srv2064046396:85 , srv2080956415:85 , srv2120167762:85 , srv278534926:85 , srv338769136:85 , srv47716955:85 , srv479019302:85 , srv487054749:85 , srv542488819:85 , srv571036030:85 , srv572063390:85 , srv582965651:85 , srv622968995:85 , srv62530350:85 , srv778114381:85 , srv789283053:85 , srv870214628:85 , srv887297652:85 , srv893575915:85 , srv902238319:85 , srv945555243:85 , srv977580725:85 , srv978606025:85 , srv996240035:85 , srv1129212:86 , srv1407565835:86 , srv1631445294:86 , srv1779115759:86 , srv258987439:630 }
2023-12-16 22:53:26,532 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-12-16 22:53:26,532 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv711994360=76, srv2009639989=50, srv642467262=74, srv582965651=71, srv1407565835=20, srv1251999457=13, srv1888393280=44, srv765508513=78, srv2123996119=56, srv2101859891=53, srv878952308=85, srv1696487604=35, srv2107023488=54, srv479019302=65, srv403858197=62, srv1350336571=16, srv978606025=96, srv893575915=87, srv1867440550=42, srv1894778436=45, srv1595791723=28, srv778114381=79, srv1033624506=1, srv1631445294=31, srv1135505301=5, srv1339216511=15, srv1519645024=26, srv1013501623=0, srv1215749524=9, srv789283053=80, srv1915675420=47, srv926402388=92, srv381289730=61, srv47716955=64, srv870214628=84, srv902228695=89, srv258987439=57, srv1879565413=43, srv1675016281=33, srv1406445834=19, srv915757839=91, srv1245932139=11, srv1412268181=21, srv1623698829=30, srv571036030=69, srv1894889473=46, srv977580725=95, srv542488819=68, srv994147446=98, srv278534926=59, srv1779115759=39, srv984806824=97, srv996240035=99, srv1092576470=3, srv142902439=22, srv1473629223=24, srv1647278100=32, srv1920207566=48, srv1994887084=49, srv487054749=66, srv488156568=67, srv1777161585=38, srv89751287=88, srv1166473453=7, srv1754853790=37, srv2080956415=52, srv1549405934=27, srv121167382=8, srv419997687=63, srv855891613=82, srv853140311=81, srv953653527=94, srv1498105542=25, srv1754789233=36, srv268412351=58, srv945555243=93, srv17866649=40, srv572063390=70, srv1866360385=41, srv338769136=60, srv1354501786=17, srv2120167762=55, srv690650967=75, srv887297652=86, srv2064046396=51, srv1303979075=14, srv1688125381=34, srv622968995=72, srv1250780439=12, srv62530350=73, srv1356233687=18, srv86026589=83, srv1058796516=2, srv1220263546=10, srv1444754019=23, srv731852413=77, srv902238319=90, srv1140824639=6, srv1601705550=29, srv1129212=4} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-12-16 22:53:26,541 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-12-16 22:53:26,541 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-12-16 22:53:26,541 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-12-16 22:53:26,542 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-12-16 22:53:26,542 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-12-16 22:53:26,542 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-12-16 22:53:26,542 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-12-16 22:53:26,542 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-12-16 22:53:26,542 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-12-16 22:53:26,542 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-12-16 22:53:26,542 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-12-16 22:53:26,542 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-12-16 22:53:26,542 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-12-16 22:53:26,542 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-12-16 22:53:26,542 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-12-16 22:53:26,542 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-12-16 22:53:26,542 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-12-16 22:53:26,542 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-12-16 22:53:26,542 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-12-16 22:53:26,542 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-12-16 22:53:26,542 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-12-16 22:53:26,542 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-12-16 22:53:26,543 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-12-16 22:53:26,543 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-12-16 22:53:26,543 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-12-16 22:53:26,543 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-12-16 22:53:26,543 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-12-16 22:53:26,543 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-12-16 22:53:26,543 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-12-16 22:53:26,543 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-12-16 22:53:26,543 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-12-16 22:53:26,543 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-12-16 22:53:26,543 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-12-16 22:53:26,543 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-12-16 22:53:26,543 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-12-16 22:53:26,543 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-12-16 22:53:26,543 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-12-16 22:53:26,543 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-12-16 22:53:26,543 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-12-16 22:53:26,543 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-12-16 22:53:26,543 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-12-16 22:53:26,544 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-12-16 22:53:26,544 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-12-16 22:53:26,544 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-12-16 22:53:26,544 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-12-16 22:53:26,544 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-12-16 22:53:26,544 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-12-16 22:53:26,544 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-12-16 22:53:26,544 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-12-16 22:53:26,544 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-12-16 22:53:26,544 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-12-16 22:53:26,544 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-12-16 22:53:26,544 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-12-16 22:53:26,544 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-12-16 22:53:26,544 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-12-16 22:53:26,544 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-12-16 22:53:26,544 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-12-16 22:53:26,544 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-12-16 22:53:26,544 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-12-16 22:53:26,545 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-12-16 22:53:26,545 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-12-16 22:53:26,545 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-12-16 22:53:26,545 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-12-16 22:53:26,545 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-12-16 22:53:26,545 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-12-16 22:53:26,545 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-12-16 22:53:26,545 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-12-16 22:53:26,545 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-12-16 22:53:26,545 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-12-16 22:53:26,545 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-12-16 22:53:26,545 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-12-16 22:53:26,545 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-12-16 22:53:26,546 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-12-16 22:53:26,546 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-12-16 22:53:26,546 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-12-16 22:53:26,546 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-12-16 22:53:26,546 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-12-16 22:53:26,546 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-12-16 22:53:26,546 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-12-16 22:53:26,546 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-12-16 22:53:26,546 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-12-16 22:53:26,546 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-12-16 22:53:26,546 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-12-16 22:53:26,546 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-12-16 22:53:26,546 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-12-16 22:53:26,546 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-12-16 22:53:26,546 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-12-16 22:53:26,546 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-12-16 22:53:26,546 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-12-16 22:53:26,546 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-12-16 22:53:26,547 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-12-16 22:53:26,547 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-12-16 22:53:26,547 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-12-16 22:53:26,547 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-12-16 22:53:26,547 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-12-16 22:53:26,547 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-12-16 22:53:26,547 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-12-16 22:53:26,547 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-12-16 22:53:26,547 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-12-16 22:53:26,547 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-12-16 22:53:26,547 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-12-16 22:53:26,624 INFO  [Time-limited test] balancer.StochasticLoadBalancer(381): Cluster wide - skipping load balancing because weighted average imbalance=1.214873063513483E-5 <= threshold(0.025). If you want more aggressive balancing, either lower hbase.master.balancer.stochastic.minCostNeedBalance from 0.025 or increase the relative multiplier(s) of the specific cost function(s). functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=3.5313429231318235E-4); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0023210354127426377); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=3.5313429231318235E-4); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-12-16 22:53:26,625 INFO  [Time-limited test] balancer.BalancerTestBase(570): Mock Final balance: { srv1412268181:83 , srv642467262:83 , srv765508513:83 , srv89751287:83 , srv1033624506:84 , srv1135505301:84 , srv1140824639:84 , srv1166473453:84 , srv121167382:84 , srv1215749524:84 , srv1245932139:84 , srv1250780439:84 , srv1251999457:84 , srv1303979075:84 , srv1339216511:84 , srv1350336571:84 , srv1498105542:84 , srv1595791723:84 , srv1601705550:84 , srv1623698829:84 , srv1754853790:84 , srv17866649:84 , srv1888393280:84 , srv2009639989:84 , srv2101859891:84 , srv2107023488:84 , srv2123996119:84 , srv268412351:84 , srv381289730:84 , srv403858197:84 , srv419997687:84 , srv488156568:84 , srv690650967:84 , srv711994360:84 , srv731852413:84 , srv853140311:84 , srv855891613:84 , srv86026589:84 , srv878952308:84 , srv902228695:84 , srv915757839:84 , srv926402388:84 , srv953653527:84 , srv984806824:84 , srv994147446:84 , srv1013501623:85 , srv1058796516:85 , srv1092576470:85 , srv1220263546:85 , srv1354501786:85 , srv1356233687:85 , srv1406445834:85 , srv142902439:85 , srv1444754019:85 , srv1473629223:85 , srv1519645024:85 , srv1549405934:85 , srv1647278100:85 , srv1675016281:85 , srv1688125381:85 , srv1696487604:85 , srv1754789233:85 , srv1777161585:85 , srv1866360385:85 , srv1867440550:85 , srv1879565413:85 , srv1894778436:85 , srv1894889473:85 , srv1915675420:85 , srv1920207566:85 , srv1994887084:85 , srv2064046396:85 , srv2080956415:85 , srv2120167762:85 , srv278534926:85 , srv338769136:85 , srv47716955:85 , srv479019302:85 , srv487054749:85 , srv542488819:85 , srv571036030:85 , srv572063390:85 , srv582965651:85 , srv622968995:85 , srv62530350:85 , srv778114381:85 , srv789283053:85 , srv870214628:85 , srv887297652:85 , srv893575915:85 , srv902238319:85 , srv945555243:85 , srv977580725:85 , srv978606025:85 , srv996240035:85 , srv1129212:86 , srv1407565835:86 , srv1631445294:86 , srv1779115759:86 , srv258987439:630 }
2023-12-16 22:53:26,644 INFO  [Time-limited test] hbase.ResourceChecker(175): after: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnLargeClusterWithRacks Thread=12 (was 12), OpenFileDescriptor=290 (was 290), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=281 (was 281), ProcessCount=170 (was 170), AvailableMemoryMB=4166 (was 4640)
2023-12-16 22:53:26,651 INFO  [Time-limited test] hbase.ResourceChecker(147): before: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnMidClusterWithRacks Thread=12, OpenFileDescriptor=290, MaxFileDescriptor=60000, SystemLoadAverage=281, ProcessCount=170, AvailableMemoryMB=4165
2023-12-16 22:53:26,651 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2023-12-16 22:53:26,652 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=5000, runMaxSteps=true, stepsPerRegion=800, maxRunningTime=120000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 111077.0 etc.
2023-12-16 22:53:26,661 INFO  [Time-limited test] balancer.BalancerTestBase(547): Mock Cluster : { srv1010195636:84 , srv1106872868:84 , srv112645736:84 , srv1144540693:84 , srv1167138109:84 , srv1242890211:84 , srv1333716811:84 , srv1345873781:84 , srv1489476109:84 , srv155646078:84 , srv1686964399:84 , srv1753084435:84 , srv1802797660:84 , srv1808762858:84 , srv186406261:84 , srv1871087525:84 , srv2024648176:84 , srv2038040620:84 , srv2058135804:84 , srv2102057795:84 , srv285190891:84 , srv424430571:84 , srv501460943:84 , srv509209193:84 , srv614458776:84 , srv666175257:84 , srv792762853:84 , srv796595450:84 , srv94337141:84 , srv1346359909:264 } [srvr=30 rgns=2700 avg=90.0 max=90 min=90]
2023-12-16 22:53:26,663 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-12-16 22:53:26,663 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv285190891=21, srv2038040620=18, srv1010195636=0, srv792762853=27, srv1333716811=6, srv1808762858=14, srv796595450=28, srv2102057795=20, srv1346359909=8, srv1686964399=11, srv1753084435=12, srv1871087525=16, srv501460943=23, srv1489476109=9, srv94337141=29, srv1345873781=7, srv509209193=24, srv1106872868=1, srv2024648176=17, srv1802797660=13, srv614458776=25, srv2058135804=19, srv155646078=10, srv186406261=15, srv1242890211=5, srv424430571=22, srv1144540693=3, srv112645736=2, srv1167138109=4, srv666175257=26} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-12-16 22:53:26,679 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-12-16 22:53:26,679 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-12-16 22:53:26,679 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-12-16 22:53:26,679 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-12-16 22:53:26,679 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-12-16 22:53:26,679 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-12-16 22:53:26,679 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-12-16 22:53:26,679 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-12-16 22:53:26,680 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-12-16 22:53:26,680 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-12-16 22:53:26,680 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-12-16 22:53:26,680 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-12-16 22:53:26,680 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-12-16 22:53:26,680 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-12-16 22:53:26,680 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-12-16 22:53:26,680 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-12-16 22:53:26,680 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-12-16 22:53:26,680 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-12-16 22:53:26,680 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-12-16 22:53:26,680 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-12-16 22:53:26,681 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-12-16 22:53:26,681 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-12-16 22:53:26,681 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-12-16 22:53:26,681 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-12-16 22:53:26,681 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-12-16 22:53:26,681 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-12-16 22:53:26,681 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-12-16 22:53:26,681 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-12-16 22:53:26,681 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-12-16 22:53:26,681 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-12-16 22:53:26,681 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=10, number of hosts=30, number of racks=4
2023-12-16 22:53:26,703 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=1.0491895528936572, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-12-16 22:53:26,704 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.9912348037939263, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=1.0491895528936572, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=64800000
2023-12-16 22:55:26,685 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 120001 ms to try 9422834 different iterations.  Found a solution that moves 1837 regions; Going from a computed imbalance of 0.9912348037939263 to a new imbalance of 4.2876496417733574E-5. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); MoveCostFunction : (multiplier=7.0, imbalance=0.6803703703703704, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-12-16 22:55:26,690 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1010195636:90 , srv1106872868:90 , srv112645736:90 , srv1144540693:90 , srv1167138109:90 , srv1242890211:90 , srv1333716811:90 , srv1345873781:90 , srv1346359909:90 , srv1489476109:90 , srv155646078:90 , srv1686964399:90 , srv1753084435:90 , srv1802797660:90 , srv1808762858:90 , srv186406261:90 , srv1871087525:90 , srv2024648176:90 , srv2038040620:90 , srv2058135804:90 , srv2102057795:90 , srv285190891:90 , srv424430571:90 , srv501460943:90 , srv509209193:90 , srv614458776:90 , srv666175257:90 , srv792762853:90 , srv796595450:90 , srv94337141:90 }
2023-12-16 22:55:26,691 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-12-16 22:55:26,691 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv285190891=21, srv2038040620=18, srv1010195636=0, srv792762853=27, srv1333716811=6, srv1808762858=14, srv796595450=28, srv2102057795=20, srv1346359909=8, srv1686964399=11, srv1753084435=12, srv1871087525=16, srv501460943=23, srv1489476109=9, srv94337141=29, srv1345873781=7, srv509209193=24, srv1106872868=1, srv2024648176=17, srv1802797660=13, srv614458776=25, srv2058135804=19, srv155646078=10, srv186406261=15, srv1242890211=5, srv424430571=22, srv1144540693=3, srv112645736=2, srv1167138109=4, srv666175257=26} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-12-16 22:55:26,695 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-12-16 22:55:26,695 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-12-16 22:55:26,695 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-12-16 22:55:26,695 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-12-16 22:55:26,695 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-12-16 22:55:26,695 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-12-16 22:55:26,695 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-12-16 22:55:26,695 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-12-16 22:55:26,695 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-12-16 22:55:26,695 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-12-16 22:55:26,695 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-12-16 22:55:26,695 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-12-16 22:55:26,695 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-12-16 22:55:26,695 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-12-16 22:55:26,695 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-12-16 22:55:26,696 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-12-16 22:55:26,696 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-12-16 22:55:26,696 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-12-16 22:55:26,696 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-12-16 22:55:26,696 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-12-16 22:55:26,696 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-12-16 22:55:26,696 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-12-16 22:55:26,696 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-12-16 22:55:26,696 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-12-16 22:55:26,696 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-12-16 22:55:26,696 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-12-16 22:55:26,696 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-12-16 22:55:26,696 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-12-16 22:55:26,696 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-12-16 22:55:26,696 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-12-16 22:55:26,696 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=10, number of hosts=30, number of racks=4
2023-12-16 22:55:26,706 INFO  [Time-limited test] balancer.StochasticLoadBalancer(381): Cluster wide - skipping load balancing because weighted average imbalance=0.0 <= threshold(0.025). If you want more aggressive balancing, either lower hbase.master.balancer.stochastic.minCostNeedBalance from 0.025 or increase the relative multiplier(s) of the specific cost function(s). functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-12-16 22:55:26,706 INFO  [Time-limited test] balancer.BalancerTestBase(570): Mock Final balance: { srv1010195636:90 , srv1106872868:90 , srv112645736:90 , srv1144540693:90 , srv1167138109:90 , srv1242890211:90 , srv1333716811:90 , srv1345873781:90 , srv1346359909:90 , srv1489476109:90 , srv155646078:90 , srv1686964399:90 , srv1753084435:90 , srv1802797660:90 , srv1808762858:90 , srv186406261:90 , srv1871087525:90 , srv2024648176:90 , srv2038040620:90 , srv2058135804:90 , srv2102057795:90 , srv285190891:90 , srv424430571:90 , srv501460943:90 , srv509209193:90 , srv614458776:90 , srv666175257:90 , srv792762853:90 , srv796595450:90 , srv94337141:90 }
2023-12-16 22:55:26,717 INFO  [Time-limited test] hbase.ResourceChecker(175): after: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnMidClusterWithRacks Thread=11 (was 12), OpenFileDescriptor=290 (was 290), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=170 (was 281), ProcessCount=169 (was 170), AvailableMemoryMB=3829 (was 4165)