2024-03-20 10:53:30,832 INFO  [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks timeout: 13 mins
2024-03-20 10:53:31,129 WARN  [Time-limited test] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties
2024-03-20 10:53:31,231 INFO  [Time-limited test] metrics.MetricRegistriesLoader(60): Loaded MetricRegistries class org.apache.hadoop.hbase.metrics.impl.MetricRegistriesImpl
2024-03-20 10:53:31,292 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2024-03-20 10:53:31,299 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc.
2024-03-20 10:53:31,314 INFO  [Time-limited test] hbase.ResourceChecker(147): before: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnLargeClusterWithRacks Thread=12, OpenFileDescriptor=290, MaxFileDescriptor=60000, SystemLoadAverage=294, ProcessCount=170, AvailableMemoryMB=3497
2024-03-20 10:53:31,316 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2024-03-20 10:53:31,316 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=5000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=10000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc.
2024-03-20 10:53:31,443 INFO  [Time-limited test] balancer.BalancerTestBase(547): Mock Cluster : { srv1000297557:84 , srv1013135889:84 , srv1020848643:84 , srv1052366046:84 , srv1055347595:84 , srv1069807531:84 , srv1073237445:84 , srv1080109336:84 , srv1158499962:84 , srv1169740081:84 , srv1176791405:84 , srv1183258436:84 , srv1221134444:84 , srv1240221230:84 , srv127785885:84 , srv1286489869:84 , srv1290661574:84 , srv1327664693:84 , srv1354375717:84 , srv1395049052:84 , srv141344389:84 , srv142538087:84 , srv1430832817:84 , srv1444982672:84 , srv1450966974:84 , srv1489778725:84 , srv1523471783:84 , srv1544684134:84 , srv1556478355:84 , srv1637085104:84 , srv1647110490:84 , srv1671491818:84 , srv168582061:84 , srv1704590123:84 , srv1714627139:84 , srv1716377906:84 , srv1726126637:84 , srv176113275:84 , srv1786204742:84 , srv1790045496:84 , srv182706338:84 , srv1831528325:84 , srv1832435582:84 , srv1847537290:84 , srv1859027234:84 , srv1890894809:84 , srv1907416522:84 , srv1907459731:84 , srv1914772922:84 , srv1934022472:84 , srv1948776071:84 , srv1967168951:84 , srv1971191798:84 , srv1997116414:84 , srv2048332774:84 , srv2048655293:84 , srv2083962554:84 , srv2090903879:84 , srv2104142306:84 , srv2107753356:84 , srv210916607:84 , srv211098782:84 , srv2127712086:84 , srv274242697:84 , srv275526663:84 , srv292848790:84 , srv39223708:84 , srv397877721:84 , srv437117898:84 , srv438928521:84 , srv442324278:84 , srv448078740:84 , srv46808575:84 , srv494550505:84 , srv539457693:84 , srv552796305:84 , srv5693841:84 , srv580170916:84 , srv58816558:84 , srv601242710:84 , srv624718587:84 , srv628434644:84 , srv673819781:84 , srv695578367:84 , srv702766096:84 , srv735119921:84 , srv798878839:84 , srv822318761:84 , srv846493055:84 , srv860052052:84 , srv893159622:84 , srv915322805:84 , srv921512566:84 , srv922960935:84 , srv929462725:84 , srv932397315:84 , srv943398579:84 , srv951634066:84 , srv990813438:84 , srv602932749:684 } [srvr=100 rgns=9000 avg=90.0 max=90 min=90]
2024-03-20 10:53:31,451 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2024-03-20 10:53:31,457 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1327664693=17, srv1671491818=31, srv921512566=93, srv552796305=75, srv142538087=21, srv602932749=80, srv1948776071=50, srv702766096=85, srv141344389=20, srv46808575=72, srv1637085104=29, srv275526663=64, srv442324278=70, srv624718587=81, srv1000297557=0, srv1489778725=25, srv1052366046=3, srv1221134444=12, srv58816558=78, srv1169740081=9, srv922960935=94, srv397877721=67, srv1183258436=11, srv929462725=95, srv1967168951=51, srv2090903879=57, srv860052052=90, srv1907459731=47, srv1013135889=1, srv1726126637=36, srv2107753356=59, srv437117898=68, srv1450966974=24, srv2104142306=58, srv951634066=98, srv1971191798=52, srv1544684134=27, srv846493055=89, srv1786204742=38, srv1790045496=39, srv448078740=71, srv1914772922=48, srv932397315=96, srv1831528325=41, srv1716377906=35, srv2127712086=62, srv2048655293=55, srv673819781=83, srv822318761=88, srv1907416522=46, srv1847537290=43, srv798878839=87, srv1430832817=22, srv1859027234=44, srv628434644=82, srv1934022472=49, srv274242697=63, srv695578367=84, srv990813438=99, srv1647110490=30, srv1290661574=16, srv735119921=86, srv182706338=40, srv176113275=37, srv1395049052=19, srv2048332774=54, srv915322805=92, srv1073237445=6, srv1240221230=13, srv539457693=74, srv601242710=79, srv292848790=65, srv1556478355=28, srv1714627139=34, srv1890894809=45, srv1832435582=42, srv1704590123=33, srv39223708=66, srv1523471783=26, srv1997116414=53, srv5693841=76, srv1176791405=10, srv211098782=61, srv1444982672=23, srv1069807531=5, srv1055347595=4, srv494550505=73, srv1080109336=7, srv1158499962=8, srv893159622=91, srv210916607=60, srv168582061=32, srv438928521=69, srv2083962554=56, srv1286489869=15, srv127785885=14, srv1354375717=18, srv580170916=77, srv1020848643=2, srv943398579=97} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2024-03-20 10:53:31,528 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2024-03-20 10:53:31,528 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2024-03-20 10:53:31,528 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2024-03-20 10:53:31,529 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2024-03-20 10:53:31,529 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2024-03-20 10:53:31,529 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2024-03-20 10:53:31,529 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2024-03-20 10:53:31,529 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2024-03-20 10:53:31,529 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2024-03-20 10:53:31,529 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2024-03-20 10:53:31,529 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2024-03-20 10:53:31,529 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2024-03-20 10:53:31,529 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2024-03-20 10:53:31,530 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2024-03-20 10:53:31,530 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2024-03-20 10:53:31,530 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2024-03-20 10:53:31,530 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2024-03-20 10:53:31,530 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2024-03-20 10:53:31,530 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2024-03-20 10:53:31,530 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2024-03-20 10:53:31,530 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2024-03-20 10:53:31,530 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2024-03-20 10:53:31,531 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2024-03-20 10:53:31,531 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2024-03-20 10:53:31,531 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2024-03-20 10:53:31,531 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2024-03-20 10:53:31,531 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2024-03-20 10:53:31,531 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2024-03-20 10:53:31,531 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2024-03-20 10:53:31,531 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2024-03-20 10:53:31,531 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2024-03-20 10:53:31,531 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2024-03-20 10:53:31,532 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2024-03-20 10:53:31,532 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2024-03-20 10:53:31,532 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2024-03-20 10:53:31,532 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2024-03-20 10:53:31,532 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2024-03-20 10:53:31,532 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2024-03-20 10:53:31,532 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2024-03-20 10:53:31,533 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2024-03-20 10:53:31,533 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2024-03-20 10:53:31,533 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2024-03-20 10:53:31,533 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2024-03-20 10:53:31,533 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2024-03-20 10:53:31,533 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2024-03-20 10:53:31,534 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2024-03-20 10:53:31,534 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2024-03-20 10:53:31,534 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2024-03-20 10:53:31,534 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2024-03-20 10:53:31,534 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2024-03-20 10:53:31,534 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2024-03-20 10:53:31,534 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2024-03-20 10:53:31,534 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2024-03-20 10:53:31,535 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2024-03-20 10:53:31,535 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2024-03-20 10:53:31,535 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2024-03-20 10:53:31,535 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2024-03-20 10:53:31,535 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2024-03-20 10:53:31,535 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2024-03-20 10:53:31,535 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2024-03-20 10:53:31,535 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2024-03-20 10:53:31,535 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2024-03-20 10:53:31,535 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2024-03-20 10:53:31,536 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2024-03-20 10:53:31,536 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2024-03-20 10:53:31,536 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2024-03-20 10:53:31,536 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2024-03-20 10:53:31,536 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2024-03-20 10:53:31,536 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2024-03-20 10:53:31,536 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2024-03-20 10:53:31,536 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2024-03-20 10:53:31,536 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2024-03-20 10:53:31,537 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2024-03-20 10:53:31,537 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2024-03-20 10:53:31,537 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2024-03-20 10:53:31,537 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2024-03-20 10:53:31,537 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2024-03-20 10:53:31,537 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2024-03-20 10:53:31,537 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2024-03-20 10:53:31,538 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2024-03-20 10:53:31,538 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2024-03-20 10:53:31,538 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2024-03-20 10:53:31,538 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2024-03-20 10:53:31,538 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2024-03-20 10:53:31,538 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2024-03-20 10:53:31,539 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2024-03-20 10:53:31,539 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2024-03-20 10:53:31,539 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2024-03-20 10:53:31,539 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2024-03-20 10:53:31,539 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2024-03-20 10:53:31,539 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2024-03-20 10:53:31,539 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2024-03-20 10:53:31,540 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2024-03-20 10:53:31,540 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2024-03-20 10:53:31,540 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2024-03-20 10:53:31,540 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2024-03-20 10:53:31,540 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2024-03-20 10:53:31,540 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2024-03-20 10:53:31,541 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2024-03-20 10:53:31,541 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2024-03-20 10:53:31,541 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2024-03-20 10:53:31,814 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.06666666666666667, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2024-03-20 10:53:31,814 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2024-03-20 10:53:31,814 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.9909252140407105, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.06666666666666667, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2024-03-20 10:53:32,143 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 578 ms to try 5000 different iterations.  Found a solution that moves 4673 regions; Going from a computed imbalance of 0.9909252140407105 to a new imbalance of 0.177825474529433. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.039821587396735705, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06142892565271054, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.5192222222222223, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.039821587396735705, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.17308333333333334, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.23883333333333334, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2024-03-20 10:53:32,152 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1183258436:82 , srv2107753356:82 , srv601242710:82 , srv1176791405:83 , srv1430832817:83 , srv1637085104:83 , srv1647110490:83 , srv2090903879:83 , srv211098782:83 , srv39223708:83 , srv58816558:83 , srv735119921:83 , srv860052052:83 , srv1444982672:84 , srv1523471783:84 , srv168582061:84 , srv1907459731:84 , srv1967168951:84 , srv1971191798:84 , srv2104142306:84 , srv438928521:84 , srv448078740:84 , srv552796305:84 , srv921512566:84 , srv1055347595:85 , srv1080109336:85 , srv127785885:85 , srv1671491818:85 , srv1726126637:85 , srv1847537290:85 , srv1948776071:85 , srv2127712086:85 , srv580170916:85 , srv893159622:85 , srv1000297557:86 , srv1013135889:86 , srv1069807531:86 , srv1286489869:86 , srv1395049052:86 , srv142538087:86 , srv1716377906:86 , srv176113275:86 , srv1786204742:86 , srv182706338:86 , srv1890894809:86 , srv1907416522:86 , srv1914772922:86 , srv2048332774:86 , srv2048655293:86 , srv5693841:86 , srv822318761:86 , srv915322805:86 , srv943398579:86 , srv990813438:86 , srv1221134444:87 , srv1450966974:87 , srv1704590123:87 , srv1714627139:87 , srv1831528325:87 , srv1832435582:87 , srv1997116414:87 , srv292848790:87 , srv442324278:87 , srv46808575:87 , srv673819781:87 , srv846493055:87 , srv929462725:87 , srv1052366046:88 , srv1073237445:88 , srv1158499962:88 , srv1169740081:88 , srv1240221230:88 , srv1544684134:88 , srv1790045496:88 , srv1859027234:88 , srv274242697:88 , srv397877721:88 , srv494550505:88 , srv539457693:88 , srv951634066:88 , srv1020848643:89 , srv1489778725:89 , srv275526663:89 , srv437117898:89 , srv624718587:89 , srv628434644:89 , srv702766096:89 , srv922960935:89 , srv932397315:89 , srv1290661574:90 , srv1354375717:90 , srv2083962554:90 , srv798878839:90 , srv141344389:91 , srv1556478355:91 , srv1934022472:91 , srv210916607:92 , srv695578367:92 , srv1327664693:93 , srv602932749:444 }
2024-03-20 10:53:32,156 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2024-03-20 10:53:32,157 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1327664693=17, srv1671491818=31, srv921512566=93, srv552796305=75, srv142538087=21, srv602932749=80, srv1948776071=50, srv702766096=85, srv141344389=20, srv46808575=72, srv1637085104=29, srv275526663=64, srv442324278=70, srv624718587=81, srv1000297557=0, srv1489778725=25, srv1052366046=3, srv1221134444=12, srv58816558=78, srv1169740081=9, srv922960935=94, srv397877721=67, srv1183258436=11, srv929462725=95, srv1967168951=51, srv2090903879=57, srv860052052=90, srv1907459731=47, srv1013135889=1, srv1726126637=36, srv2107753356=59, srv437117898=68, srv1450966974=24, srv2104142306=58, srv951634066=98, srv1971191798=52, srv1544684134=27, srv846493055=89, srv1786204742=38, srv1790045496=39, srv448078740=71, srv1914772922=48, srv932397315=96, srv1831528325=41, srv1716377906=35, srv2127712086=62, srv2048655293=55, srv673819781=83, srv822318761=88, srv1907416522=46, srv1847537290=43, srv798878839=87, srv1430832817=22, srv1859027234=44, srv628434644=82, srv1934022472=49, srv274242697=63, srv695578367=84, srv990813438=99, srv1647110490=30, srv1290661574=16, srv735119921=86, srv182706338=40, srv176113275=37, srv1395049052=19, srv2048332774=54, srv915322805=92, srv1073237445=6, srv1240221230=13, srv539457693=74, srv601242710=79, srv292848790=65, srv1556478355=28, srv1714627139=34, srv1890894809=45, srv1832435582=42, srv1704590123=33, srv39223708=66, srv1523471783=26, srv1997116414=53, srv5693841=76, srv1176791405=10, srv211098782=61, srv1444982672=23, srv1069807531=5, srv1055347595=4, srv494550505=73, srv1080109336=7, srv1158499962=8, srv893159622=91, srv210916607=60, srv168582061=32, srv438928521=69, srv2083962554=56, srv1286489869=15, srv127785885=14, srv1354375717=18, srv580170916=77, srv1020848643=2, srv943398579=97} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2024-03-20 10:53:32,173 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2024-03-20 10:53:32,173 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2024-03-20 10:53:32,173 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2024-03-20 10:53:32,173 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2024-03-20 10:53:32,173 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2024-03-20 10:53:32,173 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2024-03-20 10:53:32,174 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2024-03-20 10:53:32,174 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2024-03-20 10:53:32,174 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2024-03-20 10:53:32,174 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2024-03-20 10:53:32,174 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2024-03-20 10:53:32,174 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2024-03-20 10:53:32,174 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2024-03-20 10:53:32,175 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2024-03-20 10:53:32,175 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2024-03-20 10:53:32,175 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2024-03-20 10:53:32,175 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2024-03-20 10:53:32,175 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2024-03-20 10:53:32,175 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2024-03-20 10:53:32,175 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2024-03-20 10:53:32,175 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2024-03-20 10:53:32,175 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2024-03-20 10:53:32,176 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2024-03-20 10:53:32,176 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2024-03-20 10:53:32,176 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2024-03-20 10:53:32,176 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2024-03-20 10:53:32,176 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2024-03-20 10:53:32,176 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2024-03-20 10:53:32,176 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2024-03-20 10:53:32,176 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2024-03-20 10:53:32,176 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2024-03-20 10:53:32,177 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2024-03-20 10:53:32,177 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2024-03-20 10:53:32,177 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2024-03-20 10:53:32,177 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2024-03-20 10:53:32,177 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2024-03-20 10:53:32,177 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2024-03-20 10:53:32,177 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2024-03-20 10:53:32,177 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2024-03-20 10:53:32,177 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2024-03-20 10:53:32,177 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2024-03-20 10:53:32,178 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2024-03-20 10:53:32,178 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2024-03-20 10:53:32,178 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2024-03-20 10:53:32,178 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2024-03-20 10:53:32,178 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2024-03-20 10:53:32,178 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2024-03-20 10:53:32,178 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2024-03-20 10:53:32,178 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2024-03-20 10:53:32,178 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2024-03-20 10:53:32,178 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2024-03-20 10:53:32,178 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2024-03-20 10:53:32,178 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2024-03-20 10:53:32,179 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2024-03-20 10:53:32,179 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2024-03-20 10:53:32,179 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2024-03-20 10:53:32,179 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2024-03-20 10:53:32,179 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2024-03-20 10:53:32,179 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2024-03-20 10:53:32,179 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2024-03-20 10:53:32,179 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2024-03-20 10:53:32,179 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2024-03-20 10:53:32,179 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2024-03-20 10:53:32,179 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2024-03-20 10:53:32,179 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2024-03-20 10:53:32,180 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2024-03-20 10:53:32,180 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2024-03-20 10:53:32,180 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2024-03-20 10:53:32,180 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2024-03-20 10:53:32,180 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2024-03-20 10:53:32,180 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2024-03-20 10:53:32,180 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2024-03-20 10:53:32,180 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2024-03-20 10:53:32,180 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2024-03-20 10:53:32,180 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2024-03-20 10:53:32,181 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2024-03-20 10:53:32,181 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2024-03-20 10:53:32,181 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2024-03-20 10:53:32,181 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2024-03-20 10:53:32,181 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2024-03-20 10:53:32,181 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2024-03-20 10:53:32,181 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2024-03-20 10:53:32,181 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2024-03-20 10:53:32,181 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2024-03-20 10:53:32,182 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2024-03-20 10:53:32,182 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2024-03-20 10:53:32,182 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2024-03-20 10:53:32,182 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2024-03-20 10:53:32,182 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2024-03-20 10:53:32,182 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2024-03-20 10:53:32,182 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2024-03-20 10:53:32,182 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2024-03-20 10:53:32,182 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2024-03-20 10:53:32,183 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2024-03-20 10:53:32,183 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2024-03-20 10:53:32,183 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2024-03-20 10:53:32,183 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2024-03-20 10:53:32,183 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2024-03-20 10:53:32,183 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2024-03-20 10:53:32,183 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2024-03-20 10:53:32,183 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2024-03-20 10:53:32,361 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.039821587396735705, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06142892565271054, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.039821587396735705, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.17308333333333334, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.23883333333333334, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2024-03-20 10:53:32,362 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2024-03-20 10:53:32,362 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.17779275348407206, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.039821587396735705, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06142892565271054, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.039821587396735705, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.17308333333333334, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.23883333333333334, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2024-03-20 10:53:32,630 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 397 ms to try 5000 different iterations.  Found a solution that moves 2646 regions; Going from a computed imbalance of 0.17779275348407206 to a new imbalance of 0.014595433536949035. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.02274250642965898); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.03565012675430768, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.294, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.02274250642965898); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.01175); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.041416666666666664, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2024-03-20 10:53:32,647 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1327664693:79 , srv210916607:79 , srv695578367:80 , srv1556478355:81 , srv1790045496:81 , srv1354375717:82 , srv141344389:82 , srv275526663:82 , srv702766096:82 , srv798878839:82 , srv1073237445:83 , srv1158499962:83 , srv1221134444:83 , srv1290661574:83 , srv1704590123:83 , srv1832435582:83 , srv1997116414:83 , srv2083962554:83 , srv397877721:83 , srv437117898:83 , srv628434644:83 , srv932397315:83 , srv1069807531:84 , srv1240221230:84 , srv1286489869:84 , srv1450966974:84 , srv1489778725:84 , srv1859027234:84 , srv1907416522:84 , srv442324278:84 , srv624718587:84 , srv673819781:84 , srv951634066:84 , srv1013135889:85 , srv1080109336:85 , srv1544684134:85 , srv1714627139:85 , srv1726126637:85 , srv1847537290:85 , srv1914772922:85 , srv1934022472:85 , srv2048332774:85 , srv2127712086:85 , srv292848790:85 , srv46808575:85 , srv5693841:85 , srv893159622:85 , srv915322805:85 , srv943398579:85 , srv1000297557:86 , srv1052366046:86 , srv1671491818:86 , srv168582061:86 , srv1716377906:86 , srv176113275:86 , srv182706338:86 , srv1948776071:86 , srv2048655293:86 , srv274242697:86 , srv448078740:86 , srv539457693:86 , srv58816558:86 , srv846493055:86 , srv922960935:86 , srv929462725:86 , srv990813438:86 , srv1169740081:87 , srv127785885:87 , srv1395049052:87 , srv142538087:87 , srv1523471783:87 , srv1637085104:87 , srv1890894809:87 , srv1967168951:87 , srv2090903879:87 , srv211098782:87 , srv494550505:87 , srv822318761:87 , srv1055347595:88 , srv1647110490:88 , srv1831528325:88 , srv1971191798:88 , srv2104142306:88 , srv552796305:88 , srv735119921:88 , srv1020848643:89 , srv1444982672:89 , srv1786204742:89 , srv2107753356:89 , srv39223708:89 , srv438928521:89 , srv580170916:89 , srv921512566:89 , srv1176791405:90 , srv601242710:90 , srv860052052:90 , srv1183258436:91 , srv1430832817:91 , srv1907459731:92 , srv602932749:532 }
2024-03-20 10:53:32,653 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2024-03-20 10:53:32,654 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1327664693=17, srv1671491818=31, srv921512566=93, srv552796305=75, srv142538087=21, srv602932749=80, srv1948776071=50, srv702766096=85, srv141344389=20, srv46808575=72, srv1637085104=29, srv275526663=64, srv442324278=70, srv624718587=81, srv1000297557=0, srv1489778725=25, srv1052366046=3, srv1221134444=12, srv58816558=78, srv1169740081=9, srv922960935=94, srv397877721=67, srv1183258436=11, srv929462725=95, srv1967168951=51, srv2090903879=57, srv860052052=90, srv1907459731=47, srv1013135889=1, srv1726126637=36, srv2107753356=59, srv437117898=68, srv1450966974=24, srv2104142306=58, srv951634066=98, srv1971191798=52, srv1544684134=27, srv846493055=89, srv1786204742=38, srv1790045496=39, srv448078740=71, srv1914772922=48, srv932397315=96, srv1831528325=41, srv1716377906=35, srv2127712086=62, srv2048655293=55, srv673819781=83, srv822318761=88, srv1907416522=46, srv1847537290=43, srv798878839=87, srv1430832817=22, srv1859027234=44, srv628434644=82, srv1934022472=49, srv274242697=63, srv695578367=84, srv990813438=99, srv1647110490=30, srv1290661574=16, srv735119921=86, srv182706338=40, srv176113275=37, srv1395049052=19, srv2048332774=54, srv915322805=92, srv1073237445=6, srv1240221230=13, srv539457693=74, srv601242710=79, srv292848790=65, srv1556478355=28, srv1714627139=34, srv1890894809=45, srv1832435582=42, srv1704590123=33, srv39223708=66, srv1523471783=26, srv1997116414=53, srv5693841=76, srv1176791405=10, srv211098782=61, srv1444982672=23, srv1069807531=5, srv1055347595=4, srv494550505=73, srv1080109336=7, srv1158499962=8, srv893159622=91, srv210916607=60, srv168582061=32, srv438928521=69, srv2083962554=56, srv1286489869=15, srv127785885=14, srv1354375717=18, srv580170916=77, srv1020848643=2, srv943398579=97} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2024-03-20 10:53:32,677 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2024-03-20 10:53:32,677 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2024-03-20 10:53:32,677 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2024-03-20 10:53:32,677 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2024-03-20 10:53:32,678 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2024-03-20 10:53:32,678 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2024-03-20 10:53:32,678 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2024-03-20 10:53:32,678 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2024-03-20 10:53:32,678 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2024-03-20 10:53:32,678 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2024-03-20 10:53:32,678 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2024-03-20 10:53:32,678 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2024-03-20 10:53:32,678 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2024-03-20 10:53:32,678 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2024-03-20 10:53:32,678 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2024-03-20 10:53:32,679 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2024-03-20 10:53:32,679 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2024-03-20 10:53:32,679 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2024-03-20 10:53:32,679 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2024-03-20 10:53:32,679 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2024-03-20 10:53:32,679 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2024-03-20 10:53:32,679 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2024-03-20 10:53:32,679 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2024-03-20 10:53:32,679 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2024-03-20 10:53:32,679 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2024-03-20 10:53:32,680 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2024-03-20 10:53:32,680 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2024-03-20 10:53:32,680 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2024-03-20 10:53:32,680 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2024-03-20 10:53:32,680 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2024-03-20 10:53:32,680 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2024-03-20 10:53:32,680 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2024-03-20 10:53:32,680 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2024-03-20 10:53:32,680 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2024-03-20 10:53:32,680 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2024-03-20 10:53:32,681 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2024-03-20 10:53:32,681 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2024-03-20 10:53:32,681 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2024-03-20 10:53:32,681 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2024-03-20 10:53:32,681 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2024-03-20 10:53:32,681 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2024-03-20 10:53:32,681 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2024-03-20 10:53:32,681 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2024-03-20 10:53:32,681 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2024-03-20 10:53:32,681 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2024-03-20 10:53:32,681 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2024-03-20 10:53:32,682 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2024-03-20 10:53:32,682 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2024-03-20 10:53:32,682 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2024-03-20 10:53:32,682 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2024-03-20 10:53:32,682 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2024-03-20 10:53:32,682 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2024-03-20 10:53:32,682 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2024-03-20 10:53:32,682 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2024-03-20 10:53:32,682 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2024-03-20 10:53:32,682 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2024-03-20 10:53:32,682 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2024-03-20 10:53:32,683 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2024-03-20 10:53:32,683 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2024-03-20 10:53:32,683 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2024-03-20 10:53:32,683 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2024-03-20 10:53:32,683 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2024-03-20 10:53:32,683 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2024-03-20 10:53:32,683 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2024-03-20 10:53:32,683 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2024-03-20 10:53:32,683 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2024-03-20 10:53:32,683 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2024-03-20 10:53:32,683 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2024-03-20 10:53:32,684 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2024-03-20 10:53:32,684 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2024-03-20 10:53:32,684 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2024-03-20 10:53:32,684 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2024-03-20 10:53:32,684 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2024-03-20 10:53:32,684 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2024-03-20 10:53:32,684 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2024-03-20 10:53:32,684 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2024-03-20 10:53:32,684 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2024-03-20 10:53:32,684 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2024-03-20 10:53:32,684 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2024-03-20 10:53:32,684 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2024-03-20 10:53:32,685 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2024-03-20 10:53:32,685 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2024-03-20 10:53:32,685 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2024-03-20 10:53:32,685 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2024-03-20 10:53:32,685 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2024-03-20 10:53:32,685 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2024-03-20 10:53:32,685 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2024-03-20 10:53:32,685 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2024-03-20 10:53:32,685 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2024-03-20 10:53:32,685 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2024-03-20 10:53:32,685 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2024-03-20 10:53:32,686 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2024-03-20 10:53:32,686 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2024-03-20 10:53:32,686 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2024-03-20 10:53:32,686 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2024-03-20 10:53:32,686 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2024-03-20 10:53:32,686 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2024-03-20 10:53:32,686 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2024-03-20 10:53:32,686 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2024-03-20 10:53:32,686 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2024-03-20 10:53:32,686 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2024-03-20 10:53:32,856 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.02274250642965898); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.03565012675430768, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.02274250642965898); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.01175); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.041416666666666664, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2024-03-20 10:53:32,856 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2024-03-20 10:53:32,856 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.01457690584894882, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.02274250642965898); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.03565012675430768, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.02274250642965898); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.01175); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.041416666666666664, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2024-03-20 10:53:33,097 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 387 ms to try 5000 different iterations.  Found a solution that moves 987 regions; Going from a computed imbalance of 0.01457690584894882 to a new imbalance of 7.274385002987829E-4. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.006543950998834459); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.009732678359956285); MoveCostFunction : (multiplier=7.0, imbalance=0.10966666666666666, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.006543950998834459); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=3.333333333333333E-4); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.003833333333333333); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2024-03-20 10:53:33,099 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1020848643:80 , srv1907459731:82 , srv494550505:82 , srv1052366046:83 , srv1169740081:83 , srv1395049052:83 , srv1786204742:83 , srv1831528325:83 , srv1934022472:83 , srv922960935:83 , srv1055347595:84 , srv1176791405:84 , srv1183258436:84 , srv141344389:84 , srv1430832817:84 , srv1444982672:84 , srv1544684134:84 , srv1716377906:84 , srv1890894809:84 , srv274242697:84 , srv539457693:84 , srv580170916:84 , srv624718587:84 , srv822318761:84 , srv921512566:84 , srv1000297557:85 , srv127785885:85 , srv1290661574:85 , srv142538087:85 , srv1489778725:85 , srv1556478355:85 , srv1859027234:85 , srv1971191798:85 , srv2083962554:85 , srv2104142306:85 , srv292848790:85 , srv39223708:85 , srv438928521:85 , srv46808575:85 , srv601242710:85 , srv628434644:85 , srv798878839:85 , srv846493055:85 , srv860052052:85 , srv929462725:85 , srv951634066:85 , srv990813438:85 , srv1013135889:86 , srv1069807531:86 , srv1158499962:86 , srv1240221230:86 , srv1327664693:86 , srv1354375717:86 , srv1647110490:86 , srv1671491818:86 , srv1714627139:86 , srv176113275:86 , srv182706338:86 , srv1914772922:86 , srv2048655293:86 , srv210916607:86 , srv275526663:86 , srv437117898:86 , srv448078740:86 , srv552796305:86 , srv5693841:86 , srv673819781:86 , srv695578367:86 , srv735119921:86 , srv915322805:86 , srv932397315:86 , srv943398579:86 , srv1073237445:87 , srv1080109336:87 , srv1221134444:87 , srv1286489869:87 , srv1450966974:87 , srv1523471783:87 , srv1637085104:87 , srv168582061:87 , srv1704590123:87 , srv1726126637:87 , srv1847537290:87 , srv1948776071:87 , srv1967168951:87 , srv1997116414:87 , srv2048332774:87 , srv2090903879:87 , srv2107753356:87 , srv211098782:87 , srv2127712086:87 , srv442324278:87 , srv702766096:87 , srv893159622:87 , srv1790045496:88 , srv1832435582:88 , srv1907416522:88 , srv397877721:88 , srv58816558:89 , srv602932749:540 }
2024-03-20 10:53:33,103 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2024-03-20 10:53:33,103 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1327664693=17, srv1671491818=31, srv921512566=93, srv552796305=75, srv142538087=21, srv602932749=80, srv1948776071=50, srv702766096=85, srv141344389=20, srv46808575=72, srv1637085104=29, srv275526663=64, srv442324278=70, srv624718587=81, srv1000297557=0, srv1489778725=25, srv1052366046=3, srv1221134444=12, srv58816558=78, srv1169740081=9, srv922960935=94, srv397877721=67, srv1183258436=11, srv929462725=95, srv1967168951=51, srv2090903879=57, srv860052052=90, srv1907459731=47, srv1013135889=1, srv1726126637=36, srv2107753356=59, srv437117898=68, srv1450966974=24, srv2104142306=58, srv951634066=98, srv1971191798=52, srv1544684134=27, srv846493055=89, srv1786204742=38, srv1790045496=39, srv448078740=71, srv1914772922=48, srv932397315=96, srv1831528325=41, srv1716377906=35, srv2127712086=62, srv2048655293=55, srv673819781=83, srv822318761=88, srv1907416522=46, srv1847537290=43, srv798878839=87, srv1430832817=22, srv1859027234=44, srv628434644=82, srv1934022472=49, srv274242697=63, srv695578367=84, srv990813438=99, srv1647110490=30, srv1290661574=16, srv735119921=86, srv182706338=40, srv176113275=37, srv1395049052=19, srv2048332774=54, srv915322805=92, srv1073237445=6, srv1240221230=13, srv539457693=74, srv601242710=79, srv292848790=65, srv1556478355=28, srv1714627139=34, srv1890894809=45, srv1832435582=42, srv1704590123=33, srv39223708=66, srv1523471783=26, srv1997116414=53, srv5693841=76, srv1176791405=10, srv211098782=61, srv1444982672=23, srv1069807531=5, srv1055347595=4, srv494550505=73, srv1080109336=7, srv1158499962=8, srv893159622=91, srv210916607=60, srv168582061=32, srv438928521=69, srv2083962554=56, srv1286489869=15, srv127785885=14, srv1354375717=18, srv580170916=77, srv1020848643=2, srv943398579=97} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2024-03-20 10:53:33,115 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2024-03-20 10:53:33,115 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2024-03-20 10:53:33,115 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2024-03-20 10:53:33,115 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2024-03-20 10:53:33,115 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2024-03-20 10:53:33,115 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2024-03-20 10:53:33,115 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2024-03-20 10:53:33,115 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2024-03-20 10:53:33,115 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2024-03-20 10:53:33,115 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2024-03-20 10:53:33,115 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2024-03-20 10:53:33,115 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2024-03-20 10:53:33,115 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2024-03-20 10:53:33,115 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2024-03-20 10:53:33,115 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2024-03-20 10:53:33,116 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2024-03-20 10:53:33,116 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2024-03-20 10:53:33,116 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2024-03-20 10:53:33,116 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2024-03-20 10:53:33,116 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2024-03-20 10:53:33,116 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2024-03-20 10:53:33,116 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2024-03-20 10:53:33,116 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2024-03-20 10:53:33,116 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2024-03-20 10:53:33,116 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2024-03-20 10:53:33,116 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2024-03-20 10:53:33,116 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2024-03-20 10:53:33,116 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2024-03-20 10:53:33,116 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2024-03-20 10:53:33,116 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2024-03-20 10:53:33,116 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2024-03-20 10:53:33,117 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2024-03-20 10:53:33,117 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2024-03-20 10:53:33,117 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2024-03-20 10:53:33,117 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2024-03-20 10:53:33,117 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2024-03-20 10:53:33,117 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2024-03-20 10:53:33,117 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2024-03-20 10:53:33,117 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2024-03-20 10:53:33,117 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2024-03-20 10:53:33,117 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2024-03-20 10:53:33,117 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2024-03-20 10:53:33,117 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2024-03-20 10:53:33,117 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2024-03-20 10:53:33,117 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2024-03-20 10:53:33,117 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2024-03-20 10:53:33,117 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2024-03-20 10:53:33,118 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2024-03-20 10:53:33,118 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2024-03-20 10:53:33,118 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2024-03-20 10:53:33,118 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2024-03-20 10:53:33,118 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2024-03-20 10:53:33,118 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2024-03-20 10:53:33,118 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2024-03-20 10:53:33,118 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2024-03-20 10:53:33,118 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2024-03-20 10:53:33,118 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2024-03-20 10:53:33,118 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2024-03-20 10:53:33,118 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2024-03-20 10:53:33,118 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2024-03-20 10:53:33,118 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2024-03-20 10:53:33,118 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2024-03-20 10:53:33,118 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2024-03-20 10:53:33,118 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2024-03-20 10:53:33,119 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2024-03-20 10:53:33,119 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2024-03-20 10:53:33,119 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2024-03-20 10:53:33,119 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2024-03-20 10:53:33,119 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2024-03-20 10:53:33,119 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2024-03-20 10:53:33,119 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2024-03-20 10:53:33,119 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2024-03-20 10:53:33,119 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2024-03-20 10:53:33,119 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2024-03-20 10:53:33,119 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2024-03-20 10:53:33,119 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2024-03-20 10:53:33,119 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2024-03-20 10:53:33,119 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2024-03-20 10:53:33,119 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2024-03-20 10:53:33,119 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2024-03-20 10:53:33,119 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2024-03-20 10:53:33,120 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2024-03-20 10:53:33,120 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2024-03-20 10:53:33,120 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2024-03-20 10:53:33,120 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2024-03-20 10:53:33,120 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2024-03-20 10:53:33,120 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2024-03-20 10:53:33,120 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2024-03-20 10:53:33,120 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2024-03-20 10:53:33,120 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2024-03-20 10:53:33,120 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2024-03-20 10:53:33,120 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2024-03-20 10:53:33,120 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2024-03-20 10:53:33,120 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2024-03-20 10:53:33,120 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2024-03-20 10:53:33,120 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2024-03-20 10:53:33,120 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2024-03-20 10:53:33,120 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2024-03-20 10:53:33,120 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2024-03-20 10:53:33,121 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2024-03-20 10:53:33,121 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2024-03-20 10:53:33,228 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.006543950998834459); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.009732678359956285); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.006543950998834459); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=3.333333333333333E-4); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.003833333333333333); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2024-03-20 10:53:33,228 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2024-03-20 10:53:33,229 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=7.205273785844165E-4, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.006543950998834459); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.009732678359956285); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.006543950998834459); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=3.333333333333333E-4); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.003833333333333333); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2024-03-20 10:53:33,564 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 429 ms to try 5000 different iterations.  Found a solution that moves 272 regions; Going from a computed imbalance of 7.205273785844165E-4 to a new imbalance of 5.019865341127699E-5. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=5.23782800878924E-4); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0018349396085439343); MoveCostFunction : (multiplier=7.0, imbalance=0.030222222222222223, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=5.23782800878924E-4); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=4.166666666666667E-4); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2024-03-20 10:53:33,565 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1450966974:83 , srv1523471783:83 , srv1832435582:83 , srv397877721:83 , srv1020848643:84 , srv1073237445:84 , srv1158499962:84 , srv1169740081:84 , srv1240221230:84 , srv1286489869:84 , srv1290661574:84 , srv1327664693:84 , srv1354375717:84 , srv142538087:84 , srv1444982672:84 , srv1489778725:84 , srv1714627139:84 , srv176113275:84 , srv1786204742:84 , srv182706338:84 , srv1847537290:84 , srv1907416522:84 , srv1907459731:84 , srv1914772922:84 , srv1934022472:84 , srv1948776071:84 , srv1967168951:84 , srv2048332774:84 , srv2048655293:84 , srv2083962554:84 , srv2107753356:84 , srv210916607:84 , srv274242697:84 , srv437117898:84 , srv442324278:84 , srv46808575:84 , srv539457693:84 , srv552796305:84 , srv580170916:84 , srv58816558:84 , srv695578367:84 , srv702766096:84 , srv846493055:84 , srv860052052:84 , srv922960935:84 , srv929462725:84 , srv932397315:84 , srv1000297557:85 , srv1013135889:85 , srv1052366046:85 , srv1055347595:85 , srv1080109336:85 , srv1183258436:85 , srv1221134444:85 , srv127785885:85 , srv141344389:85 , srv1430832817:85 , srv1544684134:85 , srv1556478355:85 , srv1647110490:85 , srv1671491818:85 , srv168582061:85 , srv1704590123:85 , srv1716377906:85 , srv1726126637:85 , srv1790045496:85 , srv1831528325:85 , srv1859027234:85 , srv1890894809:85 , srv1971191798:85 , srv2090903879:85 , srv2104142306:85 , srv211098782:85 , srv2127712086:85 , srv275526663:85 , srv39223708:85 , srv438928521:85 , srv494550505:85 , srv5693841:85 , srv601242710:85 , srv624718587:85 , srv673819781:85 , srv735119921:85 , srv798878839:85 , srv822318761:85 , srv893159622:85 , srv915322805:85 , srv943398579:85 , srv990813438:85 , srv1069807531:86 , srv1176791405:86 , srv1395049052:86 , srv1637085104:86 , srv1997116414:86 , srv292848790:86 , srv448078740:86 , srv628434644:86 , srv921512566:86 , srv951634066:86 , srv602932749:626 }
2024-03-20 10:53:33,569 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2024-03-20 10:53:33,569 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1327664693=17, srv1671491818=31, srv921512566=93, srv552796305=75, srv142538087=21, srv602932749=80, srv1948776071=50, srv702766096=85, srv141344389=20, srv46808575=72, srv1637085104=29, srv275526663=64, srv442324278=70, srv624718587=81, srv1000297557=0, srv1489778725=25, srv1052366046=3, srv1221134444=12, srv58816558=78, srv1169740081=9, srv922960935=94, srv397877721=67, srv1183258436=11, srv929462725=95, srv1967168951=51, srv2090903879=57, srv860052052=90, srv1907459731=47, srv1013135889=1, srv1726126637=36, srv2107753356=59, srv437117898=68, srv1450966974=24, srv2104142306=58, srv951634066=98, srv1971191798=52, srv1544684134=27, srv846493055=89, srv1786204742=38, srv1790045496=39, srv448078740=71, srv1914772922=48, srv932397315=96, srv1831528325=41, srv1716377906=35, srv2127712086=62, srv2048655293=55, srv673819781=83, srv822318761=88, srv1907416522=46, srv1847537290=43, srv798878839=87, srv1430832817=22, srv1859027234=44, srv628434644=82, srv1934022472=49, srv274242697=63, srv695578367=84, srv990813438=99, srv1647110490=30, srv1290661574=16, srv735119921=86, srv182706338=40, srv176113275=37, srv1395049052=19, srv2048332774=54, srv915322805=92, srv1073237445=6, srv1240221230=13, srv539457693=74, srv601242710=79, srv292848790=65, srv1556478355=28, srv1714627139=34, srv1890894809=45, srv1832435582=42, srv1704590123=33, srv39223708=66, srv1523471783=26, srv1997116414=53, srv5693841=76, srv1176791405=10, srv211098782=61, srv1444982672=23, srv1069807531=5, srv1055347595=4, srv494550505=73, srv1080109336=7, srv1158499962=8, srv893159622=91, srv210916607=60, srv168582061=32, srv438928521=69, srv2083962554=56, srv1286489869=15, srv127785885=14, srv1354375717=18, srv580170916=77, srv1020848643=2, srv943398579=97} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2024-03-20 10:53:33,580 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2024-03-20 10:53:33,580 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2024-03-20 10:53:33,580 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2024-03-20 10:53:33,580 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2024-03-20 10:53:33,580 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2024-03-20 10:53:33,580 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2024-03-20 10:53:33,581 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2024-03-20 10:53:33,581 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2024-03-20 10:53:33,581 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2024-03-20 10:53:33,581 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2024-03-20 10:53:33,581 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2024-03-20 10:53:33,581 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2024-03-20 10:53:33,581 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2024-03-20 10:53:33,581 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2024-03-20 10:53:33,581 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2024-03-20 10:53:33,581 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2024-03-20 10:53:33,581 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2024-03-20 10:53:33,581 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2024-03-20 10:53:33,581 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2024-03-20 10:53:33,581 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2024-03-20 10:53:33,581 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2024-03-20 10:53:33,581 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2024-03-20 10:53:33,581 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2024-03-20 10:53:33,581 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2024-03-20 10:53:33,581 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2024-03-20 10:53:33,582 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2024-03-20 10:53:33,582 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2024-03-20 10:53:33,582 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2024-03-20 10:53:33,582 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2024-03-20 10:53:33,582 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2024-03-20 10:53:33,582 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2024-03-20 10:53:33,582 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2024-03-20 10:53:33,582 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2024-03-20 10:53:33,582 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2024-03-20 10:53:33,582 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2024-03-20 10:53:33,582 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2024-03-20 10:53:33,582 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2024-03-20 10:53:33,582 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2024-03-20 10:53:33,582 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2024-03-20 10:53:33,582 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2024-03-20 10:53:33,582 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2024-03-20 10:53:33,582 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2024-03-20 10:53:33,582 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2024-03-20 10:53:33,582 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2024-03-20 10:53:33,583 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2024-03-20 10:53:33,583 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2024-03-20 10:53:33,583 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2024-03-20 10:53:33,583 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2024-03-20 10:53:33,583 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2024-03-20 10:53:33,583 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2024-03-20 10:53:33,583 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2024-03-20 10:53:33,583 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2024-03-20 10:53:33,583 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2024-03-20 10:53:33,583 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2024-03-20 10:53:33,583 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2024-03-20 10:53:33,583 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2024-03-20 10:53:33,583 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2024-03-20 10:53:33,583 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2024-03-20 10:53:33,583 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2024-03-20 10:53:33,583 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2024-03-20 10:53:33,583 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2024-03-20 10:53:33,583 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2024-03-20 10:53:33,583 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2024-03-20 10:53:33,584 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2024-03-20 10:53:33,584 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2024-03-20 10:53:33,584 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2024-03-20 10:53:33,584 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2024-03-20 10:53:33,584 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2024-03-20 10:53:33,584 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2024-03-20 10:53:33,584 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2024-03-20 10:53:33,584 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2024-03-20 10:53:33,584 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2024-03-20 10:53:33,584 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2024-03-20 10:53:33,584 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2024-03-20 10:53:33,584 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2024-03-20 10:53:33,584 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2024-03-20 10:53:33,585 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2024-03-20 10:53:33,585 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2024-03-20 10:53:33,585 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2024-03-20 10:53:33,585 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2024-03-20 10:53:33,585 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2024-03-20 10:53:33,585 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2024-03-20 10:53:33,585 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2024-03-20 10:53:33,585 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2024-03-20 10:53:33,585 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2024-03-20 10:53:33,585 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2024-03-20 10:53:33,585 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2024-03-20 10:53:33,585 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2024-03-20 10:53:33,585 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2024-03-20 10:53:33,585 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2024-03-20 10:53:33,585 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2024-03-20 10:53:33,585 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2024-03-20 10:53:33,585 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2024-03-20 10:53:33,585 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2024-03-20 10:53:33,586 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2024-03-20 10:53:33,586 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2024-03-20 10:53:33,586 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2024-03-20 10:53:33,586 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2024-03-20 10:53:33,586 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2024-03-20 10:53:33,586 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2024-03-20 10:53:33,586 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2024-03-20 10:53:33,693 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=5.23782800878924E-4); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0018349396085439343); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=5.23782800878924E-4); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=4.166666666666667E-4); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2024-03-20 10:53:33,693 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2024-03-20 10:53:33,694 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=4.8294068703771786E-5, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=5.23782800878924E-4); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0018349396085439343); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=5.23782800878924E-4); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=4.166666666666667E-4); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2024-03-20 10:53:33,918 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 323 ms to try 5000 different iterations.  Found a solution that moves 36 regions; Going from a computed imbalance of 4.8294068703771786E-5 to a new imbalance of 7.32531668408749E-6. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0015713484026367722); MoveCostFunction : (multiplier=7.0, imbalance=0.004); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2024-03-20 10:53:33,918 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1176791405:83 , srv1430832817:83 , srv1637085104:83 , srv1831528325:83 , srv1934022472:83 , srv1997116414:83 , srv292848790:83 , srv438928521:83 , srv628434644:83 , srv921512566:83 , srv951634066:83 , srv1000297557:84 , srv1013135889:84 , srv1020848643:84 , srv1052366046:84 , srv1055347595:84 , srv1069807531:84 , srv1073237445:84 , srv1080109336:84 , srv1169740081:84 , srv1183258436:84 , srv1221134444:84 , srv1240221230:84 , srv127785885:84 , srv1290661574:84 , srv1327664693:84 , srv1354375717:84 , srv1395049052:84 , srv141344389:84 , srv142538087:84 , srv1489778725:84 , srv1544684134:84 , srv1556478355:84 , srv1647110490:84 , srv1671491818:84 , srv168582061:84 , srv1704590123:84 , srv1714627139:84 , srv1726126637:84 , srv176113275:84 , srv1786204742:84 , srv1790045496:84 , srv182706338:84 , srv1859027234:84 , srv1890894809:84 , srv1907416522:84 , srv1907459731:84 , srv1948776071:84 , srv1967168951:84 , srv1971191798:84 , srv2048332774:84 , srv2048655293:84 , srv2083962554:84 , srv2090903879:84 , srv2104142306:84 , srv2107753356:84 , srv211098782:84 , srv2127712086:84 , srv274242697:84 , srv275526663:84 , srv39223708:84 , srv397877721:84 , srv437117898:84 , srv442324278:84 , srv448078740:84 , srv494550505:84 , srv539457693:84 , srv552796305:84 , srv5693841:84 , srv580170916:84 , srv58816558:84 , srv601242710:84 , srv624718587:84 , srv673819781:84 , srv695578367:84 , srv702766096:84 , srv735119921:84 , srv798878839:84 , srv822318761:84 , srv846493055:84 , srv860052052:84 , srv893159622:84 , srv915322805:84 , srv922960935:84 , srv929462725:84 , srv932397315:84 , srv943398579:84 , srv990813438:84 , srv1158499962:85 , srv1286489869:85 , srv1444982672:85 , srv1450966974:85 , srv1523471783:85 , srv1716377906:85 , srv1832435582:85 , srv1847537290:85 , srv1914772922:85 , srv210916607:85 , srv46808575:85 , srv602932749:684 }
2024-03-20 10:53:33,922 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2024-03-20 10:53:33,922 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1327664693=17, srv1671491818=31, srv921512566=93, srv552796305=75, srv142538087=21, srv602932749=80, srv1948776071=50, srv702766096=85, srv141344389=20, srv46808575=72, srv1637085104=29, srv275526663=64, srv442324278=70, srv624718587=81, srv1000297557=0, srv1489778725=25, srv1052366046=3, srv1221134444=12, srv58816558=78, srv1169740081=9, srv922960935=94, srv397877721=67, srv1183258436=11, srv929462725=95, srv1967168951=51, srv2090903879=57, srv860052052=90, srv1907459731=47, srv1013135889=1, srv1726126637=36, srv2107753356=59, srv437117898=68, srv1450966974=24, srv2104142306=58, srv951634066=98, srv1971191798=52, srv1544684134=27, srv846493055=89, srv1786204742=38, srv1790045496=39, srv448078740=71, srv1914772922=48, srv932397315=96, srv1831528325=41, srv1716377906=35, srv2127712086=62, srv2048655293=55, srv673819781=83, srv822318761=88, srv1907416522=46, srv1847537290=43, srv798878839=87, srv1430832817=22, srv1859027234=44, srv628434644=82, srv1934022472=49, srv274242697=63, srv695578367=84, srv990813438=99, srv1647110490=30, srv1290661574=16, srv735119921=86, srv182706338=40, srv176113275=37, srv1395049052=19, srv2048332774=54, srv915322805=92, srv1073237445=6, srv1240221230=13, srv539457693=74, srv601242710=79, srv292848790=65, srv1556478355=28, srv1714627139=34, srv1890894809=45, srv1832435582=42, srv1704590123=33, srv39223708=66, srv1523471783=26, srv1997116414=53, srv5693841=76, srv1176791405=10, srv211098782=61, srv1444982672=23, srv1069807531=5, srv1055347595=4, srv494550505=73, srv1080109336=7, srv1158499962=8, srv893159622=91, srv210916607=60, srv168582061=32, srv438928521=69, srv2083962554=56, srv1286489869=15, srv127785885=14, srv1354375717=18, srv580170916=77, srv1020848643=2, srv943398579=97} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2024-03-20 10:53:33,944 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2024-03-20 10:53:33,944 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2024-03-20 10:53:33,944 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2024-03-20 10:53:33,944 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2024-03-20 10:53:33,944 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2024-03-20 10:53:33,944 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2024-03-20 10:53:33,944 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2024-03-20 10:53:33,944 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2024-03-20 10:53:33,944 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2024-03-20 10:53:33,944 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2024-03-20 10:53:33,945 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2024-03-20 10:53:33,945 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2024-03-20 10:53:33,945 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2024-03-20 10:53:33,945 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2024-03-20 10:53:33,945 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2024-03-20 10:53:33,945 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2024-03-20 10:53:33,945 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2024-03-20 10:53:33,945 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2024-03-20 10:53:33,945 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2024-03-20 10:53:33,945 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2024-03-20 10:53:33,945 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2024-03-20 10:53:33,945 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2024-03-20 10:53:33,946 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2024-03-20 10:53:33,946 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2024-03-20 10:53:33,946 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2024-03-20 10:53:33,946 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2024-03-20 10:53:33,946 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2024-03-20 10:53:33,946 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2024-03-20 10:53:33,946 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2024-03-20 10:53:33,946 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2024-03-20 10:53:33,946 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2024-03-20 10:53:33,946 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2024-03-20 10:53:33,946 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2024-03-20 10:53:33,946 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2024-03-20 10:53:33,947 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2024-03-20 10:53:33,947 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2024-03-20 10:53:33,947 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2024-03-20 10:53:33,947 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2024-03-20 10:53:33,947 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2024-03-20 10:53:33,947 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2024-03-20 10:53:33,947 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2024-03-20 10:53:33,947 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2024-03-20 10:53:33,947 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2024-03-20 10:53:33,947 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2024-03-20 10:53:33,947 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2024-03-20 10:53:33,947 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2024-03-20 10:53:33,948 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2024-03-20 10:53:33,948 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2024-03-20 10:53:33,948 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2024-03-20 10:53:33,948 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2024-03-20 10:53:33,948 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2024-03-20 10:53:33,948 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2024-03-20 10:53:33,948 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2024-03-20 10:53:33,948 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2024-03-20 10:53:33,948 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2024-03-20 10:53:33,948 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2024-03-20 10:53:33,948 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2024-03-20 10:53:33,948 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2024-03-20 10:53:33,948 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2024-03-20 10:53:33,949 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2024-03-20 10:53:33,949 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2024-03-20 10:53:33,949 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2024-03-20 10:53:33,949 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2024-03-20 10:53:33,949 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2024-03-20 10:53:33,949 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2024-03-20 10:53:33,949 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2024-03-20 10:53:33,949 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2024-03-20 10:53:33,949 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2024-03-20 10:53:33,949 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2024-03-20 10:53:33,949 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2024-03-20 10:53:33,949 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2024-03-20 10:53:33,950 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2024-03-20 10:53:33,950 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2024-03-20 10:53:33,950 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2024-03-20 10:53:33,950 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2024-03-20 10:53:33,950 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2024-03-20 10:53:33,950 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2024-03-20 10:53:33,950 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2024-03-20 10:53:33,950 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2024-03-20 10:53:33,950 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2024-03-20 10:53:33,950 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2024-03-20 10:53:33,950 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2024-03-20 10:53:33,950 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2024-03-20 10:53:33,951 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2024-03-20 10:53:33,951 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2024-03-20 10:53:33,951 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2024-03-20 10:53:33,951 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2024-03-20 10:53:33,951 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2024-03-20 10:53:33,951 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2024-03-20 10:53:33,951 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2024-03-20 10:53:33,951 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2024-03-20 10:53:33,951 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2024-03-20 10:53:33,951 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2024-03-20 10:53:33,952 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2024-03-20 10:53:33,952 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2024-03-20 10:53:33,952 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2024-03-20 10:53:33,952 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2024-03-20 10:53:33,952 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2024-03-20 10:53:33,952 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2024-03-20 10:53:33,952 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2024-03-20 10:53:33,952 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2024-03-20 10:53:34,055 INFO  [Time-limited test] balancer.StochasticLoadBalancer(381): Cluster wide - skipping load balancing because weighted average imbalance=7.073239296329447E-6 <= threshold(0.025). If you want more aggressive balancing, either lower hbase.master.balancer.stochastic.minCostNeedBalance from 0.025 or increase the relative multiplier(s) of the specific cost function(s). functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0015713484026367722); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2024-03-20 10:53:34,055 INFO  [Time-limited test] balancer.BalancerTestBase(570): Mock Final balance: { srv1176791405:83 , srv1430832817:83 , srv1637085104:83 , srv1831528325:83 , srv1934022472:83 , srv1997116414:83 , srv292848790:83 , srv438928521:83 , srv628434644:83 , srv921512566:83 , srv951634066:83 , srv1000297557:84 , srv1013135889:84 , srv1020848643:84 , srv1052366046:84 , srv1055347595:84 , srv1069807531:84 , srv1073237445:84 , srv1080109336:84 , srv1169740081:84 , srv1183258436:84 , srv1221134444:84 , srv1240221230:84 , srv127785885:84 , srv1290661574:84 , srv1327664693:84 , srv1354375717:84 , srv1395049052:84 , srv141344389:84 , srv142538087:84 , srv1489778725:84 , srv1544684134:84 , srv1556478355:84 , srv1647110490:84 , srv1671491818:84 , srv168582061:84 , srv1704590123:84 , srv1714627139:84 , srv1726126637:84 , srv176113275:84 , srv1786204742:84 , srv1790045496:84 , srv182706338:84 , srv1859027234:84 , srv1890894809:84 , srv1907416522:84 , srv1907459731:84 , srv1948776071:84 , srv1967168951:84 , srv1971191798:84 , srv2048332774:84 , srv2048655293:84 , srv2083962554:84 , srv2090903879:84 , srv2104142306:84 , srv2107753356:84 , srv211098782:84 , srv2127712086:84 , srv274242697:84 , srv275526663:84 , srv39223708:84 , srv397877721:84 , srv437117898:84 , srv442324278:84 , srv448078740:84 , srv494550505:84 , srv539457693:84 , srv552796305:84 , srv5693841:84 , srv580170916:84 , srv58816558:84 , srv601242710:84 , srv624718587:84 , srv673819781:84 , srv695578367:84 , srv702766096:84 , srv735119921:84 , srv798878839:84 , srv822318761:84 , srv846493055:84 , srv860052052:84 , srv893159622:84 , srv915322805:84 , srv922960935:84 , srv929462725:84 , srv932397315:84 , srv943398579:84 , srv990813438:84 , srv1158499962:85 , srv1286489869:85 , srv1444982672:85 , srv1450966974:85 , srv1523471783:85 , srv1716377906:85 , srv1832435582:85 , srv1847537290:85 , srv1914772922:85 , srv210916607:85 , srv46808575:85 , srv602932749:684 }
2024-03-20 10:53:34,082 INFO  [Time-limited test] hbase.ResourceChecker(175): after: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnLargeClusterWithRacks Thread=12 (was 12), OpenFileDescriptor=290 (was 290), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=303 (was 294) - SystemLoadAverage LEAK? -, ProcessCount=170 (was 170), AvailableMemoryMB=2998 (was 3497)
2024-03-20 10:53:34,091 INFO  [Time-limited test] hbase.ResourceChecker(147): before: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnMidClusterWithRacks Thread=12, OpenFileDescriptor=290, MaxFileDescriptor=60000, SystemLoadAverage=303, ProcessCount=170, AvailableMemoryMB=2998
2024-03-20 10:53:34,091 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2024-03-20 10:53:34,092 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=5000, runMaxSteps=true, stepsPerRegion=800, maxRunningTime=120000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 111077.0 etc.
2024-03-20 10:53:34,100 INFO  [Time-limited test] balancer.BalancerTestBase(547): Mock Cluster : { srv1045084389:84 , srv1180998859:84 , srv1181196258:84 , srv1200900868:84 , srv1215287823:84 , srv122069846:84 , srv1252552418:84 , srv1415292523:84 , srv1638400897:84 , srv1716884759:84 , srv1734096808:84 , srv1755128008:84 , srv1810832558:84 , srv1840110785:84 , srv184604753:84 , srv1942355328:84 , srv1994126410:84 , srv2023072851:84 , srv2030192986:84 , srv2133606135:84 , srv353611686:84 , srv360996147:84 , srv419881998:84 , srv470761387:84 , srv473208558:84 , srv585671331:84 , srv688780267:84 , srv861949566:84 , srv961530285:84 , srv400061325:264 } [srvr=30 rgns=2700 avg=90.0 max=90 min=90]
2024-03-20 10:53:34,101 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2024-03-20 10:53:34,101 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv585671331=26, srv122069846=5, srv1200900868=3, srv1840110785=13, srv400061325=22, srv1942355328=15, srv688780267=27, srv861949566=28, srv2030192986=18, srv353611686=20, srv961530285=29, srv1045084389=0, srv2133606135=19, srv1181196258=2, srv1415292523=7, srv1716884759=9, srv473208558=25, srv1252552418=6, srv1180998859=1, srv470761387=24, srv184604753=14, srv2023072851=17, srv419881998=23, srv1638400897=8, srv1994126410=16, srv1215287823=4, srv1734096808=10, srv360996147=21, srv1755128008=11, srv1810832558=12} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2024-03-20 10:53:34,110 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2024-03-20 10:53:34,110 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2024-03-20 10:53:34,110 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2024-03-20 10:53:34,110 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2024-03-20 10:53:34,110 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2024-03-20 10:53:34,110 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2024-03-20 10:53:34,110 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2024-03-20 10:53:34,110 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2024-03-20 10:53:34,110 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2024-03-20 10:53:34,110 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2024-03-20 10:53:34,111 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2024-03-20 10:53:34,111 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2024-03-20 10:53:34,111 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2024-03-20 10:53:34,111 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2024-03-20 10:53:34,111 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2024-03-20 10:53:34,111 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2024-03-20 10:53:34,111 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2024-03-20 10:53:34,111 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2024-03-20 10:53:34,111 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2024-03-20 10:53:34,111 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2024-03-20 10:53:34,111 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2024-03-20 10:53:34,111 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2024-03-20 10:53:34,111 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2024-03-20 10:53:34,111 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2024-03-20 10:53:34,111 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2024-03-20 10:53:34,112 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2024-03-20 10:53:34,112 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2024-03-20 10:53:34,112 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2024-03-20 10:53:34,112 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2024-03-20 10:53:34,112 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2024-03-20 10:53:34,112 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=10, number of hosts=30, number of racks=4
2024-03-20 10:53:34,134 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=1.1465422982636446, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2024-03-20 10:53:34,135 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.9912654793261062, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=1.1465422982636446, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=64800000
2024-03-20 10:55:34,115 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 120001 ms to try 5702565 different iterations.  Found a solution that moves 1867 regions; Going from a computed imbalance of 0.9912654793261062 to a new imbalance of 4.3576711383728133E-5. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); MoveCostFunction : (multiplier=7.0, imbalance=0.6914814814814815, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2024-03-20 10:55:34,122 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1045084389:90 , srv1180998859:90 , srv1181196258:90 , srv1200900868:90 , srv1215287823:90 , srv122069846:90 , srv1252552418:90 , srv1415292523:90 , srv1638400897:90 , srv1716884759:90 , srv1734096808:90 , srv1755128008:90 , srv1810832558:90 , srv1840110785:90 , srv184604753:90 , srv1942355328:90 , srv1994126410:90 , srv2023072851:90 , srv2030192986:90 , srv2133606135:90 , srv353611686:90 , srv360996147:90 , srv400061325:90 , srv419881998:90 , srv470761387:90 , srv473208558:90 , srv585671331:90 , srv688780267:90 , srv861949566:90 , srv961530285:90 }
2024-03-20 10:55:34,123 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2024-03-20 10:55:34,123 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv585671331=26, srv122069846=5, srv1200900868=3, srv1840110785=13, srv400061325=22, srv1942355328=15, srv688780267=27, srv861949566=28, srv2030192986=18, srv353611686=20, srv961530285=29, srv1045084389=0, srv2133606135=19, srv1181196258=2, srv1415292523=7, srv1716884759=9, srv473208558=25, srv1252552418=6, srv1180998859=1, srv470761387=24, srv184604753=14, srv2023072851=17, srv419881998=23, srv1638400897=8, srv1994126410=16, srv1215287823=4, srv1734096808=10, srv360996147=21, srv1755128008=11, srv1810832558=12} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2024-03-20 10:55:34,127 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2024-03-20 10:55:34,127 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2024-03-20 10:55:34,127 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2024-03-20 10:55:34,127 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2024-03-20 10:55:34,127 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2024-03-20 10:55:34,127 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2024-03-20 10:55:34,128 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2024-03-20 10:55:34,128 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2024-03-20 10:55:34,128 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2024-03-20 10:55:34,128 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2024-03-20 10:55:34,128 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2024-03-20 10:55:34,128 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2024-03-20 10:55:34,128 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2024-03-20 10:55:34,128 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2024-03-20 10:55:34,128 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2024-03-20 10:55:34,128 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2024-03-20 10:55:34,128 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2024-03-20 10:55:34,128 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2024-03-20 10:55:34,128 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2024-03-20 10:55:34,128 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2024-03-20 10:55:34,128 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2024-03-20 10:55:34,128 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2024-03-20 10:55:34,128 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2024-03-20 10:55:34,128 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2024-03-20 10:55:34,128 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2024-03-20 10:55:34,128 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2024-03-20 10:55:34,128 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2024-03-20 10:55:34,128 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2024-03-20 10:55:34,128 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2024-03-20 10:55:34,129 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2024-03-20 10:55:34,129 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=10, number of hosts=30, number of racks=4
2024-03-20 10:55:34,140 INFO  [Time-limited test] balancer.StochasticLoadBalancer(381): Cluster wide - skipping load balancing because weighted average imbalance=0.0 <= threshold(0.025). If you want more aggressive balancing, either lower hbase.master.balancer.stochastic.minCostNeedBalance from 0.025 or increase the relative multiplier(s) of the specific cost function(s). functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2024-03-20 10:55:34,141 INFO  [Time-limited test] balancer.BalancerTestBase(570): Mock Final balance: { srv1045084389:90 , srv1180998859:90 , srv1181196258:90 , srv1200900868:90 , srv1215287823:90 , srv122069846:90 , srv1252552418:90 , srv1415292523:90 , srv1638400897:90 , srv1716884759:90 , srv1734096808:90 , srv1755128008:90 , srv1810832558:90 , srv1840110785:90 , srv184604753:90 , srv1942355328:90 , srv1994126410:90 , srv2023072851:90 , srv2030192986:90 , srv2133606135:90 , srv353611686:90 , srv360996147:90 , srv400061325:90 , srv419881998:90 , srv470761387:90 , srv473208558:90 , srv585671331:90 , srv688780267:90 , srv861949566:90 , srv961530285:90 }
2024-03-20 10:55:34,155 INFO  [Time-limited test] hbase.ResourceChecker(175): after: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnMidClusterWithRacks Thread=11 (was 12), OpenFileDescriptor=290 (was 290), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=149 (was 303), ProcessCount=168 (was 170), AvailableMemoryMB=2254 (was 2998)