2023-10-30 14:56:51,495 INFO  [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks timeout: 13 mins
2023-10-30 14:56:51,725 WARN  [Time-limited test] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties
2023-10-30 14:56:51,811 INFO  [Time-limited test] metrics.MetricRegistriesLoader(60): Loaded MetricRegistries class org.apache.hadoop.hbase.metrics.impl.MetricRegistriesImpl
2023-10-30 14:56:51,862 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2023-10-30 14:56:51,867 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc.
2023-10-30 14:56:51,878 INFO  [Time-limited test] hbase.ResourceChecker(147): before: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnLargeClusterWithRacks Thread=12, OpenFileDescriptor=263, MaxFileDescriptor=60000, SystemLoadAverage=206, ProcessCount=168, AvailableMemoryMB=2576
2023-10-30 14:56:51,880 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2023-10-30 14:56:51,880 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=5000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=10000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc.
2023-10-30 14:56:52,007 INFO  [Time-limited test] balancer.BalancerTestBase(547): Mock Cluster : { srv1000771448:84 , srv1003159757:84 , srv1015247250:84 , srv1041163232:84 , srv1089880325:84 , srv1097006396:84 , srv113178671:84 , srv1211154425:84 , srv1215536557:84 , srv1220335145:84 , srv1223335493:84 , srv1233754774:84 , srv124296879:84 , srv1250135161:84 , srv126161569:84 , srv1263720500:84 , srv1270100051:84 , srv1359989584:84 , srv138416876:84 , srv1387303967:84 , srv1410540644:84 , srv1417060207:84 , srv1417179872:84 , srv1437767768:84 , srv1449229847:84 , srv1465482342:84 , srv150556523:84 , srv1507087568:84 , srv1524708497:84 , srv1554489770:84 , srv1577130371:84 , srv1580197862:84 , srv1585888283:84 , srv1602166462:84 , srv1640507593:84 , srv165093584:84 , srv1657869016:84 , srv1669990017:84 , srv1673443983:84 , srv16862392:84 , srv1686709376:84 , srv1710522171:84 , srv1747555832:84 , srv1756872941:84 , srv1817355659:84 , srv1821338431:84 , srv1839638093:84 , srv1855613640:84 , srv1862023646:84 , srv1925673239:84 , srv194360414:84 , srv1953485888:84 , srv195942563:84 , srv1980519019:84 , srv2009034239:84 , srv2028302140:84 , srv2034240019:84 , srv2068236997:84 , srv2071864789:84 , srv2081279365:84 , srv2087153617:84 , srv2100279502:84 , srv2132994507:84 , srv27389538:84 , srv297831982:84 , srv307470449:84 , srv307703986:84 , srv310288559:84 , srv328249503:84 , srv348071450:84 , srv349908729:84 , srv362820470:84 , srv460125174:84 , srv481799346:84 , srv485803353:84 , srv490579578:84 , srv493964512:84 , srv512351783:84 , srv613880611:84 , srv617834850:84 , srv626162225:84 , srv647827700:84 , srv670742632:84 , srv727946407:84 , srv753630679:84 , srv784150321:84 , srv795350450:84 , srv798592000:84 , srv814195451:84 , srv8305858:84 , srv839688084:84 , srv877987767:84 , srv889644663:84 , srv920410090:84 , srv927910584:84 , srv950240266:84 , srv958007070:84 , srv972364094:84 , srv973574751:84 , srv579136784:684 } [srvr=100 rgns=9000 avg=90.0 max=90 min=90]
2023-10-30 14:56:52,019 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-10-30 14:56:52,027 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1710522171=41, srv1669990017=37, srv1839638093=46, srv493964512=76, srv1097006396=5, srv1387303967=19, srv784150321=86, srv972364094=98, srv1270100051=16, srv1015247250=2, srv124296879=12, srv1437767768=23, srv1507087568=27, srv1980519019=53, srv1250135161=13, srv2071864789=58, srv16862392=39, srv795350450=87, srv126161569=14, srv1580197862=31, srv2068236997=57, srv1925673239=49, srv798592000=88, srv310288559=67, srv27389538=63, srv512351783=77, srv307703986=66, srv1585888283=32, srv1747555832=42, srv1215536557=8, srv1417060207=21, srv362820470=71, srv1233754774=11, srv1673443983=38, srv839688084=91, srv753630679=85, srv727946407=84, srv1554489770=29, srv1410540644=20, srv1657869016=36, srv1524708497=28, srv348071450=69, srv194360414=50, srv1817355659=44, srv1220335145=9, srv670742632=83, srv1821338431=45, srv1041163232=3, srv113178671=6, srv973574751=99, srv2009034239=54, srv877987767=92, srv328249503=68, srv1003159757=1, srv150556523=26, srv138416876=18, srv481799346=73, srv814195451=89, srv1577130371=30, srv195942563=52, srv920410090=94, srv1089880325=4, srv2081279365=59, srv1640507593=34, srv1223335493=10, srv8305858=90, srv1263720500=15, srv617834850=80, srv958007070=97, srv626162225=81, srv647827700=82, srv1465482342=25, srv2028302140=55, srv927910584=95, srv1000771448=0, srv297831982=64, srv1756872941=43, srv1602166462=33, srv1449229847=24, srv1211154425=7, srv1417179872=22, srv2087153617=60, srv307470449=65, srv613880611=79, srv889644663=93, srv950240266=96, srv579136784=78, srv485803353=74, srv490579578=75, srv349908729=70, srv2132994507=62, srv1359989584=17, srv1862023646=48, srv165093584=35, srv1686709376=40, srv2100279502=61, srv2034240019=56, srv460125174=72, srv1953485888=51, srv1855613640=47} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-10-30 14:56:52,101 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-10-30 14:56:52,101 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-10-30 14:56:52,101 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-10-30 14:56:52,101 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-10-30 14:56:52,101 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-10-30 14:56:52,101 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-10-30 14:56:52,101 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-10-30 14:56:52,101 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-10-30 14:56:52,101 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-10-30 14:56:52,102 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-10-30 14:56:52,102 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-10-30 14:56:52,102 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-10-30 14:56:52,102 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-10-30 14:56:52,102 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-10-30 14:56:52,102 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-10-30 14:56:52,102 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-10-30 14:56:52,102 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-10-30 14:56:52,102 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-10-30 14:56:52,102 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-10-30 14:56:52,103 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-10-30 14:56:52,103 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-10-30 14:56:52,103 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-10-30 14:56:52,103 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-10-30 14:56:52,103 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-10-30 14:56:52,103 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-10-30 14:56:52,103 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-10-30 14:56:52,103 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-10-30 14:56:52,103 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-10-30 14:56:52,103 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-10-30 14:56:52,103 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-10-30 14:56:52,104 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-10-30 14:56:52,104 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-10-30 14:56:52,104 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-10-30 14:56:52,104 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-10-30 14:56:52,104 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-10-30 14:56:52,104 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-10-30 14:56:52,104 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-10-30 14:56:52,104 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-10-30 14:56:52,104 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-10-30 14:56:52,104 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-10-30 14:56:52,104 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-10-30 14:56:52,105 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-10-30 14:56:52,105 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-10-30 14:56:52,105 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-10-30 14:56:52,105 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-10-30 14:56:52,105 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-10-30 14:56:52,105 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-10-30 14:56:52,105 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-10-30 14:56:52,105 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-10-30 14:56:52,105 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-10-30 14:56:52,105 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-10-30 14:56:52,106 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-10-30 14:56:52,106 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-10-30 14:56:52,106 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-10-30 14:56:52,106 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-10-30 14:56:52,106 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-10-30 14:56:52,106 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-10-30 14:56:52,106 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-10-30 14:56:52,106 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-10-30 14:56:52,106 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-10-30 14:56:52,106 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-10-30 14:56:52,106 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-10-30 14:56:52,107 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-10-30 14:56:52,107 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-10-30 14:56:52,107 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-10-30 14:56:52,107 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-10-30 14:56:52,107 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-10-30 14:56:52,107 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-10-30 14:56:52,107 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-10-30 14:56:52,107 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-10-30 14:56:52,107 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-10-30 14:56:52,108 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-10-30 14:56:52,108 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-10-30 14:56:52,108 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-10-30 14:56:52,108 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-10-30 14:56:52,108 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-10-30 14:56:52,108 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-10-30 14:56:52,108 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-10-30 14:56:52,108 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-10-30 14:56:52,108 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-10-30 14:56:52,108 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-10-30 14:56:52,108 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-10-30 14:56:52,109 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-10-30 14:56:52,109 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-10-30 14:56:52,109 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-10-30 14:56:52,109 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-10-30 14:56:52,109 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-10-30 14:56:52,109 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-10-30 14:56:52,109 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-10-30 14:56:52,109 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-10-30 14:56:52,109 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-10-30 14:56:52,109 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-10-30 14:56:52,109 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-10-30 14:56:52,110 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-10-30 14:56:52,110 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-10-30 14:56:52,110 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-10-30 14:56:52,110 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-10-30 14:56:52,110 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-10-30 14:56:52,110 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-10-30 14:56:52,110 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-10-30 14:56:52,110 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-10-30 14:56:52,348 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.06666666666666667, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-10-30 14:56:52,348 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-10-30 14:56:52,348 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.9909252140407105, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.06666666666666667, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-10-30 14:56:52,739 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 609 ms to try 5000 different iterations.  Found a solution that moves 4715 regions; Going from a computed imbalance of 0.9909252140407105 to a new imbalance of 0.17825575007349917. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.04240435641032519, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.05752079602464348, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.5238888888888888, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.04240435641032519, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.17241666666666666, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.25033333333333335, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-10-30 14:56:52,749 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv617834850:81 , srv1410540644:82 , srv1980519019:82 , srv784150321:82 , srv814195451:82 , srv1211154425:83 , srv1507087568:83 , srv1577130371:83 , srv1580197862:83 , srv1657869016:83 , srv1756872941:83 , srv2009034239:83 , srv2071864789:83 , srv727946407:83 , srv1233754774:84 , srv1585888283:84 , srv1710522171:84 , srv1821338431:84 , srv1953485888:84 , srv2034240019:84 , srv2100279502:84 , srv348071450:84 , srv795350450:84 , srv839688084:84 , srv920410090:84 , srv927910584:84 , srv973574751:84 , srv1000771448:85 , srv1041163232:85 , srv1089880325:85 , srv1263720500:85 , srv1449229847:85 , srv1465482342:85 , srv150556523:85 , srv1669990017:85 , srv1855613640:85 , srv753630679:85 , srv798592000:85 , srv958007070:85 , srv113178671:86 , srv124296879:86 , srv1250135161:86 , srv1270100051:86 , srv1359989584:86 , srv1524708497:86 , srv1554489770:86 , srv1686709376:86 , srv1839638093:86 , srv2028302140:86 , srv2132994507:86 , srv328249503:86 , srv349908729:86 , srv490579578:86 , srv493964512:86 , srv613880611:86 , srv877987767:86 , srv889644663:86 , srv1097006396:87 , srv1215536557:87 , srv138416876:87 , srv1387303967:87 , srv1417179872:87 , srv1640507593:87 , srv165093584:87 , srv2068236997:87 , srv2081279365:87 , srv27389538:87 , srv307703986:87 , srv512351783:87 , srv670742632:87 , srv8305858:87 , srv950240266:87 , srv1003159757:88 , srv1015247250:88 , srv1747555832:88 , srv1925673239:88 , srv194360414:88 , srv195942563:88 , srv2087153617:88 , srv297831982:88 , srv362820470:88 , srv460125174:88 , srv481799346:88 , srv1220335145:89 , srv126161569:89 , srv1437767768:89 , srv1602166462:89 , srv1817355659:89 , srv310288559:89 , srv647827700:89 , srv1223335493:90 , srv1417060207:90 , srv16862392:90 , srv1862023646:90 , srv307470449:90 , srv626162225:90 , srv1673443983:93 , srv972364094:93 , srv485803353:95 , srv579136784:467 }
2023-10-30 14:56:52,753 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-10-30 14:56:52,754 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1710522171=41, srv1669990017=37, srv1839638093=46, srv493964512=76, srv1097006396=5, srv1387303967=19, srv784150321=86, srv972364094=98, srv1270100051=16, srv1015247250=2, srv124296879=12, srv1437767768=23, srv1507087568=27, srv1980519019=53, srv1250135161=13, srv2071864789=58, srv16862392=39, srv795350450=87, srv126161569=14, srv1580197862=31, srv2068236997=57, srv1925673239=49, srv798592000=88, srv310288559=67, srv27389538=63, srv512351783=77, srv307703986=66, srv1585888283=32, srv1747555832=42, srv1215536557=8, srv1417060207=21, srv362820470=71, srv1233754774=11, srv1673443983=38, srv839688084=91, srv753630679=85, srv727946407=84, srv1554489770=29, srv1410540644=20, srv1657869016=36, srv1524708497=28, srv348071450=69, srv194360414=50, srv1817355659=44, srv1220335145=9, srv670742632=83, srv1821338431=45, srv1041163232=3, srv113178671=6, srv973574751=99, srv2009034239=54, srv877987767=92, srv328249503=68, srv1003159757=1, srv150556523=26, srv138416876=18, srv481799346=73, srv814195451=89, srv1577130371=30, srv195942563=52, srv920410090=94, srv1089880325=4, srv2081279365=59, srv1640507593=34, srv1223335493=10, srv8305858=90, srv1263720500=15, srv617834850=80, srv958007070=97, srv626162225=81, srv647827700=82, srv1465482342=25, srv2028302140=55, srv927910584=95, srv1000771448=0, srv297831982=64, srv1756872941=43, srv1602166462=33, srv1449229847=24, srv1211154425=7, srv1417179872=22, srv2087153617=60, srv307470449=65, srv613880611=79, srv889644663=93, srv950240266=96, srv579136784=78, srv485803353=74, srv490579578=75, srv349908729=70, srv2132994507=62, srv1359989584=17, srv1862023646=48, srv165093584=35, srv1686709376=40, srv2100279502=61, srv2034240019=56, srv460125174=72, srv1953485888=51, srv1855613640=47} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-10-30 14:56:52,767 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-10-30 14:56:52,767 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-10-30 14:56:52,767 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-10-30 14:56:52,768 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-10-30 14:56:52,768 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-10-30 14:56:52,768 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-10-30 14:56:52,768 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-10-30 14:56:52,768 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-10-30 14:56:52,768 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-10-30 14:56:52,769 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-10-30 14:56:52,769 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-10-30 14:56:52,769 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-10-30 14:56:52,769 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-10-30 14:56:52,769 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-10-30 14:56:52,769 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-10-30 14:56:52,769 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-10-30 14:56:52,769 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-10-30 14:56:52,770 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-10-30 14:56:52,770 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-10-30 14:56:52,770 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-10-30 14:56:52,770 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-10-30 14:56:52,770 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-10-30 14:56:52,770 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-10-30 14:56:52,770 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-10-30 14:56:52,770 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-10-30 14:56:52,771 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-10-30 14:56:52,771 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-10-30 14:56:52,771 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-10-30 14:56:52,771 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-10-30 14:56:52,771 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-10-30 14:56:52,771 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-10-30 14:56:52,771 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-10-30 14:56:52,771 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-10-30 14:56:52,772 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-10-30 14:56:52,772 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-10-30 14:56:52,772 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-10-30 14:56:52,772 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-10-30 14:56:52,772 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-10-30 14:56:52,772 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-10-30 14:56:52,772 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-10-30 14:56:52,772 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-10-30 14:56:52,772 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-10-30 14:56:52,773 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-10-30 14:56:52,773 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-10-30 14:56:52,773 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-10-30 14:56:52,773 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-10-30 14:56:52,773 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-10-30 14:56:52,773 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-10-30 14:56:52,773 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-10-30 14:56:52,773 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-10-30 14:56:52,773 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-10-30 14:56:52,774 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-10-30 14:56:52,774 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-10-30 14:56:52,774 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-10-30 14:56:52,774 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-10-30 14:56:52,774 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-10-30 14:56:52,774 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-10-30 14:56:52,774 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-10-30 14:56:52,774 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-10-30 14:56:52,774 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-10-30 14:56:52,775 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-10-30 14:56:52,775 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-10-30 14:56:52,775 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-10-30 14:56:52,775 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-10-30 14:56:52,775 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-10-30 14:56:52,775 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-10-30 14:56:52,775 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-10-30 14:56:52,775 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-10-30 14:56:52,776 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-10-30 14:56:52,776 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-10-30 14:56:52,776 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-10-30 14:56:52,776 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-10-30 14:56:52,776 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-10-30 14:56:52,776 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-10-30 14:56:52,776 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-10-30 14:56:52,776 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-10-30 14:56:52,776 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-10-30 14:56:52,776 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-10-30 14:56:52,776 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-10-30 14:56:52,776 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-10-30 14:56:52,776 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-10-30 14:56:52,776 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-10-30 14:56:52,776 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-10-30 14:56:52,777 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-10-30 14:56:52,777 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-10-30 14:56:52,777 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-10-30 14:56:52,777 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-10-30 14:56:52,777 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-10-30 14:56:52,777 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-10-30 14:56:52,777 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-10-30 14:56:52,777 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-10-30 14:56:52,777 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-10-30 14:56:52,777 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-10-30 14:56:52,777 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-10-30 14:56:52,777 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-10-30 14:56:52,777 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-10-30 14:56:52,777 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-10-30 14:56:52,777 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-10-30 14:56:52,778 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-10-30 14:56:52,778 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-10-30 14:56:52,778 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-10-30 14:56:52,877 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.04240435641032519, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.05752079602464348, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.04240435641032519, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.17241666666666666, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.25033333333333335, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-10-30 14:56:52,877 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-10-30 14:56:52,878 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.1782227349378525, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.04240435641032519, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.05752079602464348, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.04240435641032519, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.17241666666666666, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.25033333333333335, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-10-30 14:56:53,047 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 255 ms to try 5000 different iterations.  Found a solution that moves 2700 regions; Going from a computed imbalance of 0.1782227349378525 to a new imbalance of 0.013681973323717457. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.023958541736922766); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.03633612876528795, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.3, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.023958541736922766); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.010416666666666666); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0445, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-10-30 14:56:53,055 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv485803353:78 , srv1673443983:80 , srv972364094:80 , srv1220335145:81 , srv1223335493:81 , srv1817355659:81 , srv362820470:81 , srv481799346:81 , srv1437767768:82 , srv16862392:82 , srv1862023646:82 , srv460125174:82 , srv626162225:82 , srv126161569:83 , srv1602166462:83 , srv195942563:83 , srv307470449:83 , srv310288559:83 , srv1015247250:84 , srv1250135161:84 , srv138416876:84 , srv1417060207:84 , srv1449229847:84 , srv1554489770:84 , srv1640507593:84 , srv1747555832:84 , srv1839638093:84 , srv1925673239:84 , srv27389538:84 , srv307703986:84 , srv670742632:84 , srv1000771448:85 , srv1003159757:85 , srv1041163232:85 , srv113178671:85 , srv1270100051:85 , srv1387303967:85 , srv1465482342:85 , srv1585888283:85 , srv1669990017:85 , srv194360414:85 , srv2068236997:85 , srv2081279365:85 , srv297831982:85 , srv613880611:85 , srv647827700:85 , srv950240266:85 , srv1233754774:86 , srv1263720500:86 , srv1417179872:86 , srv150556523:86 , srv2028302140:86 , srv2087153617:86 , srv2100279502:86 , srv2132994507:86 , srv490579578:86 , srv512351783:86 , srv727946407:86 , srv8305858:86 , srv839688084:86 , srv889644663:86 , srv927910584:86 , srv958007070:86 , srv1359989584:87 , srv1524708497:87 , srv165093584:87 , srv1686709376:87 , srv1855613640:87 , srv328249503:87 , srv349908729:87 , srv493964512:87 , srv753630679:87 , srv877987767:87 , srv1097006396:88 , srv124296879:88 , srv1577130371:88 , srv1580197862:88 , srv1657869016:88 , srv1710522171:88 , srv1821338431:88 , srv1953485888:88 , srv798592000:88 , srv920410090:88 , srv973574751:88 , srv1089880325:89 , srv1507087568:89 , srv1756872941:89 , srv2009034239:89 , srv2071864789:89 , srv348071450:89 , srv795350450:89 , srv814195451:89 , srv1211154425:90 , srv1215536557:90 , srv2034240019:90 , srv784150321:90 , srv1410540644:91 , srv1980519019:91 , srv617834850:92 , srv579136784:520 }
2023-10-30 14:56:53,059 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-10-30 14:56:53,059 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1710522171=41, srv1669990017=37, srv1839638093=46, srv493964512=76, srv1097006396=5, srv1387303967=19, srv784150321=86, srv972364094=98, srv1270100051=16, srv1015247250=2, srv124296879=12, srv1437767768=23, srv1507087568=27, srv1980519019=53, srv1250135161=13, srv2071864789=58, srv16862392=39, srv795350450=87, srv126161569=14, srv1580197862=31, srv2068236997=57, srv1925673239=49, srv798592000=88, srv310288559=67, srv27389538=63, srv512351783=77, srv307703986=66, srv1585888283=32, srv1747555832=42, srv1215536557=8, srv1417060207=21, srv362820470=71, srv1233754774=11, srv1673443983=38, srv839688084=91, srv753630679=85, srv727946407=84, srv1554489770=29, srv1410540644=20, srv1657869016=36, srv1524708497=28, srv348071450=69, srv194360414=50, srv1817355659=44, srv1220335145=9, srv670742632=83, srv1821338431=45, srv1041163232=3, srv113178671=6, srv973574751=99, srv2009034239=54, srv877987767=92, srv328249503=68, srv1003159757=1, srv150556523=26, srv138416876=18, srv481799346=73, srv814195451=89, srv1577130371=30, srv195942563=52, srv920410090=94, srv1089880325=4, srv2081279365=59, srv1640507593=34, srv1223335493=10, srv8305858=90, srv1263720500=15, srv617834850=80, srv958007070=97, srv626162225=81, srv647827700=82, srv1465482342=25, srv2028302140=55, srv927910584=95, srv1000771448=0, srv297831982=64, srv1756872941=43, srv1602166462=33, srv1449229847=24, srv1211154425=7, srv1417179872=22, srv2087153617=60, srv307470449=65, srv613880611=79, srv889644663=93, srv950240266=96, srv579136784=78, srv485803353=74, srv490579578=75, srv349908729=70, srv2132994507=62, srv1359989584=17, srv1862023646=48, srv165093584=35, srv1686709376=40, srv2100279502=61, srv2034240019=56, srv460125174=72, srv1953485888=51, srv1855613640=47} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-10-30 14:56:53,072 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-10-30 14:56:53,072 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-10-30 14:56:53,072 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-10-30 14:56:53,072 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-10-30 14:56:53,072 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-10-30 14:56:53,072 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-10-30 14:56:53,072 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-10-30 14:56:53,072 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-10-30 14:56:53,077 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-10-30 14:56:53,077 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-10-30 14:56:53,077 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-10-30 14:56:53,077 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-10-30 14:56:53,077 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-10-30 14:56:53,077 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-10-30 14:56:53,077 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-10-30 14:56:53,078 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-10-30 14:56:53,078 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-10-30 14:56:53,078 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-10-30 14:56:53,078 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-10-30 14:56:53,078 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-10-30 14:56:53,078 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-10-30 14:56:53,078 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-10-30 14:56:53,078 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-10-30 14:56:53,078 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-10-30 14:56:53,078 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-10-30 14:56:53,078 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-10-30 14:56:53,078 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-10-30 14:56:53,078 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-10-30 14:56:53,078 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-10-30 14:56:53,078 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-10-30 14:56:53,079 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-10-30 14:56:53,079 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-10-30 14:56:53,079 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-10-30 14:56:53,079 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-10-30 14:56:53,079 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-10-30 14:56:53,079 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-10-30 14:56:53,079 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-10-30 14:56:53,079 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-10-30 14:56:53,079 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-10-30 14:56:53,079 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-10-30 14:56:53,079 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-10-30 14:56:53,079 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-10-30 14:56:53,079 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-10-30 14:56:53,079 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-10-30 14:56:53,079 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-10-30 14:56:53,080 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-10-30 14:56:53,080 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-10-30 14:56:53,080 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-10-30 14:56:53,080 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-10-30 14:56:53,080 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-10-30 14:56:53,080 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-10-30 14:56:53,080 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-10-30 14:56:53,080 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-10-30 14:56:53,080 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-10-30 14:56:53,080 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-10-30 14:56:53,080 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-10-30 14:56:53,080 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-10-30 14:56:53,080 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-10-30 14:56:53,080 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-10-30 14:56:53,080 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-10-30 14:56:53,080 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-10-30 14:56:53,080 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-10-30 14:56:53,081 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-10-30 14:56:53,081 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-10-30 14:56:53,081 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-10-30 14:56:53,081 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-10-30 14:56:53,081 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-10-30 14:56:53,081 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-10-30 14:56:53,081 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-10-30 14:56:53,081 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-10-30 14:56:53,081 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-10-30 14:56:53,081 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-10-30 14:56:53,081 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-10-30 14:56:53,081 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-10-30 14:56:53,081 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-10-30 14:56:53,081 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-10-30 14:56:53,081 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-10-30 14:56:53,081 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-10-30 14:56:53,082 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-10-30 14:56:53,082 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-10-30 14:56:53,082 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-10-30 14:56:53,082 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-10-30 14:56:53,082 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-10-30 14:56:53,082 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-10-30 14:56:53,082 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-10-30 14:56:53,082 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-10-30 14:56:53,082 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-10-30 14:56:53,082 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-10-30 14:56:53,082 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-10-30 14:56:53,082 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-10-30 14:56:53,082 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-10-30 14:56:53,082 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-10-30 14:56:53,082 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-10-30 14:56:53,083 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-10-30 14:56:53,083 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-10-30 14:56:53,083 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-10-30 14:56:53,083 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-10-30 14:56:53,083 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-10-30 14:56:53,083 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-10-30 14:56:53,083 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-10-30 14:56:53,083 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-10-30 14:56:53,164 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.023958541736922766); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.03633612876528795, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.023958541736922766); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.010416666666666666); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0445, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-10-30 14:56:53,164 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-10-30 14:56:53,164 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.013663067519635606, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.023958541736922766); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.03633612876528795, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.023958541736922766); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.010416666666666666); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0445, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-10-30 14:56:53,317 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 225 ms to try 5000 different iterations.  Found a solution that moves 1014 regions; Going from a computed imbalance of 0.013663067519635606 to a new imbalance of 5.02207771302125E-4. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.005765937968227551); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.007153911599848797); MoveCostFunction : (multiplier=7.0, imbalance=0.11266666666666666, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.005765937968227551); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=8.333333333333333E-5); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.004); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-10-30 14:56:53,319 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1215536557:81 , srv1097006396:82 , srv1089880325:83 , srv1417060207:83 , srv165093584:83 , srv124296879:84 , srv1686709376:84 , srv194360414:84 , srv2087153617:84 , srv349908729:84 , srv485803353:84 , srv493964512:84 , srv647827700:84 , srv795350450:84 , srv972364094:84 , srv1003159757:85 , srv1015247250:85 , srv1211154425:85 , srv1359989584:85 , srv1387303967:85 , srv1410540644:85 , srv1417179872:85 , srv1507087568:85 , srv1524708497:85 , srv1577130371:85 , srv1673443983:85 , srv1710522171:85 , srv1747555832:85 , srv1821338431:85 , srv1925673239:85 , srv1953485888:85 , srv1980519019:85 , srv2009034239:85 , srv2034240019:85 , srv2068236997:85 , srv2071864789:85 , srv2081279365:85 , srv2132994507:85 , srv297831982:85 , srv307470449:85 , srv307703986:85 , srv310288559:85 , srv328249503:85 , srv348071450:85 , srv512351783:85 , srv617834850:85 , srv626162225:85 , srv753630679:85 , srv784150321:85 , srv8305858:85 , srv877987767:85 , srv920410090:85 , srv950240266:85 , srv113178671:86 , srv1223335493:86 , srv126161569:86 , srv1263720500:86 , srv1270100051:86 , srv138416876:86 , srv1437767768:86 , srv150556523:86 , srv1602166462:86 , srv1640507593:86 , srv16862392:86 , srv1756872941:86 , srv1855613640:86 , srv1862023646:86 , srv195942563:86 , srv2028302140:86 , srv27389538:86 , srv798592000:86 , srv814195451:86 , srv889644663:86 , srv973574751:86 , srv1000771448:87 , srv1041163232:87 , srv1580197862:87 , srv1657869016:87 , srv1669990017:87 , srv1817355659:87 , srv2100279502:87 , srv490579578:87 , srv613880611:87 , srv670742632:87 , srv839688084:87 , srv927910584:87 , srv958007070:87 , srv1220335145:88 , srv1233754774:88 , srv1250135161:88 , srv1449229847:88 , srv1465482342:88 , srv1554489770:88 , srv1585888283:88 , srv1839638093:88 , srv362820470:88 , srv481799346:88 , srv460125174:89 , srv727946407:90 , srv579136784:522 }
2023-10-30 14:56:53,323 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-10-30 14:56:53,324 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1710522171=41, srv1669990017=37, srv1839638093=46, srv493964512=76, srv1097006396=5, srv1387303967=19, srv784150321=86, srv972364094=98, srv1270100051=16, srv1015247250=2, srv124296879=12, srv1437767768=23, srv1507087568=27, srv1980519019=53, srv1250135161=13, srv2071864789=58, srv16862392=39, srv795350450=87, srv126161569=14, srv1580197862=31, srv2068236997=57, srv1925673239=49, srv798592000=88, srv310288559=67, srv27389538=63, srv512351783=77, srv307703986=66, srv1585888283=32, srv1747555832=42, srv1215536557=8, srv1417060207=21, srv362820470=71, srv1233754774=11, srv1673443983=38, srv839688084=91, srv753630679=85, srv727946407=84, srv1554489770=29, srv1410540644=20, srv1657869016=36, srv1524708497=28, srv348071450=69, srv194360414=50, srv1817355659=44, srv1220335145=9, srv670742632=83, srv1821338431=45, srv1041163232=3, srv113178671=6, srv973574751=99, srv2009034239=54, srv877987767=92, srv328249503=68, srv1003159757=1, srv150556523=26, srv138416876=18, srv481799346=73, srv814195451=89, srv1577130371=30, srv195942563=52, srv920410090=94, srv1089880325=4, srv2081279365=59, srv1640507593=34, srv1223335493=10, srv8305858=90, srv1263720500=15, srv617834850=80, srv958007070=97, srv626162225=81, srv647827700=82, srv1465482342=25, srv2028302140=55, srv927910584=95, srv1000771448=0, srv297831982=64, srv1756872941=43, srv1602166462=33, srv1449229847=24, srv1211154425=7, srv1417179872=22, srv2087153617=60, srv307470449=65, srv613880611=79, srv889644663=93, srv950240266=96, srv579136784=78, srv485803353=74, srv490579578=75, srv349908729=70, srv2132994507=62, srv1359989584=17, srv1862023646=48, srv165093584=35, srv1686709376=40, srv2100279502=61, srv2034240019=56, srv460125174=72, srv1953485888=51, srv1855613640=47} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-10-30 14:56:53,333 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-10-30 14:56:53,333 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-10-30 14:56:53,333 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-10-30 14:56:53,334 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-10-30 14:56:53,334 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-10-30 14:56:53,334 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-10-30 14:56:53,334 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-10-30 14:56:53,334 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-10-30 14:56:53,334 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-10-30 14:56:53,334 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-10-30 14:56:53,334 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-10-30 14:56:53,334 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-10-30 14:56:53,334 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-10-30 14:56:53,334 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-10-30 14:56:53,334 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-10-30 14:56:53,334 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-10-30 14:56:53,334 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-10-30 14:56:53,334 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-10-30 14:56:53,335 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-10-30 14:56:53,335 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-10-30 14:56:53,335 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-10-30 14:56:53,335 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-10-30 14:56:53,335 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-10-30 14:56:53,335 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-10-30 14:56:53,335 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-10-30 14:56:53,335 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-10-30 14:56:53,335 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-10-30 14:56:53,335 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-10-30 14:56:53,335 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-10-30 14:56:53,335 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-10-30 14:56:53,335 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-10-30 14:56:53,335 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-10-30 14:56:53,335 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-10-30 14:56:53,335 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-10-30 14:56:53,336 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-10-30 14:56:53,336 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-10-30 14:56:53,336 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-10-30 14:56:53,336 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-10-30 14:56:53,336 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-10-30 14:56:53,336 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-10-30 14:56:53,336 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-10-30 14:56:53,336 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-10-30 14:56:53,336 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-10-30 14:56:53,336 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-10-30 14:56:53,336 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-10-30 14:56:53,336 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-10-30 14:56:53,336 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-10-30 14:56:53,336 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-10-30 14:56:53,337 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-10-30 14:56:53,337 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-10-30 14:56:53,337 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-10-30 14:56:53,337 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-10-30 14:56:53,337 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-10-30 14:56:53,337 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-10-30 14:56:53,337 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-10-30 14:56:53,337 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-10-30 14:56:53,337 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-10-30 14:56:53,337 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-10-30 14:56:53,337 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-10-30 14:56:53,337 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-10-30 14:56:53,337 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-10-30 14:56:53,337 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-10-30 14:56:53,337 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-10-30 14:56:53,337 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-10-30 14:56:53,338 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-10-30 14:56:53,338 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-10-30 14:56:53,338 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-10-30 14:56:53,338 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-10-30 14:56:53,338 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-10-30 14:56:53,338 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-10-30 14:56:53,338 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-10-30 14:56:53,338 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-10-30 14:56:53,338 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-10-30 14:56:53,338 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-10-30 14:56:53,338 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-10-30 14:56:53,338 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-10-30 14:56:53,338 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-10-30 14:56:53,338 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-10-30 14:56:53,338 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-10-30 14:56:53,338 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-10-30 14:56:53,338 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-10-30 14:56:53,339 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-10-30 14:56:53,339 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-10-30 14:56:53,339 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-10-30 14:56:53,339 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-10-30 14:56:53,339 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-10-30 14:56:53,339 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-10-30 14:56:53,339 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-10-30 14:56:53,339 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-10-30 14:56:53,339 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-10-30 14:56:53,339 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-10-30 14:56:53,339 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-10-30 14:56:53,339 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-10-30 14:56:53,339 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-10-30 14:56:53,339 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-10-30 14:56:53,339 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-10-30 14:56:53,339 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-10-30 14:56:53,339 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-10-30 14:56:53,339 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-10-30 14:56:53,340 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-10-30 14:56:53,340 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-10-30 14:56:53,418 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.005765937968227551); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.007153911599848797); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.005765937968227551); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=8.333333333333333E-5); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.004); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-10-30 14:56:53,418 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-10-30 14:56:53,418 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=4.951075915469402E-4, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.005765937968227551); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.007153911599848797); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.005765937968227551); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=8.333333333333333E-5); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.004); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-10-30 14:56:53,635 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 288 ms to try 5000 different iterations.  Found a solution that moves 244 regions; Going from a computed imbalance of 4.951075915469402E-4 to a new imbalance of 2.9463806737811427E-5. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=5.23782800878924E-4); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0022721660362024225); MoveCostFunction : (multiplier=7.0, imbalance=0.02711111111111111, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=5.23782800878924E-4); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.6666666666666666E-4); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-10-30 14:56:53,636 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv647827700:82 , srv1673443983:83 , srv2034240019:83 , srv2087153617:83 , srv460125174:83 , srv798592000:83 , srv1000771448:84 , srv1003159757:84 , srv113178671:84 , srv1211154425:84 , srv1215536557:84 , srv1220335145:84 , srv1223335493:84 , srv1233754774:84 , srv124296879:84 , srv1250135161:84 , srv126161569:84 , srv1359989584:84 , srv1410540644:84 , srv1417179872:84 , srv1465482342:84 , srv150556523:84 , srv1524708497:84 , srv1554489770:84 , srv1580197862:84 , srv1657869016:84 , srv1756872941:84 , srv1839638093:84 , srv1855613640:84 , srv1862023646:84 , srv1980519019:84 , srv2028302140:84 , srv307470449:84 , srv328249503:84 , srv348071450:84 , srv490579578:84 , srv512351783:84 , srv613880611:84 , srv617834850:84 , srv670742632:84 , srv727946407:84 , srv8305858:84 , srv877987767:84 , srv889644663:84 , srv958007070:84 , srv973574751:84 , srv1015247250:85 , srv1041163232:85 , srv1097006396:85 , srv1263720500:85 , srv138416876:85 , srv1387303967:85 , srv1417060207:85 , srv1449229847:85 , srv1507087568:85 , srv1585888283:85 , srv1602166462:85 , srv1640507593:85 , srv165093584:85 , srv1669990017:85 , srv16862392:85 , srv1686709376:85 , srv1710522171:85 , srv1747555832:85 , srv1817355659:85 , srv1821338431:85 , srv1925673239:85 , srv194360414:85 , srv195942563:85 , srv2009034239:85 , srv2068236997:85 , srv2071864789:85 , srv2081279365:85 , srv2100279502:85 , srv2132994507:85 , srv27389538:85 , srv297831982:85 , srv307703986:85 , srv349908729:85 , srv362820470:85 , srv481799346:85 , srv485803353:85 , srv493964512:85 , srv626162225:85 , srv753630679:85 , srv784150321:85 , srv795350450:85 , srv814195451:85 , srv839688084:85 , srv920410090:85 , srv927910584:85 , srv950240266:85 , srv972364094:85 , srv1089880325:86 , srv1270100051:86 , srv1437767768:86 , srv1577130371:86 , srv1953485888:86 , srv310288559:86 , srv579136784:632 }
2023-10-30 14:56:53,639 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-10-30 14:56:53,639 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1710522171=41, srv1669990017=37, srv1839638093=46, srv493964512=76, srv1097006396=5, srv1387303967=19, srv784150321=86, srv972364094=98, srv1270100051=16, srv1015247250=2, srv124296879=12, srv1437767768=23, srv1507087568=27, srv1980519019=53, srv1250135161=13, srv2071864789=58, srv16862392=39, srv795350450=87, srv126161569=14, srv1580197862=31, srv2068236997=57, srv1925673239=49, srv798592000=88, srv310288559=67, srv27389538=63, srv512351783=77, srv307703986=66, srv1585888283=32, srv1747555832=42, srv1215536557=8, srv1417060207=21, srv362820470=71, srv1233754774=11, srv1673443983=38, srv839688084=91, srv753630679=85, srv727946407=84, srv1554489770=29, srv1410540644=20, srv1657869016=36, srv1524708497=28, srv348071450=69, srv194360414=50, srv1817355659=44, srv1220335145=9, srv670742632=83, srv1821338431=45, srv1041163232=3, srv113178671=6, srv973574751=99, srv2009034239=54, srv877987767=92, srv328249503=68, srv1003159757=1, srv150556523=26, srv138416876=18, srv481799346=73, srv814195451=89, srv1577130371=30, srv195942563=52, srv920410090=94, srv1089880325=4, srv2081279365=59, srv1640507593=34, srv1223335493=10, srv8305858=90, srv1263720500=15, srv617834850=80, srv958007070=97, srv626162225=81, srv647827700=82, srv1465482342=25, srv2028302140=55, srv927910584=95, srv1000771448=0, srv297831982=64, srv1756872941=43, srv1602166462=33, srv1449229847=24, srv1211154425=7, srv1417179872=22, srv2087153617=60, srv307470449=65, srv613880611=79, srv889644663=93, srv950240266=96, srv579136784=78, srv485803353=74, srv490579578=75, srv349908729=70, srv2132994507=62, srv1359989584=17, srv1862023646=48, srv165093584=35, srv1686709376=40, srv2100279502=61, srv2034240019=56, srv460125174=72, srv1953485888=51, srv1855613640=47} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-10-30 14:56:53,648 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-10-30 14:56:53,648 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-10-30 14:56:53,648 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-10-30 14:56:53,649 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-10-30 14:56:53,649 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-10-30 14:56:53,649 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-10-30 14:56:53,649 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-10-30 14:56:53,649 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-10-30 14:56:53,649 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-10-30 14:56:53,649 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-10-30 14:56:53,649 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-10-30 14:56:53,649 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-10-30 14:56:53,649 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-10-30 14:56:53,649 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-10-30 14:56:53,649 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-10-30 14:56:53,649 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-10-30 14:56:53,649 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-10-30 14:56:53,649 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-10-30 14:56:53,649 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-10-30 14:56:53,649 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-10-30 14:56:53,649 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-10-30 14:56:53,649 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-10-30 14:56:53,650 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-10-30 14:56:53,650 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-10-30 14:56:53,650 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-10-30 14:56:53,650 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-10-30 14:56:53,650 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-10-30 14:56:53,650 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-10-30 14:56:53,650 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-10-30 14:56:53,650 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-10-30 14:56:53,650 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-10-30 14:56:53,650 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-10-30 14:56:53,650 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-10-30 14:56:53,650 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-10-30 14:56:53,650 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-10-30 14:56:53,650 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-10-30 14:56:53,650 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-10-30 14:56:53,650 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-10-30 14:56:53,650 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-10-30 14:56:53,650 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-10-30 14:56:53,650 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-10-30 14:56:53,651 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-10-30 14:56:53,651 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-10-30 14:56:53,651 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-10-30 14:56:53,651 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-10-30 14:56:53,651 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-10-30 14:56:53,651 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-10-30 14:56:53,651 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-10-30 14:56:53,651 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-10-30 14:56:53,651 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-10-30 14:56:53,651 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-10-30 14:56:53,651 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-10-30 14:56:53,651 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-10-30 14:56:53,651 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-10-30 14:56:53,651 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-10-30 14:56:53,651 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-10-30 14:56:53,651 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-10-30 14:56:53,652 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-10-30 14:56:53,652 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-10-30 14:56:53,652 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-10-30 14:56:53,652 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-10-30 14:56:53,652 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-10-30 14:56:53,652 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-10-30 14:56:53,652 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-10-30 14:56:53,652 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-10-30 14:56:53,652 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-10-30 14:56:53,652 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-10-30 14:56:53,652 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-10-30 14:56:53,652 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-10-30 14:56:53,652 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-10-30 14:56:53,652 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-10-30 14:56:53,653 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-10-30 14:56:53,653 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-10-30 14:56:53,653 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-10-30 14:56:53,653 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-10-30 14:56:53,653 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-10-30 14:56:53,653 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-10-30 14:56:53,653 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-10-30 14:56:53,653 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-10-30 14:56:53,653 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-10-30 14:56:53,653 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-10-30 14:56:53,653 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-10-30 14:56:53,653 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-10-30 14:56:53,653 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-10-30 14:56:53,653 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-10-30 14:56:53,653 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-10-30 14:56:53,653 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-10-30 14:56:53,653 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-10-30 14:56:53,653 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-10-30 14:56:53,654 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-10-30 14:56:53,654 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-10-30 14:56:53,654 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-10-30 14:56:53,654 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-10-30 14:56:53,654 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-10-30 14:56:53,654 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-10-30 14:56:53,654 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-10-30 14:56:53,654 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-10-30 14:56:53,654 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-10-30 14:56:53,654 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-10-30 14:56:53,654 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-10-30 14:56:53,654 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-10-30 14:56:53,732 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=5.23782800878924E-4); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0022721660362024225); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=5.23782800878924E-4); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.6666666666666666E-4); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-10-30 14:56:53,732 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-10-30 14:56:53,732 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=2.7755282220784697E-5, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=5.23782800878924E-4); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0022721660362024225); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=5.23782800878924E-4); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.6666666666666666E-4); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-10-30 14:56:53,877 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 216 ms to try 5000 different iterations.  Found a solution that moves 35 regions; Going from a computed imbalance of 2.7755282220784697E-5 to a new imbalance of 7.318314534427544E-6. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0015713484026367722); MoveCostFunction : (multiplier=7.0, imbalance=0.0038888888888888888); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-10-30 14:56:53,878 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1089880325:83 , srv1270100051:83 , srv1437767768:83 , srv1602166462:83 , srv16862392:83 , srv1953485888:83 , srv297831982:83 , srv310288559:83 , srv490579578:83 , srv727946407:83 , srv1003159757:84 , srv1015247250:84 , srv1041163232:84 , srv1097006396:84 , srv1211154425:84 , srv1215536557:84 , srv1220335145:84 , srv1233754774:84 , srv124296879:84 , srv1250135161:84 , srv126161569:84 , srv1263720500:84 , srv1359989584:84 , srv138416876:84 , srv1387303967:84 , srv1410540644:84 , srv1417060207:84 , srv1417179872:84 , srv1449229847:84 , srv1465482342:84 , srv1507087568:84 , srv1524708497:84 , srv1554489770:84 , srv1577130371:84 , srv1580197862:84 , srv1585888283:84 , srv1640507593:84 , srv165093584:84 , srv1657869016:84 , srv1669990017:84 , srv1686709376:84 , srv1710522171:84 , srv1747555832:84 , srv1756872941:84 , srv1817355659:84 , srv1821338431:84 , srv1839638093:84 , srv1855613640:84 , srv1862023646:84 , srv1925673239:84 , srv194360414:84 , srv195942563:84 , srv1980519019:84 , srv2009034239:84 , srv2028302140:84 , srv2034240019:84 , srv2068236997:84 , srv2071864789:84 , srv2081279365:84 , srv2100279502:84 , srv2132994507:84 , srv27389538:84 , srv307470449:84 , srv328249503:84 , srv348071450:84 , srv349908729:84 , srv362820470:84 , srv460125174:84 , srv481799346:84 , srv485803353:84 , srv493964512:84 , srv512351783:84 , srv613880611:84 , srv617834850:84 , srv626162225:84 , srv670742632:84 , srv753630679:84 , srv784150321:84 , srv795350450:84 , srv798592000:84 , srv814195451:84 , srv8305858:84 , srv839688084:84 , srv877987767:84 , srv889644663:84 , srv920410090:84 , srv927910584:84 , srv950240266:84 , srv958007070:84 , srv972364094:84 , srv973574751:84 , srv1000771448:85 , srv113178671:85 , srv1223335493:85 , srv150556523:85 , srv1673443983:85 , srv2087153617:85 , srv307703986:85 , srv647827700:86 , srv579136784:685 }
2023-10-30 14:56:53,881 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-10-30 14:56:53,882 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1710522171=41, srv1669990017=37, srv1839638093=46, srv493964512=76, srv1097006396=5, srv1387303967=19, srv784150321=86, srv972364094=98, srv1270100051=16, srv1015247250=2, srv124296879=12, srv1437767768=23, srv1507087568=27, srv1980519019=53, srv1250135161=13, srv2071864789=58, srv16862392=39, srv795350450=87, srv126161569=14, srv1580197862=31, srv2068236997=57, srv1925673239=49, srv798592000=88, srv310288559=67, srv27389538=63, srv512351783=77, srv307703986=66, srv1585888283=32, srv1747555832=42, srv1215536557=8, srv1417060207=21, srv362820470=71, srv1233754774=11, srv1673443983=38, srv839688084=91, srv753630679=85, srv727946407=84, srv1554489770=29, srv1410540644=20, srv1657869016=36, srv1524708497=28, srv348071450=69, srv194360414=50, srv1817355659=44, srv1220335145=9, srv670742632=83, srv1821338431=45, srv1041163232=3, srv113178671=6, srv973574751=99, srv2009034239=54, srv877987767=92, srv328249503=68, srv1003159757=1, srv150556523=26, srv138416876=18, srv481799346=73, srv814195451=89, srv1577130371=30, srv195942563=52, srv920410090=94, srv1089880325=4, srv2081279365=59, srv1640507593=34, srv1223335493=10, srv8305858=90, srv1263720500=15, srv617834850=80, srv958007070=97, srv626162225=81, srv647827700=82, srv1465482342=25, srv2028302140=55, srv927910584=95, srv1000771448=0, srv297831982=64, srv1756872941=43, srv1602166462=33, srv1449229847=24, srv1211154425=7, srv1417179872=22, srv2087153617=60, srv307470449=65, srv613880611=79, srv889644663=93, srv950240266=96, srv579136784=78, srv485803353=74, srv490579578=75, srv349908729=70, srv2132994507=62, srv1359989584=17, srv1862023646=48, srv165093584=35, srv1686709376=40, srv2100279502=61, srv2034240019=56, srv460125174=72, srv1953485888=51, srv1855613640=47} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-10-30 14:56:53,900 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-10-30 14:56:53,900 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-10-30 14:56:53,900 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-10-30 14:56:53,900 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-10-30 14:56:53,900 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-10-30 14:56:53,900 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-10-30 14:56:53,900 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-10-30 14:56:53,900 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-10-30 14:56:53,900 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-10-30 14:56:53,900 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-10-30 14:56:53,900 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-10-30 14:56:53,900 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-10-30 14:56:53,900 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-10-30 14:56:53,900 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-10-30 14:56:53,900 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-10-30 14:56:53,901 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-10-30 14:56:53,901 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-10-30 14:56:53,901 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-10-30 14:56:53,901 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-10-30 14:56:53,901 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-10-30 14:56:53,901 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-10-30 14:56:53,901 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-10-30 14:56:53,901 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-10-30 14:56:53,901 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-10-30 14:56:53,901 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-10-30 14:56:53,901 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-10-30 14:56:53,901 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-10-30 14:56:53,901 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-10-30 14:56:53,901 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-10-30 14:56:53,901 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-10-30 14:56:53,901 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-10-30 14:56:53,901 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-10-30 14:56:53,901 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-10-30 14:56:53,901 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-10-30 14:56:53,901 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-10-30 14:56:53,901 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-10-30 14:56:53,902 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-10-30 14:56:53,902 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-10-30 14:56:53,902 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-10-30 14:56:53,902 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-10-30 14:56:53,902 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-10-30 14:56:53,902 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-10-30 14:56:53,902 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-10-30 14:56:53,902 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-10-30 14:56:53,902 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-10-30 14:56:53,902 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-10-30 14:56:53,902 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-10-30 14:56:53,902 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-10-30 14:56:53,902 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-10-30 14:56:53,902 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-10-30 14:56:53,902 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-10-30 14:56:53,902 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-10-30 14:56:53,902 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-10-30 14:56:53,903 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-10-30 14:56:53,903 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-10-30 14:56:53,903 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-10-30 14:56:53,903 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-10-30 14:56:53,903 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-10-30 14:56:53,903 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-10-30 14:56:53,903 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-10-30 14:56:53,903 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-10-30 14:56:53,903 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-10-30 14:56:53,903 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-10-30 14:56:53,903 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-10-30 14:56:53,903 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-10-30 14:56:53,903 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-10-30 14:56:53,903 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-10-30 14:56:53,903 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-10-30 14:56:53,903 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-10-30 14:56:53,903 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-10-30 14:56:53,903 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-10-30 14:56:53,903 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-10-30 14:56:53,903 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-10-30 14:56:53,903 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-10-30 14:56:53,903 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-10-30 14:56:53,903 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-10-30 14:56:53,904 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-10-30 14:56:53,904 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-10-30 14:56:53,904 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-10-30 14:56:53,904 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-10-30 14:56:53,904 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-10-30 14:56:53,904 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-10-30 14:56:53,904 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-10-30 14:56:53,904 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-10-30 14:56:53,904 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-10-30 14:56:53,904 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-10-30 14:56:53,904 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-10-30 14:56:53,904 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-10-30 14:56:53,904 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-10-30 14:56:53,904 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-10-30 14:56:53,904 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-10-30 14:56:53,904 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-10-30 14:56:53,904 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-10-30 14:56:53,904 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-10-30 14:56:53,905 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-10-30 14:56:53,905 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-10-30 14:56:53,905 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-10-30 14:56:53,905 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-10-30 14:56:53,905 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-10-30 14:56:53,905 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-10-30 14:56:53,905 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-10-30 14:56:53,984 INFO  [Time-limited test] balancer.StochasticLoadBalancer(381): Cluster wide - skipping load balancing because weighted average imbalance=7.073239296329447E-6 <= threshold(0.025). If you want more aggressive balancing, either lower hbase.master.balancer.stochastic.minCostNeedBalance from 0.025 or increase the relative multiplier(s) of the specific cost function(s). functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0015713484026367722); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-10-30 14:56:53,984 INFO  [Time-limited test] balancer.BalancerTestBase(570): Mock Final balance: { srv1089880325:83 , srv1270100051:83 , srv1437767768:83 , srv1602166462:83 , srv16862392:83 , srv1953485888:83 , srv297831982:83 , srv310288559:83 , srv490579578:83 , srv727946407:83 , srv1003159757:84 , srv1015247250:84 , srv1041163232:84 , srv1097006396:84 , srv1211154425:84 , srv1215536557:84 , srv1220335145:84 , srv1233754774:84 , srv124296879:84 , srv1250135161:84 , srv126161569:84 , srv1263720500:84 , srv1359989584:84 , srv138416876:84 , srv1387303967:84 , srv1410540644:84 , srv1417060207:84 , srv1417179872:84 , srv1449229847:84 , srv1465482342:84 , srv1507087568:84 , srv1524708497:84 , srv1554489770:84 , srv1577130371:84 , srv1580197862:84 , srv1585888283:84 , srv1640507593:84 , srv165093584:84 , srv1657869016:84 , srv1669990017:84 , srv1686709376:84 , srv1710522171:84 , srv1747555832:84 , srv1756872941:84 , srv1817355659:84 , srv1821338431:84 , srv1839638093:84 , srv1855613640:84 , srv1862023646:84 , srv1925673239:84 , srv194360414:84 , srv195942563:84 , srv1980519019:84 , srv2009034239:84 , srv2028302140:84 , srv2034240019:84 , srv2068236997:84 , srv2071864789:84 , srv2081279365:84 , srv2100279502:84 , srv2132994507:84 , srv27389538:84 , srv307470449:84 , srv328249503:84 , srv348071450:84 , srv349908729:84 , srv362820470:84 , srv460125174:84 , srv481799346:84 , srv485803353:84 , srv493964512:84 , srv512351783:84 , srv613880611:84 , srv617834850:84 , srv626162225:84 , srv670742632:84 , srv753630679:84 , srv784150321:84 , srv795350450:84 , srv798592000:84 , srv814195451:84 , srv8305858:84 , srv839688084:84 , srv877987767:84 , srv889644663:84 , srv920410090:84 , srv927910584:84 , srv950240266:84 , srv958007070:84 , srv972364094:84 , srv973574751:84 , srv1000771448:85 , srv113178671:85 , srv1223335493:85 , srv150556523:85 , srv1673443983:85 , srv2087153617:85 , srv307703986:85 , srv647827700:86 , srv579136784:685 }
2023-10-30 14:56:54,007 INFO  [Time-limited test] hbase.ResourceChecker(175): after: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnLargeClusterWithRacks Thread=12 (was 12), OpenFileDescriptor=263 (was 263), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=206 (was 206), ProcessCount=168 (was 168), AvailableMemoryMB=2093 (was 2576)
2023-10-30 14:56:54,014 INFO  [Time-limited test] hbase.ResourceChecker(147): before: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnMidClusterWithRacks Thread=12, OpenFileDescriptor=263, MaxFileDescriptor=60000, SystemLoadAverage=206, ProcessCount=168, AvailableMemoryMB=2092
2023-10-30 14:56:54,015 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2023-10-30 14:56:54,015 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=5000, runMaxSteps=true, stepsPerRegion=800, maxRunningTime=120000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 111077.0 etc.
2023-10-30 14:56:54,025 INFO  [Time-limited test] balancer.BalancerTestBase(547): Mock Cluster : { srv1119237707:84 , srv1193516319:84 , srv1259351872:84 , srv1262462880:84 , srv137996548:84 , srv1414969270:84 , srv1465042461:84 , srv1514226752:84 , srv1518638430:84 , srv1610570826:84 , srv165339973:84 , srv1681252329:84 , srv168240677:84 , srv1940656747:84 , srv1956114659:84 , srv2058098211:84 , srv2059050211:84 , srv2145841159:84 , srv27425195:84 , srv284885293:84 , srv393490116:84 , srv619815879:84 , srv669706933:84 , srv713010115:84 , srv759541867:84 , srv788856310:84 , srv810538084:84 , srv824595557:84 , srv838075683:84 , srv1426182327:264 } [srvr=30 rgns=2700 avg=90.0 max=90 min=90]
2023-10-30 14:56:54,026 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-10-30 14:56:54,026 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1414969270=5, srv1956114659=15, srv1262462880=3, srv1119237707=0, srv1465042461=7, srv165339973=11, srv810538084=27, srv137996548=4, srv2145841159=18, srv2058098211=16, srv284885293=20, srv838075683=29, srv669706933=23, srv1259351872=2, srv1610570826=10, srv2059050211=17, srv788856310=26, srv1940656747=14, srv619815879=22, srv1426182327=6, srv1681252329=12, srv824595557=28, srv27425195=19, srv759541867=25, srv713010115=24, srv1193516319=1, srv393490116=21, srv1518638430=9, srv1514226752=8, srv168240677=13} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-10-30 14:56:54,034 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-10-30 14:56:54,035 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-10-30 14:56:54,035 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-10-30 14:56:54,035 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-10-30 14:56:54,035 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-10-30 14:56:54,035 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-10-30 14:56:54,035 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-10-30 14:56:54,035 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-10-30 14:56:54,035 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-10-30 14:56:54,035 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-10-30 14:56:54,035 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-10-30 14:56:54,035 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-10-30 14:56:54,035 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-10-30 14:56:54,035 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-10-30 14:56:54,035 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-10-30 14:56:54,035 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-10-30 14:56:54,035 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-10-30 14:56:54,035 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-10-30 14:56:54,035 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-10-30 14:56:54,035 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-10-30 14:56:54,036 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-10-30 14:56:54,036 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-10-30 14:56:54,036 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-10-30 14:56:54,036 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-10-30 14:56:54,036 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-10-30 14:56:54,036 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-10-30 14:56:54,036 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-10-30 14:56:54,036 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-10-30 14:56:54,036 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-10-30 14:56:54,036 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-10-30 14:56:54,036 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=10, number of hosts=30, number of racks=4
2023-10-30 14:56:54,049 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=1.141131774046665, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-10-30 14:56:54,049 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.9912637744875924, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=1.141131774046665, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=64800000
2023-10-30 14:58:54,039 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 120001 ms to try 9392992 different iterations.  Found a solution that moves 1831 regions; Going from a computed imbalance of 0.9912637744875924 to a new imbalance of 4.2736453424534666E-5. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); MoveCostFunction : (multiplier=7.0, imbalance=0.6781481481481482, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-10-30 14:58:54,045 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1119237707:90 , srv1193516319:90 , srv1259351872:90 , srv1262462880:90 , srv137996548:90 , srv1414969270:90 , srv1426182327:90 , srv1465042461:90 , srv1514226752:90 , srv1518638430:90 , srv1610570826:90 , srv165339973:90 , srv1681252329:90 , srv168240677:90 , srv1940656747:90 , srv1956114659:90 , srv2058098211:90 , srv2059050211:90 , srv2145841159:90 , srv27425195:90 , srv284885293:90 , srv393490116:90 , srv619815879:90 , srv669706933:90 , srv713010115:90 , srv759541867:90 , srv788856310:90 , srv810538084:90 , srv824595557:90 , srv838075683:90 }
2023-10-30 14:58:54,047 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-10-30 14:58:54,047 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1414969270=5, srv1956114659=15, srv1262462880=3, srv1119237707=0, srv1465042461=7, srv165339973=11, srv810538084=27, srv137996548=4, srv2145841159=18, srv2058098211=16, srv284885293=20, srv838075683=29, srv669706933=23, srv1259351872=2, srv1610570826=10, srv2059050211=17, srv788856310=26, srv1940656747=14, srv619815879=22, srv1426182327=6, srv1681252329=12, srv824595557=28, srv27425195=19, srv759541867=25, srv713010115=24, srv1193516319=1, srv393490116=21, srv1518638430=9, srv1514226752=8, srv168240677=13} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-10-30 14:58:54,050 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-10-30 14:58:54,051 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-10-30 14:58:54,051 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-10-30 14:58:54,051 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-10-30 14:58:54,051 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-10-30 14:58:54,051 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-10-30 14:58:54,051 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-10-30 14:58:54,051 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-10-30 14:58:54,051 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-10-30 14:58:54,051 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-10-30 14:58:54,051 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-10-30 14:58:54,051 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-10-30 14:58:54,051 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-10-30 14:58:54,051 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-10-30 14:58:54,051 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-10-30 14:58:54,051 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-10-30 14:58:54,051 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-10-30 14:58:54,051 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-10-30 14:58:54,051 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-10-30 14:58:54,051 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-10-30 14:58:54,052 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-10-30 14:58:54,052 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-10-30 14:58:54,052 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-10-30 14:58:54,052 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-10-30 14:58:54,052 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-10-30 14:58:54,052 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-10-30 14:58:54,052 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-10-30 14:58:54,052 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-10-30 14:58:54,052 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-10-30 14:58:54,052 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-10-30 14:58:54,052 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=10, number of hosts=30, number of racks=4
2023-10-30 14:58:54,061 INFO  [Time-limited test] balancer.StochasticLoadBalancer(381): Cluster wide - skipping load balancing because weighted average imbalance=0.0 <= threshold(0.025). If you want more aggressive balancing, either lower hbase.master.balancer.stochastic.minCostNeedBalance from 0.025 or increase the relative multiplier(s) of the specific cost function(s). functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-10-30 14:58:54,061 INFO  [Time-limited test] balancer.BalancerTestBase(570): Mock Final balance: { srv1119237707:90 , srv1193516319:90 , srv1259351872:90 , srv1262462880:90 , srv137996548:90 , srv1414969270:90 , srv1426182327:90 , srv1465042461:90 , srv1514226752:90 , srv1518638430:90 , srv1610570826:90 , srv165339973:90 , srv1681252329:90 , srv168240677:90 , srv1940656747:90 , srv1956114659:90 , srv2058098211:90 , srv2059050211:90 , srv2145841159:90 , srv27425195:90 , srv284885293:90 , srv393490116:90 , srv619815879:90 , srv669706933:90 , srv713010115:90 , srv759541867:90 , srv788856310:90 , srv810538084:90 , srv824595557:90 , srv838075683:90 }
2023-10-30 14:58:54,073 INFO  [Time-limited test] hbase.ResourceChecker(175): after: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnMidClusterWithRacks Thread=11 (was 12), OpenFileDescriptor=263 (was 263), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=252 (was 206) - SystemLoadAverage LEAK? -, ProcessCount=166 (was 168), AvailableMemoryMB=2371 (was 2092) - AvailableMemoryMB LEAK? -