2023-09-25 11:53:13,367 INFO  [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks timeout: 13 mins
2023-09-25 11:53:13,696 WARN  [Time-limited test] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties
2023-09-25 11:53:13,805 INFO  [Time-limited test] metrics.MetricRegistriesLoader(60): Loaded MetricRegistries class org.apache.hadoop.hbase.metrics.impl.MetricRegistriesImpl
2023-09-25 11:53:13,864 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2023-09-25 11:53:13,873 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc.
2023-09-25 11:53:13,886 INFO  [Time-limited test] hbase.ResourceChecker(147): before: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnLargeClusterWithRacks Thread=12, OpenFileDescriptor=263, MaxFileDescriptor=60000, SystemLoadAverage=274, ProcessCount=169, AvailableMemoryMB=9392
2023-09-25 11:53:13,889 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2023-09-25 11:53:13,889 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=5000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=10000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc.
2023-09-25 11:53:14,035 INFO  [Time-limited test] balancer.BalancerTestBase(547): Mock Cluster : { srv1026558377:84 , srv1041483581:84 , srv1046339861:84 , srv1050874743:84 , srv1078769884:84 , srv1118717485:84 , srv1155185051:84 , srv1172856204:84 , srv1184710096:84 , srv1196147371:84 , srv1211833356:84 , srv1245010003:84 , srv1255480243:84 , srv1255640868:84 , srv1328516440:84 , srv1334512029:84 , srv1342632469:84 , srv1351926855:84 , srv1362972119:84 , srv1367128793:84 , srv1379992247:84 , srv1386609996:84 , srv1398285579:84 , srv1426657453:84 , srv1432339172:84 , srv1454754608:84 , srv1464411632:84 , srv1484915107:84 , srv1493693542:84 , srv1495766136:84 , srv149930938:84 , srv1517876339:84 , srv1543576176:84 , srv1548108677:84 , srv1569964724:84 , srv1579682951:84 , srv1586841202:84 , srv1589163632:84 , srv1614477886:84 , srv165284858:84 , srv1660889057:84 , srv1670399538:84 , srv1730845034:84 , srv1731601188:84 , srv1790485616:84 , srv1802872335:84 , srv1837456038:84 , srv188827884:84 , srv1896115926:84 , srv1904805202:84 , srv1920289450:84 , srv1944141250:84 , srv1949611332:84 , srv1961511808:84 , srv1992805905:84 , srv2023400777:84 , srv2033790168:84 , srv2063311825:84 , srv2065515341:84 , srv208844920:84 , srv2115243485:84 , srv2142076752:84 , srv234753299:84 , srv243769268:84 , srv256219958:84 , srv312620354:84 , srv314147771:84 , srv33089391:84 , srv332134089:84 , srv35894698:84 , srv367224889:84 , srv461574461:84 , srv488087581:84 , srv493874881:84 , srv524723680:84 , srv528363552:84 , srv554109915:84 , srv587822645:84 , srv609881564:84 , srv627531042:84 , srv644152082:84 , srv671889373:84 , srv676865671:84 , srv692564399:84 , srv697082840:84 , srv697404721:84 , srv706883270:84 , srv724676823:84 , srv745677466:84 , srv748909318:84 , srv760263208:84 , srv784696515:84 , srv792727674:84 , srv82587541:84 , srv865670415:84 , srv902939161:84 , srv926120920:84 , srv966469547:84 , srv99906518:84 , srv676235752:684 } [srvr=100 rgns=9000 avg=90.0 max=90 min=90]
2023-09-25 11:53:14,045 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-09-25 11:53:14,051 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv234753299=62, srv760263208=91, srv1386609996=21, srv554109915=76, srv1920289450=50, srv188827884=47, srv1026558377=0, srv1398285579=22, srv1426657453=23, srv1118717485=5, srv1837456038=46, srv784696515=92, srv1495766136=29, srv2115243485=60, srv676235752=82, srv1493693542=28, srv243769268=63, srv1569964724=34, srv1579682951=35, srv312620354=65, srv1362972119=18, srv1454754608=25, srv35894698=69, srv697404721=86, srv1944141250=51, srv1896115926=48, srv165284858=39, srv2023400777=55, srv1586841202=36, srv1904805202=49, srv1992805905=54, srv1046339861=2, srv208844920=59, srv256219958=64, srv587822645=77, srv1172856204=7, srv528363552=75, srv1790485616=44, srv2033790168=56, srv488087581=72, srv609881564=78, srv644152082=80, srv1334512029=15, srv676865671=83, srv1184710096=8, srv1245010003=11, srv1614477886=38, srv1484915107=27, srv1730845034=42, srv1255480243=12, srv1802872335=45, srv1155185051=6, srv2142076752=61, srv902939161=96, srv1589163632=37, srv1041483581=1, srv1351926855=17, srv724676823=88, srv966469547=98, srv697082840=85, srv1211833356=10, srv1961511808=53, srv745677466=89, srv367224889=70, srv332134089=68, srv493874881=73, srv706883270=87, srv627531042=79, srv1379992247=20, srv748909318=90, srv1255640868=13, srv99906518=99, srv926120920=97, srv1517876339=31, srv82587541=94, srv1078769884=4, srv1660889057=40, srv2063311825=57, srv1342632469=16, srv1548108677=33, srv524723680=74, srv314147771=66, srv1050874743=3, srv1543576176=32, srv1328516440=14, srv792727674=93, srv1367128793=19, srv1432339172=24, srv1196147371=9, srv2065515341=58, srv33089391=67, srv149930938=30, srv1731601188=43, srv1670399538=41, srv865670415=95, srv671889373=81, srv461574461=71, srv692564399=84, srv1464411632=26, srv1949611332=52} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-09-25 11:53:14,134 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-09-25 11:53:14,134 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-09-25 11:53:14,134 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-09-25 11:53:14,134 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-09-25 11:53:14,134 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-09-25 11:53:14,134 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-09-25 11:53:14,134 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-09-25 11:53:14,135 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-09-25 11:53:14,135 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-09-25 11:53:14,135 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-09-25 11:53:14,135 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-09-25 11:53:14,135 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-09-25 11:53:14,135 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-09-25 11:53:14,135 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-09-25 11:53:14,135 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-09-25 11:53:14,135 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-09-25 11:53:14,135 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-09-25 11:53:14,135 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-09-25 11:53:14,136 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-09-25 11:53:14,136 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-09-25 11:53:14,136 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-09-25 11:53:14,136 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-09-25 11:53:14,136 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-09-25 11:53:14,136 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-09-25 11:53:14,136 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-09-25 11:53:14,136 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-09-25 11:53:14,136 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-09-25 11:53:14,136 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-09-25 11:53:14,137 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-09-25 11:53:14,137 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-09-25 11:53:14,137 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-09-25 11:53:14,137 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-09-25 11:53:14,137 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-09-25 11:53:14,137 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-09-25 11:53:14,137 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-09-25 11:53:14,137 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-09-25 11:53:14,137 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-09-25 11:53:14,138 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-09-25 11:53:14,138 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-09-25 11:53:14,138 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-09-25 11:53:14,138 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-09-25 11:53:14,138 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-09-25 11:53:14,138 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-09-25 11:53:14,138 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-09-25 11:53:14,139 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-09-25 11:53:14,139 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-09-25 11:53:14,139 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-09-25 11:53:14,139 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-09-25 11:53:14,139 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-09-25 11:53:14,139 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-09-25 11:53:14,139 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-09-25 11:53:14,139 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-09-25 11:53:14,139 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-09-25 11:53:14,140 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-09-25 11:53:14,140 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-09-25 11:53:14,140 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-09-25 11:53:14,140 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-09-25 11:53:14,140 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-09-25 11:53:14,140 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-09-25 11:53:14,140 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-09-25 11:53:14,140 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-09-25 11:53:14,141 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-09-25 11:53:14,141 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-09-25 11:53:14,141 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-09-25 11:53:14,141 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-09-25 11:53:14,141 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-09-25 11:53:14,141 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-09-25 11:53:14,141 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-09-25 11:53:14,142 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-09-25 11:53:14,142 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-09-25 11:53:14,142 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-09-25 11:53:14,142 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-09-25 11:53:14,142 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-09-25 11:53:14,142 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-09-25 11:53:14,142 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-09-25 11:53:14,142 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-09-25 11:53:14,142 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-09-25 11:53:14,143 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-09-25 11:53:14,143 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-09-25 11:53:14,143 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-09-25 11:53:14,143 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-09-25 11:53:14,143 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-09-25 11:53:14,143 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-09-25 11:53:14,143 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-09-25 11:53:14,144 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-09-25 11:53:14,144 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-09-25 11:53:14,144 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-09-25 11:53:14,144 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-09-25 11:53:14,144 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-09-25 11:53:14,144 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-09-25 11:53:14,144 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-09-25 11:53:14,145 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-09-25 11:53:14,145 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-09-25 11:53:14,145 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-09-25 11:53:14,145 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-09-25 11:53:14,145 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-09-25 11:53:14,145 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-09-25 11:53:14,145 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-09-25 11:53:14,145 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-09-25 11:53:14,146 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-09-25 11:53:14,146 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-09-25 11:53:14,315 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.06666666666666667, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-09-25 11:53:14,315 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-09-25 11:53:14,316 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.9909252140407105, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.06666666666666667, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-09-25 11:53:14,718 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 547 ms to try 5000 different iterations.  Found a solution that moves 4695 regions; Going from a computed imbalance of 0.9909252140407105 to a new imbalance of 0.17585568797677817. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.039806239778173796, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.05381516356386147, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.5216666666666666, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.039806239778173796, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.1715, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.23316666666666666, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-09-25 11:53:14,746 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1026558377:81 , srv1118717485:81 , srv1961511808:81 , srv2065515341:81 , srv243769268:81 , srv792727674:81 , srv1543576176:82 , srv1896115926:82 , srv1078769884:83 , srv1245010003:83 , srv1334512029:83 , srv1342632469:83 , srv1454754608:83 , srv1495766136:83 , srv256219958:83 , srv312620354:83 , srv488087581:83 , srv524723680:83 , srv865670415:83 , srv1041483581:84 , srv1184710096:84 , srv1211833356:84 , srv1351926855:84 , srv1493693542:84 , srv1589163632:84 , srv2023400777:84 , srv2142076752:84 , srv314147771:84 , srv461574461:84 , srv587822645:84 , srv609881564:84 , srv748909318:84 , srv760263208:84 , srv784696515:84 , srv1379992247:85 , srv149930938:85 , srv1660889057:85 , srv332134089:85 , srv493874881:85 , srv528363552:85 , srv554109915:85 , srv644152082:85 , srv706883270:85 , srv724676823:85 , srv1046339861:86 , srv1464411632:86 , srv1484915107:86 , srv1586841202:86 , srv1614477886:86 , srv2033790168:86 , srv33089391:86 , srv367224889:86 , srv676865671:86 , srv697082840:86 , srv966469547:86 , srv1050874743:87 , srv1196147371:87 , srv1255480243:87 , srv1362972119:87 , srv1426657453:87 , srv1432339172:87 , srv1944141250:87 , srv627531042:87 , srv671889373:87 , srv692564399:87 , srv926120920:87 , srv1569964724:88 , srv2063311825:88 , srv208844920:88 , srv2115243485:88 , srv745677466:88 , srv82587541:88 , srv99906518:88 , srv1172856204:89 , srv1367128793:89 , srv1517876339:89 , srv1579682951:89 , srv165284858:89 , srv1731601188:89 , srv188827884:89 , srv1949611332:89 , srv1992805905:89 , srv234753299:89 , srv1670399538:90 , srv1790485616:90 , srv1920289450:90 , srv35894698:90 , srv902939161:90 , srv1155185051:91 , srv1548108677:91 , srv1802872335:91 , srv697404721:91 , srv1730845034:92 , srv1837456038:92 , srv1904805202:93 , srv1255640868:94 , srv1398285579:94 , srv1386609996:95 , srv1328516440:101 , srv676235752:443 }
2023-09-25 11:53:14,750 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-09-25 11:53:14,751 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv234753299=62, srv760263208=91, srv1386609996=21, srv554109915=76, srv1920289450=50, srv188827884=47, srv1026558377=0, srv1398285579=22, srv1426657453=23, srv1118717485=5, srv1837456038=46, srv784696515=92, srv1495766136=29, srv2115243485=60, srv676235752=82, srv1493693542=28, srv243769268=63, srv1569964724=34, srv1579682951=35, srv312620354=65, srv1362972119=18, srv1454754608=25, srv35894698=69, srv697404721=86, srv1944141250=51, srv1896115926=48, srv165284858=39, srv2023400777=55, srv1586841202=36, srv1904805202=49, srv1992805905=54, srv1046339861=2, srv208844920=59, srv256219958=64, srv587822645=77, srv1172856204=7, srv528363552=75, srv1790485616=44, srv2033790168=56, srv488087581=72, srv609881564=78, srv644152082=80, srv1334512029=15, srv676865671=83, srv1184710096=8, srv1245010003=11, srv1614477886=38, srv1484915107=27, srv1730845034=42, srv1255480243=12, srv1802872335=45, srv1155185051=6, srv2142076752=61, srv902939161=96, srv1589163632=37, srv1041483581=1, srv1351926855=17, srv724676823=88, srv966469547=98, srv697082840=85, srv1211833356=10, srv1961511808=53, srv745677466=89, srv367224889=70, srv332134089=68, srv493874881=73, srv706883270=87, srv627531042=79, srv1379992247=20, srv748909318=90, srv1255640868=13, srv99906518=99, srv926120920=97, srv1517876339=31, srv82587541=94, srv1078769884=4, srv1660889057=40, srv2063311825=57, srv1342632469=16, srv1548108677=33, srv524723680=74, srv314147771=66, srv1050874743=3, srv1543576176=32, srv1328516440=14, srv792727674=93, srv1367128793=19, srv1432339172=24, srv1196147371=9, srv2065515341=58, srv33089391=67, srv149930938=30, srv1731601188=43, srv1670399538=41, srv865670415=95, srv671889373=81, srv461574461=71, srv692564399=84, srv1464411632=26, srv1949611332=52} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-09-25 11:53:14,788 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-09-25 11:53:14,788 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-09-25 11:53:14,788 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-09-25 11:53:14,788 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-09-25 11:53:14,788 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-09-25 11:53:14,788 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-09-25 11:53:14,789 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-09-25 11:53:14,789 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-09-25 11:53:14,789 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-09-25 11:53:14,789 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-09-25 11:53:14,789 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-09-25 11:53:14,789 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-09-25 11:53:14,789 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-09-25 11:53:14,790 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-09-25 11:53:14,790 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-09-25 11:53:14,790 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-09-25 11:53:14,790 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-09-25 11:53:14,790 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-09-25 11:53:14,790 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-09-25 11:53:14,790 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-09-25 11:53:14,790 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-09-25 11:53:14,791 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-09-25 11:53:14,791 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-09-25 11:53:14,791 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-09-25 11:53:14,791 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-09-25 11:53:14,791 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-09-25 11:53:14,791 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-09-25 11:53:14,791 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-09-25 11:53:14,791 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-09-25 11:53:14,791 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-09-25 11:53:14,792 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-09-25 11:53:14,792 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-09-25 11:53:14,792 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-09-25 11:53:14,792 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-09-25 11:53:14,792 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-09-25 11:53:14,792 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-09-25 11:53:14,792 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-09-25 11:53:14,792 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-09-25 11:53:14,792 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-09-25 11:53:14,793 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-09-25 11:53:14,793 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-09-25 11:53:14,793 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-09-25 11:53:14,793 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-09-25 11:53:14,793 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-09-25 11:53:14,793 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-09-25 11:53:14,793 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-09-25 11:53:14,793 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-09-25 11:53:14,793 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-09-25 11:53:14,794 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-09-25 11:53:14,794 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-09-25 11:53:14,794 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-09-25 11:53:14,794 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-09-25 11:53:14,794 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-09-25 11:53:14,794 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-09-25 11:53:14,794 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-09-25 11:53:14,794 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-09-25 11:53:14,794 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-09-25 11:53:14,795 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-09-25 11:53:14,795 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-09-25 11:53:14,795 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-09-25 11:53:14,795 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-09-25 11:53:14,795 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-09-25 11:53:14,795 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-09-25 11:53:14,795 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-09-25 11:53:14,795 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-09-25 11:53:14,795 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-09-25 11:53:14,796 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-09-25 11:53:14,796 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-09-25 11:53:14,796 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-09-25 11:53:14,796 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-09-25 11:53:14,796 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-09-25 11:53:14,796 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-09-25 11:53:14,796 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-09-25 11:53:14,796 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-09-25 11:53:14,796 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-09-25 11:53:14,797 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-09-25 11:53:14,797 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-09-25 11:53:14,797 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-09-25 11:53:14,797 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-09-25 11:53:14,797 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-09-25 11:53:14,797 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-09-25 11:53:14,797 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-09-25 11:53:14,797 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-09-25 11:53:14,797 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-09-25 11:53:14,798 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-09-25 11:53:14,798 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-09-25 11:53:14,798 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-09-25 11:53:14,798 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-09-25 11:53:14,798 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-09-25 11:53:14,798 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-09-25 11:53:14,798 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-09-25 11:53:14,798 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-09-25 11:53:14,798 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-09-25 11:53:14,799 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-09-25 11:53:14,799 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-09-25 11:53:14,799 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-09-25 11:53:14,799 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-09-25 11:53:14,799 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-09-25 11:53:14,799 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-09-25 11:53:14,799 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-09-25 11:53:14,799 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-09-25 11:53:15,005 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.039806239778173796, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.05381516356386147, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.039806239778173796, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.1715, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.23316666666666666, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-09-25 11:53:15,005 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-09-25 11:53:15,005 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.1758228128841247, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.039806239778173796, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.05381516356386147, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.039806239778173796, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.1715, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.23316666666666666, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-09-25 11:53:15,469 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 636 ms to try 5000 different iterations.  Found a solution that moves 2611 regions; Going from a computed imbalance of 0.1758228128841247 to a new imbalance of 0.013558538007328775. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.021715318481206808); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.03478650614966973, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.2901111111111111, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.021715318481206808); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.010583333333333333); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.041666666666666664, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-09-25 11:53:15,474 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1328516440:71 , srv1386609996:78 , srv1398285579:78 , srv1730845034:78 , srv1255640868:79 , srv1155185051:80 , srv1548108677:80 , srv1802872335:80 , srv1579682951:81 , srv1904805202:81 , srv1670399538:82 , srv1731601188:82 , srv1837456038:82 , srv697404721:82 , srv745677466:82 , srv1172856204:83 , srv1255480243:83 , srv1367128793:83 , srv1426657453:83 , srv1517876339:83 , srv1790485616:83 , srv188827884:83 , srv1920289450:83 , srv1992805905:83 , srv35894698:83 , srv1196147371:84 , srv1362972119:84 , srv1432339172:84 , srv1569964724:84 , srv165284858:84 , srv1949611332:84 , srv234753299:84 , srv627531042:84 , srv82587541:84 , srv902939161:84 , srv99906518:84 , srv1050874743:85 , srv1484915107:85 , srv1614477886:85 , srv1944141250:85 , srv33089391:85 , srv671889373:85 , srv692564399:85 , srv697082840:85 , srv1379992247:86 , srv1464411632:86 , srv1589163632:86 , srv2023400777:86 , srv2063311825:86 , srv2115243485:86 , srv332134089:86 , srv367224889:86 , srv528363552:86 , srv676865671:86 , srv724676823:86 , srv1046339861:87 , srv1211833356:87 , srv1245010003:87 , srv1454754608:87 , srv149930938:87 , srv1660889057:87 , srv208844920:87 , srv461574461:87 , srv524723680:87 , srv554109915:87 , srv644152082:87 , srv706883270:87 , srv966469547:87 , srv1184710096:88 , srv1334512029:88 , srv1342632469:88 , srv1351926855:88 , srv1493693542:88 , srv1495766136:88 , srv1543576176:88 , srv2033790168:88 , srv493874881:88 , srv587822645:88 , srv748909318:88 , srv784696515:88 , srv865670415:88 , srv1118717485:89 , srv1586841202:89 , srv2142076752:89 , srv760263208:89 , srv1026558377:90 , srv1041483581:90 , srv1078769884:90 , srv312620354:90 , srv314147771:90 , srv488087581:90 , srv609881564:90 , srv792727674:90 , srv1961511808:91 , srv256219958:91 , srv926120920:91 , srv1896115926:92 , srv2065515341:92 , srv243769268:92 , srv676235752:524 }
2023-09-25 11:53:15,480 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-09-25 11:53:15,482 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv234753299=62, srv760263208=91, srv1386609996=21, srv554109915=76, srv1920289450=50, srv188827884=47, srv1026558377=0, srv1398285579=22, srv1426657453=23, srv1118717485=5, srv1837456038=46, srv784696515=92, srv1495766136=29, srv2115243485=60, srv676235752=82, srv1493693542=28, srv243769268=63, srv1569964724=34, srv1579682951=35, srv312620354=65, srv1362972119=18, srv1454754608=25, srv35894698=69, srv697404721=86, srv1944141250=51, srv1896115926=48, srv165284858=39, srv2023400777=55, srv1586841202=36, srv1904805202=49, srv1992805905=54, srv1046339861=2, srv208844920=59, srv256219958=64, srv587822645=77, srv1172856204=7, srv528363552=75, srv1790485616=44, srv2033790168=56, srv488087581=72, srv609881564=78, srv644152082=80, srv1334512029=15, srv676865671=83, srv1184710096=8, srv1245010003=11, srv1614477886=38, srv1484915107=27, srv1730845034=42, srv1255480243=12, srv1802872335=45, srv1155185051=6, srv2142076752=61, srv902939161=96, srv1589163632=37, srv1041483581=1, srv1351926855=17, srv724676823=88, srv966469547=98, srv697082840=85, srv1211833356=10, srv1961511808=53, srv745677466=89, srv367224889=70, srv332134089=68, srv493874881=73, srv706883270=87, srv627531042=79, srv1379992247=20, srv748909318=90, srv1255640868=13, srv99906518=99, srv926120920=97, srv1517876339=31, srv82587541=94, srv1078769884=4, srv1660889057=40, srv2063311825=57, srv1342632469=16, srv1548108677=33, srv524723680=74, srv314147771=66, srv1050874743=3, srv1543576176=32, srv1328516440=14, srv792727674=93, srv1367128793=19, srv1432339172=24, srv1196147371=9, srv2065515341=58, srv33089391=67, srv149930938=30, srv1731601188=43, srv1670399538=41, srv865670415=95, srv671889373=81, srv461574461=71, srv692564399=84, srv1464411632=26, srv1949611332=52} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-09-25 11:53:15,523 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-09-25 11:53:15,524 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-09-25 11:53:15,524 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-09-25 11:53:15,524 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-09-25 11:53:15,524 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-09-25 11:53:15,524 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-09-25 11:53:15,524 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-09-25 11:53:15,524 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-09-25 11:53:15,525 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-09-25 11:53:15,525 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-09-25 11:53:15,525 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-09-25 11:53:15,525 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-09-25 11:53:15,525 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-09-25 11:53:15,525 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-09-25 11:53:15,525 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-09-25 11:53:15,525 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-09-25 11:53:15,526 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-09-25 11:53:15,526 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-09-25 11:53:15,526 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-09-25 11:53:15,526 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-09-25 11:53:15,526 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-09-25 11:53:15,526 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-09-25 11:53:15,526 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-09-25 11:53:15,526 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-09-25 11:53:15,526 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-09-25 11:53:15,527 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-09-25 11:53:15,527 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-09-25 11:53:15,527 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-09-25 11:53:15,527 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-09-25 11:53:15,527 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-09-25 11:53:15,527 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-09-25 11:53:15,527 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-09-25 11:53:15,527 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-09-25 11:53:15,528 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-09-25 11:53:15,528 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-09-25 11:53:15,528 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-09-25 11:53:15,528 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-09-25 11:53:15,528 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-09-25 11:53:15,528 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-09-25 11:53:15,528 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-09-25 11:53:15,528 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-09-25 11:53:15,528 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-09-25 11:53:15,529 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-09-25 11:53:15,545 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-09-25 11:53:15,545 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-09-25 11:53:15,545 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-09-25 11:53:15,545 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-09-25 11:53:15,545 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-09-25 11:53:15,546 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-09-25 11:53:15,546 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-09-25 11:53:15,546 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-09-25 11:53:15,546 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-09-25 11:53:15,546 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-09-25 11:53:15,546 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-09-25 11:53:15,546 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-09-25 11:53:15,546 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-09-25 11:53:15,547 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-09-25 11:53:15,547 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-09-25 11:53:15,547 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-09-25 11:53:15,547 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-09-25 11:53:15,547 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-09-25 11:53:15,547 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-09-25 11:53:15,547 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-09-25 11:53:15,547 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-09-25 11:53:15,547 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-09-25 11:53:15,548 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-09-25 11:53:15,548 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-09-25 11:53:15,548 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-09-25 11:53:15,548 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-09-25 11:53:15,548 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-09-25 11:53:15,548 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-09-25 11:53:15,548 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-09-25 11:53:15,548 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-09-25 11:53:15,548 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-09-25 11:53:15,549 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-09-25 11:53:15,549 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-09-25 11:53:15,549 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-09-25 11:53:15,549 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-09-25 11:53:15,549 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-09-25 11:53:15,549 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-09-25 11:53:15,549 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-09-25 11:53:15,549 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-09-25 11:53:15,550 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-09-25 11:53:15,550 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-09-25 11:53:15,550 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-09-25 11:53:15,550 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-09-25 11:53:15,550 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-09-25 11:53:15,550 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-09-25 11:53:15,550 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-09-25 11:53:15,550 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-09-25 11:53:15,550 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-09-25 11:53:15,551 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-09-25 11:53:15,551 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-09-25 11:53:15,551 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-09-25 11:53:15,551 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-09-25 11:53:15,551 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-09-25 11:53:15,551 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-09-25 11:53:15,551 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-09-25 11:53:15,551 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-09-25 11:53:15,551 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-09-25 11:53:15,552 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-09-25 11:53:15,769 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.021715318481206808); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.03478650614966973, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.021715318481206808); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.010583333333333333); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.041666666666666664, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-09-25 11:53:15,769 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-09-25 11:53:15,770 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.013540255394566655, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.021715318481206808); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.03478650614966973, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.021715318481206808); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.010583333333333333); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.041666666666666664, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-09-25 11:53:16,131 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 549 ms to try 5000 different iterations.  Found a solution that moves 970 regions; Going from a computed imbalance of 0.013540255394566655 to a new imbalance of 8.174478896426802E-4. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.007888422553043067); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.009983150788368353); MoveCostFunction : (multiplier=7.0, imbalance=0.10777777777777778, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.007888422553043067); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=4.166666666666667E-4); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.003916666666666666); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-09-25 11:53:16,135 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv926120920:80 , srv1586841202:82 , srv208844920:82 , srv256219958:82 , srv1837456038:83 , srv1896115926:83 , srv1920289450:83 , srv2063311825:83 , srv2115243485:83 , srv314147771:83 , srv488087581:83 , srv609881564:83 , srv1041483581:84 , srv1046339861:84 , srv1050874743:84 , srv1255640868:84 , srv1386609996:84 , srv1904805202:84 , srv1949611332:84 , srv2033790168:84 , srv234753299:84 , srv243769268:84 , srv35894698:84 , srv644152082:84 , srv697404721:84 , srv1078769884:85 , srv1172856204:85 , srv1184710096:85 , srv1328516440:85 , srv1351926855:85 , srv1362972119:85 , srv1367128793:85 , srv1398285579:85 , srv1464411632:85 , srv1493693542:85 , srv149930938:85 , srv1517876339:85 , srv1569964724:85 , srv165284858:85 , srv1660889057:85 , srv1790485616:85 , srv1802872335:85 , srv188827884:85 , srv1961511808:85 , srv1992805905:85 , srv2065515341:85 , srv2142076752:85 , srv312620354:85 , srv367224889:85 , srv554109915:85 , srv587822645:85 , srv676865671:85 , srv706883270:85 , srv748909318:85 , srv760263208:85 , srv82587541:85 , srv902939161:85 , srv966469547:85 , srv1026558377:86 , srv1155185051:86 , srv1211833356:86 , srv1334512029:86 , srv1342632469:86 , srv1432339172:86 , srv1484915107:86 , srv1548108677:86 , srv1589163632:86 , srv1614477886:86 , srv1670399538:86 , srv1944141250:86 , srv461574461:86 , srv493874881:86 , srv671889373:86 , srv692564399:86 , srv784696515:86 , srv792727674:86 , srv99906518:86 , srv1118717485:87 , srv1196147371:87 , srv1245010003:87 , srv1255480243:87 , srv1379992247:87 , srv1495766136:87 , srv1579682951:87 , srv1730845034:87 , srv1731601188:87 , srv2023400777:87 , srv33089391:87 , srv332134089:87 , srv528363552:87 , srv627531042:87 , srv697082840:87 , srv724676823:87 , srv745677466:87 , srv865670415:87 , srv1426657453:88 , srv1454754608:88 , srv1543576176:88 , srv524723680:88 , srv676235752:561 }
2023-09-25 11:53:16,141 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-09-25 11:53:16,142 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv234753299=62, srv760263208=91, srv1386609996=21, srv554109915=76, srv1920289450=50, srv188827884=47, srv1026558377=0, srv1398285579=22, srv1426657453=23, srv1118717485=5, srv1837456038=46, srv784696515=92, srv1495766136=29, srv2115243485=60, srv676235752=82, srv1493693542=28, srv243769268=63, srv1569964724=34, srv1579682951=35, srv312620354=65, srv1362972119=18, srv1454754608=25, srv35894698=69, srv697404721=86, srv1944141250=51, srv1896115926=48, srv165284858=39, srv2023400777=55, srv1586841202=36, srv1904805202=49, srv1992805905=54, srv1046339861=2, srv208844920=59, srv256219958=64, srv587822645=77, srv1172856204=7, srv528363552=75, srv1790485616=44, srv2033790168=56, srv488087581=72, srv609881564=78, srv644152082=80, srv1334512029=15, srv676865671=83, srv1184710096=8, srv1245010003=11, srv1614477886=38, srv1484915107=27, srv1730845034=42, srv1255480243=12, srv1802872335=45, srv1155185051=6, srv2142076752=61, srv902939161=96, srv1589163632=37, srv1041483581=1, srv1351926855=17, srv724676823=88, srv966469547=98, srv697082840=85, srv1211833356=10, srv1961511808=53, srv745677466=89, srv367224889=70, srv332134089=68, srv493874881=73, srv706883270=87, srv627531042=79, srv1379992247=20, srv748909318=90, srv1255640868=13, srv99906518=99, srv926120920=97, srv1517876339=31, srv82587541=94, srv1078769884=4, srv1660889057=40, srv2063311825=57, srv1342632469=16, srv1548108677=33, srv524723680=74, srv314147771=66, srv1050874743=3, srv1543576176=32, srv1328516440=14, srv792727674=93, srv1367128793=19, srv1432339172=24, srv1196147371=9, srv2065515341=58, srv33089391=67, srv149930938=30, srv1731601188=43, srv1670399538=41, srv865670415=95, srv671889373=81, srv461574461=71, srv692564399=84, srv1464411632=26, srv1949611332=52} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-09-25 11:53:16,160 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-09-25 11:53:16,161 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-09-25 11:53:16,161 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-09-25 11:53:16,161 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-09-25 11:53:16,161 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-09-25 11:53:16,161 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-09-25 11:53:16,161 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-09-25 11:53:16,161 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-09-25 11:53:16,161 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-09-25 11:53:16,162 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-09-25 11:53:16,162 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-09-25 11:53:16,162 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-09-25 11:53:16,162 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-09-25 11:53:16,162 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-09-25 11:53:16,162 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-09-25 11:53:16,162 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-09-25 11:53:16,162 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-09-25 11:53:16,163 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-09-25 11:53:16,163 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-09-25 11:53:16,163 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-09-25 11:53:16,163 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-09-25 11:53:16,163 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-09-25 11:53:16,163 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-09-25 11:53:16,163 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-09-25 11:53:16,163 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-09-25 11:53:16,163 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-09-25 11:53:16,164 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-09-25 11:53:16,164 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-09-25 11:53:16,164 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-09-25 11:53:16,164 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-09-25 11:53:16,164 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-09-25 11:53:16,164 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-09-25 11:53:16,164 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-09-25 11:53:16,164 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-09-25 11:53:16,164 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-09-25 11:53:16,165 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-09-25 11:53:16,165 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-09-25 11:53:16,165 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-09-25 11:53:16,165 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-09-25 11:53:16,165 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-09-25 11:53:16,165 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-09-25 11:53:16,165 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-09-25 11:53:16,165 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-09-25 11:53:16,165 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-09-25 11:53:16,166 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-09-25 11:53:16,166 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-09-25 11:53:16,166 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-09-25 11:53:16,166 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-09-25 11:53:16,166 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-09-25 11:53:16,166 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-09-25 11:53:16,166 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-09-25 11:53:16,166 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-09-25 11:53:16,166 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-09-25 11:53:16,167 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-09-25 11:53:16,167 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-09-25 11:53:16,167 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-09-25 11:53:16,167 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-09-25 11:53:16,167 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-09-25 11:53:16,167 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-09-25 11:53:16,167 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-09-25 11:53:16,167 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-09-25 11:53:16,167 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-09-25 11:53:16,168 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-09-25 11:53:16,168 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-09-25 11:53:16,168 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-09-25 11:53:16,168 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-09-25 11:53:16,168 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-09-25 11:53:16,168 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-09-25 11:53:16,168 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-09-25 11:53:16,168 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-09-25 11:53:16,168 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-09-25 11:53:16,168 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-09-25 11:53:16,169 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-09-25 11:53:16,169 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-09-25 11:53:16,169 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-09-25 11:53:16,169 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-09-25 11:53:16,169 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-09-25 11:53:16,169 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-09-25 11:53:16,169 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-09-25 11:53:16,169 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-09-25 11:53:16,169 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-09-25 11:53:16,169 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-09-25 11:53:16,170 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-09-25 11:53:16,170 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-09-25 11:53:16,170 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-09-25 11:53:16,170 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-09-25 11:53:16,170 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-09-25 11:53:16,170 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-09-25 11:53:16,170 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-09-25 11:53:16,170 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-09-25 11:53:16,170 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-09-25 11:53:16,170 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-09-25 11:53:16,171 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-09-25 11:53:16,171 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-09-25 11:53:16,171 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-09-25 11:53:16,171 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-09-25 11:53:16,171 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-09-25 11:53:16,171 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-09-25 11:53:16,171 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-09-25 11:53:16,171 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-09-25 11:53:16,171 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-09-25 11:53:16,308 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.007888422553043067); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.009983150788368353); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.007888422553043067); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=4.166666666666667E-4); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.003916666666666666); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-09-25 11:53:16,308 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-09-25 11:53:16,308 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=8.10655804472533E-4, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.007888422553043067); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.009983150788368353); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.007888422553043067); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=4.166666666666667E-4); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.003916666666666666); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-09-25 11:53:16,666 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 473 ms to try 5000 different iterations.  Found a solution that moves 291 regions; Going from a computed imbalance of 8.10655804472533E-4 to a new imbalance of 2.83722982979154E-5. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=4.737793696791342E-4); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.002010075630518424); MoveCostFunction : (multiplier=7.0, imbalance=0.03233333333333333, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=4.737793696791342E-4); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.6666666666666666E-4); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-09-25 11:53:16,667 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1543576176:83 , srv2065515341:83 , srv493874881:83 , srv902939161:83 , srv99906518:83 , srv1041483581:84 , srv1046339861:84 , srv1078769884:84 , srv1196147371:84 , srv1328516440:84 , srv1379992247:84 , srv1426657453:84 , srv1454754608:84 , srv1495766136:84 , srv1614477886:84 , srv165284858:84 , srv1670399538:84 , srv1730845034:84 , srv1731601188:84 , srv1790485616:84 , srv1904805202:84 , srv1944141250:84 , srv1949611332:84 , srv2033790168:84 , srv2142076752:84 , srv312620354:84 , srv33089391:84 , srv524723680:84 , srv528363552:84 , srv609881564:84 , srv671889373:84 , srv692564399:84 , srv697082840:84 , srv724676823:84 , srv760263208:84 , srv784696515:84 , srv865670415:84 , srv1026558377:85 , srv1118717485:85 , srv1155185051:85 , srv1172856204:85 , srv1184710096:85 , srv1211833356:85 , srv1245010003:85 , srv1255480243:85 , srv1255640868:85 , srv1334512029:85 , srv1342632469:85 , srv1351926855:85 , srv1367128793:85 , srv1386609996:85 , srv1398285579:85 , srv1432339172:85 , srv1464411632:85 , srv1484915107:85 , srv1493693542:85 , srv149930938:85 , srv1517876339:85 , srv1548108677:85 , srv1569964724:85 , srv1660889057:85 , srv1837456038:85 , srv188827884:85 , srv1896115926:85 , srv1992805905:85 , srv2023400777:85 , srv2063311825:85 , srv208844920:85 , srv2115243485:85 , srv234753299:85 , srv314147771:85 , srv332134089:85 , srv35894698:85 , srv367224889:85 , srv461574461:85 , srv554109915:85 , srv587822645:85 , srv627531042:85 , srv676865671:85 , srv697404721:85 , srv706883270:85 , srv745677466:85 , srv748909318:85 , srv82587541:85 , srv926120920:85 , srv966469547:85 , srv1050874743:86 , srv1362972119:86 , srv1579682951:86 , srv1586841202:86 , srv1589163632:86 , srv1802872335:86 , srv1920289450:86 , srv1961511808:86 , srv243769268:86 , srv256219958:86 , srv488087581:86 , srv644152082:86 , srv792727674:86 , srv676235752:614 }
2023-09-25 11:53:16,671 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-09-25 11:53:16,671 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv234753299=62, srv760263208=91, srv1386609996=21, srv554109915=76, srv1920289450=50, srv188827884=47, srv1026558377=0, srv1398285579=22, srv1426657453=23, srv1118717485=5, srv1837456038=46, srv784696515=92, srv1495766136=29, srv2115243485=60, srv676235752=82, srv1493693542=28, srv243769268=63, srv1569964724=34, srv1579682951=35, srv312620354=65, srv1362972119=18, srv1454754608=25, srv35894698=69, srv697404721=86, srv1944141250=51, srv1896115926=48, srv165284858=39, srv2023400777=55, srv1586841202=36, srv1904805202=49, srv1992805905=54, srv1046339861=2, srv208844920=59, srv256219958=64, srv587822645=77, srv1172856204=7, srv528363552=75, srv1790485616=44, srv2033790168=56, srv488087581=72, srv609881564=78, srv644152082=80, srv1334512029=15, srv676865671=83, srv1184710096=8, srv1245010003=11, srv1614477886=38, srv1484915107=27, srv1730845034=42, srv1255480243=12, srv1802872335=45, srv1155185051=6, srv2142076752=61, srv902939161=96, srv1589163632=37, srv1041483581=1, srv1351926855=17, srv724676823=88, srv966469547=98, srv697082840=85, srv1211833356=10, srv1961511808=53, srv745677466=89, srv367224889=70, srv332134089=68, srv493874881=73, srv706883270=87, srv627531042=79, srv1379992247=20, srv748909318=90, srv1255640868=13, srv99906518=99, srv926120920=97, srv1517876339=31, srv82587541=94, srv1078769884=4, srv1660889057=40, srv2063311825=57, srv1342632469=16, srv1548108677=33, srv524723680=74, srv314147771=66, srv1050874743=3, srv1543576176=32, srv1328516440=14, srv792727674=93, srv1367128793=19, srv1432339172=24, srv1196147371=9, srv2065515341=58, srv33089391=67, srv149930938=30, srv1731601188=43, srv1670399538=41, srv865670415=95, srv671889373=81, srv461574461=71, srv692564399=84, srv1464411632=26, srv1949611332=52} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-09-25 11:53:16,682 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-09-25 11:53:16,682 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-09-25 11:53:16,682 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-09-25 11:53:16,682 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-09-25 11:53:16,682 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-09-25 11:53:16,682 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-09-25 11:53:16,682 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-09-25 11:53:16,682 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-09-25 11:53:16,682 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-09-25 11:53:16,682 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-09-25 11:53:16,683 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-09-25 11:53:16,683 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-09-25 11:53:16,683 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-09-25 11:53:16,683 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-09-25 11:53:16,683 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-09-25 11:53:16,683 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-09-25 11:53:16,683 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-09-25 11:53:16,683 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-09-25 11:53:16,683 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-09-25 11:53:16,683 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-09-25 11:53:16,683 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-09-25 11:53:16,683 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-09-25 11:53:16,683 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-09-25 11:53:16,683 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-09-25 11:53:16,683 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-09-25 11:53:16,683 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-09-25 11:53:16,683 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-09-25 11:53:16,683 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-09-25 11:53:16,683 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-09-25 11:53:16,683 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-09-25 11:53:16,684 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-09-25 11:53:16,684 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-09-25 11:53:16,684 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-09-25 11:53:16,684 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-09-25 11:53:16,684 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-09-25 11:53:16,684 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-09-25 11:53:16,684 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-09-25 11:53:16,684 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-09-25 11:53:16,684 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-09-25 11:53:16,684 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-09-25 11:53:16,684 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-09-25 11:53:16,684 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-09-25 11:53:16,684 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-09-25 11:53:16,684 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-09-25 11:53:16,684 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-09-25 11:53:16,684 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-09-25 11:53:16,684 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-09-25 11:53:16,684 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-09-25 11:53:16,684 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-09-25 11:53:16,684 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-09-25 11:53:16,685 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-09-25 11:53:16,685 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-09-25 11:53:16,685 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-09-25 11:53:16,685 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-09-25 11:53:16,685 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-09-25 11:53:16,685 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-09-25 11:53:16,685 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-09-25 11:53:16,685 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-09-25 11:53:16,685 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-09-25 11:53:16,685 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-09-25 11:53:16,685 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-09-25 11:53:16,685 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-09-25 11:53:16,685 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-09-25 11:53:16,685 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-09-25 11:53:16,685 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-09-25 11:53:16,685 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-09-25 11:53:16,685 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-09-25 11:53:16,685 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-09-25 11:53:16,686 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-09-25 11:53:16,686 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-09-25 11:53:16,686 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-09-25 11:53:16,686 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-09-25 11:53:16,686 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-09-25 11:53:16,686 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-09-25 11:53:16,686 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-09-25 11:53:16,686 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-09-25 11:53:16,686 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-09-25 11:53:16,686 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-09-25 11:53:16,686 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-09-25 11:53:16,686 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-09-25 11:53:16,686 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-09-25 11:53:16,686 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-09-25 11:53:16,687 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-09-25 11:53:16,687 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-09-25 11:53:16,687 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-09-25 11:53:16,687 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-09-25 11:53:16,687 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-09-25 11:53:16,687 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-09-25 11:53:16,687 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-09-25 11:53:16,687 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-09-25 11:53:16,687 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-09-25 11:53:16,687 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-09-25 11:53:16,687 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-09-25 11:53:16,687 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-09-25 11:53:16,687 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-09-25 11:53:16,687 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-09-25 11:53:16,687 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-09-25 11:53:16,687 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-09-25 11:53:16,687 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-09-25 11:53:16,687 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-09-25 11:53:16,687 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-09-25 11:53:16,794 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=4.737793696791342E-4); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.002010075630518424); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=4.737793696791342E-4); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.6666666666666666E-4); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-09-25 11:53:16,794 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-09-25 11:53:16,794 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=2.6334672746871227E-5, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=4.737793696791342E-4); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.002010075630518424); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=4.737793696791342E-4); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.6666666666666666E-4); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-09-25 11:53:17,055 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 357 ms to try 5000 different iterations.  Found a solution that moves 24 regions; Going from a computed imbalance of 2.6334672746871227E-5 to a new imbalance of 8.147741708879284E-6. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0017727200782610348); MoveCostFunction : (multiplier=7.0, imbalance=0.0026666666666666666); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-09-25 11:53:17,055 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1579682951:83 , srv1586841202:83 , srv1961511808:83 , srv243769268:83 , srv332134089:83 , srv627531042:83 , srv792727674:83 , srv926120920:83 , srv966469547:83 , srv1026558377:84 , srv1041483581:84 , srv1050874743:84 , srv1078769884:84 , srv1118717485:84 , srv1155185051:84 , srv1172856204:84 , srv1184710096:84 , srv1196147371:84 , srv1211833356:84 , srv1245010003:84 , srv1255480243:84 , srv1255640868:84 , srv1334512029:84 , srv1342632469:84 , srv1351926855:84 , srv1362972119:84 , srv1367128793:84 , srv1379992247:84 , srv1386609996:84 , srv1398285579:84 , srv1426657453:84 , srv1432339172:84 , srv1454754608:84 , srv1464411632:84 , srv1484915107:84 , srv1493693542:84 , srv1495766136:84 , srv149930938:84 , srv1517876339:84 , srv1548108677:84 , srv1569964724:84 , srv1589163632:84 , srv165284858:84 , srv1660889057:84 , srv1670399538:84 , srv1731601188:84 , srv1790485616:84 , srv1802872335:84 , srv1837456038:84 , srv188827884:84 , srv1896115926:84 , srv1904805202:84 , srv1920289450:84 , srv1944141250:84 , srv1992805905:84 , srv2023400777:84 , srv2033790168:84 , srv2063311825:84 , srv208844920:84 , srv2115243485:84 , srv2142076752:84 , srv234753299:84 , srv256219958:84 , srv312620354:84 , srv314147771:84 , srv33089391:84 , srv35894698:84 , srv367224889:84 , srv461574461:84 , srv488087581:84 , srv493874881:84 , srv524723680:84 , srv528363552:84 , srv554109915:84 , srv587822645:84 , srv644152082:84 , srv671889373:84 , srv676865671:84 , srv692564399:84 , srv697082840:84 , srv697404721:84 , srv706883270:84 , srv724676823:84 , srv745677466:84 , srv748909318:84 , srv760263208:84 , srv784696515:84 , srv82587541:84 , srv865670415:84 , srv902939161:84 , srv1046339861:85 , srv1328516440:85 , srv1543576176:85 , srv1614477886:85 , srv1730845034:85 , srv1949611332:85 , srv2065515341:85 , srv609881564:85 , srv99906518:85 , srv676235752:684 }
2023-09-25 11:53:17,059 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-09-25 11:53:17,059 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv234753299=62, srv760263208=91, srv1386609996=21, srv554109915=76, srv1920289450=50, srv188827884=47, srv1026558377=0, srv1398285579=22, srv1426657453=23, srv1118717485=5, srv1837456038=46, srv784696515=92, srv1495766136=29, srv2115243485=60, srv676235752=82, srv1493693542=28, srv243769268=63, srv1569964724=34, srv1579682951=35, srv312620354=65, srv1362972119=18, srv1454754608=25, srv35894698=69, srv697404721=86, srv1944141250=51, srv1896115926=48, srv165284858=39, srv2023400777=55, srv1586841202=36, srv1904805202=49, srv1992805905=54, srv1046339861=2, srv208844920=59, srv256219958=64, srv587822645=77, srv1172856204=7, srv528363552=75, srv1790485616=44, srv2033790168=56, srv488087581=72, srv609881564=78, srv644152082=80, srv1334512029=15, srv676865671=83, srv1184710096=8, srv1245010003=11, srv1614477886=38, srv1484915107=27, srv1730845034=42, srv1255480243=12, srv1802872335=45, srv1155185051=6, srv2142076752=61, srv902939161=96, srv1589163632=37, srv1041483581=1, srv1351926855=17, srv724676823=88, srv966469547=98, srv697082840=85, srv1211833356=10, srv1961511808=53, srv745677466=89, srv367224889=70, srv332134089=68, srv493874881=73, srv706883270=87, srv627531042=79, srv1379992247=20, srv748909318=90, srv1255640868=13, srv99906518=99, srv926120920=97, srv1517876339=31, srv82587541=94, srv1078769884=4, srv1660889057=40, srv2063311825=57, srv1342632469=16, srv1548108677=33, srv524723680=74, srv314147771=66, srv1050874743=3, srv1543576176=32, srv1328516440=14, srv792727674=93, srv1367128793=19, srv1432339172=24, srv1196147371=9, srv2065515341=58, srv33089391=67, srv149930938=30, srv1731601188=43, srv1670399538=41, srv865670415=95, srv671889373=81, srv461574461=71, srv692564399=84, srv1464411632=26, srv1949611332=52} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-09-25 11:53:17,070 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-09-25 11:53:17,071 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-09-25 11:53:17,071 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-09-25 11:53:17,071 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-09-25 11:53:17,071 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-09-25 11:53:17,071 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-09-25 11:53:17,071 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-09-25 11:53:17,071 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-09-25 11:53:17,071 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-09-25 11:53:17,071 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-09-25 11:53:17,071 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-09-25 11:53:17,071 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-09-25 11:53:17,071 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-09-25 11:53:17,071 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-09-25 11:53:17,071 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-09-25 11:53:17,071 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-09-25 11:53:17,071 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-09-25 11:53:17,071 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-09-25 11:53:17,071 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-09-25 11:53:17,071 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-09-25 11:53:17,071 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-09-25 11:53:17,071 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-09-25 11:53:17,072 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-09-25 11:53:17,072 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-09-25 11:53:17,072 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-09-25 11:53:17,072 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-09-25 11:53:17,072 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-09-25 11:53:17,072 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-09-25 11:53:17,072 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-09-25 11:53:17,072 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-09-25 11:53:17,072 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-09-25 11:53:17,072 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-09-25 11:53:17,072 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-09-25 11:53:17,072 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-09-25 11:53:17,072 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-09-25 11:53:17,072 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-09-25 11:53:17,072 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-09-25 11:53:17,072 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-09-25 11:53:17,072 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-09-25 11:53:17,072 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-09-25 11:53:17,072 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-09-25 11:53:17,072 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-09-25 11:53:17,072 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-09-25 11:53:17,072 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-09-25 11:53:17,073 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-09-25 11:53:17,073 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-09-25 11:53:17,073 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-09-25 11:53:17,073 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-09-25 11:53:17,073 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-09-25 11:53:17,073 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-09-25 11:53:17,073 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-09-25 11:53:17,073 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-09-25 11:53:17,073 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-09-25 11:53:17,073 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-09-25 11:53:17,073 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-09-25 11:53:17,073 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-09-25 11:53:17,073 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-09-25 11:53:17,073 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-09-25 11:53:17,073 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-09-25 11:53:17,073 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-09-25 11:53:17,073 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-09-25 11:53:17,073 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-09-25 11:53:17,073 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-09-25 11:53:17,073 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-09-25 11:53:17,073 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-09-25 11:53:17,073 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-09-25 11:53:17,074 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-09-25 11:53:17,074 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-09-25 11:53:17,074 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-09-25 11:53:17,074 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-09-25 11:53:17,074 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-09-25 11:53:17,074 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-09-25 11:53:17,074 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-09-25 11:53:17,074 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-09-25 11:53:17,074 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-09-25 11:53:17,074 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-09-25 11:53:17,074 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-09-25 11:53:17,074 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-09-25 11:53:17,074 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-09-25 11:53:17,074 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-09-25 11:53:17,074 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-09-25 11:53:17,074 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-09-25 11:53:17,074 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-09-25 11:53:17,074 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-09-25 11:53:17,074 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-09-25 11:53:17,074 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-09-25 11:53:17,074 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-09-25 11:53:17,074 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-09-25 11:53:17,075 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-09-25 11:53:17,075 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-09-25 11:53:17,075 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-09-25 11:53:17,075 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-09-25 11:53:17,075 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-09-25 11:53:17,075 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-09-25 11:53:17,075 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-09-25 11:53:17,075 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-09-25 11:53:17,075 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-09-25 11:53:17,075 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-09-25 11:53:17,075 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-09-25 11:53:17,075 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-09-25 11:53:17,075 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-09-25 11:53:17,182 INFO  [Time-limited test] balancer.StochasticLoadBalancer(381): Cluster wide - skipping load balancing because weighted average imbalance=7.979690117040589E-6 <= threshold(0.025). If you want more aggressive balancing, either lower hbase.master.balancer.stochastic.minCostNeedBalance from 0.025 or increase the relative multiplier(s) of the specific cost function(s). functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0017727200782610348); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-09-25 11:53:17,182 INFO  [Time-limited test] balancer.BalancerTestBase(570): Mock Final balance: { srv1579682951:83 , srv1586841202:83 , srv1961511808:83 , srv243769268:83 , srv332134089:83 , srv627531042:83 , srv792727674:83 , srv926120920:83 , srv966469547:83 , srv1026558377:84 , srv1041483581:84 , srv1050874743:84 , srv1078769884:84 , srv1118717485:84 , srv1155185051:84 , srv1172856204:84 , srv1184710096:84 , srv1196147371:84 , srv1211833356:84 , srv1245010003:84 , srv1255480243:84 , srv1255640868:84 , srv1334512029:84 , srv1342632469:84 , srv1351926855:84 , srv1362972119:84 , srv1367128793:84 , srv1379992247:84 , srv1386609996:84 , srv1398285579:84 , srv1426657453:84 , srv1432339172:84 , srv1454754608:84 , srv1464411632:84 , srv1484915107:84 , srv1493693542:84 , srv1495766136:84 , srv149930938:84 , srv1517876339:84 , srv1548108677:84 , srv1569964724:84 , srv1589163632:84 , srv165284858:84 , srv1660889057:84 , srv1670399538:84 , srv1731601188:84 , srv1790485616:84 , srv1802872335:84 , srv1837456038:84 , srv188827884:84 , srv1896115926:84 , srv1904805202:84 , srv1920289450:84 , srv1944141250:84 , srv1992805905:84 , srv2023400777:84 , srv2033790168:84 , srv2063311825:84 , srv208844920:84 , srv2115243485:84 , srv2142076752:84 , srv234753299:84 , srv256219958:84 , srv312620354:84 , srv314147771:84 , srv33089391:84 , srv35894698:84 , srv367224889:84 , srv461574461:84 , srv488087581:84 , srv493874881:84 , srv524723680:84 , srv528363552:84 , srv554109915:84 , srv587822645:84 , srv644152082:84 , srv671889373:84 , srv676865671:84 , srv692564399:84 , srv697082840:84 , srv697404721:84 , srv706883270:84 , srv724676823:84 , srv745677466:84 , srv748909318:84 , srv760263208:84 , srv784696515:84 , srv82587541:84 , srv865670415:84 , srv902939161:84 , srv1046339861:85 , srv1328516440:85 , srv1543576176:85 , srv1614477886:85 , srv1730845034:85 , srv1949611332:85 , srv2065515341:85 , srv609881564:85 , srv99906518:85 , srv676235752:684 }
2023-09-25 11:53:17,205 INFO  [Time-limited test] hbase.ResourceChecker(175): after: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnLargeClusterWithRacks Thread=12 (was 12), OpenFileDescriptor=263 (was 263), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=274 (was 274), ProcessCount=169 (was 169), AvailableMemoryMB=8776 (was 9392)
2023-09-25 11:53:17,213 INFO  [Time-limited test] hbase.ResourceChecker(147): before: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnMidClusterWithRacks Thread=12, OpenFileDescriptor=263, MaxFileDescriptor=60000, SystemLoadAverage=274, ProcessCount=169, AvailableMemoryMB=8776
2023-09-25 11:53:17,214 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2023-09-25 11:53:17,214 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=5000, runMaxSteps=true, stepsPerRegion=800, maxRunningTime=120000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 111077.0 etc.
2023-09-25 11:53:17,222 INFO  [Time-limited test] balancer.BalancerTestBase(547): Mock Cluster : { srv1005576083:84 , srv1026512250:84 , srv1074064540:84 , srv1220737229:84 , srv1310884227:84 , srv1440671537:84 , srv1510178975:84 , srv1518043354:84 , srv1546680936:84 , srv1623482082:84 , srv1813087733:84 , srv1932901418:84 , srv2108342629:84 , srv214287112:84 , srv261994038:84 , srv308350264:84 , srv324871373:84 , srv419811203:84 , srv495997213:84 , srv501544087:84 , srv526398584:84 , srv566538428:84 , srv677267188:84 , srv688570639:84 , srv718776894:84 , srv724765024:84 , srv778159666:84 , srv854340470:84 , srv89834717:84 , srv178949198:264 } [srvr=30 rgns=2700 avg=90.0 max=90 min=90]
2023-09-25 11:53:17,223 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-09-25 11:53:17,224 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv724765024=26, srv214287112=14, srv1005576083=0, srv2108342629=13, srv778159666=27, srv1074064540=2, srv324871373=17, srv1026512250=1, srv1440671537=5, srv178949198=10, srv1932901418=12, srv1510178975=6, srv501544087=20, srv718776894=25, srv495997213=19, srv1220737229=3, srv1518043354=7, srv854340470=28, srv89834717=29, srv566538428=22, srv1310884227=4, srv1546680936=8, srv688570639=24, srv677267188=23, srv1623482082=9, srv526398584=21, srv308350264=16, srv419811203=18, srv261994038=15, srv1813087733=11} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-09-25 11:53:17,231 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-09-25 11:53:17,231 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-09-25 11:53:17,231 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-09-25 11:53:17,231 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-09-25 11:53:17,231 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-09-25 11:53:17,231 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-09-25 11:53:17,231 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-09-25 11:53:17,232 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-09-25 11:53:17,232 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-09-25 11:53:17,232 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-09-25 11:53:17,232 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-09-25 11:53:17,232 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-09-25 11:53:17,232 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-09-25 11:53:17,232 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-09-25 11:53:17,232 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-09-25 11:53:17,232 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-09-25 11:53:17,232 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-09-25 11:53:17,232 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-09-25 11:53:17,232 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-09-25 11:53:17,232 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-09-25 11:53:17,232 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-09-25 11:53:17,232 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-09-25 11:53:17,232 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-09-25 11:53:17,232 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-09-25 11:53:17,232 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-09-25 11:53:17,232 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-09-25 11:53:17,232 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-09-25 11:53:17,232 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-09-25 11:53:17,232 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-09-25 11:53:17,232 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-09-25 11:53:17,233 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=10, number of hosts=30, number of racks=4
2023-09-25 11:53:17,248 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=1.1092337309429043, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-09-25 11:53:17,249 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.9912537235183672, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=1.1092337309429043, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=64800000
2023-09-25 11:55:17,235 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 120001 ms to try 5405622 different iterations.  Found a solution that moves 1848 regions; Going from a computed imbalance of 0.9912537235183672 to a new imbalance of 4.313324190526491E-5. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); MoveCostFunction : (multiplier=7.0, imbalance=0.6844444444444444, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-09-25 11:55:17,241 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1005576083:90 , srv1026512250:90 , srv1074064540:90 , srv1220737229:90 , srv1310884227:90 , srv1440671537:90 , srv1510178975:90 , srv1518043354:90 , srv1546680936:90 , srv1623482082:90 , srv178949198:90 , srv1813087733:90 , srv1932901418:90 , srv2108342629:90 , srv214287112:90 , srv261994038:90 , srv308350264:90 , srv324871373:90 , srv419811203:90 , srv495997213:90 , srv501544087:90 , srv526398584:90 , srv566538428:90 , srv677267188:90 , srv688570639:90 , srv718776894:90 , srv724765024:90 , srv778159666:90 , srv854340470:90 , srv89834717:90 }
2023-09-25 11:55:17,242 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-09-25 11:55:17,242 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv724765024=26, srv214287112=14, srv1005576083=0, srv2108342629=13, srv778159666=27, srv1074064540=2, srv324871373=17, srv1026512250=1, srv1440671537=5, srv178949198=10, srv1932901418=12, srv1510178975=6, srv501544087=20, srv718776894=25, srv495997213=19, srv1220737229=3, srv1518043354=7, srv854340470=28, srv89834717=29, srv566538428=22, srv1310884227=4, srv1546680936=8, srv688570639=24, srv677267188=23, srv1623482082=9, srv526398584=21, srv308350264=16, srv419811203=18, srv261994038=15, srv1813087733=11} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-09-25 11:55:17,245 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-09-25 11:55:17,245 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-09-25 11:55:17,245 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-09-25 11:55:17,245 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-09-25 11:55:17,245 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-09-25 11:55:17,245 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-09-25 11:55:17,245 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-09-25 11:55:17,245 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-09-25 11:55:17,245 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-09-25 11:55:17,245 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-09-25 11:55:17,245 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-09-25 11:55:17,246 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-09-25 11:55:17,246 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-09-25 11:55:17,246 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-09-25 11:55:17,246 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-09-25 11:55:17,246 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-09-25 11:55:17,246 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-09-25 11:55:17,246 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-09-25 11:55:17,246 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-09-25 11:55:17,246 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-09-25 11:55:17,246 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-09-25 11:55:17,246 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-09-25 11:55:17,246 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-09-25 11:55:17,246 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-09-25 11:55:17,246 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-09-25 11:55:17,246 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-09-25 11:55:17,246 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-09-25 11:55:17,246 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-09-25 11:55:17,246 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-09-25 11:55:17,246 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-09-25 11:55:17,246 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=10, number of hosts=30, number of racks=4
2023-09-25 11:55:17,258 INFO  [Time-limited test] balancer.StochasticLoadBalancer(381): Cluster wide - skipping load balancing because weighted average imbalance=0.0 <= threshold(0.025). If you want more aggressive balancing, either lower hbase.master.balancer.stochastic.minCostNeedBalance from 0.025 or increase the relative multiplier(s) of the specific cost function(s). functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-09-25 11:55:17,258 INFO  [Time-limited test] balancer.BalancerTestBase(570): Mock Final balance: { srv1005576083:90 , srv1026512250:90 , srv1074064540:90 , srv1220737229:90 , srv1310884227:90 , srv1440671537:90 , srv1510178975:90 , srv1518043354:90 , srv1546680936:90 , srv1623482082:90 , srv178949198:90 , srv1813087733:90 , srv1932901418:90 , srv2108342629:90 , srv214287112:90 , srv261994038:90 , srv308350264:90 , srv324871373:90 , srv419811203:90 , srv495997213:90 , srv501544087:90 , srv526398584:90 , srv566538428:90 , srv677267188:90 , srv688570639:90 , srv718776894:90 , srv724765024:90 , srv778159666:90 , srv854340470:90 , srv89834717:90 }
2023-09-25 11:55:17,270 INFO  [Time-limited test] hbase.ResourceChecker(175): after: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnMidClusterWithRacks Thread=11 (was 12), OpenFileDescriptor=263 (was 263), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=261 (was 274), ProcessCount=167 (was 169), AvailableMemoryMB=7531 (was 8776)