2023-11-05 00:58:07,495 INFO  [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks timeout: 13 mins
2023-11-05 00:58:07,729 WARN  [Time-limited test] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties
2023-11-05 00:58:07,823 INFO  [Time-limited test] metrics.MetricRegistriesLoader(60): Loaded MetricRegistries class org.apache.hadoop.hbase.metrics.impl.MetricRegistriesImpl
2023-11-05 00:58:07,876 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2023-11-05 00:58:07,882 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc.
2023-11-05 00:58:07,893 INFO  [Time-limited test] hbase.ResourceChecker(147): before: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnLargeClusterWithRacks Thread=12, OpenFileDescriptor=290, MaxFileDescriptor=60000, SystemLoadAverage=267, ProcessCount=168, AvailableMemoryMB=9124
2023-11-05 00:58:07,896 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2023-11-05 00:58:07,896 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=5000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=10000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc.
2023-11-05 00:58:08,004 INFO  [Time-limited test] balancer.BalancerTestBase(547): Mock Cluster : { srv1088494516:84 , srv1130979536:84 , srv119592453:84 , srv119972549:84 , srv1201301211:84 , srv1232977714:84 , srv1261120859:84 , srv1272471313:84 , srv1284693285:84 , srv1292185001:84 , srv1312711425:84 , srv1316562889:84 , srv1356492409:84 , srv1375377744:84 , srv1376721358:84 , srv1376911668:84 , srv1423245258:84 , srv1435381662:84 , srv1436713281:84 , srv144650104:84 , srv1450138157:84 , srv1478267571:84 , srv1484306495:84 , srv1501018527:84 , srv1514593748:84 , srv1514791407:84 , srv1523057115:84 , srv1558300196:84 , srv1648057414:84 , srv1665675399:84 , srv1678177888:84 , srv1689270971:84 , srv1694923642:84 , srv1706225551:84 , srv1710644681:84 , srv1716247977:84 , srv1725653755:84 , srv1739234266:84 , srv1739319604:84 , srv177040747:84 , srv1788107986:84 , srv1788515144:84 , srv1821496641:84 , srv1833245018:84 , srv1837830005:84 , srv1860430638:84 , srv1891063474:84 , srv1892036282:84 , srv1917307432:84 , srv1919277491:84 , srv1924940367:84 , srv1950328229:84 , srv2016911973:84 , srv2028297324:84 , srv2033111334:84 , srv2060797204:84 , srv2084266654:84 , srv2129200165:84 , srv230793378:84 , srv244520347:84 , srv268066495:84 , srv269091884:84 , srv272060665:84 , srv277220532:84 , srv290465973:84 , srv304352943:84 , srv313576972:84 , srv319183283:84 , srv331953567:84 , srv338525364:84 , srv35233274:84 , srv380461818:84 , srv42251639:84 , srv425800389:84 , srv442981683:84 , srv45296995:84 , srv456834845:84 , srv518083428:84 , srv519330144:84 , srv555916687:84 , srv556793772:84 , srv667184683:84 , srv693126974:84 , srv694637135:84 , srv728751360:84 , srv740145290:84 , srv763573698:84 , srv7675945:84 , srv782979292:84 , srv850874880:84 , srv884378502:84 , srv902476708:84 , srv918008094:84 , srv934386912:84 , srv958931334:84 , srv96624660:84 , srv966514640:84 , srv970615407:84 , srv972263868:84 , srv888486914:684 } [srvr=100 rgns=9000 avg=90.0 max=90 min=90]
2023-11-05 00:58:08,011 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-11-05 00:58:08,018 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1950328229=51, srv1514791407=25, srv1284693285=8, srv42251639=72, srv425800389=73, srv268066495=60, srv290465973=64, srv442981683=74, srv694637135=83, srv1694923642=32, srv519330144=78, srv1665675399=29, srv1088494516=0, srv740145290=85, srv338525364=69, srv1678177888=30, srv1558300196=27, srv230793378=58, srv2129200165=57, srv272060665=62, srv1376721358=14, srv1356492409=12, srv1860430638=45, srv1375377744=13, srv119972549=3, srv1788107986=40, srv518083428=77, srv958931334=95, srv1706225551=33, srv728751360=84, srv269091884=61, srv1716247977=35, srv1725653755=36, srv2028297324=53, srv2033111334=54, srv693126974=82, srv934386912=94, srv96624660=96, srv1924940367=50, srv970615407=98, srv1130979536=1, srv1833245018=43, srv1423245258=16, srv667184683=81, srv45296995=75, srv1710644681=34, srv1837830005=44, srv456834845=76, srv7675945=87, srv782979292=88, srv1919277491=49, srv380461818=71, srv1292185001=9, srv277220532=63, srv177040747=39, srv1501018527=23, srv1436713281=18, srv1478267571=21, srv1450138157=20, srv1739319604=38, srv313576972=66, srv555916687=79, srv1316562889=11, srv850874880=89, srv1232977714=5, srv972263868=99, srv763573698=86, srv1892036282=47, srv1376911668=15, srv1484306495=22, srv35233274=70, srv1201301211=4, srv304352943=65, srv2016911973=52, srv1272471313=7, srv1523057115=26, srv1739234266=37, srv1648057414=28, srv918008094=93, srv888486914=91, srv319183283=67, srv556793772=80, srv1689270971=31, srv1435381662=17, srv244520347=59, srv1917307432=48, srv144650104=19, srv2060797204=55, srv884378502=90, srv119592453=2, srv1788515144=41, srv1891063474=46, srv331953567=68, srv2084266654=56, srv1514593748=24, srv1821496641=42, srv1261120859=6, srv902476708=92, srv966514640=97, srv1312711425=10} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-11-05 00:58:08,079 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-11-05 00:58:08,080 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-11-05 00:58:08,080 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-11-05 00:58:08,080 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-11-05 00:58:08,080 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-11-05 00:58:08,080 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-11-05 00:58:08,080 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-11-05 00:58:08,080 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-11-05 00:58:08,080 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-11-05 00:58:08,080 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-11-05 00:58:08,081 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-11-05 00:58:08,081 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-11-05 00:58:08,081 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-11-05 00:58:08,081 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-11-05 00:58:08,081 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-11-05 00:58:08,081 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-11-05 00:58:08,081 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-11-05 00:58:08,081 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-11-05 00:58:08,081 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-11-05 00:58:08,081 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-11-05 00:58:08,082 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-11-05 00:58:08,082 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-11-05 00:58:08,082 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-11-05 00:58:08,082 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-11-05 00:58:08,082 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-11-05 00:58:08,082 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-11-05 00:58:08,082 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-11-05 00:58:08,082 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-11-05 00:58:08,082 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-11-05 00:58:08,082 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-11-05 00:58:08,082 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-11-05 00:58:08,083 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-11-05 00:58:08,083 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-11-05 00:58:08,083 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-11-05 00:58:08,083 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-11-05 00:58:08,083 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-11-05 00:58:08,083 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-11-05 00:58:08,083 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-11-05 00:58:08,083 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-11-05 00:58:08,083 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-11-05 00:58:08,083 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-11-05 00:58:08,084 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-11-05 00:58:08,084 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-11-05 00:58:08,084 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-11-05 00:58:08,084 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-11-05 00:58:08,084 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-11-05 00:58:08,084 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-11-05 00:58:08,084 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-11-05 00:58:08,084 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-11-05 00:58:08,084 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-11-05 00:58:08,084 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-11-05 00:58:08,085 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-11-05 00:58:08,085 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-11-05 00:58:08,085 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-11-05 00:58:08,085 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-11-05 00:58:08,085 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-11-05 00:58:08,085 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-11-05 00:58:08,085 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-11-05 00:58:08,085 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-11-05 00:58:08,085 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-11-05 00:58:08,085 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-11-05 00:58:08,085 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-11-05 00:58:08,086 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-11-05 00:58:08,086 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-11-05 00:58:08,086 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-11-05 00:58:08,086 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-11-05 00:58:08,086 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-11-05 00:58:08,086 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-11-05 00:58:08,086 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-11-05 00:58:08,086 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-11-05 00:58:08,086 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-11-05 00:58:08,086 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-11-05 00:58:08,087 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-11-05 00:58:08,087 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-11-05 00:58:08,087 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-11-05 00:58:08,087 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-11-05 00:58:08,087 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-11-05 00:58:08,087 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-11-05 00:58:08,087 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-11-05 00:58:08,087 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-11-05 00:58:08,087 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-11-05 00:58:08,087 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-11-05 00:58:08,087 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-11-05 00:58:08,087 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-11-05 00:58:08,088 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-11-05 00:58:08,088 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-11-05 00:58:08,088 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-11-05 00:58:08,088 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-11-05 00:58:08,088 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-11-05 00:58:08,088 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-11-05 00:58:08,088 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-11-05 00:58:08,088 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-11-05 00:58:08,088 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-11-05 00:58:08,088 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-11-05 00:58:08,088 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-11-05 00:58:08,088 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-11-05 00:58:08,089 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-11-05 00:58:08,089 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-11-05 00:58:08,089 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-11-05 00:58:08,089 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-11-05 00:58:08,089 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-11-05 00:58:08,356 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.06666666666666667, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-11-05 00:58:08,356 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-11-05 00:58:08,356 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.9909252140407105, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.06666666666666667, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-11-05 00:58:08,625 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 516 ms to try 5000 different iterations.  Found a solution that moves 4694 regions; Going from a computed imbalance of 0.9909252140407105 to a new imbalance of 0.179329768877282. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.041157040500877505, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.05748566404998935, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.5215555555555556, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.041157040500877505, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.17416666666666666, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.24483333333333332, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-11-05 00:58:08,637 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv119972549:82 , srv1356492409:82 , srv850874880:82 , srv1232977714:83 , srv1284693285:83 , srv1292185001:83 , srv1501018527:83 , srv2060797204:83 , srv2129200165:83 , srv290465973:83 , srv338525364:83 , srv667184683:83 , srv7675945:83 , srv966514640:83 , srv1316562889:84 , srv1423245258:84 , srv1678177888:84 , srv1706225551:84 , srv1891063474:84 , srv1919277491:84 , srv2016911973:84 , srv230793378:84 , srv269091884:84 , srv1261120859:85 , srv1312711425:85 , srv1436713281:85 , srv1917307432:85 , srv1950328229:85 , srv2084266654:85 , srv313576972:85 , srv35233274:85 , srv425800389:85 , srv693126974:85 , srv740145290:85 , srv763573698:85 , srv902476708:85 , srv918008094:85 , srv96624660:85 , srv1088494516:86 , srv1130979536:86 , srv1375377744:86 , srv1376721358:86 , srv1376911668:86 , srv1648057414:86 , srv1739234266:86 , srv1837830005:86 , srv272060665:86 , srv277220532:86 , srv319183283:86 , srv456834845:86 , srv518083428:86 , srv555916687:86 , srv556793772:86 , srv694637135:86 , srv1201301211:87 , srv1710644681:87 , srv1725653755:87 , srv177040747:87 , srv1833245018:87 , srv1860430638:87 , srv2028297324:87 , srv2033111334:87 , srv244520347:87 , srv304352943:87 , srv380461818:87 , srv42251639:87 , srv728751360:87 , srv958931334:87 , srv1272471313:88 , srv1435381662:88 , srv144650104:88 , srv1558300196:88 , srv1716247977:88 , srv1788107986:88 , srv1924940367:88 , srv268066495:88 , srv331953567:88 , srv442981683:88 , srv45296995:88 , srv519330144:88 , srv972263868:88 , srv1450138157:89 , srv1514593748:89 , srv1523057115:89 , srv1665675399:89 , srv1689270971:89 , srv1739319604:89 , srv1788515144:89 , srv1821496641:89 , srv119592453:90 , srv1478267571:90 , srv1484306495:90 , srv1514791407:90 , srv884378502:90 , srv934386912:90 , srv970615407:90 , srv1694923642:91 , srv782979292:91 , srv1892036282:92 , srv888486914:456 }
2023-11-05 00:58:08,641 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-11-05 00:58:08,642 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1950328229=51, srv1514791407=25, srv1284693285=8, srv42251639=72, srv425800389=73, srv268066495=60, srv290465973=64, srv442981683=74, srv694637135=83, srv1694923642=32, srv519330144=78, srv1665675399=29, srv1088494516=0, srv740145290=85, srv338525364=69, srv1678177888=30, srv1558300196=27, srv230793378=58, srv2129200165=57, srv272060665=62, srv1376721358=14, srv1356492409=12, srv1860430638=45, srv1375377744=13, srv119972549=3, srv1788107986=40, srv518083428=77, srv958931334=95, srv1706225551=33, srv728751360=84, srv269091884=61, srv1716247977=35, srv1725653755=36, srv2028297324=53, srv2033111334=54, srv693126974=82, srv934386912=94, srv96624660=96, srv1924940367=50, srv970615407=98, srv1130979536=1, srv1833245018=43, srv1423245258=16, srv667184683=81, srv45296995=75, srv1710644681=34, srv1837830005=44, srv456834845=76, srv7675945=87, srv782979292=88, srv1919277491=49, srv380461818=71, srv1292185001=9, srv277220532=63, srv177040747=39, srv1501018527=23, srv1436713281=18, srv1478267571=21, srv1450138157=20, srv1739319604=38, srv313576972=66, srv555916687=79, srv1316562889=11, srv850874880=89, srv1232977714=5, srv972263868=99, srv763573698=86, srv1892036282=47, srv1376911668=15, srv1484306495=22, srv35233274=70, srv1201301211=4, srv304352943=65, srv2016911973=52, srv1272471313=7, srv1523057115=26, srv1739234266=37, srv1648057414=28, srv918008094=93, srv888486914=91, srv319183283=67, srv556793772=80, srv1689270971=31, srv1435381662=17, srv244520347=59, srv1917307432=48, srv144650104=19, srv2060797204=55, srv884378502=90, srv119592453=2, srv1788515144=41, srv1891063474=46, srv331953567=68, srv2084266654=56, srv1514593748=24, srv1821496641=42, srv1261120859=6, srv902476708=92, srv966514640=97, srv1312711425=10} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-11-05 00:58:08,655 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-11-05 00:58:08,655 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-11-05 00:58:08,655 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-11-05 00:58:08,655 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-11-05 00:58:08,655 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-11-05 00:58:08,655 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-11-05 00:58:08,655 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-11-05 00:58:08,655 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-11-05 00:58:08,656 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-11-05 00:58:08,656 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-11-05 00:58:08,656 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-11-05 00:58:08,656 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-11-05 00:58:08,656 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-11-05 00:58:08,656 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-11-05 00:58:08,656 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-11-05 00:58:08,656 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-11-05 00:58:08,656 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-11-05 00:58:08,656 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-11-05 00:58:08,656 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-11-05 00:58:08,656 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-11-05 00:58:08,656 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-11-05 00:58:08,657 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-11-05 00:58:08,657 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-11-05 00:58:08,657 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-11-05 00:58:08,657 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-11-05 00:58:08,657 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-11-05 00:58:08,657 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-11-05 00:58:08,657 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-11-05 00:58:08,657 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-11-05 00:58:08,657 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-11-05 00:58:08,657 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-11-05 00:58:08,657 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-11-05 00:58:08,657 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-11-05 00:58:08,657 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-11-05 00:58:08,657 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-11-05 00:58:08,658 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-11-05 00:58:08,658 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-11-05 00:58:08,658 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-11-05 00:58:08,658 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-11-05 00:58:08,658 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-11-05 00:58:08,658 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-11-05 00:58:08,658 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-11-05 00:58:08,658 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-11-05 00:58:08,658 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-11-05 00:58:08,658 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-11-05 00:58:08,658 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-11-05 00:58:08,658 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-11-05 00:58:08,658 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-11-05 00:58:08,658 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-11-05 00:58:08,659 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-11-05 00:58:08,659 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-11-05 00:58:08,659 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-11-05 00:58:08,659 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-11-05 00:58:08,659 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-11-05 00:58:08,659 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-11-05 00:58:08,659 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-11-05 00:58:08,659 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-11-05 00:58:08,659 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-11-05 00:58:08,659 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-11-05 00:58:08,659 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-11-05 00:58:08,659 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-11-05 00:58:08,659 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-11-05 00:58:08,659 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-11-05 00:58:08,660 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-11-05 00:58:08,660 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-11-05 00:58:08,660 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-11-05 00:58:08,660 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-11-05 00:58:08,660 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-11-05 00:58:08,660 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-11-05 00:58:08,660 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-11-05 00:58:08,660 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-11-05 00:58:08,660 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-11-05 00:58:08,660 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-11-05 00:58:08,660 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-11-05 00:58:08,660 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-11-05 00:58:08,660 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-11-05 00:58:08,660 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-11-05 00:58:08,661 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-11-05 00:58:08,661 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-11-05 00:58:08,661 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-11-05 00:58:08,661 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-11-05 00:58:08,661 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-11-05 00:58:08,661 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-11-05 00:58:08,661 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-11-05 00:58:08,661 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-11-05 00:58:08,661 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-11-05 00:58:08,661 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-11-05 00:58:08,661 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-11-05 00:58:08,661 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-11-05 00:58:08,661 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-11-05 00:58:08,661 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-11-05 00:58:08,661 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-11-05 00:58:08,662 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-11-05 00:58:08,662 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-11-05 00:58:08,662 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-11-05 00:58:08,662 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-11-05 00:58:08,662 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-11-05 00:58:08,662 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-11-05 00:58:08,662 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-11-05 00:58:08,662 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-11-05 00:58:08,662 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-11-05 00:58:08,763 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.041157040500877505, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.05748566404998935, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.041157040500877505, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.17416666666666666, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.24483333333333332, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-11-05 00:58:08,763 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-11-05 00:58:08,763 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.1792969007867782, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.041157040500877505, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.05748566404998935, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.041157040500877505, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.17416666666666666, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.24483333333333332, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-11-05 00:58:08,928 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 249 ms to try 5000 different iterations.  Found a solution that moves 2688 regions; Going from a computed imbalance of 0.1792969007867782 to a new imbalance of 0.016850100639639015. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.021052846527870064); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0332760450468778, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.2986666666666667, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.021052846527870064); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.013666666666666667); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0475, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-11-05 00:58:08,939 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1694923642:80 , srv1450138157:81 , srv1478267571:81 , srv1665675399:81 , srv1821496641:81 , srv1892036282:81 , srv1514791407:82 , srv1689270971:82 , srv884378502:82 , srv972263868:82 , srv1788515144:83 , srv1833245018:83 , srv268066495:83 , srv380461818:83 , srv519330144:83 , srv782979292:83 , srv970615407:83 , srv1088494516:84 , srv1201301211:84 , srv1272471313:84 , srv1375377744:84 , srv144650104:84 , srv1484306495:84 , srv1514593748:84 , srv1558300196:84 , srv1739319604:84 , srv1788107986:84 , srv1924940367:84 , srv244520347:84 , srv272060665:84 , srv304352943:84 , srv331953567:84 , srv456834845:84 , srv958931334:84 , srv96624660:84 , srv1130979536:85 , srv1435381662:85 , srv1523057115:85 , srv1950328229:85 , srv2028297324:85 , srv277220532:85 , srv442981683:85 , srv45296995:85 , srv555916687:85 , srv694637135:85 , srv934386912:85 , srv119592453:86 , srv1261120859:86 , srv1312711425:86 , srv1316562889:86 , srv1423245258:86 , srv1710644681:86 , srv1716247977:86 , srv1739234266:86 , srv177040747:86 , srv1837830005:86 , srv313576972:86 , srv35233274:86 , srv556793772:86 , srv728751360:86 , srv1376721358:87 , srv1376911668:87 , srv1648057414:87 , srv1725653755:87 , srv1917307432:87 , srv1919277491:87 , srv2016911973:87 , srv2033111334:87 , srv425800389:87 , srv518083428:87 , srv918008094:87 , srv1284693285:88 , srv1436713281:88 , srv1678177888:88 , srv1891063474:88 , srv2129200165:88 , srv230793378:88 , srv269091884:88 , srv319183283:88 , srv693126974:88 , srv763573698:88 , srv902476708:88 , srv119972549:89 , srv1232977714:89 , srv1501018527:89 , srv1860430638:89 , srv2084266654:89 , srv338525364:89 , srv42251639:89 , srv667184683:89 , srv740145290:89 , srv7675945:89 , srv1292185001:90 , srv1706225551:90 , srv2060797204:90 , srv850874880:90 , srv966514640:90 , srv1356492409:92 , srv290465973:93 , srv888486914:505 }
2023-11-05 00:58:08,945 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-11-05 00:58:08,946 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1950328229=51, srv1514791407=25, srv1284693285=8, srv42251639=72, srv425800389=73, srv268066495=60, srv290465973=64, srv442981683=74, srv694637135=83, srv1694923642=32, srv519330144=78, srv1665675399=29, srv1088494516=0, srv740145290=85, srv338525364=69, srv1678177888=30, srv1558300196=27, srv230793378=58, srv2129200165=57, srv272060665=62, srv1376721358=14, srv1356492409=12, srv1860430638=45, srv1375377744=13, srv119972549=3, srv1788107986=40, srv518083428=77, srv958931334=95, srv1706225551=33, srv728751360=84, srv269091884=61, srv1716247977=35, srv1725653755=36, srv2028297324=53, srv2033111334=54, srv693126974=82, srv934386912=94, srv96624660=96, srv1924940367=50, srv970615407=98, srv1130979536=1, srv1833245018=43, srv1423245258=16, srv667184683=81, srv45296995=75, srv1710644681=34, srv1837830005=44, srv456834845=76, srv7675945=87, srv782979292=88, srv1919277491=49, srv380461818=71, srv1292185001=9, srv277220532=63, srv177040747=39, srv1501018527=23, srv1436713281=18, srv1478267571=21, srv1450138157=20, srv1739319604=38, srv313576972=66, srv555916687=79, srv1316562889=11, srv850874880=89, srv1232977714=5, srv972263868=99, srv763573698=86, srv1892036282=47, srv1376911668=15, srv1484306495=22, srv35233274=70, srv1201301211=4, srv304352943=65, srv2016911973=52, srv1272471313=7, srv1523057115=26, srv1739234266=37, srv1648057414=28, srv918008094=93, srv888486914=91, srv319183283=67, srv556793772=80, srv1689270971=31, srv1435381662=17, srv244520347=59, srv1917307432=48, srv144650104=19, srv2060797204=55, srv884378502=90, srv119592453=2, srv1788515144=41, srv1891063474=46, srv331953567=68, srv2084266654=56, srv1514593748=24, srv1821496641=42, srv1261120859=6, srv902476708=92, srv966514640=97, srv1312711425=10} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-11-05 00:58:08,970 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-11-05 00:58:08,970 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-11-05 00:58:08,970 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-11-05 00:58:08,970 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-11-05 00:58:08,970 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-11-05 00:58:08,970 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-11-05 00:58:08,970 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-11-05 00:58:08,971 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-11-05 00:58:08,971 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-11-05 00:58:08,971 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-11-05 00:58:08,971 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-11-05 00:58:08,971 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-11-05 00:58:08,971 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-11-05 00:58:08,971 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-11-05 00:58:08,971 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-11-05 00:58:08,971 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-11-05 00:58:08,972 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-11-05 00:58:08,972 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-11-05 00:58:08,972 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-11-05 00:58:08,972 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-11-05 00:58:08,972 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-11-05 00:58:08,972 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-11-05 00:58:08,972 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-11-05 00:58:08,972 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-11-05 00:58:08,973 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-11-05 00:58:08,973 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-11-05 00:58:08,973 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-11-05 00:58:08,973 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-11-05 00:58:08,973 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-11-05 00:58:08,973 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-11-05 00:58:08,973 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-11-05 00:58:08,973 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-11-05 00:58:08,974 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-11-05 00:58:08,974 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-11-05 00:58:08,974 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-11-05 00:58:08,974 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-11-05 00:58:08,974 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-11-05 00:58:08,974 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-11-05 00:58:08,974 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-11-05 00:58:08,975 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-11-05 00:58:08,975 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-11-05 00:58:08,975 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-11-05 00:58:08,975 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-11-05 00:58:08,975 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-11-05 00:58:08,975 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-11-05 00:58:08,975 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-11-05 00:58:08,975 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-11-05 00:58:08,976 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-11-05 00:58:08,976 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-11-05 00:58:08,976 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-11-05 00:58:08,976 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-11-05 00:58:08,976 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-11-05 00:58:08,976 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-11-05 00:58:08,976 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-11-05 00:58:08,976 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-11-05 00:58:08,976 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-11-05 00:58:08,977 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-11-05 00:58:08,977 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-11-05 00:58:08,977 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-11-05 00:58:08,977 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-11-05 00:58:08,977 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-11-05 00:58:08,977 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-11-05 00:58:08,977 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-11-05 00:58:08,977 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-11-05 00:58:08,977 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-11-05 00:58:08,978 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-11-05 00:58:08,978 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-11-05 00:58:08,978 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-11-05 00:58:08,978 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-11-05 00:58:08,978 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-11-05 00:58:08,978 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-11-05 00:58:08,978 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-11-05 00:58:08,978 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-11-05 00:58:08,978 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-11-05 00:58:08,978 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-11-05 00:58:08,979 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-11-05 00:58:08,979 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-11-05 00:58:08,979 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-11-05 00:58:08,979 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-11-05 00:58:08,979 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-11-05 00:58:08,979 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-11-05 00:58:08,979 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-11-05 00:58:08,979 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-11-05 00:58:08,979 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-11-05 00:58:08,979 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-11-05 00:58:08,980 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-11-05 00:58:08,980 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-11-05 00:58:08,980 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-11-05 00:58:08,980 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-11-05 00:58:08,980 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-11-05 00:58:08,980 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-11-05 00:58:08,980 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-11-05 00:58:08,980 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-11-05 00:58:08,980 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-11-05 00:58:08,980 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-11-05 00:58:08,981 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-11-05 00:58:08,981 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-11-05 00:58:08,981 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-11-05 00:58:08,981 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-11-05 00:58:08,981 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-11-05 00:58:08,981 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-11-05 00:58:09,084 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.021052846527870064); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0332760450468778, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.021052846527870064); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.013666666666666667); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0475, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-11-05 00:58:09,085 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-11-05 00:58:09,085 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.01683127886135308, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.021052846527870064); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0332760450468778, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.021052846527870064); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.013666666666666667); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0475, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-11-05 00:58:09,238 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 238 ms to try 5000 different iterations.  Found a solution that moves 989 regions; Going from a computed imbalance of 0.01683127886135308 to a new imbalance of 6.401068497922667E-4. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0046528039515487405); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.005685352436149611); MoveCostFunction : (multiplier=7.0, imbalance=0.10988888888888888, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0046528039515487405); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=2.5E-4); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.004); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-11-05 00:58:09,240 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1860430638:81 , srv119592453:82 , srv290465973:82 , srv42251639:82 , srv1356492409:83 , srv1523057115:83 , srv1725653755:83 , srv319183283:83 , srv782979292:83 , srv934386912:83 , srv1232977714:84 , srv1376721358:84 , srv1376911668:84 , srv1484306495:84 , srv1514593748:84 , srv1648057414:84 , srv1716247977:84 , srv1739319604:84 , srv2033111334:84 , srv2060797204:84 , srv2084266654:84 , srv442981683:84 , srv45296995:84 , srv740145290:84 , srv966514640:84 , srv1272471313:85 , srv1292185001:85 , srv1435381662:85 , srv1436713281:85 , srv1514791407:85 , srv1678177888:85 , srv1706225551:85 , srv1710644681:85 , srv177040747:85 , srv1788107986:85 , srv1788515144:85 , srv1892036282:85 , srv1917307432:85 , srv1924940367:85 , srv331953567:85 , srv338525364:85 , srv425800389:85 , srv518083428:85 , srv556793772:85 , srv693126974:85 , srv728751360:85 , srv850874880:85 , srv884378502:85 , srv902476708:85 , srv970615407:85 , srv119972549:86 , srv1261120859:86 , srv144650104:86 , srv1501018527:86 , srv1558300196:86 , srv1689270971:86 , srv1694923642:86 , srv1739234266:86 , srv1891063474:86 , srv2028297324:86 , srv2129200165:86 , srv230793378:86 , srv244520347:86 , srv268066495:86 , srv269091884:86 , srv277220532:86 , srv667184683:86 , srv694637135:86 , srv763573698:86 , srv7675945:86 , srv918008094:86 , srv958931334:86 , srv1088494516:87 , srv1201301211:87 , srv1284693285:87 , srv1375377744:87 , srv1450138157:87 , srv1478267571:87 , srv1837830005:87 , srv1919277491:87 , srv2016911973:87 , srv304352943:87 , srv313576972:87 , srv35233274:87 , srv380461818:87 , srv456834845:87 , srv519330144:87 , srv555916687:87 , srv972263868:87 , srv1130979536:88 , srv1312711425:88 , srv1316562889:88 , srv1423245258:88 , srv1821496641:88 , srv1833245018:88 , srv1950328229:88 , srv272060665:88 , srv96624660:88 , srv1665675399:89 , srv888486914:538 }
2023-11-05 00:58:09,244 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-11-05 00:58:09,244 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1950328229=51, srv1514791407=25, srv1284693285=8, srv42251639=72, srv425800389=73, srv268066495=60, srv290465973=64, srv442981683=74, srv694637135=83, srv1694923642=32, srv519330144=78, srv1665675399=29, srv1088494516=0, srv740145290=85, srv338525364=69, srv1678177888=30, srv1558300196=27, srv230793378=58, srv2129200165=57, srv272060665=62, srv1376721358=14, srv1356492409=12, srv1860430638=45, srv1375377744=13, srv119972549=3, srv1788107986=40, srv518083428=77, srv958931334=95, srv1706225551=33, srv728751360=84, srv269091884=61, srv1716247977=35, srv1725653755=36, srv2028297324=53, srv2033111334=54, srv693126974=82, srv934386912=94, srv96624660=96, srv1924940367=50, srv970615407=98, srv1130979536=1, srv1833245018=43, srv1423245258=16, srv667184683=81, srv45296995=75, srv1710644681=34, srv1837830005=44, srv456834845=76, srv7675945=87, srv782979292=88, srv1919277491=49, srv380461818=71, srv1292185001=9, srv277220532=63, srv177040747=39, srv1501018527=23, srv1436713281=18, srv1478267571=21, srv1450138157=20, srv1739319604=38, srv313576972=66, srv555916687=79, srv1316562889=11, srv850874880=89, srv1232977714=5, srv972263868=99, srv763573698=86, srv1892036282=47, srv1376911668=15, srv1484306495=22, srv35233274=70, srv1201301211=4, srv304352943=65, srv2016911973=52, srv1272471313=7, srv1523057115=26, srv1739234266=37, srv1648057414=28, srv918008094=93, srv888486914=91, srv319183283=67, srv556793772=80, srv1689270971=31, srv1435381662=17, srv244520347=59, srv1917307432=48, srv144650104=19, srv2060797204=55, srv884378502=90, srv119592453=2, srv1788515144=41, srv1891063474=46, srv331953567=68, srv2084266654=56, srv1514593748=24, srv1821496641=42, srv1261120859=6, srv902476708=92, srv966514640=97, srv1312711425=10} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-11-05 00:58:09,253 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-11-05 00:58:09,254 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-11-05 00:58:09,254 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-11-05 00:58:09,254 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-11-05 00:58:09,254 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-11-05 00:58:09,254 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-11-05 00:58:09,254 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-11-05 00:58:09,254 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-11-05 00:58:09,254 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-11-05 00:58:09,254 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-11-05 00:58:09,254 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-11-05 00:58:09,254 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-11-05 00:58:09,254 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-11-05 00:58:09,254 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-11-05 00:58:09,254 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-11-05 00:58:09,254 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-11-05 00:58:09,254 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-11-05 00:58:09,255 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-11-05 00:58:09,255 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-11-05 00:58:09,255 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-11-05 00:58:09,255 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-11-05 00:58:09,255 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-11-05 00:58:09,255 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-11-05 00:58:09,255 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-11-05 00:58:09,255 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-11-05 00:58:09,255 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-11-05 00:58:09,255 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-11-05 00:58:09,255 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-11-05 00:58:09,255 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-11-05 00:58:09,255 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-11-05 00:58:09,255 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-11-05 00:58:09,255 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-11-05 00:58:09,255 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-11-05 00:58:09,255 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-11-05 00:58:09,256 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-11-05 00:58:09,256 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-11-05 00:58:09,256 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-11-05 00:58:09,256 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-11-05 00:58:09,256 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-11-05 00:58:09,256 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-11-05 00:58:09,256 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-11-05 00:58:09,256 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-11-05 00:58:09,256 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-11-05 00:58:09,256 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-11-05 00:58:09,256 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-11-05 00:58:09,256 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-11-05 00:58:09,256 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-11-05 00:58:09,256 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-11-05 00:58:09,256 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-11-05 00:58:09,256 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-11-05 00:58:09,257 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-11-05 00:58:09,257 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-11-05 00:58:09,257 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-11-05 00:58:09,257 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-11-05 00:58:09,257 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-11-05 00:58:09,257 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-11-05 00:58:09,257 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-11-05 00:58:09,257 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-11-05 00:58:09,257 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-11-05 00:58:09,257 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-11-05 00:58:09,257 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-11-05 00:58:09,257 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-11-05 00:58:09,257 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-11-05 00:58:09,257 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-11-05 00:58:09,257 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-11-05 00:58:09,257 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-11-05 00:58:09,257 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-11-05 00:58:09,258 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-11-05 00:58:09,258 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-11-05 00:58:09,258 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-11-05 00:58:09,258 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-11-05 00:58:09,258 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-11-05 00:58:09,258 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-11-05 00:58:09,258 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-11-05 00:58:09,258 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-11-05 00:58:09,258 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-11-05 00:58:09,258 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-11-05 00:58:09,258 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-11-05 00:58:09,258 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-11-05 00:58:09,258 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-11-05 00:58:09,258 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-11-05 00:58:09,258 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-11-05 00:58:09,258 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-11-05 00:58:09,258 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-11-05 00:58:09,258 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-11-05 00:58:09,258 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-11-05 00:58:09,259 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-11-05 00:58:09,259 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-11-05 00:58:09,259 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-11-05 00:58:09,259 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-11-05 00:58:09,259 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-11-05 00:58:09,259 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-11-05 00:58:09,259 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-11-05 00:58:09,259 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-11-05 00:58:09,259 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-11-05 00:58:09,259 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-11-05 00:58:09,259 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-11-05 00:58:09,259 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-11-05 00:58:09,259 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-11-05 00:58:09,259 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-11-05 00:58:09,259 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-11-05 00:58:09,344 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0046528039515487405); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.005685352436149611); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0046528039515487405); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=2.5E-4); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.004); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-11-05 00:58:09,344 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-11-05 00:58:09,345 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=6.331817237785805E-4, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0046528039515487405); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.005685352436149611); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0046528039515487405); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=2.5E-4); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.004); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-11-05 00:58:09,565 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 298 ms to try 5000 different iterations.  Found a solution that moves 250 regions; Going from a computed imbalance of 6.331817237785805E-4 to a new imbalance of 1.9163386804741038E-5. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=5.23782800878924E-4); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0016412198797244363); MoveCostFunction : (multiplier=7.0, imbalance=0.027777777777777776, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=5.23782800878924E-4); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=8.333333333333333E-5); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-11-05 00:58:09,566 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1130979536:83 , srv1312711425:83 , srv1316562889:83 , srv1501018527:83 , srv1665675399:83 , srv1706225551:83 , srv1837830005:83 , srv1950328229:83 , srv763573698:83 , srv119592453:84 , srv119972549:84 , srv1201301211:84 , srv1272471313:84 , srv1284693285:84 , srv1292185001:84 , srv1423245258:84 , srv1435381662:84 , srv1436713281:84 , srv144650104:84 , srv1478267571:84 , srv1484306495:84 , srv1558300196:84 , srv1716247977:84 , srv1739234266:84 , srv177040747:84 , srv1821496641:84 , srv1833245018:84 , srv1891063474:84 , srv1892036282:84 , srv2016911973:84 , srv2033111334:84 , srv2060797204:84 , srv2084266654:84 , srv230793378:84 , srv269091884:84 , srv272060665:84 , srv277220532:84 , srv290465973:84 , srv304352943:84 , srv313576972:84 , srv35233274:84 , srv380461818:84 , srv425800389:84 , srv45296995:84 , srv518083428:84 , srv519330144:84 , srv555916687:84 , srv693126974:84 , srv728751360:84 , srv740145290:84 , srv7675945:84 , srv902476708:84 , srv918008094:84 , srv934386912:84 , srv958931334:84 , srv970615407:84 , srv1088494516:85 , srv1261120859:85 , srv1375377744:85 , srv1376721358:85 , srv1376911668:85 , srv1450138157:85 , srv1514593748:85 , srv1514791407:85 , srv1523057115:85 , srv1648057414:85 , srv1678177888:85 , srv1689270971:85 , srv1694923642:85 , srv1710644681:85 , srv1739319604:85 , srv1788107986:85 , srv1788515144:85 , srv1860430638:85 , srv1919277491:85 , srv1924940367:85 , srv2028297324:85 , srv2129200165:85 , srv244520347:85 , srv268066495:85 , srv319183283:85 , srv331953567:85 , srv42251639:85 , srv456834845:85 , srv556793772:85 , srv667184683:85 , srv694637135:85 , srv782979292:85 , srv850874880:85 , srv884378502:85 , srv96624660:85 , srv966514640:85 , srv972263868:85 , srv1232977714:86 , srv1356492409:86 , srv1725653755:86 , srv1917307432:86 , srv338525364:86 , srv442981683:86 , srv888486914:644 }
2023-11-05 00:58:09,569 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-11-05 00:58:09,569 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1950328229=51, srv1514791407=25, srv1284693285=8, srv42251639=72, srv425800389=73, srv268066495=60, srv290465973=64, srv442981683=74, srv694637135=83, srv1694923642=32, srv519330144=78, srv1665675399=29, srv1088494516=0, srv740145290=85, srv338525364=69, srv1678177888=30, srv1558300196=27, srv230793378=58, srv2129200165=57, srv272060665=62, srv1376721358=14, srv1356492409=12, srv1860430638=45, srv1375377744=13, srv119972549=3, srv1788107986=40, srv518083428=77, srv958931334=95, srv1706225551=33, srv728751360=84, srv269091884=61, srv1716247977=35, srv1725653755=36, srv2028297324=53, srv2033111334=54, srv693126974=82, srv934386912=94, srv96624660=96, srv1924940367=50, srv970615407=98, srv1130979536=1, srv1833245018=43, srv1423245258=16, srv667184683=81, srv45296995=75, srv1710644681=34, srv1837830005=44, srv456834845=76, srv7675945=87, srv782979292=88, srv1919277491=49, srv380461818=71, srv1292185001=9, srv277220532=63, srv177040747=39, srv1501018527=23, srv1436713281=18, srv1478267571=21, srv1450138157=20, srv1739319604=38, srv313576972=66, srv555916687=79, srv1316562889=11, srv850874880=89, srv1232977714=5, srv972263868=99, srv763573698=86, srv1892036282=47, srv1376911668=15, srv1484306495=22, srv35233274=70, srv1201301211=4, srv304352943=65, srv2016911973=52, srv1272471313=7, srv1523057115=26, srv1739234266=37, srv1648057414=28, srv918008094=93, srv888486914=91, srv319183283=67, srv556793772=80, srv1689270971=31, srv1435381662=17, srv244520347=59, srv1917307432=48, srv144650104=19, srv2060797204=55, srv884378502=90, srv119592453=2, srv1788515144=41, srv1891063474=46, srv331953567=68, srv2084266654=56, srv1514593748=24, srv1821496641=42, srv1261120859=6, srv902476708=92, srv966514640=97, srv1312711425=10} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-11-05 00:58:09,578 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-11-05 00:58:09,578 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-11-05 00:58:09,578 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-11-05 00:58:09,578 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-11-05 00:58:09,579 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-11-05 00:58:09,579 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-11-05 00:58:09,579 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-11-05 00:58:09,579 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-11-05 00:58:09,579 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-11-05 00:58:09,579 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-11-05 00:58:09,579 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-11-05 00:58:09,579 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-11-05 00:58:09,579 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-11-05 00:58:09,579 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-11-05 00:58:09,579 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-11-05 00:58:09,579 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-11-05 00:58:09,579 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-11-05 00:58:09,579 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-11-05 00:58:09,579 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-11-05 00:58:09,579 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-11-05 00:58:09,579 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-11-05 00:58:09,579 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-11-05 00:58:09,579 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-11-05 00:58:09,579 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-11-05 00:58:09,579 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-11-05 00:58:09,580 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-11-05 00:58:09,580 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-11-05 00:58:09,580 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-11-05 00:58:09,580 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-11-05 00:58:09,580 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-11-05 00:58:09,580 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-11-05 00:58:09,580 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-11-05 00:58:09,580 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-11-05 00:58:09,580 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-11-05 00:58:09,580 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-11-05 00:58:09,580 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-11-05 00:58:09,580 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-11-05 00:58:09,580 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-11-05 00:58:09,580 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-11-05 00:58:09,580 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-11-05 00:58:09,580 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-11-05 00:58:09,580 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-11-05 00:58:09,580 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-11-05 00:58:09,580 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-11-05 00:58:09,580 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-11-05 00:58:09,580 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-11-05 00:58:09,581 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-11-05 00:58:09,581 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-11-05 00:58:09,581 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-11-05 00:58:09,581 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-11-05 00:58:09,581 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-11-05 00:58:09,581 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-11-05 00:58:09,581 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-11-05 00:58:09,581 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-11-05 00:58:09,581 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-11-05 00:58:09,581 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-11-05 00:58:09,581 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-11-05 00:58:09,581 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-11-05 00:58:09,581 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-11-05 00:58:09,581 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-11-05 00:58:09,581 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-11-05 00:58:09,581 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-11-05 00:58:09,581 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-11-05 00:58:09,581 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-11-05 00:58:09,581 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-11-05 00:58:09,581 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-11-05 00:58:09,581 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-11-05 00:58:09,582 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-11-05 00:58:09,582 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-11-05 00:58:09,582 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-11-05 00:58:09,582 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-11-05 00:58:09,582 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-11-05 00:58:09,582 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-11-05 00:58:09,582 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-11-05 00:58:09,582 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-11-05 00:58:09,582 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-11-05 00:58:09,582 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-11-05 00:58:09,582 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-11-05 00:58:09,582 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-11-05 00:58:09,582 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-11-05 00:58:09,582 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-11-05 00:58:09,582 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-11-05 00:58:09,583 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-11-05 00:58:09,583 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-11-05 00:58:09,583 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-11-05 00:58:09,583 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-11-05 00:58:09,583 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-11-05 00:58:09,583 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-11-05 00:58:09,583 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-11-05 00:58:09,583 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-11-05 00:58:09,583 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-11-05 00:58:09,583 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-11-05 00:58:09,583 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-11-05 00:58:09,583 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-11-05 00:58:09,583 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-11-05 00:58:09,583 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-11-05 00:58:09,583 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-11-05 00:58:09,583 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-11-05 00:58:09,583 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-11-05 00:58:09,583 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-11-05 00:58:09,583 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-11-05 00:58:09,669 INFO  [Time-limited test] balancer.StochasticLoadBalancer(381): Cluster wide - skipping load balancing because weighted average imbalance=1.7412849389754636E-5 <= threshold(0.025). If you want more aggressive balancing, either lower hbase.master.balancer.stochastic.minCostNeedBalance from 0.025 or increase the relative multiplier(s) of the specific cost function(s). functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=5.23782800878924E-4); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0016412198797244363); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=5.23782800878924E-4); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=8.333333333333333E-5); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-11-05 00:58:09,669 INFO  [Time-limited test] balancer.BalancerTestBase(570): Mock Final balance: { srv1130979536:83 , srv1312711425:83 , srv1316562889:83 , srv1501018527:83 , srv1665675399:83 , srv1706225551:83 , srv1837830005:83 , srv1950328229:83 , srv763573698:83 , srv119592453:84 , srv119972549:84 , srv1201301211:84 , srv1272471313:84 , srv1284693285:84 , srv1292185001:84 , srv1423245258:84 , srv1435381662:84 , srv1436713281:84 , srv144650104:84 , srv1478267571:84 , srv1484306495:84 , srv1558300196:84 , srv1716247977:84 , srv1739234266:84 , srv177040747:84 , srv1821496641:84 , srv1833245018:84 , srv1891063474:84 , srv1892036282:84 , srv2016911973:84 , srv2033111334:84 , srv2060797204:84 , srv2084266654:84 , srv230793378:84 , srv269091884:84 , srv272060665:84 , srv277220532:84 , srv290465973:84 , srv304352943:84 , srv313576972:84 , srv35233274:84 , srv380461818:84 , srv425800389:84 , srv45296995:84 , srv518083428:84 , srv519330144:84 , srv555916687:84 , srv693126974:84 , srv728751360:84 , srv740145290:84 , srv7675945:84 , srv902476708:84 , srv918008094:84 , srv934386912:84 , srv958931334:84 , srv970615407:84 , srv1088494516:85 , srv1261120859:85 , srv1375377744:85 , srv1376721358:85 , srv1376911668:85 , srv1450138157:85 , srv1514593748:85 , srv1514791407:85 , srv1523057115:85 , srv1648057414:85 , srv1678177888:85 , srv1689270971:85 , srv1694923642:85 , srv1710644681:85 , srv1739319604:85 , srv1788107986:85 , srv1788515144:85 , srv1860430638:85 , srv1919277491:85 , srv1924940367:85 , srv2028297324:85 , srv2129200165:85 , srv244520347:85 , srv268066495:85 , srv319183283:85 , srv331953567:85 , srv42251639:85 , srv456834845:85 , srv556793772:85 , srv667184683:85 , srv694637135:85 , srv782979292:85 , srv850874880:85 , srv884378502:85 , srv96624660:85 , srv966514640:85 , srv972263868:85 , srv1232977714:86 , srv1356492409:86 , srv1725653755:86 , srv1917307432:86 , srv338525364:86 , srv442981683:86 , srv888486914:644 }
2023-11-05 00:58:09,689 INFO  [Time-limited test] hbase.ResourceChecker(175): after: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnLargeClusterWithRacks Thread=12 (was 12), OpenFileDescriptor=290 (was 290), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=267 (was 267), ProcessCount=168 (was 168), AvailableMemoryMB=8646 (was 9124)
2023-11-05 00:58:09,696 INFO  [Time-limited test] hbase.ResourceChecker(147): before: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnMidClusterWithRacks Thread=12, OpenFileDescriptor=290, MaxFileDescriptor=60000, SystemLoadAverage=267, ProcessCount=168, AvailableMemoryMB=8646
2023-11-05 00:58:09,696 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2023-11-05 00:58:09,697 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=5000, runMaxSteps=true, stepsPerRegion=800, maxRunningTime=120000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 111077.0 etc.
2023-11-05 00:58:09,703 INFO  [Time-limited test] balancer.BalancerTestBase(547): Mock Cluster : { srv103561963:84 , srv1042870556:84 , srv108904303:84 , srv1144600658:84 , srv1157850841:84 , srv1165429902:84 , srv1188266851:84 , srv124716258:84 , srv127879090:84 , srv1295565871:84 , srv1376647730:84 , srv1504551173:84 , srv1556043963:84 , srv167887967:84 , srv1783818962:84 , srv1827429541:84 , srv1851873578:84 , srv1874719820:84 , srv231919204:84 , srv310785906:84 , srv338338166:84 , srv454330081:84 , srv454657740:84 , srv58117522:84 , srv626842329:84 , srv645033213:84 , srv747108753:84 , srv948311853:84 , srv980172386:84 , srv868527088:264 } [srvr=30 rgns=2700 avg=90.0 max=90 min=90]
2023-11-05 00:58:09,704 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-11-05 00:58:09,704 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv645033213=25, srv1556043963=12, srv1874719820=17, srv868527088=27, srv1827429541=15, srv103561963=0, srv1295565871=9, srv338338166=20, srv1144600658=3, srv1376647730=10, srv1157850841=4, srv108904303=2, srv626842329=24, srv980172386=29, srv747108753=26, srv1042870556=1, srv454330081=21, srv454657740=22, srv124716258=7, srv310785906=19, srv1783818962=14, srv948311853=28, srv1504551173=11, srv167887967=13, srv1188266851=6, srv231919204=18, srv127879090=8, srv58117522=23, srv1851873578=16, srv1165429902=5} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-11-05 00:58:09,711 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-11-05 00:58:09,711 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-11-05 00:58:09,711 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-11-05 00:58:09,711 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-11-05 00:58:09,711 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-11-05 00:58:09,711 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-11-05 00:58:09,711 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-11-05 00:58:09,712 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-11-05 00:58:09,712 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-11-05 00:58:09,712 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-11-05 00:58:09,712 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-11-05 00:58:09,712 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-11-05 00:58:09,712 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-11-05 00:58:09,712 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-11-05 00:58:09,712 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-11-05 00:58:09,712 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-11-05 00:58:09,712 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-11-05 00:58:09,712 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-11-05 00:58:09,712 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-11-05 00:58:09,712 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-11-05 00:58:09,712 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-11-05 00:58:09,712 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-11-05 00:58:09,712 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-11-05 00:58:09,712 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-11-05 00:58:09,712 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-11-05 00:58:09,712 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-11-05 00:58:09,712 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-11-05 00:58:09,713 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-11-05 00:58:09,713 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-11-05 00:58:09,713 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-11-05 00:58:09,713 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=10, number of hosts=30, number of racks=4
2023-11-05 00:58:09,726 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=1.1513771995095488, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-11-05 00:58:09,726 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.9912670027877014, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=1.1513771995095488, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=64800000
2023-11-05 01:00:09,716 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 120001 ms to try 9047161 different iterations.  Found a solution that moves 1843 regions; Going from a computed imbalance of 0.9912670027877014 to a new imbalance of 4.3016539410932495E-5. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); MoveCostFunction : (multiplier=7.0, imbalance=0.6825925925925926, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-11-05 01:00:09,722 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv103561963:90 , srv1042870556:90 , srv108904303:90 , srv1144600658:90 , srv1157850841:90 , srv1165429902:90 , srv1188266851:90 , srv124716258:90 , srv127879090:90 , srv1295565871:90 , srv1376647730:90 , srv1504551173:90 , srv1556043963:90 , srv167887967:90 , srv1783818962:90 , srv1827429541:90 , srv1851873578:90 , srv1874719820:90 , srv231919204:90 , srv310785906:90 , srv338338166:90 , srv454330081:90 , srv454657740:90 , srv58117522:90 , srv626842329:90 , srv645033213:90 , srv747108753:90 , srv868527088:90 , srv948311853:90 , srv980172386:90 }
2023-11-05 01:00:09,723 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-11-05 01:00:09,724 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv645033213=25, srv1556043963=12, srv1874719820=17, srv868527088=27, srv1827429541=15, srv103561963=0, srv1295565871=9, srv338338166=20, srv1144600658=3, srv1376647730=10, srv1157850841=4, srv108904303=2, srv626842329=24, srv980172386=29, srv747108753=26, srv1042870556=1, srv454330081=21, srv454657740=22, srv124716258=7, srv310785906=19, srv1783818962=14, srv948311853=28, srv1504551173=11, srv167887967=13, srv1188266851=6, srv231919204=18, srv127879090=8, srv58117522=23, srv1851873578=16, srv1165429902=5} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-11-05 01:00:09,726 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-11-05 01:00:09,727 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-11-05 01:00:09,727 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-11-05 01:00:09,727 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-11-05 01:00:09,727 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-11-05 01:00:09,727 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-11-05 01:00:09,727 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-11-05 01:00:09,727 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-11-05 01:00:09,727 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-11-05 01:00:09,727 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-11-05 01:00:09,727 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-11-05 01:00:09,727 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-11-05 01:00:09,727 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-11-05 01:00:09,727 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-11-05 01:00:09,727 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-11-05 01:00:09,727 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-11-05 01:00:09,727 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-11-05 01:00:09,727 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-11-05 01:00:09,727 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-11-05 01:00:09,727 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-11-05 01:00:09,727 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-11-05 01:00:09,727 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-11-05 01:00:09,727 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-11-05 01:00:09,728 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-11-05 01:00:09,728 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-11-05 01:00:09,728 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-11-05 01:00:09,728 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-11-05 01:00:09,728 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-11-05 01:00:09,728 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-11-05 01:00:09,728 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-11-05 01:00:09,728 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=10, number of hosts=30, number of racks=4
2023-11-05 01:00:09,739 INFO  [Time-limited test] balancer.StochasticLoadBalancer(381): Cluster wide - skipping load balancing because weighted average imbalance=0.0 <= threshold(0.025). If you want more aggressive balancing, either lower hbase.master.balancer.stochastic.minCostNeedBalance from 0.025 or increase the relative multiplier(s) of the specific cost function(s). functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-11-05 01:00:09,739 INFO  [Time-limited test] balancer.BalancerTestBase(570): Mock Final balance: { srv103561963:90 , srv1042870556:90 , srv108904303:90 , srv1144600658:90 , srv1157850841:90 , srv1165429902:90 , srv1188266851:90 , srv124716258:90 , srv127879090:90 , srv1295565871:90 , srv1376647730:90 , srv1504551173:90 , srv1556043963:90 , srv167887967:90 , srv1783818962:90 , srv1827429541:90 , srv1851873578:90 , srv1874719820:90 , srv231919204:90 , srv310785906:90 , srv338338166:90 , srv454330081:90 , srv454657740:90 , srv58117522:90 , srv626842329:90 , srv645033213:90 , srv747108753:90 , srv868527088:90 , srv948311853:90 , srv980172386:90 }
2023-11-05 01:00:09,750 INFO  [Time-limited test] hbase.ResourceChecker(175): after: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnMidClusterWithRacks Thread=11 (was 12), OpenFileDescriptor=290 (was 290), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=192 (was 267), ProcessCount=166 (was 168), AvailableMemoryMB=8426 (was 8646)