2023-12-17 08:53:15,162 INFO  [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks timeout: 13 mins
2023-12-17 08:53:15,485 WARN  [Time-limited test] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties
2023-12-17 08:53:15,598 INFO  [Time-limited test] metrics.MetricRegistriesLoader(60): Loaded MetricRegistries class org.apache.hadoop.hbase.metrics.impl.MetricRegistriesImpl
2023-12-17 08:53:15,681 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2023-12-17 08:53:15,689 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc.
2023-12-17 08:53:15,701 INFO  [Time-limited test] hbase.ResourceChecker(147): before: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnLargeClusterWithRacks Thread=12, OpenFileDescriptor=290, MaxFileDescriptor=60000, SystemLoadAverage=314, ProcessCount=169, AvailableMemoryMB=5623
2023-12-17 08:53:15,704 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2023-12-17 08:53:15,704 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=5000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=10000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc.
2023-12-17 08:53:15,825 INFO  [Time-limited test] balancer.BalancerTestBase(547): Mock Cluster : { srv103687302:84 , srv1068306823:84 , srv1070065224:84 , srv1122740710:84 , srv1142589986:84 , srv1148880205:84 , srv1153503904:84 , srv1196468646:84 , srv1200115505:84 , srv1215856667:84 , srv1218302703:84 , srv1221046879:84 , srv1234829010:84 , srv1291545201:84 , srv1298945087:84 , srv1314217612:84 , srv1314808994:84 , srv1336948436:84 , srv1350595662:84 , srv1371706316:84 , srv139272484:84 , srv1393033705:84 , srv1405151332:84 , srv1409627547:84 , srv1413902425:84 , srv1427438256:84 , srv1470947078:84 , srv1502653362:84 , srv1537382451:84 , srv1592690740:84 , srv1607049249:84 , srv1608531472:84 , srv1614773878:84 , srv1623877991:84 , srv1645237998:84 , srv168974947:84 , srv1692560000:84 , srv1698278986:84 , srv173116723:84 , srv1749425997:84 , srv1763874995:84 , srv1766775051:84 , srv1769998391:84 , srv1817990438:84 , srv1848932678:84 , srv1854135865:84 , srv1868526130:84 , srv187233880:84 , srv1956180964:84 , srv2062086951:84 , srv2095736660:84 , srv2106835271:84 , srv222988667:84 , srv232184957:84 , srv258969080:84 , srv265787416:84 , srv266312468:84 , srv266603004:84 , srv267887716:84 , srv270196151:84 , srv276773534:84 , srv305110642:84 , srv325920577:84 , srv364395590:84 , srv367188821:84 , srv408020836:84 , srv435580612:84 , srv446941111:84 , srv45252210:84 , srv471150406:84 , srv484951878:84 , srv494879012:84 , srv532495410:84 , srv538396174:84 , srv563783970:84 , srv563908760:84 , srv586518660:84 , srv595012367:84 , srv61992034:84 , srv641651634:84 , srv701130893:84 , srv70185044:84 , srv714327476:84 , srv720420585:84 , srv727615566:84 , srv734257623:84 , srv750046874:84 , srv819001183:84 , srv822437800:84 , srv845697077:84 , srv871758448:84 , srv878391578:84 , srv879414411:84 , srv882072408:84 , srv910707668:84 , srv916635342:84 , srv917749849:84 , srv928768577:84 , srv944349518:84 , srv1140679171:684 } [srvr=100 rgns=9000 avg=90.0 max=90 min=90]
2023-12-17 08:53:15,834 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-12-17 08:53:15,841 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv266312468=57, srv1763874995=41, srv822437800=89, srv1122740710=3, srv446941111=68, srv871758448=91, srv494879012=72, srv916635342=96, srv917749849=97, srv276773534=61, srv819001183=88, srv1405151332=23, srv1068306823=1, srv1537382451=29, srv1218302703=11, srv1298945087=15, srv538396174=74, srv408020836=66, srv1314808994=17, srv563783970=75, srv1314217612=16, srv532495410=73, srv1196468646=8, srv1769998391=43, srv1148880205=6, srv1393033705=22, srv187233880=48, srv435580612=67, srv70185044=82, srv258969080=55, srv750046874=87, srv1142589986=5, srv1153503904=7, srv595012367=78, srv1766775051=42, srv701130893=81, srv882072408=94, srv1215856667=10, srv1698278986=38, srv45252210=69, srv266603004=58, srv222988667=53, srv103687302=0, srv879414411=93, srv1291545201=14, srv1868526130=47, srv641651634=80, srv1200115505=9, srv1608531472=32, srv1848932678=45, srv1409627547=24, srv1614773878=33, srv1427438256=26, srv1470947078=27, srv173116723=39, srv168974947=36, srv563908760=76, srv910707668=95, srv139272484=21, srv1692560000=37, srv714327476=83, srv1592690740=30, srv267887716=59, srv1234829010=13, srv270196151=60, srv1371706316=20, srv265787416=56, srv232184957=54, srv61992034=79, srv325920577=63, srv2106835271=52, srv1623877991=34, srv1140679171=4, srv2062086951=50, srv1221046879=12, srv586518660=77, srv1956180964=49, srv1336948436=18, srv1502653362=28, srv484951878=71, srv734257623=86, srv364395590=64, srv1854135865=46, srv471150406=70, srv727615566=85, srv1413902425=25, srv1749425997=40, srv878391578=92, srv1645237998=35, srv1070065224=2, srv845697077=90, srv928768577=98, srv367188821=65, srv1607049249=31, srv305110642=62, srv720420585=84, srv2095736660=51, srv1817990438=44, srv1350595662=19, srv944349518=99} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-12-17 08:53:15,923 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-12-17 08:53:15,923 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-12-17 08:53:15,923 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-12-17 08:53:15,923 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-12-17 08:53:15,923 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-12-17 08:53:15,923 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-12-17 08:53:15,923 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-12-17 08:53:15,923 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-12-17 08:53:15,924 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-12-17 08:53:15,924 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-12-17 08:53:15,924 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-12-17 08:53:15,924 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-12-17 08:53:15,924 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-12-17 08:53:15,924 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-12-17 08:53:15,924 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-12-17 08:53:15,924 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-12-17 08:53:15,924 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-12-17 08:53:15,924 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-12-17 08:53:15,924 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-12-17 08:53:15,925 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-12-17 08:53:15,925 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-12-17 08:53:15,925 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-12-17 08:53:15,925 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-12-17 08:53:15,925 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-12-17 08:53:15,925 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-12-17 08:53:15,925 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-12-17 08:53:15,925 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-12-17 08:53:15,925 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-12-17 08:53:15,925 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-12-17 08:53:15,925 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-12-17 08:53:15,926 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-12-17 08:53:15,926 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-12-17 08:53:15,926 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-12-17 08:53:15,926 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-12-17 08:53:15,926 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-12-17 08:53:15,926 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-12-17 08:53:15,926 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-12-17 08:53:15,926 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-12-17 08:53:15,926 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-12-17 08:53:15,926 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-12-17 08:53:15,926 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-12-17 08:53:15,927 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-12-17 08:53:15,927 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-12-17 08:53:15,927 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-12-17 08:53:15,927 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-12-17 08:53:15,927 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-12-17 08:53:15,927 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-12-17 08:53:15,928 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-12-17 08:53:15,928 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-12-17 08:53:15,928 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-12-17 08:53:15,928 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-12-17 08:53:15,928 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-12-17 08:53:15,928 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-12-17 08:53:15,929 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-12-17 08:53:15,929 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-12-17 08:53:15,929 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-12-17 08:53:15,929 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-12-17 08:53:15,929 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-12-17 08:53:15,929 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-12-17 08:53:15,930 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-12-17 08:53:15,930 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-12-17 08:53:15,930 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-12-17 08:53:15,930 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-12-17 08:53:15,930 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-12-17 08:53:15,930 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-12-17 08:53:15,931 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-12-17 08:53:15,931 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-12-17 08:53:15,931 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-12-17 08:53:15,931 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-12-17 08:53:15,931 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-12-17 08:53:15,931 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-12-17 08:53:15,932 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-12-17 08:53:15,932 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-12-17 08:53:15,932 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-12-17 08:53:15,932 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-12-17 08:53:15,932 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-12-17 08:53:15,932 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-12-17 08:53:15,932 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-12-17 08:53:15,933 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-12-17 08:53:15,933 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-12-17 08:53:15,933 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-12-17 08:53:15,933 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-12-17 08:53:15,933 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-12-17 08:53:15,933 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-12-17 08:53:15,933 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-12-17 08:53:15,933 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-12-17 08:53:15,933 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-12-17 08:53:15,933 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-12-17 08:53:15,933 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-12-17 08:53:15,933 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-12-17 08:53:15,934 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-12-17 08:53:15,934 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-12-17 08:53:15,934 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-12-17 08:53:15,934 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-12-17 08:53:15,934 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-12-17 08:53:15,934 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-12-17 08:53:15,934 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-12-17 08:53:15,934 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-12-17 08:53:15,935 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-12-17 08:53:15,935 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-12-17 08:53:15,935 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-12-17 08:53:16,137 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.06666666666666667, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-12-17 08:53:16,137 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-12-17 08:53:16,138 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.9909252140407105, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.06666666666666667, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-12-17 08:53:16,509 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 538 ms to try 5000 different iterations.  Found a solution that moves 4713 regions; Going from a computed imbalance of 0.9909252140407105 to a new imbalance of 0.17634112523399612. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.03892174337686713, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.05757540315325965, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.5236666666666666, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.03892174337686713, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.1715, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.23841666666666667, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-12-17 08:53:16,539 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1142589986:81 , srv1336948436:81 , srv232184957:81 , srv267887716:81 , srv595012367:82 , srv1221046879:83 , srv258969080:83 , srv586518660:83 , srv1427438256:84 , srv1614773878:84 , srv1692560000:84 , srv1763874995:84 , srv2062086951:84 , srv325920577:84 , srv871758448:84 , srv916635342:84 , srv928768577:84 , srv1153503904:85 , srv1405151332:85 , srv1413902425:85 , srv1502653362:85 , srv1592690740:85 , srv1607049249:85 , srv1956180964:85 , srv266603004:85 , srv367188821:85 , srv446941111:85 , srv45252210:85 , srv471150406:85 , srv484951878:85 , srv70185044:85 , srv714327476:85 , srv734257623:85 , srv845697077:85 , srv1070065224:86 , srv1122740710:86 , srv1200115505:86 , srv1218302703:86 , srv1291545201:86 , srv1298945087:86 , srv1314217612:86 , srv1314808994:86 , srv1608531472:86 , srv1623877991:86 , srv1645237998:86 , srv222988667:86 , srv364395590:86 , srv61992034:86 , srv701130893:86 , srv727615566:86 , srv910707668:86 , srv1234829010:87 , srv1350595662:87 , srv1749425997:87 , srv1769998391:87 , srv1848932678:87 , srv1854135865:87 , srv1868526130:87 , srv187233880:87 , srv2106835271:87 , srv270196151:87 , srv435580612:87 , srv563783970:87 , srv879414411:87 , srv882072408:87 , srv103687302:88 , srv1068306823:88 , srv1215856667:88 , srv1537382451:88 , srv173116723:88 , srv1766775051:88 , srv1817990438:88 , srv2095736660:88 , srv563908760:88 , srv641651634:88 , srv750046874:88 , srv917749849:88 , srv139272484:89 , srv1393033705:89 , srv1470947078:89 , srv168974947:89 , srv1698278986:89 , srv266312468:89 , srv276773534:89 , srv305110642:89 , srv408020836:89 , srv532495410:89 , srv538396174:89 , srv720420585:89 , srv819001183:89 , srv822437800:89 , srv878391578:89 , srv944349518:89 , srv1196468646:90 , srv1409627547:90 , srv1148880205:91 , srv265787416:92 , srv494879012:92 , srv1371706316:93 , srv1140679171:436 }
2023-12-17 08:53:16,543 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-12-17 08:53:16,543 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv266312468=57, srv1763874995=41, srv822437800=89, srv1122740710=3, srv446941111=68, srv871758448=91, srv494879012=72, srv916635342=96, srv917749849=97, srv276773534=61, srv819001183=88, srv1405151332=23, srv1068306823=1, srv1537382451=29, srv1218302703=11, srv1298945087=15, srv538396174=74, srv408020836=66, srv1314808994=17, srv563783970=75, srv1314217612=16, srv532495410=73, srv1196468646=8, srv1769998391=43, srv1148880205=6, srv1393033705=22, srv187233880=48, srv435580612=67, srv70185044=82, srv258969080=55, srv750046874=87, srv1142589986=5, srv1153503904=7, srv595012367=78, srv1766775051=42, srv701130893=81, srv882072408=94, srv1215856667=10, srv1698278986=38, srv45252210=69, srv266603004=58, srv222988667=53, srv103687302=0, srv879414411=93, srv1291545201=14, srv1868526130=47, srv641651634=80, srv1200115505=9, srv1608531472=32, srv1848932678=45, srv1409627547=24, srv1614773878=33, srv1427438256=26, srv1470947078=27, srv173116723=39, srv168974947=36, srv563908760=76, srv910707668=95, srv139272484=21, srv1692560000=37, srv714327476=83, srv1592690740=30, srv267887716=59, srv1234829010=13, srv270196151=60, srv1371706316=20, srv265787416=56, srv232184957=54, srv61992034=79, srv325920577=63, srv2106835271=52, srv1623877991=34, srv1140679171=4, srv2062086951=50, srv1221046879=12, srv586518660=77, srv1956180964=49, srv1336948436=18, srv1502653362=28, srv484951878=71, srv734257623=86, srv364395590=64, srv1854135865=46, srv471150406=70, srv727615566=85, srv1413902425=25, srv1749425997=40, srv878391578=92, srv1645237998=35, srv1070065224=2, srv845697077=90, srv928768577=98, srv367188821=65, srv1607049249=31, srv305110642=62, srv720420585=84, srv2095736660=51, srv1817990438=44, srv1350595662=19, srv944349518=99} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-12-17 08:53:16,557 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-12-17 08:53:16,557 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-12-17 08:53:16,557 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-12-17 08:53:16,557 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-12-17 08:53:16,557 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-12-17 08:53:16,557 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-12-17 08:53:16,557 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-12-17 08:53:16,557 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-12-17 08:53:16,557 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-12-17 08:53:16,558 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-12-17 08:53:16,558 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-12-17 08:53:16,558 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-12-17 08:53:16,558 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-12-17 08:53:16,558 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-12-17 08:53:16,558 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-12-17 08:53:16,558 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-12-17 08:53:16,558 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-12-17 08:53:16,558 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-12-17 08:53:16,558 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-12-17 08:53:16,558 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-12-17 08:53:16,558 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-12-17 08:53:16,558 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-12-17 08:53:16,559 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-12-17 08:53:16,559 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-12-17 08:53:16,559 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-12-17 08:53:16,559 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-12-17 08:53:16,559 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-12-17 08:53:16,559 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-12-17 08:53:16,559 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-12-17 08:53:16,559 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-12-17 08:53:16,559 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-12-17 08:53:16,559 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-12-17 08:53:16,559 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-12-17 08:53:16,559 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-12-17 08:53:16,559 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-12-17 08:53:16,559 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-12-17 08:53:16,560 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-12-17 08:53:16,560 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-12-17 08:53:16,560 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-12-17 08:53:16,560 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-12-17 08:53:16,560 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-12-17 08:53:16,560 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-12-17 08:53:16,560 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-12-17 08:53:16,560 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-12-17 08:53:16,560 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-12-17 08:53:16,560 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-12-17 08:53:16,560 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-12-17 08:53:16,560 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-12-17 08:53:16,560 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-12-17 08:53:16,560 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-12-17 08:53:16,561 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-12-17 08:53:16,561 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-12-17 08:53:16,561 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-12-17 08:53:16,561 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-12-17 08:53:16,561 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-12-17 08:53:16,561 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-12-17 08:53:16,561 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-12-17 08:53:16,561 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-12-17 08:53:16,561 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-12-17 08:53:16,561 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-12-17 08:53:16,561 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-12-17 08:53:16,561 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-12-17 08:53:16,561 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-12-17 08:53:16,561 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-12-17 08:53:16,561 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-12-17 08:53:16,562 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-12-17 08:53:16,562 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-12-17 08:53:16,562 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-12-17 08:53:16,562 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-12-17 08:53:16,562 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-12-17 08:53:16,562 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-12-17 08:53:16,562 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-12-17 08:53:16,562 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-12-17 08:53:16,562 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-12-17 08:53:16,562 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-12-17 08:53:16,562 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-12-17 08:53:16,562 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-12-17 08:53:16,562 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-12-17 08:53:16,562 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-12-17 08:53:16,563 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-12-17 08:53:16,563 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-12-17 08:53:16,563 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-12-17 08:53:16,563 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-12-17 08:53:16,563 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-12-17 08:53:16,563 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-12-17 08:53:16,563 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-12-17 08:53:16,563 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-12-17 08:53:16,563 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-12-17 08:53:16,563 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-12-17 08:53:16,563 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-12-17 08:53:16,563 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-12-17 08:53:16,563 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-12-17 08:53:16,563 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-12-17 08:53:16,563 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-12-17 08:53:16,564 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-12-17 08:53:16,564 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-12-17 08:53:16,564 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-12-17 08:53:16,564 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-12-17 08:53:16,564 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-12-17 08:53:16,564 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-12-17 08:53:16,564 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-12-17 08:53:16,693 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.03892174337686713, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.05757540315325965, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.03892174337686713, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.1715, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.23841666666666667, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-12-17 08:53:16,693 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-12-17 08:53:16,694 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.1763081241026488, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.03892174337686713, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.05757540315325965, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.03892174337686713, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.1715, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.23841666666666667, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-12-17 08:53:16,934 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 354 ms to try 5000 different iterations.  Found a solution that moves 2625 regions; Going from a computed imbalance of 0.1763081241026488 to a new imbalance of 0.014872474823189452. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.021874952122584914); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.03649023976633019, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.2916666666666667, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.021874952122584914); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.011916666666666667); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.042833333333333334, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-12-17 08:53:16,943 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1148880205:79 , srv494879012:79 , srv1409627547:80 , srv265787416:81 , srv408020836:81 , srv1068306823:82 , srv1215856667:82 , srv1371706316:82 , srv1470947078:82 , srv1698278986:82 , srv2095736660:82 , srv266312468:82 , srv532495410:82 , srv538396174:82 , srv103687302:83 , srv1196468646:83 , srv1393033705:83 , srv1537382451:83 , srv168974947:83 , srv173116723:83 , srv305110642:83 , srv563783970:83 , srv878391578:83 , srv882072408:83 , srv944349518:83 , srv1234829010:84 , srv1314217612:84 , srv1314808994:84 , srv1350595662:84 , srv1769998391:84 , srv1817990438:84 , srv1848932678:84 , srv1868526130:84 , srv276773534:84 , srv435580612:84 , srv563908760:84 , srv720420585:84 , srv1122740710:85 , srv1200115505:85 , srv1218302703:85 , srv1291545201:85 , srv1645237998:85 , srv1749425997:85 , srv270196151:85 , srv641651634:85 , srv727615566:85 , srv819001183:85 , srv879414411:85 , srv917749849:85 , srv1153503904:86 , srv1298945087:86 , srv1413902425:86 , srv1502653362:86 , srv1592690740:86 , srv1607049249:86 , srv1608531472:86 , srv1614773878:86 , srv1623877991:86 , srv1766775051:86 , srv1854135865:86 , srv1956180964:86 , srv2106835271:86 , srv266603004:86 , srv471150406:86 , srv484951878:86 , srv714327476:86 , srv750046874:86 , srv910707668:86 , srv1427438256:87 , srv2062086951:87 , srv222988667:87 , srv258969080:87 , srv325920577:87 , srv364395590:87 , srv61992034:87 , srv845697077:87 , srv1070065224:88 , srv1221046879:88 , srv1405151332:88 , srv1692560000:88 , srv187233880:88 , srv367188821:88 , srv446941111:88 , srv45252210:88 , srv871758448:88 , srv928768577:88 , srv139272484:89 , srv586518660:89 , srv701130893:89 , srv70185044:89 , srv916635342:89 , srv1763874995:90 , srv267887716:90 , srv595012367:90 , srv734257623:91 , srv1336948436:92 , srv1142589986:93 , srv232184957:93 , srv822437800:95 , srv1140679171:532 }
2023-12-17 08:53:16,947 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-12-17 08:53:16,948 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv266312468=57, srv1763874995=41, srv822437800=89, srv1122740710=3, srv446941111=68, srv871758448=91, srv494879012=72, srv916635342=96, srv917749849=97, srv276773534=61, srv819001183=88, srv1405151332=23, srv1068306823=1, srv1537382451=29, srv1218302703=11, srv1298945087=15, srv538396174=74, srv408020836=66, srv1314808994=17, srv563783970=75, srv1314217612=16, srv532495410=73, srv1196468646=8, srv1769998391=43, srv1148880205=6, srv1393033705=22, srv187233880=48, srv435580612=67, srv70185044=82, srv258969080=55, srv750046874=87, srv1142589986=5, srv1153503904=7, srv595012367=78, srv1766775051=42, srv701130893=81, srv882072408=94, srv1215856667=10, srv1698278986=38, srv45252210=69, srv266603004=58, srv222988667=53, srv103687302=0, srv879414411=93, srv1291545201=14, srv1868526130=47, srv641651634=80, srv1200115505=9, srv1608531472=32, srv1848932678=45, srv1409627547=24, srv1614773878=33, srv1427438256=26, srv1470947078=27, srv173116723=39, srv168974947=36, srv563908760=76, srv910707668=95, srv139272484=21, srv1692560000=37, srv714327476=83, srv1592690740=30, srv267887716=59, srv1234829010=13, srv270196151=60, srv1371706316=20, srv265787416=56, srv232184957=54, srv61992034=79, srv325920577=63, srv2106835271=52, srv1623877991=34, srv1140679171=4, srv2062086951=50, srv1221046879=12, srv586518660=77, srv1956180964=49, srv1336948436=18, srv1502653362=28, srv484951878=71, srv734257623=86, srv364395590=64, srv1854135865=46, srv471150406=70, srv727615566=85, srv1413902425=25, srv1749425997=40, srv878391578=92, srv1645237998=35, srv1070065224=2, srv845697077=90, srv928768577=98, srv367188821=65, srv1607049249=31, srv305110642=62, srv720420585=84, srv2095736660=51, srv1817990438=44, srv1350595662=19, srv944349518=99} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-12-17 08:53:16,973 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-12-17 08:53:16,973 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-12-17 08:53:16,973 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-12-17 08:53:16,973 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-12-17 08:53:16,973 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-12-17 08:53:16,974 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-12-17 08:53:16,974 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-12-17 08:53:16,974 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-12-17 08:53:16,974 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-12-17 08:53:16,974 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-12-17 08:53:16,974 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-12-17 08:53:16,974 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-12-17 08:53:16,974 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-12-17 08:53:16,974 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-12-17 08:53:16,974 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-12-17 08:53:16,974 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-12-17 08:53:16,975 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-12-17 08:53:16,975 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-12-17 08:53:16,975 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-12-17 08:53:16,975 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-12-17 08:53:16,975 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-12-17 08:53:16,975 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-12-17 08:53:16,975 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-12-17 08:53:16,975 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-12-17 08:53:16,975 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-12-17 08:53:16,975 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-12-17 08:53:16,975 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-12-17 08:53:16,975 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-12-17 08:53:16,976 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-12-17 08:53:16,976 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-12-17 08:53:16,976 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-12-17 08:53:16,976 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-12-17 08:53:16,976 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-12-17 08:53:16,976 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-12-17 08:53:16,976 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-12-17 08:53:16,976 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-12-17 08:53:16,976 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-12-17 08:53:16,976 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-12-17 08:53:16,976 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-12-17 08:53:16,977 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-12-17 08:53:16,977 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-12-17 08:53:16,977 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-12-17 08:53:16,977 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-12-17 08:53:16,977 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-12-17 08:53:16,977 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-12-17 08:53:16,977 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-12-17 08:53:16,977 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-12-17 08:53:16,977 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-12-17 08:53:16,977 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-12-17 08:53:16,977 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-12-17 08:53:16,978 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-12-17 08:53:16,978 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-12-17 08:53:16,978 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-12-17 08:53:16,978 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-12-17 08:53:16,978 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-12-17 08:53:16,978 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-12-17 08:53:16,978 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-12-17 08:53:16,978 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-12-17 08:53:16,978 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-12-17 08:53:16,978 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-12-17 08:53:16,978 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-12-17 08:53:16,979 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-12-17 08:53:16,979 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-12-17 08:53:16,979 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-12-17 08:53:16,979 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-12-17 08:53:16,979 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-12-17 08:53:16,979 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-12-17 08:53:16,979 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-12-17 08:53:16,979 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-12-17 08:53:16,979 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-12-17 08:53:16,979 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-12-17 08:53:16,979 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-12-17 08:53:16,980 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-12-17 08:53:16,980 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-12-17 08:53:16,980 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-12-17 08:53:16,980 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-12-17 08:53:16,980 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-12-17 08:53:16,980 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-12-17 08:53:16,980 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-12-17 08:53:16,980 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-12-17 08:53:16,980 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-12-17 08:53:16,980 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-12-17 08:53:16,980 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-12-17 08:53:16,981 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-12-17 08:53:16,981 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-12-17 08:53:16,981 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-12-17 08:53:16,981 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-12-17 08:53:16,981 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-12-17 08:53:16,981 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-12-17 08:53:16,981 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-12-17 08:53:16,981 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-12-17 08:53:16,981 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-12-17 08:53:16,981 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-12-17 08:53:16,981 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-12-17 08:53:16,981 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-12-17 08:53:16,982 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-12-17 08:53:16,982 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-12-17 08:53:16,982 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-12-17 08:53:16,982 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-12-17 08:53:16,982 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-12-17 08:53:16,982 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-12-17 08:53:17,140 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.021874952122584914); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.03649023976633019, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.021874952122584914); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.011916666666666667); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.042833333333333334, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-12-17 08:53:17,140 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-12-17 08:53:17,141 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.014854094180332096, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.021874952122584914); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.03649023976633019, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.021874952122584914); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.011916666666666667); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.042833333333333334, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-12-17 08:53:17,386 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 383 ms to try 5000 different iterations.  Found a solution that moves 976 regions; Going from a computed imbalance of 0.014854094180332096 to a new imbalance of 7.068337831747443E-4. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.005999127009691806); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.00908866414480969); MoveCostFunction : (multiplier=7.0, imbalance=0.10844444444444444, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.005999127009691806); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=2.5E-4); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0045); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-12-17 08:53:17,390 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv822437800:74 , srv139272484:80 , srv1371706316:82 , srv187233880:82 , srv734257623:82 , srv1070065224:83 , srv1763874995:83 , srv265787416:83 , srv701130893:83 , srv750046874:83 , srv819001183:83 , srv1142589986:84 , srv1298945087:84 , srv1336948436:84 , srv1692560000:84 , srv1766775051:84 , srv222988667:84 , srv232184957:84 , srv364395590:84 , srv446941111:84 , srv70185044:84 , srv720420585:84 , srv879414411:84 , srv916635342:84 , srv1196468646:85 , srv1221046879:85 , srv1405151332:85 , srv1608531472:85 , srv1623877991:85 , srv168974947:85 , srv1749425997:85 , srv1868526130:85 , srv2106835271:85 , srv270196151:85 , srv276773534:85 , srv367188821:85 , srv45252210:85 , srv61992034:85 , srv641651634:85 , srv871758448:85 , srv878391578:85 , srv917749849:85 , srv103687302:86 , srv1215856667:86 , srv1234829010:86 , srv1291545201:86 , srv1350595662:86 , srv1393033705:86 , srv1502653362:86 , srv1592690740:86 , srv1607049249:86 , srv173116723:86 , srv1769998391:86 , srv1817990438:86 , srv1848932678:86 , srv1854135865:86 , srv1956180964:86 , srv2062086951:86 , srv266312468:86 , srv267887716:86 , srv532495410:86 , srv563908760:86 , srv586518660:86 , srv595012367:86 , srv727615566:86 , srv845697077:86 , srv910707668:86 , srv928768577:86 , srv1068306823:87 , srv1122740710:87 , srv1153503904:87 , srv1200115505:87 , srv1218302703:87 , srv1314217612:87 , srv1314808994:87 , srv1409627547:87 , srv1413902425:87 , srv1427438256:87 , srv1470947078:87 , srv1537382451:87 , srv1614773878:87 , srv1645237998:87 , srv2095736660:87 , srv258969080:87 , srv266603004:87 , srv305110642:87 , srv325920577:87 , srv435580612:87 , srv471150406:87 , srv484951878:87 , srv494879012:87 , srv538396174:87 , srv563783970:87 , srv714327476:87 , srv882072408:87 , srv944349518:87 , srv1698278986:88 , srv408020836:88 , srv1148880205:89 , srv1140679171:543 }
2023-12-17 08:53:17,394 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-12-17 08:53:17,394 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv266312468=57, srv1763874995=41, srv822437800=89, srv1122740710=3, srv446941111=68, srv871758448=91, srv494879012=72, srv916635342=96, srv917749849=97, srv276773534=61, srv819001183=88, srv1405151332=23, srv1068306823=1, srv1537382451=29, srv1218302703=11, srv1298945087=15, srv538396174=74, srv408020836=66, srv1314808994=17, srv563783970=75, srv1314217612=16, srv532495410=73, srv1196468646=8, srv1769998391=43, srv1148880205=6, srv1393033705=22, srv187233880=48, srv435580612=67, srv70185044=82, srv258969080=55, srv750046874=87, srv1142589986=5, srv1153503904=7, srv595012367=78, srv1766775051=42, srv701130893=81, srv882072408=94, srv1215856667=10, srv1698278986=38, srv45252210=69, srv266603004=58, srv222988667=53, srv103687302=0, srv879414411=93, srv1291545201=14, srv1868526130=47, srv641651634=80, srv1200115505=9, srv1608531472=32, srv1848932678=45, srv1409627547=24, srv1614773878=33, srv1427438256=26, srv1470947078=27, srv173116723=39, srv168974947=36, srv563908760=76, srv910707668=95, srv139272484=21, srv1692560000=37, srv714327476=83, srv1592690740=30, srv267887716=59, srv1234829010=13, srv270196151=60, srv1371706316=20, srv265787416=56, srv232184957=54, srv61992034=79, srv325920577=63, srv2106835271=52, srv1623877991=34, srv1140679171=4, srv2062086951=50, srv1221046879=12, srv586518660=77, srv1956180964=49, srv1336948436=18, srv1502653362=28, srv484951878=71, srv734257623=86, srv364395590=64, srv1854135865=46, srv471150406=70, srv727615566=85, srv1413902425=25, srv1749425997=40, srv878391578=92, srv1645237998=35, srv1070065224=2, srv845697077=90, srv928768577=98, srv367188821=65, srv1607049249=31, srv305110642=62, srv720420585=84, srv2095736660=51, srv1817990438=44, srv1350595662=19, srv944349518=99} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-12-17 08:53:17,405 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-12-17 08:53:17,405 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-12-17 08:53:17,405 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-12-17 08:53:17,405 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-12-17 08:53:17,405 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-12-17 08:53:17,405 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-12-17 08:53:17,405 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-12-17 08:53:17,405 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-12-17 08:53:17,405 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-12-17 08:53:17,406 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-12-17 08:53:17,406 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-12-17 08:53:17,406 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-12-17 08:53:17,406 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-12-17 08:53:17,406 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-12-17 08:53:17,406 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-12-17 08:53:17,406 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-12-17 08:53:17,406 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-12-17 08:53:17,406 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-12-17 08:53:17,406 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-12-17 08:53:17,406 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-12-17 08:53:17,406 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-12-17 08:53:17,406 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-12-17 08:53:17,406 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-12-17 08:53:17,406 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-12-17 08:53:17,406 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-12-17 08:53:17,407 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-12-17 08:53:17,407 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-12-17 08:53:17,407 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-12-17 08:53:17,407 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-12-17 08:53:17,407 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-12-17 08:53:17,407 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-12-17 08:53:17,407 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-12-17 08:53:17,407 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-12-17 08:53:17,407 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-12-17 08:53:17,407 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-12-17 08:53:17,407 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-12-17 08:53:17,407 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-12-17 08:53:17,407 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-12-17 08:53:17,407 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-12-17 08:53:17,407 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-12-17 08:53:17,408 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-12-17 08:53:17,408 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-12-17 08:53:17,408 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-12-17 08:53:17,408 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-12-17 08:53:17,408 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-12-17 08:53:17,408 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-12-17 08:53:17,408 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-12-17 08:53:17,408 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-12-17 08:53:17,408 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-12-17 08:53:17,408 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-12-17 08:53:17,408 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-12-17 08:53:17,408 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-12-17 08:53:17,408 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-12-17 08:53:17,408 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-12-17 08:53:17,408 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-12-17 08:53:17,409 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-12-17 08:53:17,409 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-12-17 08:53:17,409 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-12-17 08:53:17,409 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-12-17 08:53:17,409 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-12-17 08:53:17,409 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-12-17 08:53:17,409 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-12-17 08:53:17,409 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-12-17 08:53:17,409 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-12-17 08:53:17,409 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-12-17 08:53:17,409 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-12-17 08:53:17,410 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-12-17 08:53:17,410 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-12-17 08:53:17,410 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-12-17 08:53:17,410 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-12-17 08:53:17,410 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-12-17 08:53:17,410 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-12-17 08:53:17,410 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-12-17 08:53:17,410 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-12-17 08:53:17,410 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-12-17 08:53:17,410 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-12-17 08:53:17,410 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-12-17 08:53:17,411 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-12-17 08:53:17,411 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-12-17 08:53:17,411 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-12-17 08:53:17,411 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-12-17 08:53:17,411 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-12-17 08:53:17,411 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-12-17 08:53:17,411 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-12-17 08:53:17,411 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-12-17 08:53:17,411 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-12-17 08:53:17,411 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-12-17 08:53:17,411 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-12-17 08:53:17,411 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-12-17 08:53:17,411 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-12-17 08:53:17,411 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-12-17 08:53:17,411 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-12-17 08:53:17,411 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-12-17 08:53:17,411 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-12-17 08:53:17,412 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-12-17 08:53:17,412 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-12-17 08:53:17,412 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-12-17 08:53:17,412 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-12-17 08:53:17,412 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-12-17 08:53:17,412 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-12-17 08:53:17,412 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-12-17 08:53:17,524 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.005999127009691806); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.00908866414480969); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.005999127009691806); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=2.5E-4); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0045); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-12-17 08:53:17,525 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-12-17 08:53:17,525 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=6.999996851066374E-4, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.005999127009691806); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.00908866414480969); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.005999127009691806); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=2.5E-4); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0045); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-12-17 08:53:17,867 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 443 ms to try 5000 different iterations.  Found a solution that moves 280 regions; Going from a computed imbalance of 6.999996851066374E-4 to a new imbalance of 3.4459690810770265E-5. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=4.178341294946416E-4); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0017727200782610348); MoveCostFunction : (multiplier=7.0, imbalance=0.03111111111111111, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=4.178341294946416E-4); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=2.5E-4); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-12-17 08:53:17,868 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1148880205:83 , srv1698278986:83 , srv1854135865:83 , srv305110642:83 , srv494879012:83 , srv103687302:84 , srv1122740710:84 , srv1196468646:84 , srv1200115505:84 , srv1218302703:84 , srv1393033705:84 , srv1405151332:84 , srv1413902425:84 , srv1427438256:84 , srv1470947078:84 , srv1537382451:84 , srv1608531472:84 , srv1645237998:84 , srv1749425997:84 , srv1766775051:84 , srv1817990438:84 , srv187233880:84 , srv2106835271:84 , srv232184957:84 , srv266603004:84 , srv276773534:84 , srv325920577:84 , srv367188821:84 , srv408020836:84 , srv435580612:84 , srv45252210:84 , srv471150406:84 , srv484951878:84 , srv538396174:84 , srv563908760:84 , srv586518660:84 , srv61992034:84 , srv641651634:84 , srv701130893:84 , srv70185044:84 , srv714327476:84 , srv734257623:84 , srv822437800:84 , srv845697077:84 , srv910707668:84 , srv916635342:84 , srv917749849:84 , srv928768577:84 , srv944349518:84 , srv1068306823:85 , srv1070065224:85 , srv1142589986:85 , srv1153503904:85 , srv1234829010:85 , srv1291545201:85 , srv1314217612:85 , srv1314808994:85 , srv1336948436:85 , srv1350595662:85 , srv1371706316:85 , srv139272484:85 , srv1409627547:85 , srv1502653362:85 , srv1592690740:85 , srv1614773878:85 , srv1623877991:85 , srv168974947:85 , srv173116723:85 , srv1763874995:85 , srv1769998391:85 , srv1956180964:85 , srv2062086951:85 , srv2095736660:85 , srv222988667:85 , srv258969080:85 , srv265787416:85 , srv266312468:85 , srv267887716:85 , srv270196151:85 , srv364395590:85 , srv446941111:85 , srv532495410:85 , srv563783970:85 , srv595012367:85 , srv720420585:85 , srv727615566:85 , srv750046874:85 , srv819001183:85 , srv871758448:85 , srv878391578:85 , srv882072408:85 , srv1215856667:86 , srv1221046879:86 , srv1298945087:86 , srv1607049249:86 , srv1692560000:86 , srv1848932678:86 , srv1868526130:86 , srv879414411:86 , srv1140679171:631 }
2023-12-17 08:53:17,871 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-12-17 08:53:17,872 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv266312468=57, srv1763874995=41, srv822437800=89, srv1122740710=3, srv446941111=68, srv871758448=91, srv494879012=72, srv916635342=96, srv917749849=97, srv276773534=61, srv819001183=88, srv1405151332=23, srv1068306823=1, srv1537382451=29, srv1218302703=11, srv1298945087=15, srv538396174=74, srv408020836=66, srv1314808994=17, srv563783970=75, srv1314217612=16, srv532495410=73, srv1196468646=8, srv1769998391=43, srv1148880205=6, srv1393033705=22, srv187233880=48, srv435580612=67, srv70185044=82, srv258969080=55, srv750046874=87, srv1142589986=5, srv1153503904=7, srv595012367=78, srv1766775051=42, srv701130893=81, srv882072408=94, srv1215856667=10, srv1698278986=38, srv45252210=69, srv266603004=58, srv222988667=53, srv103687302=0, srv879414411=93, srv1291545201=14, srv1868526130=47, srv641651634=80, srv1200115505=9, srv1608531472=32, srv1848932678=45, srv1409627547=24, srv1614773878=33, srv1427438256=26, srv1470947078=27, srv173116723=39, srv168974947=36, srv563908760=76, srv910707668=95, srv139272484=21, srv1692560000=37, srv714327476=83, srv1592690740=30, srv267887716=59, srv1234829010=13, srv270196151=60, srv1371706316=20, srv265787416=56, srv232184957=54, srv61992034=79, srv325920577=63, srv2106835271=52, srv1623877991=34, srv1140679171=4, srv2062086951=50, srv1221046879=12, srv586518660=77, srv1956180964=49, srv1336948436=18, srv1502653362=28, srv484951878=71, srv734257623=86, srv364395590=64, srv1854135865=46, srv471150406=70, srv727615566=85, srv1413902425=25, srv1749425997=40, srv878391578=92, srv1645237998=35, srv1070065224=2, srv845697077=90, srv928768577=98, srv367188821=65, srv1607049249=31, srv305110642=62, srv720420585=84, srv2095736660=51, srv1817990438=44, srv1350595662=19, srv944349518=99} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-12-17 08:53:17,882 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-12-17 08:53:17,882 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-12-17 08:53:17,882 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-12-17 08:53:17,882 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-12-17 08:53:17,883 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-12-17 08:53:17,883 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-12-17 08:53:17,883 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-12-17 08:53:17,883 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-12-17 08:53:17,883 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-12-17 08:53:17,883 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-12-17 08:53:17,883 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-12-17 08:53:17,883 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-12-17 08:53:17,883 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-12-17 08:53:17,883 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-12-17 08:53:17,883 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-12-17 08:53:17,883 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-12-17 08:53:17,883 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-12-17 08:53:17,883 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-12-17 08:53:17,883 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-12-17 08:53:17,883 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-12-17 08:53:17,883 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-12-17 08:53:17,883 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-12-17 08:53:17,883 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-12-17 08:53:17,883 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-12-17 08:53:17,884 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-12-17 08:53:17,884 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-12-17 08:53:17,884 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-12-17 08:53:17,884 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-12-17 08:53:17,884 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-12-17 08:53:17,884 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-12-17 08:53:17,884 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-12-17 08:53:17,884 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-12-17 08:53:17,884 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-12-17 08:53:17,884 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-12-17 08:53:17,884 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-12-17 08:53:17,884 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-12-17 08:53:17,884 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-12-17 08:53:17,884 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-12-17 08:53:17,884 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-12-17 08:53:17,884 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-12-17 08:53:17,884 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-12-17 08:53:17,884 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-12-17 08:53:17,884 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-12-17 08:53:17,884 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-12-17 08:53:17,885 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-12-17 08:53:17,885 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-12-17 08:53:17,885 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-12-17 08:53:17,885 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-12-17 08:53:17,885 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-12-17 08:53:17,885 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-12-17 08:53:17,885 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-12-17 08:53:17,885 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-12-17 08:53:17,885 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-12-17 08:53:17,885 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-12-17 08:53:17,885 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-12-17 08:53:17,885 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-12-17 08:53:17,885 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-12-17 08:53:17,885 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-12-17 08:53:17,885 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-12-17 08:53:17,885 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-12-17 08:53:17,885 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-12-17 08:53:17,885 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-12-17 08:53:17,886 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-12-17 08:53:17,886 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-12-17 08:53:17,886 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-12-17 08:53:17,886 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-12-17 08:53:17,886 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-12-17 08:53:17,886 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-12-17 08:53:17,886 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-12-17 08:53:17,886 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-12-17 08:53:17,886 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-12-17 08:53:17,886 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-12-17 08:53:17,886 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-12-17 08:53:17,886 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-12-17 08:53:17,886 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-12-17 08:53:17,886 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-12-17 08:53:17,886 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-12-17 08:53:17,887 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-12-17 08:53:17,887 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-12-17 08:53:17,887 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-12-17 08:53:17,887 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-12-17 08:53:17,887 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-12-17 08:53:17,887 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-12-17 08:53:17,887 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-12-17 08:53:17,887 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-12-17 08:53:17,887 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-12-17 08:53:17,887 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-12-17 08:53:17,887 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-12-17 08:53:17,887 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-12-17 08:53:17,887 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-12-17 08:53:17,887 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-12-17 08:53:17,887 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-12-17 08:53:17,887 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-12-17 08:53:17,887 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-12-17 08:53:17,887 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-12-17 08:53:17,887 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-12-17 08:53:17,887 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-12-17 08:53:17,888 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-12-17 08:53:17,888 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-12-17 08:53:17,888 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-12-17 08:53:17,888 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-12-17 08:53:17,991 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=4.178341294946416E-4); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0017727200782610348); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=4.178341294946416E-4); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=2.5E-4); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-12-17 08:53:17,991 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-12-17 08:53:17,992 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=3.2499088905985494E-5, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=4.178341294946416E-4); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0017727200782610348); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=4.178341294946416E-4); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=2.5E-4); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-12-17 08:53:18,219 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 324 ms to try 5000 different iterations.  Found a solution that moves 23 regions; Going from a computed imbalance of 3.2499088905985494E-5 to a new imbalance of 7.234288738508196E-6. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0015713484026367722); MoveCostFunction : (multiplier=7.0, imbalance=0.0025555555555555557); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-12-17 08:53:18,220 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1142589986:83 , srv1153503904:83 , srv139272484:83 , srv1607049249:83 , srv1848932678:83 , srv595012367:83 , srv944349518:83 , srv1068306823:84 , srv1070065224:84 , srv1122740710:84 , srv1148880205:84 , srv1196468646:84 , srv1200115505:84 , srv1215856667:84 , srv1218302703:84 , srv1221046879:84 , srv1234829010:84 , srv1291545201:84 , srv1298945087:84 , srv1314217612:84 , srv1314808994:84 , srv1336948436:84 , srv1350595662:84 , srv1371706316:84 , srv1393033705:84 , srv1405151332:84 , srv1409627547:84 , srv1413902425:84 , srv1427438256:84 , srv1470947078:84 , srv1502653362:84 , srv1537382451:84 , srv1592690740:84 , srv1614773878:84 , srv1623877991:84 , srv1645237998:84 , srv168974947:84 , srv1692560000:84 , srv1698278986:84 , srv173116723:84 , srv1763874995:84 , srv1766775051:84 , srv1769998391:84 , srv1817990438:84 , srv1854135865:84 , srv1868526130:84 , srv1956180964:84 , srv2062086951:84 , srv2095736660:84 , srv2106835271:84 , srv222988667:84 , srv232184957:84 , srv258969080:84 , srv266312468:84 , srv266603004:84 , srv267887716:84 , srv270196151:84 , srv276773534:84 , srv305110642:84 , srv325920577:84 , srv364395590:84 , srv367188821:84 , srv408020836:84 , srv435580612:84 , srv446941111:84 , srv45252210:84 , srv471150406:84 , srv484951878:84 , srv532495410:84 , srv538396174:84 , srv563783970:84 , srv563908760:84 , srv586518660:84 , srv61992034:84 , srv641651634:84 , srv701130893:84 , srv70185044:84 , srv714327476:84 , srv720420585:84 , srv727615566:84 , srv734257623:84 , srv750046874:84 , srv819001183:84 , srv822437800:84 , srv845697077:84 , srv871758448:84 , srv878391578:84 , srv879414411:84 , srv882072408:84 , srv910707668:84 , srv917749849:84 , srv928768577:84 , srv103687302:85 , srv1608531472:85 , srv1749425997:85 , srv187233880:85 , srv265787416:85 , srv494879012:85 , srv916635342:85 , srv1140679171:684 }
2023-12-17 08:53:18,229 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-12-17 08:53:18,230 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv266312468=57, srv1763874995=41, srv822437800=89, srv1122740710=3, srv446941111=68, srv871758448=91, srv494879012=72, srv916635342=96, srv917749849=97, srv276773534=61, srv819001183=88, srv1405151332=23, srv1068306823=1, srv1537382451=29, srv1218302703=11, srv1298945087=15, srv538396174=74, srv408020836=66, srv1314808994=17, srv563783970=75, srv1314217612=16, srv532495410=73, srv1196468646=8, srv1769998391=43, srv1148880205=6, srv1393033705=22, srv187233880=48, srv435580612=67, srv70185044=82, srv258969080=55, srv750046874=87, srv1142589986=5, srv1153503904=7, srv595012367=78, srv1766775051=42, srv701130893=81, srv882072408=94, srv1215856667=10, srv1698278986=38, srv45252210=69, srv266603004=58, srv222988667=53, srv103687302=0, srv879414411=93, srv1291545201=14, srv1868526130=47, srv641651634=80, srv1200115505=9, srv1608531472=32, srv1848932678=45, srv1409627547=24, srv1614773878=33, srv1427438256=26, srv1470947078=27, srv173116723=39, srv168974947=36, srv563908760=76, srv910707668=95, srv139272484=21, srv1692560000=37, srv714327476=83, srv1592690740=30, srv267887716=59, srv1234829010=13, srv270196151=60, srv1371706316=20, srv265787416=56, srv232184957=54, srv61992034=79, srv325920577=63, srv2106835271=52, srv1623877991=34, srv1140679171=4, srv2062086951=50, srv1221046879=12, srv586518660=77, srv1956180964=49, srv1336948436=18, srv1502653362=28, srv484951878=71, srv734257623=86, srv364395590=64, srv1854135865=46, srv471150406=70, srv727615566=85, srv1413902425=25, srv1749425997=40, srv878391578=92, srv1645237998=35, srv1070065224=2, srv845697077=90, srv928768577=98, srv367188821=65, srv1607049249=31, srv305110642=62, srv720420585=84, srv2095736660=51, srv1817990438=44, srv1350595662=19, srv944349518=99} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-12-17 08:53:18,240 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-12-17 08:53:18,240 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-12-17 08:53:18,240 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-12-17 08:53:18,240 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-12-17 08:53:18,240 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-12-17 08:53:18,240 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-12-17 08:53:18,240 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-12-17 08:53:18,240 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-12-17 08:53:18,240 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-12-17 08:53:18,240 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-12-17 08:53:18,240 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-12-17 08:53:18,240 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-12-17 08:53:18,240 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-12-17 08:53:18,240 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-12-17 08:53:18,240 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-12-17 08:53:18,241 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-12-17 08:53:18,241 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-12-17 08:53:18,241 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-12-17 08:53:18,241 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-12-17 08:53:18,241 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-12-17 08:53:18,241 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-12-17 08:53:18,241 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-12-17 08:53:18,241 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-12-17 08:53:18,241 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-12-17 08:53:18,241 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-12-17 08:53:18,241 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-12-17 08:53:18,241 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-12-17 08:53:18,241 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-12-17 08:53:18,241 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-12-17 08:53:18,241 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-12-17 08:53:18,241 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-12-17 08:53:18,241 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-12-17 08:53:18,241 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-12-17 08:53:18,241 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-12-17 08:53:18,242 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-12-17 08:53:18,242 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-12-17 08:53:18,242 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-12-17 08:53:18,242 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-12-17 08:53:18,242 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-12-17 08:53:18,242 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-12-17 08:53:18,242 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-12-17 08:53:18,242 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-12-17 08:53:18,242 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-12-17 08:53:18,242 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-12-17 08:53:18,242 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-12-17 08:53:18,242 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-12-17 08:53:18,242 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-12-17 08:53:18,242 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-12-17 08:53:18,242 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-12-17 08:53:18,242 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-12-17 08:53:18,242 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-12-17 08:53:18,242 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-12-17 08:53:18,242 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-12-17 08:53:18,242 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-12-17 08:53:18,242 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-12-17 08:53:18,243 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-12-17 08:53:18,243 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-12-17 08:53:18,243 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-12-17 08:53:18,243 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-12-17 08:53:18,243 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-12-17 08:53:18,243 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-12-17 08:53:18,243 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-12-17 08:53:18,243 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-12-17 08:53:18,243 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-12-17 08:53:18,243 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-12-17 08:53:18,243 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-12-17 08:53:18,243 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-12-17 08:53:18,243 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-12-17 08:53:18,243 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-12-17 08:53:18,243 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-12-17 08:53:18,243 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-12-17 08:53:18,243 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-12-17 08:53:18,243 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-12-17 08:53:18,243 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-12-17 08:53:18,243 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-12-17 08:53:18,243 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-12-17 08:53:18,243 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-12-17 08:53:18,244 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-12-17 08:53:18,244 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-12-17 08:53:18,244 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-12-17 08:53:18,244 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-12-17 08:53:18,244 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-12-17 08:53:18,244 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-12-17 08:53:18,244 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-12-17 08:53:18,244 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-12-17 08:53:18,244 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-12-17 08:53:18,244 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-12-17 08:53:18,244 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-12-17 08:53:18,244 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-12-17 08:53:18,244 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-12-17 08:53:18,244 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-12-17 08:53:18,244 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-12-17 08:53:18,244 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-12-17 08:53:18,245 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-12-17 08:53:18,245 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-12-17 08:53:18,245 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-12-17 08:53:18,245 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-12-17 08:53:18,245 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-12-17 08:53:18,245 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-12-17 08:53:18,245 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-12-17 08:53:18,245 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-12-17 08:53:18,354 INFO  [Time-limited test] balancer.StochasticLoadBalancer(381): Cluster wide - skipping load balancing because weighted average imbalance=7.073239296329447E-6 <= threshold(0.025). If you want more aggressive balancing, either lower hbase.master.balancer.stochastic.minCostNeedBalance from 0.025 or increase the relative multiplier(s) of the specific cost function(s). functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0015713484026367722); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-12-17 08:53:18,354 INFO  [Time-limited test] balancer.BalancerTestBase(570): Mock Final balance: { srv1142589986:83 , srv1153503904:83 , srv139272484:83 , srv1607049249:83 , srv1848932678:83 , srv595012367:83 , srv944349518:83 , srv1068306823:84 , srv1070065224:84 , srv1122740710:84 , srv1148880205:84 , srv1196468646:84 , srv1200115505:84 , srv1215856667:84 , srv1218302703:84 , srv1221046879:84 , srv1234829010:84 , srv1291545201:84 , srv1298945087:84 , srv1314217612:84 , srv1314808994:84 , srv1336948436:84 , srv1350595662:84 , srv1371706316:84 , srv1393033705:84 , srv1405151332:84 , srv1409627547:84 , srv1413902425:84 , srv1427438256:84 , srv1470947078:84 , srv1502653362:84 , srv1537382451:84 , srv1592690740:84 , srv1614773878:84 , srv1623877991:84 , srv1645237998:84 , srv168974947:84 , srv1692560000:84 , srv1698278986:84 , srv173116723:84 , srv1763874995:84 , srv1766775051:84 , srv1769998391:84 , srv1817990438:84 , srv1854135865:84 , srv1868526130:84 , srv1956180964:84 , srv2062086951:84 , srv2095736660:84 , srv2106835271:84 , srv222988667:84 , srv232184957:84 , srv258969080:84 , srv266312468:84 , srv266603004:84 , srv267887716:84 , srv270196151:84 , srv276773534:84 , srv305110642:84 , srv325920577:84 , srv364395590:84 , srv367188821:84 , srv408020836:84 , srv435580612:84 , srv446941111:84 , srv45252210:84 , srv471150406:84 , srv484951878:84 , srv532495410:84 , srv538396174:84 , srv563783970:84 , srv563908760:84 , srv586518660:84 , srv61992034:84 , srv641651634:84 , srv701130893:84 , srv70185044:84 , srv714327476:84 , srv720420585:84 , srv727615566:84 , srv734257623:84 , srv750046874:84 , srv819001183:84 , srv822437800:84 , srv845697077:84 , srv871758448:84 , srv878391578:84 , srv879414411:84 , srv882072408:84 , srv910707668:84 , srv917749849:84 , srv928768577:84 , srv103687302:85 , srv1608531472:85 , srv1749425997:85 , srv187233880:85 , srv265787416:85 , srv494879012:85 , srv916635342:85 , srv1140679171:684 }
2023-12-17 08:53:18,381 INFO  [Time-limited test] hbase.ResourceChecker(175): after: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnLargeClusterWithRacks Thread=12 (was 12), OpenFileDescriptor=290 (was 290), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=314 (was 314), ProcessCount=169 (was 169), AvailableMemoryMB=5022 (was 5623)
2023-12-17 08:53:18,388 INFO  [Time-limited test] hbase.ResourceChecker(147): before: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnMidClusterWithRacks Thread=12, OpenFileDescriptor=290, MaxFileDescriptor=60000, SystemLoadAverage=314, ProcessCount=169, AvailableMemoryMB=5022
2023-12-17 08:53:18,389 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2023-12-17 08:53:18,389 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=5000, runMaxSteps=true, stepsPerRegion=800, maxRunningTime=120000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 111077.0 etc.
2023-12-17 08:53:18,396 INFO  [Time-limited test] balancer.BalancerTestBase(547): Mock Cluster : { srv1002533631:84 , srv1078033362:84 , srv1144985589:84 , srv114621865:84 , srv1261293320:84 , srv1266727150:84 , srv1426045023:84 , srv1463163302:84 , srv148370958:84 , srv1596241011:84 , srv1639857754:84 , srv1662906391:84 , srv1703568258:84 , srv171268080:84 , srv1750184591:84 , srv1867597285:84 , srv1910300502:84 , srv1965885599:84 , srv2069067515:84 , srv253264566:84 , srv494582187:84 , srv562403644:84 , srv59191123:84 , srv776776787:84 , srv793019636:84 , srv807117487:84 , srv813457324:84 , srv83408146:84 , srv977004781:84 , srv1867103725:264 } [srvr=30 rgns=2700 avg=90.0 max=90 min=90]
2023-12-17 08:53:18,398 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-12-17 08:53:18,398 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1750184591=14, srv776776787=24, srv253264566=20, srv1078033362=1, srv977004781=29, srv171268080=13, srv1965885599=18, srv2069067515=19, srv813457324=27, srv59191123=23, srv793019636=25, srv1261293320=4, srv1910300502=17, srv1867597285=16, srv1662906391=11, srv1867103725=15, srv1703568258=12, srv562403644=22, srv1144985589=2, srv114621865=3, srv1596241011=9, srv1639857754=10, srv494582187=21, srv807117487=26, srv148370958=8, srv1002533631=0, srv1266727150=5, srv1463163302=7, srv1426045023=6, srv83408146=28} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-12-17 08:53:18,405 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-12-17 08:53:18,405 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-12-17 08:53:18,405 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-12-17 08:53:18,405 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-12-17 08:53:18,406 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-12-17 08:53:18,406 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-12-17 08:53:18,406 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-12-17 08:53:18,406 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-12-17 08:53:18,406 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-12-17 08:53:18,406 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-12-17 08:53:18,406 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-12-17 08:53:18,406 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-12-17 08:53:18,406 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-12-17 08:53:18,406 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-12-17 08:53:18,406 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-12-17 08:53:18,406 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-12-17 08:53:18,406 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-12-17 08:53:18,406 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-12-17 08:53:18,406 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-12-17 08:53:18,406 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-12-17 08:53:18,406 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-12-17 08:53:18,406 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-12-17 08:53:18,406 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-12-17 08:53:18,406 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-12-17 08:53:18,406 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-12-17 08:53:18,406 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-12-17 08:53:18,406 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-12-17 08:53:18,407 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-12-17 08:53:18,407 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-12-17 08:53:18,407 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-12-17 08:53:18,407 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=10, number of hosts=30, number of racks=4
2023-12-17 08:53:18,422 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=1.167787220377815, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-12-17 08:53:18,422 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.9912721735316933, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=1.167787220377815, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=64800000
2023-12-17 08:55:18,410 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 120001 ms to try 5773236 different iterations.  Found a solution that moves 1855 regions; Going from a computed imbalance of 0.9912721735316933 to a new imbalance of 4.329662539733032E-5. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); MoveCostFunction : (multiplier=7.0, imbalance=0.687037037037037, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-12-17 08:55:18,417 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1002533631:90 , srv1078033362:90 , srv1144985589:90 , srv114621865:90 , srv1261293320:90 , srv1266727150:90 , srv1426045023:90 , srv1463163302:90 , srv148370958:90 , srv1596241011:90 , srv1639857754:90 , srv1662906391:90 , srv1703568258:90 , srv171268080:90 , srv1750184591:90 , srv1867103725:90 , srv1867597285:90 , srv1910300502:90 , srv1965885599:90 , srv2069067515:90 , srv253264566:90 , srv494582187:90 , srv562403644:90 , srv59191123:90 , srv776776787:90 , srv793019636:90 , srv807117487:90 , srv813457324:90 , srv83408146:90 , srv977004781:90 }
2023-12-17 08:55:18,419 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-12-17 08:55:18,419 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1750184591=14, srv776776787=24, srv253264566=20, srv1078033362=1, srv977004781=29, srv171268080=13, srv1965885599=18, srv2069067515=19, srv813457324=27, srv59191123=23, srv793019636=25, srv1261293320=4, srv1910300502=17, srv1867597285=16, srv1662906391=11, srv1867103725=15, srv1703568258=12, srv562403644=22, srv1144985589=2, srv114621865=3, srv1596241011=9, srv1639857754=10, srv494582187=21, srv807117487=26, srv148370958=8, srv1002533631=0, srv1266727150=5, srv1463163302=7, srv1426045023=6, srv83408146=28} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-12-17 08:55:18,422 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-12-17 08:55:18,422 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-12-17 08:55:18,422 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-12-17 08:55:18,422 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-12-17 08:55:18,422 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-12-17 08:55:18,422 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-12-17 08:55:18,423 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-12-17 08:55:18,423 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-12-17 08:55:18,423 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-12-17 08:55:18,423 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-12-17 08:55:18,423 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-12-17 08:55:18,423 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-12-17 08:55:18,423 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-12-17 08:55:18,423 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-12-17 08:55:18,423 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-12-17 08:55:18,423 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-12-17 08:55:18,423 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-12-17 08:55:18,423 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-12-17 08:55:18,423 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-12-17 08:55:18,423 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-12-17 08:55:18,423 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-12-17 08:55:18,423 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-12-17 08:55:18,423 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-12-17 08:55:18,423 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-12-17 08:55:18,423 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-12-17 08:55:18,423 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-12-17 08:55:18,423 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-12-17 08:55:18,423 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-12-17 08:55:18,424 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-12-17 08:55:18,424 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-12-17 08:55:18,424 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=10, number of hosts=30, number of racks=4
2023-12-17 08:55:18,435 INFO  [Time-limited test] balancer.StochasticLoadBalancer(381): Cluster wide - skipping load balancing because weighted average imbalance=0.0 <= threshold(0.025). If you want more aggressive balancing, either lower hbase.master.balancer.stochastic.minCostNeedBalance from 0.025 or increase the relative multiplier(s) of the specific cost function(s). functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-12-17 08:55:18,436 INFO  [Time-limited test] balancer.BalancerTestBase(570): Mock Final balance: { srv1002533631:90 , srv1078033362:90 , srv1144985589:90 , srv114621865:90 , srv1261293320:90 , srv1266727150:90 , srv1426045023:90 , srv1463163302:90 , srv148370958:90 , srv1596241011:90 , srv1639857754:90 , srv1662906391:90 , srv1703568258:90 , srv171268080:90 , srv1750184591:90 , srv1867103725:90 , srv1867597285:90 , srv1910300502:90 , srv1965885599:90 , srv2069067515:90 , srv253264566:90 , srv494582187:90 , srv562403644:90 , srv59191123:90 , srv776776787:90 , srv793019636:90 , srv807117487:90 , srv813457324:90 , srv83408146:90 , srv977004781:90 }
2023-12-17 08:55:18,448 INFO  [Time-limited test] hbase.ResourceChecker(175): after: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnMidClusterWithRacks Thread=11 (was 12), OpenFileDescriptor=290 (was 290), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=161 (was 314), ProcessCount=169 (was 169), AvailableMemoryMB=3927 (was 5022)