2023-05-24 04:00:23,307 INFO  [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks timeout: 13 mins
2023-05-24 04:00:23,544 WARN  [Time-limited test] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties
2023-05-24 04:00:23,631 INFO  [Time-limited test] metrics.MetricRegistriesLoader(60): Loaded MetricRegistries class org.apache.hadoop.hbase.metrics.impl.MetricRegistriesImpl
2023-05-24 04:00:23,679 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2023-05-24 04:00:23,685 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc.
2023-05-24 04:00:23,696 INFO  [Time-limited test] hbase.ResourceChecker(147): before: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnLargeClusterWithRacks Thread=12, OpenFileDescriptor=264, MaxFileDescriptor=60000, SystemLoadAverage=115, ProcessCount=167, AvailableMemoryMB=13349
2023-05-24 04:00:23,698 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2023-05-24 04:00:23,699 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=5000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=10000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc.
2023-05-24 04:00:23,800 INFO  [Time-limited test] balancer.BalancerTestBase(547): Mock Cluster : { srv1031753021:84 , srv1058659233:84 , srv1061596630:84 , srv1080885904:84 , srv1085042762:84 , srv1135673819:84 , srv1171304749:84 , srv1185124334:84 , srv1201883076:84 , srv1228737779:84 , srv1261318951:84 , srv1262401893:84 , srv1297561071:84 , srv1359697624:84 , srv1362815994:84 , srv1377586190:84 , srv1434121449:84 , srv1450371857:84 , srv148028826:84 , srv1489454434:84 , srv1494455991:84 , srv1500452199:84 , srv1509269464:84 , srv1514046060:84 , srv1516274214:84 , srv1566874802:84 , srv1590628186:84 , srv1600177674:84 , srv1651535937:84 , srv1654526210:84 , srv1701716665:84 , srv1722919863:84 , srv1741195159:84 , srv1746835924:84 , srv1763439698:84 , srv1785148259:84 , srv18229023:84 , srv1870478492:84 , srv1877761707:84 , srv1914586991:84 , srv1925414182:84 , srv1929800355:84 , srv1933862511:84 , srv194101685:84 , srv195460271:84 , srv1959290040:84 , srv1987053360:84 , srv204611786:84 , srv2056596236:84 , srv2067084930:84 , srv2070062705:84 , srv2081625226:84 , srv2087033381:84 , srv2091846700:84 , srv2103478508:84 , srv2119656485:84 , srv214088003:84 , srv219231552:84 , srv292428978:84 , srv321843885:84 , srv333290458:84 , srv36186113:84 , srv385960836:84 , srv43477500:84 , srv527942068:84 , srv537694953:84 , srv544749383:84 , srv554912957:84 , srv561033154:84 , srv582309912:84 , srv601331203:84 , srv610027896:84 , srv656686867:84 , srv686524342:84 , srv69256765:84 , srv729530799:84 , srv739214244:84 , srv745296839:84 , srv764930358:84 , srv788673046:84 , srv789528110:84 , srv791376720:84 , srv792425822:84 , srv804384643:84 , srv809585489:84 , srv8186410:84 , srv824255813:84 , srv829584444:84 , srv837334598:84 , srv839731928:84 , srv84791013:84 , srv85642798:84 , srv864059850:84 , srv918321220:84 , srv930631546:84 , srv933052934:84 , srv940711640:84 , srv944188428:84 , srv999591420:84 , srv1368465954:684 } [srvr=100 rgns=9000 avg=90.0 max=90 min=90]
2023-05-24 04:00:23,807 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-05-24 04:00:23,822 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv385960836=63, srv2087033381=53, srv839731928=90, srv1494455991=21, srv8186410=86, srv1061596630=2, srv1516274214=25, srv788673046=80, srv918321220=94, srv85642798=92, srv829584444=88, srv292428978=59, srv582309912=70, srv804384643=84, srv195460271=45, srv824255813=87, srv1746835924=34, srv18229023=37, srv739214244=77, srv204611786=48, srv1654526210=30, srv84791013=91, srv1201883076=8, srv2119656485=56, srv2091846700=54, srv1500452199=22, srv610027896=72, srv999591420=99, srv1741195159=33, srv1590628186=27, srv1925414182=41, srv1228737779=9, srv789528110=81, srv1085042762=4, srv1058659233=1, srv1959290040=46, srv1870478492=38, srv1877761707=39, srv1514046060=24, srv1933862511=43, srv1450371857=18, srv69256765=75, srv1171304749=6, srv930631546=95, srv544749383=67, srv1763439698=35, srv2056596236=49, srv1929800355=42, srv1651535937=29, srv864059850=93, srv745296839=78, srv1566874802=26, srv1509269464=23, srv1031753021=0, srv1600177674=28, srv601331203=71, srv944188428=98, srv321843885=60, srv2070062705=51, srv333290458=61, srv933052934=96, srv148028826=19, srv940711640=97, srv1135673819=5, srv561033154=69, srv1080885904=3, srv554912957=68, srv1362815994=14, srv1914586991=40, srv1262401893=11, srv194101685=44, srv219231552=58, srv656686867=73, srv1297561071=12, srv1185124334=7, srv2067084930=50, srv1261318951=10, srv764930358=79, srv2103478508=55, srv214088003=57, srv791376720=82, srv1368465954=15, srv1701716665=31, srv43477500=64, srv1489454434=20, srv1377586190=16, srv1434121449=17, srv2081625226=52, srv36186113=62, srv729530799=76, srv1987053360=47, srv527942068=65, srv537694953=66, srv1359697624=13, srv792425822=83, srv1722919863=32, srv809585489=85, srv686524342=74, srv837334598=89, srv1785148259=36} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-05-24 04:00:23,903 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-05-24 04:00:23,904 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-05-24 04:00:23,904 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-05-24 04:00:23,904 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-05-24 04:00:23,904 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-05-24 04:00:23,904 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-05-24 04:00:23,905 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-05-24 04:00:23,905 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-05-24 04:00:23,905 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-05-24 04:00:23,905 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-05-24 04:00:23,905 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-05-24 04:00:23,905 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-05-24 04:00:23,906 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-05-24 04:00:23,906 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-05-24 04:00:23,906 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-05-24 04:00:23,906 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-05-24 04:00:23,906 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-05-24 04:00:23,906 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-05-24 04:00:23,906 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-05-24 04:00:23,907 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-05-24 04:00:23,907 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-05-24 04:00:23,907 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-05-24 04:00:23,907 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-05-24 04:00:23,907 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-05-24 04:00:23,907 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-05-24 04:00:23,908 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-05-24 04:00:23,908 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-05-24 04:00:23,908 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-05-24 04:00:23,908 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-05-24 04:00:23,908 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-05-24 04:00:23,908 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-05-24 04:00:23,908 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-05-24 04:00:23,909 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-05-24 04:00:23,909 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-05-24 04:00:23,909 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-05-24 04:00:23,909 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-05-24 04:00:23,909 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-05-24 04:00:23,909 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-05-24 04:00:23,910 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-05-24 04:00:23,910 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-05-24 04:00:23,910 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-05-24 04:00:23,910 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-05-24 04:00:23,910 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-05-24 04:00:23,910 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-05-24 04:00:23,910 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-05-24 04:00:23,911 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-05-24 04:00:23,911 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-05-24 04:00:23,911 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-05-24 04:00:23,911 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-05-24 04:00:23,911 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-05-24 04:00:23,911 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-05-24 04:00:23,911 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-05-24 04:00:23,912 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-05-24 04:00:23,912 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-05-24 04:00:23,912 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-05-24 04:00:23,912 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-05-24 04:00:23,912 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-05-24 04:00:23,912 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-05-24 04:00:23,912 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-05-24 04:00:23,913 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-05-24 04:00:23,913 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-05-24 04:00:23,913 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-05-24 04:00:23,913 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-05-24 04:00:23,913 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-05-24 04:00:23,913 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-05-24 04:00:23,913 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-05-24 04:00:23,914 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-05-24 04:00:23,914 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-05-24 04:00:23,914 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-05-24 04:00:23,914 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-05-24 04:00:23,914 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-05-24 04:00:23,914 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-05-24 04:00:23,914 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-05-24 04:00:23,915 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-05-24 04:00:23,915 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-05-24 04:00:23,915 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-05-24 04:00:23,915 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-05-24 04:00:23,915 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-05-24 04:00:23,915 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-05-24 04:00:23,915 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-05-24 04:00:23,916 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-05-24 04:00:23,916 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-05-24 04:00:23,916 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-05-24 04:00:23,916 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-05-24 04:00:23,916 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-05-24 04:00:23,916 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-05-24 04:00:23,916 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-05-24 04:00:23,916 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-05-24 04:00:23,917 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-05-24 04:00:23,917 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-05-24 04:00:23,917 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-05-24 04:00:23,917 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-05-24 04:00:23,917 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-05-24 04:00:23,917 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-05-24 04:00:23,918 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-05-24 04:00:23,918 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-05-24 04:00:23,918 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-05-24 04:00:23,918 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-05-24 04:00:23,918 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-05-24 04:00:23,918 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-05-24 04:00:23,919 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-05-24 04:00:24,142 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.06666666666666667, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-05-24 04:00:24,143 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-05-24 04:00:24,143 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.9909252140407105, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.06666666666666667, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-05-24 04:00:24,392 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 446 ms to try 5000 different iterations.  Found a solution that moves 4703 regions; Going from a computed imbalance of 0.9909252140407105 to a new imbalance of 0.17865590419681995. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.037142946216913476, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.05373167737712848, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.5225555555555556, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.037142946216913476, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.1735, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.24441666666666667, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-05-24 04:00:24,403 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv2091846700:81 , srv1061596630:82 , srv2056596236:82 , srv788673046:82 , srv1058659233:83 , srv1135673819:83 , srv1185124334:83 , srv1450371857:83 , srv1929800355:83 , srv214088003:83 , srv333290458:83 , srv1362815994:84 , srv148028826:84 , srv1516274214:84 , srv1566874802:84 , srv2067084930:84 , srv292428978:84 , srv554912957:84 , srv764930358:84 , srv1031753021:85 , srv1261318951:85 , srv1359697624:85 , srv1500452199:85 , srv1870478492:85 , srv195460271:85 , srv1987053360:85 , srv2070062705:85 , srv219231552:85 , srv527942068:85 , srv739214244:85 , srv789528110:85 , srv837334598:85 , srv864059850:85 , srv940711640:85 , srv1085042762:86 , srv1489454434:86 , srv1651535937:86 , srv1654526210:86 , srv1722919863:86 , srv1741195159:86 , srv1933862511:86 , srv2081625226:86 , srv385960836:86 , srv43477500:86 , srv537694953:86 , srv544749383:86 , srv791376720:86 , srv809585489:86 , srv8186410:86 , srv829584444:86 , srv999591420:86 , srv1494455991:87 , srv1509269464:87 , srv1701716665:87 , srv18229023:87 , srv2087033381:87 , srv2103478508:87 , srv561033154:87 , srv582309912:87 , srv792425822:87 , srv839731928:87 , srv85642798:87 , srv1171304749:88 , srv1201883076:88 , srv1590628186:88 , srv1763439698:88 , srv1914586991:88 , srv1959290040:88 , srv321843885:88 , srv36186113:88 , srv610027896:88 , srv656686867:88 , srv933052934:88 , srv1228737779:89 , srv1297561071:89 , srv1514046060:89 , srv1785148259:89 , srv194101685:89 , srv204611786:89 , srv2119656485:89 , srv686524342:89 , srv69256765:89 , srv745296839:89 , srv918321220:89 , srv944188428:89 , srv1262401893:90 , srv1377586190:90 , srv1434121449:90 , srv1877761707:90 , srv1925414182:90 , srv729530799:90 , srv804384643:90 , srv930631546:90 , srv1080885904:91 , srv1746835924:91 , srv824255813:91 , srv84791013:91 , srv1600177674:92 , srv601331203:94 , srv1368465954:420 }
2023-05-24 04:00:24,408 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-05-24 04:00:24,408 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv385960836=63, srv2087033381=53, srv839731928=90, srv1494455991=21, srv8186410=86, srv1061596630=2, srv1516274214=25, srv788673046=80, srv918321220=94, srv85642798=92, srv829584444=88, srv292428978=59, srv582309912=70, srv804384643=84, srv195460271=45, srv824255813=87, srv1746835924=34, srv18229023=37, srv739214244=77, srv204611786=48, srv1654526210=30, srv84791013=91, srv1201883076=8, srv2119656485=56, srv2091846700=54, srv1500452199=22, srv610027896=72, srv999591420=99, srv1741195159=33, srv1590628186=27, srv1925414182=41, srv1228737779=9, srv789528110=81, srv1085042762=4, srv1058659233=1, srv1959290040=46, srv1870478492=38, srv1877761707=39, srv1514046060=24, srv1933862511=43, srv1450371857=18, srv69256765=75, srv1171304749=6, srv930631546=95, srv544749383=67, srv1763439698=35, srv2056596236=49, srv1929800355=42, srv1651535937=29, srv864059850=93, srv745296839=78, srv1566874802=26, srv1509269464=23, srv1031753021=0, srv1600177674=28, srv601331203=71, srv944188428=98, srv321843885=60, srv2070062705=51, srv333290458=61, srv933052934=96, srv148028826=19, srv940711640=97, srv1135673819=5, srv561033154=69, srv1080885904=3, srv554912957=68, srv1362815994=14, srv1914586991=40, srv1262401893=11, srv194101685=44, srv219231552=58, srv656686867=73, srv1297561071=12, srv1185124334=7, srv2067084930=50, srv1261318951=10, srv764930358=79, srv2103478508=55, srv214088003=57, srv791376720=82, srv1368465954=15, srv1701716665=31, srv43477500=64, srv1489454434=20, srv1377586190=16, srv1434121449=17, srv2081625226=52, srv36186113=62, srv729530799=76, srv1987053360=47, srv527942068=65, srv537694953=66, srv1359697624=13, srv792425822=83, srv1722919863=32, srv809585489=85, srv686524342=74, srv837334598=89, srv1785148259=36} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-05-24 04:00:24,431 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-05-24 04:00:24,431 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-05-24 04:00:24,431 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-05-24 04:00:24,431 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-05-24 04:00:24,431 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-05-24 04:00:24,431 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-05-24 04:00:24,432 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-05-24 04:00:24,432 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-05-24 04:00:24,432 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-05-24 04:00:24,432 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-05-24 04:00:24,432 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-05-24 04:00:24,432 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-05-24 04:00:24,432 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-05-24 04:00:24,432 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-05-24 04:00:24,433 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-05-24 04:00:24,433 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-05-24 04:00:24,433 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-05-24 04:00:24,433 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-05-24 04:00:24,433 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-05-24 04:00:24,433 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-05-24 04:00:24,433 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-05-24 04:00:24,433 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-05-24 04:00:24,433 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-05-24 04:00:24,434 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-05-24 04:00:24,434 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-05-24 04:00:24,434 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-05-24 04:00:24,434 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-05-24 04:00:24,434 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-05-24 04:00:24,434 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-05-24 04:00:24,434 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-05-24 04:00:24,434 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-05-24 04:00:24,435 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-05-24 04:00:24,435 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-05-24 04:00:24,435 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-05-24 04:00:24,435 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-05-24 04:00:24,435 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-05-24 04:00:24,435 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-05-24 04:00:24,435 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-05-24 04:00:24,435 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-05-24 04:00:24,435 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-05-24 04:00:24,435 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-05-24 04:00:24,436 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-05-24 04:00:24,436 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-05-24 04:00:24,436 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-05-24 04:00:24,436 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-05-24 04:00:24,436 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-05-24 04:00:24,436 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-05-24 04:00:24,436 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-05-24 04:00:24,436 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-05-24 04:00:24,436 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-05-24 04:00:24,436 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-05-24 04:00:24,437 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-05-24 04:00:24,437 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-05-24 04:00:24,437 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-05-24 04:00:24,437 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-05-24 04:00:24,437 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-05-24 04:00:24,437 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-05-24 04:00:24,437 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-05-24 04:00:24,437 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-05-24 04:00:24,437 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-05-24 04:00:24,438 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-05-24 04:00:24,438 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-05-24 04:00:24,438 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-05-24 04:00:24,438 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-05-24 04:00:24,438 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-05-24 04:00:24,438 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-05-24 04:00:24,438 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-05-24 04:00:24,438 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-05-24 04:00:24,438 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-05-24 04:00:24,438 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-05-24 04:00:24,439 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-05-24 04:00:24,439 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-05-24 04:00:24,439 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-05-24 04:00:24,439 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-05-24 04:00:24,439 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-05-24 04:00:24,439 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-05-24 04:00:24,439 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-05-24 04:00:24,439 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-05-24 04:00:24,439 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-05-24 04:00:24,440 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-05-24 04:00:24,440 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-05-24 04:00:24,440 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-05-24 04:00:24,440 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-05-24 04:00:24,440 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-05-24 04:00:24,440 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-05-24 04:00:24,440 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-05-24 04:00:24,440 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-05-24 04:00:24,440 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-05-24 04:00:24,441 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-05-24 04:00:24,441 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-05-24 04:00:24,441 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-05-24 04:00:24,441 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-05-24 04:00:24,441 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-05-24 04:00:24,441 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-05-24 04:00:24,441 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-05-24 04:00:24,441 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-05-24 04:00:24,441 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-05-24 04:00:24,442 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-05-24 04:00:24,442 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-05-24 04:00:24,442 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-05-24 04:00:24,442 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-05-24 04:00:24,539 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.037142946216913476, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.05373167737712848, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.037142946216913476, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.1735, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.24441666666666667, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-05-24 04:00:24,539 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-05-24 04:00:24,539 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.1786229730869692, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.037142946216913476, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.05373167737712848, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.037142946216913476, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.1735, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.24441666666666667, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-05-24 04:00:24,720 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 262 ms to try 5000 different iterations.  Found a solution that moves 2642 regions; Going from a computed imbalance of 0.1786229730869692 to a new imbalance of 0.01609819823944871. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.020596540570609); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0334643888314925, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.29355555555555557, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.020596540570609); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.012833333333333334); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0475, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-05-24 04:00:24,731 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1600177674:79 , srv1746835924:79 , srv601331203:80 , srv824255813:80 , srv84791013:81 , srv1080885904:82 , srv1201883076:82 , srv1297561071:82 , srv1434121449:82 , srv1877761707:82 , srv1959290040:82 , srv2119656485:82 , srv69256765:82 , srv930631546:82 , srv1171304749:83 , srv1262401893:83 , srv1590628186:83 , srv1763439698:83 , srv1785148259:83 , srv18229023:83 , srv656686867:83 , srv686524342:83 , srv729530799:83 , srv839731928:83 , srv1228737779:84 , srv1500452199:84 , srv1722919863:84 , srv1741195159:84 , srv1925414182:84 , srv194101685:84 , srv204611786:84 , srv2081625226:84 , srv2103478508:84 , srv385960836:84 , srv544749383:84 , srv1377586190:85 , srv1489454434:85 , srv1494455991:85 , srv1514046060:85 , srv1914586991:85 , srv321843885:85 , srv36186113:85 , srv745296839:85 , srv804384643:85 , srv864059850:85 , srv940711640:85 , srv944188428:85 , srv999591420:85 , srv1509269464:86 , srv1654526210:86 , srv1701716665:86 , srv43477500:86 , srv582309912:86 , srv610027896:86 , srv791376720:86 , srv792425822:86 , srv809585489:86 , srv8186410:86 , srv829584444:86 , srv837334598:86 , srv85642798:86 , srv918321220:86 , srv933052934:86 , srv1085042762:87 , srv1261318951:87 , srv1450371857:87 , srv148028826:87 , srv1566874802:87 , srv1651535937:87 , srv1870478492:87 , srv1933862511:87 , srv1987053360:87 , srv2070062705:87 , srv2087033381:87 , srv561033154:87 , srv789528110:87 , srv1359697624:88 , srv1362815994:88 , srv1929800355:88 , srv292428978:88 , srv333290458:88 , srv527942068:88 , srv537694953:88 , srv788673046:88 , srv1031753021:89 , srv1058659233:89 , srv1185124334:89 , srv1516274214:89 , srv195460271:89 , srv2067084930:89 , srv214088003:89 , srv219231552:89 , srv554912957:89 , srv739214244:89 , srv764930358:89 , srv1061596630:90 , srv1135673819:91 , srv2056596236:91 , srv2091846700:91 , srv1368465954:537 }
2023-05-24 04:00:24,734 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-05-24 04:00:24,735 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv385960836=63, srv2087033381=53, srv839731928=90, srv1494455991=21, srv8186410=86, srv1061596630=2, srv1516274214=25, srv788673046=80, srv918321220=94, srv85642798=92, srv829584444=88, srv292428978=59, srv582309912=70, srv804384643=84, srv195460271=45, srv824255813=87, srv1746835924=34, srv18229023=37, srv739214244=77, srv204611786=48, srv1654526210=30, srv84791013=91, srv1201883076=8, srv2119656485=56, srv2091846700=54, srv1500452199=22, srv610027896=72, srv999591420=99, srv1741195159=33, srv1590628186=27, srv1925414182=41, srv1228737779=9, srv789528110=81, srv1085042762=4, srv1058659233=1, srv1959290040=46, srv1870478492=38, srv1877761707=39, srv1514046060=24, srv1933862511=43, srv1450371857=18, srv69256765=75, srv1171304749=6, srv930631546=95, srv544749383=67, srv1763439698=35, srv2056596236=49, srv1929800355=42, srv1651535937=29, srv864059850=93, srv745296839=78, srv1566874802=26, srv1509269464=23, srv1031753021=0, srv1600177674=28, srv601331203=71, srv944188428=98, srv321843885=60, srv2070062705=51, srv333290458=61, srv933052934=96, srv148028826=19, srv940711640=97, srv1135673819=5, srv561033154=69, srv1080885904=3, srv554912957=68, srv1362815994=14, srv1914586991=40, srv1262401893=11, srv194101685=44, srv219231552=58, srv656686867=73, srv1297561071=12, srv1185124334=7, srv2067084930=50, srv1261318951=10, srv764930358=79, srv2103478508=55, srv214088003=57, srv791376720=82, srv1368465954=15, srv1701716665=31, srv43477500=64, srv1489454434=20, srv1377586190=16, srv1434121449=17, srv2081625226=52, srv36186113=62, srv729530799=76, srv1987053360=47, srv527942068=65, srv537694953=66, srv1359697624=13, srv792425822=83, srv1722919863=32, srv809585489=85, srv686524342=74, srv837334598=89, srv1785148259=36} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-05-24 04:00:24,749 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-05-24 04:00:24,749 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-05-24 04:00:24,749 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-05-24 04:00:24,749 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-05-24 04:00:24,749 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-05-24 04:00:24,749 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-05-24 04:00:24,749 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-05-24 04:00:24,749 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-05-24 04:00:24,749 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-05-24 04:00:24,749 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-05-24 04:00:24,749 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-05-24 04:00:24,749 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-05-24 04:00:24,750 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-05-24 04:00:24,750 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-05-24 04:00:24,750 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-05-24 04:00:24,750 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-05-24 04:00:24,750 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-05-24 04:00:24,750 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-05-24 04:00:24,750 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-05-24 04:00:24,750 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-05-24 04:00:24,750 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-05-24 04:00:24,750 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-05-24 04:00:24,750 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-05-24 04:00:24,750 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-05-24 04:00:24,750 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-05-24 04:00:24,750 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-05-24 04:00:24,750 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-05-24 04:00:24,751 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-05-24 04:00:24,751 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-05-24 04:00:24,751 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-05-24 04:00:24,751 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-05-24 04:00:24,751 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-05-24 04:00:24,751 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-05-24 04:00:24,751 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-05-24 04:00:24,751 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-05-24 04:00:24,751 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-05-24 04:00:24,751 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-05-24 04:00:24,751 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-05-24 04:00:24,751 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-05-24 04:00:24,751 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-05-24 04:00:24,751 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-05-24 04:00:24,751 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-05-24 04:00:24,751 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-05-24 04:00:24,752 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-05-24 04:00:24,752 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-05-24 04:00:24,752 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-05-24 04:00:24,752 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-05-24 04:00:24,752 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-05-24 04:00:24,752 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-05-24 04:00:24,752 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-05-24 04:00:24,752 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-05-24 04:00:24,752 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-05-24 04:00:24,753 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-05-24 04:00:24,753 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-05-24 04:00:24,753 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-05-24 04:00:24,753 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-05-24 04:00:24,753 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-05-24 04:00:24,753 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-05-24 04:00:24,753 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-05-24 04:00:24,753 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-05-24 04:00:24,753 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-05-24 04:00:24,754 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-05-24 04:00:24,754 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-05-24 04:00:24,754 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-05-24 04:00:24,754 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-05-24 04:00:24,754 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-05-24 04:00:24,754 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-05-24 04:00:24,754 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-05-24 04:00:24,754 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-05-24 04:00:24,754 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-05-24 04:00:24,755 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-05-24 04:00:24,755 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-05-24 04:00:24,755 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-05-24 04:00:24,755 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-05-24 04:00:24,755 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-05-24 04:00:24,755 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-05-24 04:00:24,755 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-05-24 04:00:24,756 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-05-24 04:00:24,756 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-05-24 04:00:24,756 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-05-24 04:00:24,756 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-05-24 04:00:24,756 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-05-24 04:00:24,756 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-05-24 04:00:24,756 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-05-24 04:00:24,756 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-05-24 04:00:24,756 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-05-24 04:00:24,756 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-05-24 04:00:24,756 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-05-24 04:00:24,756 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-05-24 04:00:24,756 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-05-24 04:00:24,756 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-05-24 04:00:24,757 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-05-24 04:00:24,757 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-05-24 04:00:24,757 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-05-24 04:00:24,757 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-05-24 04:00:24,757 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-05-24 04:00:24,757 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-05-24 04:00:24,757 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-05-24 04:00:24,757 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-05-24 04:00:24,757 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-05-24 04:00:24,757 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-05-24 04:00:24,838 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.020596540570609); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0334643888314925, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.020596540570609); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.012833333333333334); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0475, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-05-24 04:00:24,838 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-05-24 04:00:24,838 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.016079698560047134, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.020596540570609); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0334643888314925, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.020596540570609); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.012833333333333334); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0475, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-05-24 04:00:25,001 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 234 ms to try 5000 different iterations.  Found a solution that moves 991 regions; Going from a computed imbalance of 0.016079698560047134 to a new imbalance of 0.0010293581179851. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.006683480480676067); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.006649810339649611); MoveCostFunction : (multiplier=7.0, imbalance=0.11011111111111112, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.006683480480676067); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=5.0E-4); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.005666666666666667); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-05-24 04:00:25,003 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv739214244:82 , srv745296839:82 , srv1135673819:83 , srv1377586190:83 , srv1651535937:83 , srv2087033381:83 , srv537694953:83 , srv561033154:83 , srv601331203:83 , srv764930358:83 , srv804384643:83 , srv918321220:83 , srv933052934:83 , srv944188428:83 , srv1031753021:84 , srv1359697624:84 , srv1362815994:84 , srv1514046060:84 , srv1516274214:84 , srv1925414182:84 , srv195460271:84 , srv527942068:84 , srv554912957:84 , srv610027896:84 , srv792425822:84 , srv1058659233:85 , srv1061596630:85 , srv1080885904:85 , srv1085042762:85 , srv1185124334:85 , srv1228737779:85 , srv1262401893:85 , srv1509269464:85 , srv1654526210:85 , srv1701716665:85 , srv1870478492:85 , srv1877761707:85 , srv1914586991:85 , srv1933862511:85 , srv194101685:85 , srv1987053360:85 , srv204611786:85 , srv2056596236:85 , srv2067084930:85 , srv2103478508:85 , srv214088003:85 , srv219231552:85 , srv292428978:85 , srv321843885:85 , srv333290458:85 , srv36186113:85 , srv43477500:85 , srv582309912:85 , srv656686867:85 , srv686524342:85 , srv789528110:85 , srv791376720:85 , srv8186410:85 , srv837334598:85 , srv84791013:85 , srv930631546:85 , srv1261318951:86 , srv1297561071:86 , srv1434121449:86 , srv148028826:86 , srv1489454434:86 , srv1494455991:86 , srv1746835924:86 , srv1763439698:86 , srv1785148259:86 , srv18229023:86 , srv2070062705:86 , srv2091846700:86 , srv2119656485:86 , srv69256765:86 , srv729530799:86 , srv809585489:86 , srv829584444:86 , srv864059850:86 , srv940711640:86 , srv999591420:86 , srv1450371857:87 , srv1566874802:87 , srv1590628186:87 , srv1741195159:87 , srv1929800355:87 , srv1959290040:87 , srv788673046:87 , srv824255813:87 , srv85642798:87 , srv1171304749:88 , srv1201883076:88 , srv1500452199:88 , srv1600177674:88 , srv1722919863:88 , srv2081625226:88 , srv385960836:88 , srv839731928:88 , srv544749383:89 , srv1368465954:560 }
2023-05-24 04:00:25,006 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-05-24 04:00:25,006 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv385960836=63, srv2087033381=53, srv839731928=90, srv1494455991=21, srv8186410=86, srv1061596630=2, srv1516274214=25, srv788673046=80, srv918321220=94, srv85642798=92, srv829584444=88, srv292428978=59, srv582309912=70, srv804384643=84, srv195460271=45, srv824255813=87, srv1746835924=34, srv18229023=37, srv739214244=77, srv204611786=48, srv1654526210=30, srv84791013=91, srv1201883076=8, srv2119656485=56, srv2091846700=54, srv1500452199=22, srv610027896=72, srv999591420=99, srv1741195159=33, srv1590628186=27, srv1925414182=41, srv1228737779=9, srv789528110=81, srv1085042762=4, srv1058659233=1, srv1959290040=46, srv1870478492=38, srv1877761707=39, srv1514046060=24, srv1933862511=43, srv1450371857=18, srv69256765=75, srv1171304749=6, srv930631546=95, srv544749383=67, srv1763439698=35, srv2056596236=49, srv1929800355=42, srv1651535937=29, srv864059850=93, srv745296839=78, srv1566874802=26, srv1509269464=23, srv1031753021=0, srv1600177674=28, srv601331203=71, srv944188428=98, srv321843885=60, srv2070062705=51, srv333290458=61, srv933052934=96, srv148028826=19, srv940711640=97, srv1135673819=5, srv561033154=69, srv1080885904=3, srv554912957=68, srv1362815994=14, srv1914586991=40, srv1262401893=11, srv194101685=44, srv219231552=58, srv656686867=73, srv1297561071=12, srv1185124334=7, srv2067084930=50, srv1261318951=10, srv764930358=79, srv2103478508=55, srv214088003=57, srv791376720=82, srv1368465954=15, srv1701716665=31, srv43477500=64, srv1489454434=20, srv1377586190=16, srv1434121449=17, srv2081625226=52, srv36186113=62, srv729530799=76, srv1987053360=47, srv527942068=65, srv537694953=66, srv1359697624=13, srv792425822=83, srv1722919863=32, srv809585489=85, srv686524342=74, srv837334598=89, srv1785148259=36} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-05-24 04:00:25,015 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-05-24 04:00:25,015 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-05-24 04:00:25,015 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-05-24 04:00:25,015 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-05-24 04:00:25,015 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-05-24 04:00:25,015 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-05-24 04:00:25,016 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-05-24 04:00:25,016 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-05-24 04:00:25,016 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-05-24 04:00:25,016 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-05-24 04:00:25,016 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-05-24 04:00:25,016 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-05-24 04:00:25,016 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-05-24 04:00:25,016 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-05-24 04:00:25,016 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-05-24 04:00:25,016 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-05-24 04:00:25,016 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-05-24 04:00:25,016 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-05-24 04:00:25,016 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-05-24 04:00:25,016 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-05-24 04:00:25,016 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-05-24 04:00:25,016 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-05-24 04:00:25,016 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-05-24 04:00:25,016 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-05-24 04:00:25,017 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-05-24 04:00:25,017 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-05-24 04:00:25,017 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-05-24 04:00:25,017 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-05-24 04:00:25,017 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-05-24 04:00:25,017 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-05-24 04:00:25,017 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-05-24 04:00:25,017 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-05-24 04:00:25,017 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-05-24 04:00:25,017 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-05-24 04:00:25,017 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-05-24 04:00:25,017 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-05-24 04:00:25,017 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-05-24 04:00:25,017 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-05-24 04:00:25,017 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-05-24 04:00:25,017 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-05-24 04:00:25,018 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-05-24 04:00:25,018 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-05-24 04:00:25,018 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-05-24 04:00:25,018 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-05-24 04:00:25,018 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-05-24 04:00:25,018 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-05-24 04:00:25,018 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-05-24 04:00:25,018 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-05-24 04:00:25,018 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-05-24 04:00:25,018 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-05-24 04:00:25,018 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-05-24 04:00:25,018 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-05-24 04:00:25,018 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-05-24 04:00:25,018 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-05-24 04:00:25,019 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-05-24 04:00:25,019 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-05-24 04:00:25,019 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-05-24 04:00:25,019 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-05-24 04:00:25,019 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-05-24 04:00:25,019 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-05-24 04:00:25,019 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-05-24 04:00:25,019 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-05-24 04:00:25,019 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-05-24 04:00:25,019 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-05-24 04:00:25,019 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-05-24 04:00:25,019 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-05-24 04:00:25,019 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-05-24 04:00:25,019 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-05-24 04:00:25,019 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-05-24 04:00:25,019 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-05-24 04:00:25,020 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-05-24 04:00:25,020 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-05-24 04:00:25,020 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-05-24 04:00:25,020 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-05-24 04:00:25,020 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-05-24 04:00:25,020 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-05-24 04:00:25,020 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-05-24 04:00:25,020 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-05-24 04:00:25,020 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-05-24 04:00:25,020 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-05-24 04:00:25,020 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-05-24 04:00:25,020 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-05-24 04:00:25,020 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-05-24 04:00:25,020 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-05-24 04:00:25,020 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-05-24 04:00:25,020 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-05-24 04:00:25,020 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-05-24 04:00:25,020 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-05-24 04:00:25,021 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-05-24 04:00:25,021 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-05-24 04:00:25,021 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-05-24 04:00:25,021 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-05-24 04:00:25,021 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-05-24 04:00:25,021 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-05-24 04:00:25,021 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-05-24 04:00:25,021 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-05-24 04:00:25,021 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-05-24 04:00:25,021 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-05-24 04:00:25,021 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-05-24 04:00:25,021 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-05-24 04:00:25,021 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-05-24 04:00:25,100 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.006683480480676067); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.006649810339649611); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.006683480480676067); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=5.0E-4); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.005666666666666667); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-05-24 04:00:25,100 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-05-24 04:00:25,100 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.0010224189876720938, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.006683480480676067); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.006649810339649611); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.006683480480676067); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=5.0E-4); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.005666666666666667); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-05-24 04:00:25,320 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 292 ms to try 5000 different iterations.  Found a solution that moves 299 regions; Going from a computed imbalance of 0.0010224189876720938 to a new imbalance of 5.948679053225902E-5. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=4.4668347344853864E-4); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0022721660362024225); MoveCostFunction : (multiplier=7.0, imbalance=0.03322222222222222, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=4.4668347344853864E-4); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=5.0E-4); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-05-24 04:00:25,321 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv85642798:82 , srv1262401893:83 , srv1600177674:83 , srv1722919863:83 , srv219231552:83 , srv544749383:83 , srv729530799:83 , srv1080885904:84 , srv1085042762:84 , srv1171304749:84 , srv1201883076:84 , srv1261318951:84 , srv1377586190:84 , srv1434121449:84 , srv1494455991:84 , srv1509269464:84 , srv1566874802:84 , srv1590628186:84 , srv1654526210:84 , srv1701716665:84 , srv1785148259:84 , srv1914586991:84 , srv1925414182:84 , srv1929800355:84 , srv1933862511:84 , srv194101685:84 , srv195460271:84 , srv204611786:84 , srv2056596236:84 , srv2067084930:84 , srv2070062705:84 , srv2081625226:84 , srv2087033381:84 , srv2091846700:84 , srv292428978:84 , srv321843885:84 , srv36186113:84 , srv385960836:84 , srv582309912:84 , srv791376720:84 , srv809585489:84 , srv824255813:84 , srv839731928:84 , srv84791013:84 , srv918321220:84 , srv1031753021:85 , srv1058659233:85 , srv1061596630:85 , srv1135673819:85 , srv1185124334:85 , srv1228737779:85 , srv1297561071:85 , srv1450371857:85 , srv148028826:85 , srv1489454434:85 , srv1500452199:85 , srv1514046060:85 , srv1516274214:85 , srv1741195159:85 , srv1763439698:85 , srv1870478492:85 , srv1877761707:85 , srv1959290040:85 , srv1987053360:85 , srv2119656485:85 , srv214088003:85 , srv43477500:85 , srv527942068:85 , srv537694953:85 , srv554912957:85 , srv561033154:85 , srv601331203:85 , srv610027896:85 , srv686524342:85 , srv69256765:85 , srv788673046:85 , srv789528110:85 , srv792425822:85 , srv804384643:85 , srv8186410:85 , srv829584444:85 , srv930631546:85 , srv933052934:85 , srv940711640:85 , srv944188428:85 , srv999591420:85 , srv1359697624:86 , srv1362815994:86 , srv1651535937:86 , srv1746835924:86 , srv18229023:86 , srv2103478508:86 , srv333290458:86 , srv656686867:86 , srv739214244:86 , srv745296839:86 , srv764930358:86 , srv837334598:86 , srv864059850:86 , srv1368465954:625 }
2023-05-24 04:00:25,325 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-05-24 04:00:25,325 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv385960836=63, srv2087033381=53, srv839731928=90, srv1494455991=21, srv8186410=86, srv1061596630=2, srv1516274214=25, srv788673046=80, srv918321220=94, srv85642798=92, srv829584444=88, srv292428978=59, srv582309912=70, srv804384643=84, srv195460271=45, srv824255813=87, srv1746835924=34, srv18229023=37, srv739214244=77, srv204611786=48, srv1654526210=30, srv84791013=91, srv1201883076=8, srv2119656485=56, srv2091846700=54, srv1500452199=22, srv610027896=72, srv999591420=99, srv1741195159=33, srv1590628186=27, srv1925414182=41, srv1228737779=9, srv789528110=81, srv1085042762=4, srv1058659233=1, srv1959290040=46, srv1870478492=38, srv1877761707=39, srv1514046060=24, srv1933862511=43, srv1450371857=18, srv69256765=75, srv1171304749=6, srv930631546=95, srv544749383=67, srv1763439698=35, srv2056596236=49, srv1929800355=42, srv1651535937=29, srv864059850=93, srv745296839=78, srv1566874802=26, srv1509269464=23, srv1031753021=0, srv1600177674=28, srv601331203=71, srv944188428=98, srv321843885=60, srv2070062705=51, srv333290458=61, srv933052934=96, srv148028826=19, srv940711640=97, srv1135673819=5, srv561033154=69, srv1080885904=3, srv554912957=68, srv1362815994=14, srv1914586991=40, srv1262401893=11, srv194101685=44, srv219231552=58, srv656686867=73, srv1297561071=12, srv1185124334=7, srv2067084930=50, srv1261318951=10, srv764930358=79, srv2103478508=55, srv214088003=57, srv791376720=82, srv1368465954=15, srv1701716665=31, srv43477500=64, srv1489454434=20, srv1377586190=16, srv1434121449=17, srv2081625226=52, srv36186113=62, srv729530799=76, srv1987053360=47, srv527942068=65, srv537694953=66, srv1359697624=13, srv792425822=83, srv1722919863=32, srv809585489=85, srv686524342=74, srv837334598=89, srv1785148259=36} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-05-24 04:00:25,333 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-05-24 04:00:25,334 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-05-24 04:00:25,334 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-05-24 04:00:25,334 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-05-24 04:00:25,334 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-05-24 04:00:25,334 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-05-24 04:00:25,334 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-05-24 04:00:25,334 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-05-24 04:00:25,334 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-05-24 04:00:25,334 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-05-24 04:00:25,334 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-05-24 04:00:25,334 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-05-24 04:00:25,334 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-05-24 04:00:25,334 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-05-24 04:00:25,334 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-05-24 04:00:25,334 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-05-24 04:00:25,334 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-05-24 04:00:25,334 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-05-24 04:00:25,334 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-05-24 04:00:25,334 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-05-24 04:00:25,335 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-05-24 04:00:25,335 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-05-24 04:00:25,335 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-05-24 04:00:25,335 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-05-24 04:00:25,335 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-05-24 04:00:25,335 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-05-24 04:00:25,335 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-05-24 04:00:25,335 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-05-24 04:00:25,335 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-05-24 04:00:25,335 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-05-24 04:00:25,335 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-05-24 04:00:25,335 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-05-24 04:00:25,335 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-05-24 04:00:25,335 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-05-24 04:00:25,335 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-05-24 04:00:25,335 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-05-24 04:00:25,335 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-05-24 04:00:25,335 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-05-24 04:00:25,335 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-05-24 04:00:25,335 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-05-24 04:00:25,335 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-05-24 04:00:25,336 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-05-24 04:00:25,336 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-05-24 04:00:25,336 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-05-24 04:00:25,336 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-05-24 04:00:25,336 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-05-24 04:00:25,336 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-05-24 04:00:25,336 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-05-24 04:00:25,336 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-05-24 04:00:25,336 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-05-24 04:00:25,336 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-05-24 04:00:25,336 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-05-24 04:00:25,336 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-05-24 04:00:25,336 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-05-24 04:00:25,336 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-05-24 04:00:25,336 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-05-24 04:00:25,336 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-05-24 04:00:25,336 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-05-24 04:00:25,336 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-05-24 04:00:25,337 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-05-24 04:00:25,337 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-05-24 04:00:25,337 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-05-24 04:00:25,337 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-05-24 04:00:25,337 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-05-24 04:00:25,337 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-05-24 04:00:25,337 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-05-24 04:00:25,337 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-05-24 04:00:25,337 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-05-24 04:00:25,337 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-05-24 04:00:25,337 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-05-24 04:00:25,337 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-05-24 04:00:25,337 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-05-24 04:00:25,337 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-05-24 04:00:25,338 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-05-24 04:00:25,338 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-05-24 04:00:25,338 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-05-24 04:00:25,338 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-05-24 04:00:25,338 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-05-24 04:00:25,338 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-05-24 04:00:25,338 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-05-24 04:00:25,338 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-05-24 04:00:25,338 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-05-24 04:00:25,338 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-05-24 04:00:25,338 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-05-24 04:00:25,338 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-05-24 04:00:25,338 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-05-24 04:00:25,338 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-05-24 04:00:25,338 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-05-24 04:00:25,338 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-05-24 04:00:25,338 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-05-24 04:00:25,338 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-05-24 04:00:25,339 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-05-24 04:00:25,339 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-05-24 04:00:25,339 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-05-24 04:00:25,339 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-05-24 04:00:25,339 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-05-24 04:00:25,339 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-05-24 04:00:25,339 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-05-24 04:00:25,339 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-05-24 04:00:25,339 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-05-24 04:00:25,339 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-05-24 04:00:25,417 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=4.4668347344853864E-4); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0022721660362024225); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=4.4668347344853864E-4); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=5.0E-4); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-05-24 04:00:25,417 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-05-24 04:00:25,417 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=5.739314778393528E-5, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=4.4668347344853864E-4); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0022721660362024225); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=4.4668347344853864E-4); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=5.0E-4); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-05-24 04:00:25,561 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 216 ms to try 5000 different iterations.  Found a solution that moves 40 regions; Going from a computed imbalance of 5.739314778393528E-5 to a new imbalance of 8.539849972389227E-6. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0018349396085439343); MoveCostFunction : (multiplier=7.0, imbalance=0.0044444444444444444); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-05-24 04:00:25,562 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1031753021:83 , srv1171304749:83 , srv1228737779:83 , srv1359697624:83 , srv1514046060:83 , srv610027896:83 , srv804384643:83 , srv829584444:83 , srv1058659233:84 , srv1061596630:84 , srv1080885904:84 , srv1085042762:84 , srv1135673819:84 , srv1185124334:84 , srv1201883076:84 , srv1261318951:84 , srv1297561071:84 , srv1362815994:84 , srv1377586190:84 , srv1434121449:84 , srv1450371857:84 , srv148028826:84 , srv1489454434:84 , srv1494455991:84 , srv1500452199:84 , srv1509269464:84 , srv1516274214:84 , srv1566874802:84 , srv1590628186:84 , srv1600177674:84 , srv1651535937:84 , srv1701716665:84 , srv1741195159:84 , srv1746835924:84 , srv1763439698:84 , srv1785148259:84 , srv18229023:84 , srv1870478492:84 , srv1877761707:84 , srv1914586991:84 , srv1925414182:84 , srv1929800355:84 , srv1933862511:84 , srv194101685:84 , srv195460271:84 , srv1959290040:84 , srv1987053360:84 , srv204611786:84 , srv2056596236:84 , srv2067084930:84 , srv2070062705:84 , srv2081625226:84 , srv2091846700:84 , srv2103478508:84 , srv2119656485:84 , srv214088003:84 , srv219231552:84 , srv321843885:84 , srv333290458:84 , srv36186113:84 , srv385960836:84 , srv43477500:84 , srv527942068:84 , srv537694953:84 , srv544749383:84 , srv554912957:84 , srv561033154:84 , srv582309912:84 , srv601331203:84 , srv656686867:84 , srv686524342:84 , srv69256765:84 , srv729530799:84 , srv739214244:84 , srv745296839:84 , srv764930358:84 , srv788673046:84 , srv789528110:84 , srv792425822:84 , srv809585489:84 , srv8186410:84 , srv824255813:84 , srv837334598:84 , srv839731928:84 , srv85642798:84 , srv864059850:84 , srv918321220:84 , srv930631546:84 , srv933052934:84 , srv944188428:84 , srv999591420:84 , srv1262401893:85 , srv1654526210:85 , srv1722919863:85 , srv2087033381:85 , srv292428978:85 , srv791376720:85 , srv84791013:85 , srv940711640:85 , srv1368465954:684 }
2023-05-24 04:00:25,565 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-05-24 04:00:25,565 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv385960836=63, srv2087033381=53, srv839731928=90, srv1494455991=21, srv8186410=86, srv1061596630=2, srv1516274214=25, srv788673046=80, srv918321220=94, srv85642798=92, srv829584444=88, srv292428978=59, srv582309912=70, srv804384643=84, srv195460271=45, srv824255813=87, srv1746835924=34, srv18229023=37, srv739214244=77, srv204611786=48, srv1654526210=30, srv84791013=91, srv1201883076=8, srv2119656485=56, srv2091846700=54, srv1500452199=22, srv610027896=72, srv999591420=99, srv1741195159=33, srv1590628186=27, srv1925414182=41, srv1228737779=9, srv789528110=81, srv1085042762=4, srv1058659233=1, srv1959290040=46, srv1870478492=38, srv1877761707=39, srv1514046060=24, srv1933862511=43, srv1450371857=18, srv69256765=75, srv1171304749=6, srv930631546=95, srv544749383=67, srv1763439698=35, srv2056596236=49, srv1929800355=42, srv1651535937=29, srv864059850=93, srv745296839=78, srv1566874802=26, srv1509269464=23, srv1031753021=0, srv1600177674=28, srv601331203=71, srv944188428=98, srv321843885=60, srv2070062705=51, srv333290458=61, srv933052934=96, srv148028826=19, srv940711640=97, srv1135673819=5, srv561033154=69, srv1080885904=3, srv554912957=68, srv1362815994=14, srv1914586991=40, srv1262401893=11, srv194101685=44, srv219231552=58, srv656686867=73, srv1297561071=12, srv1185124334=7, srv2067084930=50, srv1261318951=10, srv764930358=79, srv2103478508=55, srv214088003=57, srv791376720=82, srv1368465954=15, srv1701716665=31, srv43477500=64, srv1489454434=20, srv1377586190=16, srv1434121449=17, srv2081625226=52, srv36186113=62, srv729530799=76, srv1987053360=47, srv527942068=65, srv537694953=66, srv1359697624=13, srv792425822=83, srv1722919863=32, srv809585489=85, srv686524342=74, srv837334598=89, srv1785148259=36} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-05-24 04:00:25,574 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-05-24 04:00:25,574 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-05-24 04:00:25,574 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-05-24 04:00:25,574 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-05-24 04:00:25,574 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-05-24 04:00:25,574 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-05-24 04:00:25,575 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-05-24 04:00:25,575 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-05-24 04:00:25,575 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-05-24 04:00:25,575 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-05-24 04:00:25,575 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-05-24 04:00:25,575 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-05-24 04:00:25,575 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-05-24 04:00:25,575 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-05-24 04:00:25,575 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-05-24 04:00:25,575 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-05-24 04:00:25,575 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-05-24 04:00:25,575 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-05-24 04:00:25,575 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-05-24 04:00:25,575 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-05-24 04:00:25,575 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-05-24 04:00:25,575 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-05-24 04:00:25,575 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-05-24 04:00:25,575 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-05-24 04:00:25,575 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-05-24 04:00:25,575 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-05-24 04:00:25,576 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-05-24 04:00:25,576 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-05-24 04:00:25,576 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-05-24 04:00:25,576 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-05-24 04:00:25,576 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-05-24 04:00:25,576 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-05-24 04:00:25,576 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-05-24 04:00:25,576 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-05-24 04:00:25,576 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-05-24 04:00:25,576 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-05-24 04:00:25,576 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-05-24 04:00:25,576 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-05-24 04:00:25,576 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-05-24 04:00:25,576 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-05-24 04:00:25,576 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-05-24 04:00:25,576 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-05-24 04:00:25,576 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-05-24 04:00:25,576 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-05-24 04:00:25,576 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-05-24 04:00:25,577 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-05-24 04:00:25,577 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-05-24 04:00:25,577 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-05-24 04:00:25,577 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-05-24 04:00:25,577 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-05-24 04:00:25,577 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-05-24 04:00:25,577 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-05-24 04:00:25,577 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-05-24 04:00:25,577 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-05-24 04:00:25,577 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-05-24 04:00:25,577 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-05-24 04:00:25,577 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-05-24 04:00:25,577 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-05-24 04:00:25,577 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-05-24 04:00:25,577 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-05-24 04:00:25,577 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-05-24 04:00:25,577 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-05-24 04:00:25,577 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-05-24 04:00:25,577 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-05-24 04:00:25,577 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-05-24 04:00:25,578 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-05-24 04:00:25,578 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-05-24 04:00:25,578 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-05-24 04:00:25,578 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-05-24 04:00:25,578 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-05-24 04:00:25,578 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-05-24 04:00:25,578 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-05-24 04:00:25,578 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-05-24 04:00:25,578 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-05-24 04:00:25,578 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-05-24 04:00:25,578 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-05-24 04:00:25,578 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-05-24 04:00:25,578 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-05-24 04:00:25,578 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-05-24 04:00:25,578 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-05-24 04:00:25,578 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-05-24 04:00:25,578 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-05-24 04:00:25,578 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-05-24 04:00:25,578 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-05-24 04:00:25,578 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-05-24 04:00:25,578 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-05-24 04:00:25,578 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-05-24 04:00:25,578 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-05-24 04:00:25,579 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-05-24 04:00:25,579 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-05-24 04:00:25,579 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-05-24 04:00:25,579 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-05-24 04:00:25,579 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-05-24 04:00:25,579 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-05-24 04:00:25,579 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-05-24 04:00:25,579 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-05-24 04:00:25,579 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-05-24 04:00:25,579 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-05-24 04:00:25,579 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-05-24 04:00:25,579 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-05-24 04:00:25,579 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-05-24 04:00:25,655 INFO  [Time-limited test] balancer.StochasticLoadBalancer(381): Cluster wide - skipping load balancing because weighted average imbalance=8.259763985991403E-6 <= threshold(0.025). If you want more aggressive balancing, either lower hbase.master.balancer.stochastic.minCostNeedBalance from 0.025 or increase the relative multiplier(s) of the specific cost function(s). functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0018349396085439343); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-05-24 04:00:25,656 INFO  [Time-limited test] balancer.BalancerTestBase(570): Mock Final balance: { srv1031753021:83 , srv1171304749:83 , srv1228737779:83 , srv1359697624:83 , srv1514046060:83 , srv610027896:83 , srv804384643:83 , srv829584444:83 , srv1058659233:84 , srv1061596630:84 , srv1080885904:84 , srv1085042762:84 , srv1135673819:84 , srv1185124334:84 , srv1201883076:84 , srv1261318951:84 , srv1297561071:84 , srv1362815994:84 , srv1377586190:84 , srv1434121449:84 , srv1450371857:84 , srv148028826:84 , srv1489454434:84 , srv1494455991:84 , srv1500452199:84 , srv1509269464:84 , srv1516274214:84 , srv1566874802:84 , srv1590628186:84 , srv1600177674:84 , srv1651535937:84 , srv1701716665:84 , srv1741195159:84 , srv1746835924:84 , srv1763439698:84 , srv1785148259:84 , srv18229023:84 , srv1870478492:84 , srv1877761707:84 , srv1914586991:84 , srv1925414182:84 , srv1929800355:84 , srv1933862511:84 , srv194101685:84 , srv195460271:84 , srv1959290040:84 , srv1987053360:84 , srv204611786:84 , srv2056596236:84 , srv2067084930:84 , srv2070062705:84 , srv2081625226:84 , srv2091846700:84 , srv2103478508:84 , srv2119656485:84 , srv214088003:84 , srv219231552:84 , srv321843885:84 , srv333290458:84 , srv36186113:84 , srv385960836:84 , srv43477500:84 , srv527942068:84 , srv537694953:84 , srv544749383:84 , srv554912957:84 , srv561033154:84 , srv582309912:84 , srv601331203:84 , srv656686867:84 , srv686524342:84 , srv69256765:84 , srv729530799:84 , srv739214244:84 , srv745296839:84 , srv764930358:84 , srv788673046:84 , srv789528110:84 , srv792425822:84 , srv809585489:84 , srv8186410:84 , srv824255813:84 , srv837334598:84 , srv839731928:84 , srv85642798:84 , srv864059850:84 , srv918321220:84 , srv930631546:84 , srv933052934:84 , srv944188428:84 , srv999591420:84 , srv1262401893:85 , srv1654526210:85 , srv1722919863:85 , srv2087033381:85 , srv292428978:85 , srv791376720:85 , srv84791013:85 , srv940711640:85 , srv1368465954:684 }
2023-05-24 04:00:25,679 INFO  [Time-limited test] hbase.ResourceChecker(175): after: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnLargeClusterWithRacks Thread=12 (was 12), OpenFileDescriptor=264 (was 264), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=115 (was 115), ProcessCount=167 (was 167), AvailableMemoryMB=12871 (was 13349)
2023-05-24 04:00:25,685 INFO  [Time-limited test] hbase.ResourceChecker(147): before: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnMidClusterWithRacks Thread=12, OpenFileDescriptor=264, MaxFileDescriptor=60000, SystemLoadAverage=115, ProcessCount=167, AvailableMemoryMB=12871
2023-05-24 04:00:25,685 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2023-05-24 04:00:25,685 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=5000, runMaxSteps=true, stepsPerRegion=800, maxRunningTime=120000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 111077.0 etc.
2023-05-24 04:00:25,696 INFO  [Time-limited test] balancer.BalancerTestBase(547): Mock Cluster : { srv1004208632:84 , srv1031851677:84 , srv1055821890:84 , srv1057298010:84 , srv1074907928:84 , srv1181218432:84 , srv1210304707:84 , srv1248369008:84 , srv1308687304:84 , srv1322983217:84 , srv1362793908:84 , srv1394208927:84 , srv1416785237:84 , srv1471372416:84 , srv1539693399:84 , srv1794365419:84 , srv1861243810:84 , srv1969911154:84 , srv2101966378:84 , srv309150210:84 , srv349647255:84 , srv417410017:84 , srv426650340:84 , srv550622698:84 , srv551154243:84 , srv592248764:84 , srv651134103:84 , srv677559151:84 , srv723912128:84 , srv1149240749:264 } [srvr=30 rgns=2700 avg=90.0 max=90 min=90]
2023-05-24 04:00:25,698 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-05-24 04:00:25,698 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv2101966378=19, srv1969911154=18, srv1794365419=16, srv426650340=23, srv1210304707=7, srv1322983217=10, srv1471372416=14, srv309150210=20, srv1181218432=6, srv1055821890=2, srv417410017=22, srv1248369008=8, srv1074907928=4, srv1539693399=15, srv1861243810=17, srv551154243=25, srv1149240749=5, srv1004208632=0, srv349647255=21, srv723912128=29, srv1416785237=13, srv550622698=24, srv677559151=28, srv1031851677=1, srv1394208927=12, srv1362793908=11, srv592248764=26, srv1057298010=3, srv1308687304=9, srv651134103=27} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-05-24 04:00:25,710 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-05-24 04:00:25,710 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-05-24 04:00:25,710 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-05-24 04:00:25,710 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-05-24 04:00:25,710 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-05-24 04:00:25,710 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-05-24 04:00:25,710 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-05-24 04:00:25,710 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-05-24 04:00:25,710 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-05-24 04:00:25,710 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-05-24 04:00:25,710 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-05-24 04:00:25,711 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-05-24 04:00:25,711 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-05-24 04:00:25,711 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-05-24 04:00:25,711 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-05-24 04:00:25,711 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-05-24 04:00:25,711 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-05-24 04:00:25,711 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-05-24 04:00:25,711 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-05-24 04:00:25,711 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-05-24 04:00:25,711 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-05-24 04:00:25,711 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-05-24 04:00:25,711 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-05-24 04:00:25,711 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-05-24 04:00:25,712 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-05-24 04:00:25,712 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-05-24 04:00:25,712 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-05-24 04:00:25,712 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-05-24 04:00:25,712 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-05-24 04:00:25,712 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-05-24 04:00:25,712 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=10, number of hosts=30, number of racks=4
2023-05-24 04:00:25,732 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=1.098006535889026, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-05-24 04:00:25,732 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.9912501858658659, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=1.098006535889026, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=64800000
2023-05-24 04:02:25,716 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 120001 ms to try 9905159 different iterations.  Found a solution that moves 1837 regions; Going from a computed imbalance of 0.9912501858658659 to a new imbalance of 4.2876496417733574E-5. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); MoveCostFunction : (multiplier=7.0, imbalance=0.6803703703703704, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-05-24 04:02:25,721 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1004208632:90 , srv1031851677:90 , srv1055821890:90 , srv1057298010:90 , srv1074907928:90 , srv1149240749:90 , srv1181218432:90 , srv1210304707:90 , srv1248369008:90 , srv1308687304:90 , srv1322983217:90 , srv1362793908:90 , srv1394208927:90 , srv1416785237:90 , srv1471372416:90 , srv1539693399:90 , srv1794365419:90 , srv1861243810:90 , srv1969911154:90 , srv2101966378:90 , srv309150210:90 , srv349647255:90 , srv417410017:90 , srv426650340:90 , srv550622698:90 , srv551154243:90 , srv592248764:90 , srv651134103:90 , srv677559151:90 , srv723912128:90 }
2023-05-24 04:02:25,722 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-05-24 04:02:25,722 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv2101966378=19, srv1969911154=18, srv1794365419=16, srv426650340=23, srv1210304707=7, srv1322983217=10, srv1471372416=14, srv309150210=20, srv1181218432=6, srv1055821890=2, srv417410017=22, srv1248369008=8, srv1074907928=4, srv1539693399=15, srv1861243810=17, srv551154243=25, srv1149240749=5, srv1004208632=0, srv349647255=21, srv723912128=29, srv1416785237=13, srv550622698=24, srv677559151=28, srv1031851677=1, srv1394208927=12, srv1362793908=11, srv592248764=26, srv1057298010=3, srv1308687304=9, srv651134103=27} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-05-24 04:02:25,725 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-05-24 04:02:25,725 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-05-24 04:02:25,725 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-05-24 04:02:25,725 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-05-24 04:02:25,725 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-05-24 04:02:25,725 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-05-24 04:02:25,725 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-05-24 04:02:25,725 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-05-24 04:02:25,725 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-05-24 04:02:25,725 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-05-24 04:02:25,725 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-05-24 04:02:25,725 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-05-24 04:02:25,726 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-05-24 04:02:25,726 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-05-24 04:02:25,726 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-05-24 04:02:25,726 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-05-24 04:02:25,726 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-05-24 04:02:25,726 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-05-24 04:02:25,726 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-05-24 04:02:25,726 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-05-24 04:02:25,726 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-05-24 04:02:25,726 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-05-24 04:02:25,726 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-05-24 04:02:25,726 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-05-24 04:02:25,726 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-05-24 04:02:25,726 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-05-24 04:02:25,726 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-05-24 04:02:25,726 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-05-24 04:02:25,726 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-05-24 04:02:25,726 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-05-24 04:02:25,726 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=10, number of hosts=30, number of racks=4
2023-05-24 04:02:25,735 INFO  [Time-limited test] balancer.StochasticLoadBalancer(381): Cluster wide - skipping load balancing because weighted average imbalance=0.0 <= threshold(0.025). If you want more aggressive balancing, either lower hbase.master.balancer.stochastic.minCostNeedBalance from 0.025 or increase the relative multiplier(s) of the specific cost function(s). functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-05-24 04:02:25,736 INFO  [Time-limited test] balancer.BalancerTestBase(570): Mock Final balance: { srv1004208632:90 , srv1031851677:90 , srv1055821890:90 , srv1057298010:90 , srv1074907928:90 , srv1149240749:90 , srv1181218432:90 , srv1210304707:90 , srv1248369008:90 , srv1308687304:90 , srv1322983217:90 , srv1362793908:90 , srv1394208927:90 , srv1416785237:90 , srv1471372416:90 , srv1539693399:90 , srv1794365419:90 , srv1861243810:90 , srv1969911154:90 , srv2101966378:90 , srv309150210:90 , srv349647255:90 , srv417410017:90 , srv426650340:90 , srv550622698:90 , srv551154243:90 , srv592248764:90 , srv651134103:90 , srv677559151:90 , srv723912128:90 }
2023-05-24 04:02:25,746 INFO  [Time-limited test] hbase.ResourceChecker(175): after: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnMidClusterWithRacks Thread=11 (was 12), OpenFileDescriptor=264 (was 264), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=127 (was 115) - SystemLoadAverage LEAK? -, ProcessCount=165 (was 167), AvailableMemoryMB=12771 (was 12871)