2023-08-03 10:53:13,317 INFO  [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks timeout: 13 mins
2023-08-03 10:53:13,651 WARN  [Time-limited test] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties
2023-08-03 10:53:13,776 INFO  [Time-limited test] metrics.MetricRegistriesLoader(60): Loaded MetricRegistries class org.apache.hadoop.hbase.metrics.impl.MetricRegistriesImpl
2023-08-03 10:53:13,841 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2023-08-03 10:53:13,849 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc.
2023-08-03 10:53:13,863 INFO  [Time-limited test] hbase.ResourceChecker(147): before: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnLargeClusterWithRacks Thread=12, OpenFileDescriptor=263, MaxFileDescriptor=60000, SystemLoadAverage=281, ProcessCount=173, AvailableMemoryMB=2617
2023-08-03 10:53:13,865 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2023-08-03 10:53:13,865 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=5000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=10000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc.
2023-08-03 10:53:14,006 INFO  [Time-limited test] balancer.BalancerTestBase(547): Mock Cluster : { srv1000997000:84 , srv1026858756:84 , srv1028703774:84 , srv1050707566:84 , srv1082073941:84 , srv108441073:84 , srv1105210159:84 , srv1164466034:84 , srv1170191256:84 , srv1180813431:84 , srv12168729:84 , srv1228275683:84 , srv1245676935:84 , srv1271846804:84 , srv1304128190:84 , srv1325186336:84 , srv1434087558:84 , srv1443805417:84 , srv1458565088:84 , srv1481446625:84 , srv1489602006:84 , srv1499717685:84 , srv1503852332:84 , srv1505227921:84 , srv1508784081:84 , srv1535854609:84 , srv1592396991:84 , srv1594911125:84 , srv1615011600:84 , srv1642441116:84 , srv1656175095:84 , srv1663625147:84 , srv16845875:84 , srv1688374829:84 , srv1719044969:84 , srv1762634604:84 , srv1765115343:84 , srv1769047182:84 , srv177317794:84 , srv1778861160:84 , srv1828516103:84 , srv1852588998:84 , srv187199392:84 , srv1881060740:84 , srv1887783249:84 , srv1972098365:84 , srv1986263286:84 , srv2000152763:84 , srv2066231690:84 , srv2073014093:84 , srv2092950946:84 , srv2097882808:84 , srv2116589747:84 , srv215196900:84 , srv223058564:84 , srv228208580:84 , srv244091914:84 , srv277257784:84 , srv290848365:84 , srv291699185:84 , srv301876879:84 , srv34386550:84 , srv372242388:84 , srv374740469:84 , srv387358119:84 , srv426360577:84 , srv433835282:84 , srv44275996:84 , srv447162285:84 , srv549160317:84 , srv572745871:84 , srv575309134:84 , srv580000922:84 , srv599078338:84 , srv604286228:84 , srv671590869:84 , srv693792067:84 , srv704117719:84 , srv705437955:84 , srv727607963:84 , srv737029930:84 , srv742684637:84 , srv758075749:84 , srv774660227:84 , srv779170889:84 , srv807559818:84 , srv810984635:84 , srv829328148:84 , srv838253750:84 , srv848076517:84 , srv850862884:84 , srv852758412:84 , srv886704157:84 , srv895012989:84 , srv942021489:84 , srv967431480:84 , srv974668619:84 , srv993456188:84 , srv993900636:84 , srv2134507838:684 } [srvr=100 rgns=9000 avg=90.0 max=90 min=90]
2023-08-03 10:53:14,014 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-08-03 10:53:14,020 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv108441073=5, srv1508784081=24, srv604286228=75, srv2116589747=52, srv572745871=71, srv2097882808=51, srv447162285=69, srv1663625147=31, srv1434087558=16, srv177317794=38, srv215196900=54, srv44275996=68, srv1499717685=21, srv852758412=92, srv1180813431=9, srv301876879=61, srv693792067=77, srv779170889=85, srv1594911125=27, srv2066231690=48, srv1000997000=0, srv1164466034=7, srv1505227921=23, srv1688374829=33, srv1765115343=36, srv810984635=87, srv967431480=96, srv1271846804=13, srv16845875=32, srv886704157=93, srv1082073941=4, srv12168729=10, srv223058564=55, srv1828516103=40, srv372242388=63, srv1105210159=6, srv774660227=84, srv1304128190=14, srv1481446625=19, srv737029930=81, srv374740469=64, srv1972098365=45, srv290848365=59, srv1642441116=29, srv1986263286=46, srv1325186336=15, srv1458565088=18, srv1535854609=25, srv742684637=82, srv599078338=74, srv1028703774=2, srv758075749=83, srv993900636=99, srv1887783249=44, srv838253750=89, srv1050707566=3, srv228208580=56, srv277257784=58, srv1026858756=1, srv807559818=86, srv1656175095=30, srv187199392=42, srv2134507838=53, srv1852588998=41, srv1489602006=20, srv580000922=73, srv549160317=70, srv1228275683=11, srv1443805417=17, srv575309134=72, srv1615011600=28, srv895012989=94, srv942021489=95, srv1503852332=22, srv974668619=97, srv1245676935=12, srv993456188=98, srv34386550=62, srv2000152763=47, srv848076517=90, srv1592396991=26, srv1719044969=34, srv829328148=88, srv1881060740=43, srv704117719=78, srv1778861160=39, srv433835282=67, srv2092950946=50, srv705437955=79, srv850862884=91, srv671590869=76, srv2073014093=49, srv426360577=66, srv244091914=57, srv1762634604=35, srv727607963=80, srv1170191256=8, srv387358119=65, srv1769047182=37, srv291699185=60} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-08-03 10:53:14,103 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-08-03 10:53:14,104 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-08-03 10:53:14,104 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-08-03 10:53:14,104 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-08-03 10:53:14,104 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-08-03 10:53:14,104 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-08-03 10:53:14,105 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-08-03 10:53:14,105 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-08-03 10:53:14,105 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-08-03 10:53:14,105 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-08-03 10:53:14,105 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-08-03 10:53:14,105 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-08-03 10:53:14,105 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-08-03 10:53:14,105 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-08-03 10:53:14,106 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-08-03 10:53:14,106 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-08-03 10:53:14,106 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-08-03 10:53:14,106 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-08-03 10:53:14,106 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-08-03 10:53:14,106 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-08-03 10:53:14,106 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-08-03 10:53:14,106 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-08-03 10:53:14,107 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-08-03 10:53:14,107 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-08-03 10:53:14,107 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-08-03 10:53:14,107 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-08-03 10:53:14,107 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-08-03 10:53:14,107 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-08-03 10:53:14,107 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-08-03 10:53:14,107 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-08-03 10:53:14,108 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-08-03 10:53:14,108 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-08-03 10:53:14,108 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-08-03 10:53:14,108 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-08-03 10:53:14,108 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-08-03 10:53:14,108 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-08-03 10:53:14,108 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-08-03 10:53:14,109 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-08-03 10:53:14,109 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-08-03 10:53:14,109 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-08-03 10:53:14,109 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-08-03 10:53:14,109 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-08-03 10:53:14,109 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-08-03 10:53:14,109 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-08-03 10:53:14,110 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-08-03 10:53:14,110 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-08-03 10:53:14,110 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-08-03 10:53:14,110 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-08-03 10:53:14,110 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-08-03 10:53:14,110 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-08-03 10:53:14,111 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-08-03 10:53:14,111 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-08-03 10:53:14,111 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-08-03 10:53:14,111 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-08-03 10:53:14,111 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-08-03 10:53:14,111 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-08-03 10:53:14,111 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-08-03 10:53:14,111 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-08-03 10:53:14,111 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-08-03 10:53:14,112 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-08-03 10:53:14,112 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-08-03 10:53:14,112 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-08-03 10:53:14,112 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-08-03 10:53:14,112 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-08-03 10:53:14,112 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-08-03 10:53:14,112 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-08-03 10:53:14,112 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-08-03 10:53:14,112 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-08-03 10:53:14,112 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-08-03 10:53:14,112 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-08-03 10:53:14,113 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-08-03 10:53:14,113 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-08-03 10:53:14,113 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-08-03 10:53:14,113 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-08-03 10:53:14,113 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-08-03 10:53:14,113 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-08-03 10:53:14,113 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-08-03 10:53:14,113 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-08-03 10:53:14,114 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-08-03 10:53:14,114 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-08-03 10:53:14,114 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-08-03 10:53:14,114 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-08-03 10:53:14,114 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-08-03 10:53:14,114 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-08-03 10:53:14,115 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-08-03 10:53:14,115 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-08-03 10:53:14,115 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-08-03 10:53:14,115 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-08-03 10:53:14,115 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-08-03 10:53:14,115 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-08-03 10:53:14,116 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-08-03 10:53:14,116 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-08-03 10:53:14,116 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-08-03 10:53:14,116 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-08-03 10:53:14,116 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-08-03 10:53:14,116 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-08-03 10:53:14,117 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-08-03 10:53:14,117 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-08-03 10:53:14,117 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-08-03 10:53:14,117 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-08-03 10:53:14,117 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-08-03 10:53:14,358 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.06666666666666667, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-08-03 10:53:14,358 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-08-03 10:53:14,359 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.9909252140407105, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.06666666666666667, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-08-03 10:53:14,746 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 594 ms to try 5000 different iterations.  Found a solution that moves 4676 regions; Going from a computed imbalance of 0.9909252140407105 to a new imbalance of 0.18019808430275816. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.042560520790005, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.057245018505183584, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.5195555555555555, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.042560520790005, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.17566666666666667, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.23941666666666667, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-08-03 10:53:14,762 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv850862884:80 , srv1000997000:81 , srv12168729:81 , srv942021489:81 , srv1170191256:82 , srv1325186336:82 , srv1594911125:82 , srv2092950946:82 , srv374740469:82 , srv1503852332:83 , srv1615011600:83 , srv1719044969:83 , srv187199392:83 , srv1887783249:83 , srv223058564:83 , srv829328148:83 , srv895012989:83 , srv1026858756:84 , srv1082073941:84 , srv1105210159:84 , srv1481446625:84 , srv1688374829:84 , srv1762634604:84 , srv1778861160:84 , srv1852588998:84 , srv426360577:84 , srv575309134:84 , srv704117719:84 , srv967431480:84 , srv993456188:84 , srv108441073:85 , srv1164466034:85 , srv1180813431:85 , srv1663625147:85 , srv1765115343:85 , srv177317794:85 , srv1986263286:85 , srv2066231690:85 , srv2097882808:85 , srv2116589747:85 , srv228208580:85 , srv447162285:85 , srv549160317:85 , srv671590869:85 , srv742684637:85 , srv779170889:85 , srv810984635:85 , srv1028703774:86 , srv1245676935:86 , srv1271846804:86 , srv1304128190:86 , srv1489602006:86 , srv1505227921:86 , srv599078338:86 , srv705437955:86 , srv758075749:86 , srv852758412:86 , srv974668619:86 , srv1458565088:87 , srv16845875:87 , srv1881060740:87 , srv2000152763:87 , srv277257784:87 , srv34386550:87 , srv433835282:87 , srv580000922:87 , srv604286228:87 , srv737029930:87 , srv1050707566:88 , srv1499717685:88 , srv1592396991:88 , srv1972098365:88 , srv290848365:88 , srv372242388:88 , srv44275996:88 , srv693792067:88 , srv727607963:88 , srv774660227:88 , srv886704157:88 , srv993900636:88 , srv1443805417:89 , srv1508784081:89 , srv1535854609:89 , srv1828516103:89 , srv2073014093:89 , srv291699185:89 , srv838253750:89 , srv848076517:89 , srv1656175095:90 , srv215196900:90 , srv301876879:90 , srv572745871:90 , srv1434087558:92 , srv1769047182:92 , srv387358119:92 , srv244091914:93 , srv807559818:93 , srv1228275683:96 , srv1642441116:96 , srv2134507838:468 }
2023-08-03 10:53:14,767 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-08-03 10:53:14,768 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv108441073=5, srv1508784081=24, srv604286228=75, srv2116589747=52, srv572745871=71, srv2097882808=51, srv447162285=69, srv1663625147=31, srv1434087558=16, srv177317794=38, srv215196900=54, srv44275996=68, srv1499717685=21, srv852758412=92, srv1180813431=9, srv301876879=61, srv693792067=77, srv779170889=85, srv1594911125=27, srv2066231690=48, srv1000997000=0, srv1164466034=7, srv1505227921=23, srv1688374829=33, srv1765115343=36, srv810984635=87, srv967431480=96, srv1271846804=13, srv16845875=32, srv886704157=93, srv1082073941=4, srv12168729=10, srv223058564=55, srv1828516103=40, srv372242388=63, srv1105210159=6, srv774660227=84, srv1304128190=14, srv1481446625=19, srv737029930=81, srv374740469=64, srv1972098365=45, srv290848365=59, srv1642441116=29, srv1986263286=46, srv1325186336=15, srv1458565088=18, srv1535854609=25, srv742684637=82, srv599078338=74, srv1028703774=2, srv758075749=83, srv993900636=99, srv1887783249=44, srv838253750=89, srv1050707566=3, srv228208580=56, srv277257784=58, srv1026858756=1, srv807559818=86, srv1656175095=30, srv187199392=42, srv2134507838=53, srv1852588998=41, srv1489602006=20, srv580000922=73, srv549160317=70, srv1228275683=11, srv1443805417=17, srv575309134=72, srv1615011600=28, srv895012989=94, srv942021489=95, srv1503852332=22, srv974668619=97, srv1245676935=12, srv993456188=98, srv34386550=62, srv2000152763=47, srv848076517=90, srv1592396991=26, srv1719044969=34, srv829328148=88, srv1881060740=43, srv704117719=78, srv1778861160=39, srv433835282=67, srv2092950946=50, srv705437955=79, srv850862884=91, srv671590869=76, srv2073014093=49, srv426360577=66, srv244091914=57, srv1762634604=35, srv727607963=80, srv1170191256=8, srv387358119=65, srv1769047182=37, srv291699185=60} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-08-03 10:53:14,791 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-08-03 10:53:14,791 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-08-03 10:53:14,791 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-08-03 10:53:14,792 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-08-03 10:53:14,792 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-08-03 10:53:14,792 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-08-03 10:53:14,792 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-08-03 10:53:14,792 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-08-03 10:53:14,792 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-08-03 10:53:14,793 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-08-03 10:53:14,793 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-08-03 10:53:14,793 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-08-03 10:53:14,793 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-08-03 10:53:14,793 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-08-03 10:53:14,793 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-08-03 10:53:14,793 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-08-03 10:53:14,793 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-08-03 10:53:14,794 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-08-03 10:53:14,794 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-08-03 10:53:14,794 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-08-03 10:53:14,794 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-08-03 10:53:14,794 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-08-03 10:53:14,794 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-08-03 10:53:14,794 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-08-03 10:53:14,795 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-08-03 10:53:14,795 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-08-03 10:53:14,795 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-08-03 10:53:14,795 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-08-03 10:53:14,795 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-08-03 10:53:14,795 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-08-03 10:53:14,795 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-08-03 10:53:14,795 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-08-03 10:53:14,796 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-08-03 10:53:14,796 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-08-03 10:53:14,796 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-08-03 10:53:14,796 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-08-03 10:53:14,796 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-08-03 10:53:14,796 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-08-03 10:53:14,796 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-08-03 10:53:14,796 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-08-03 10:53:14,797 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-08-03 10:53:14,797 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-08-03 10:53:14,797 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-08-03 10:53:14,797 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-08-03 10:53:14,797 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-08-03 10:53:14,797 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-08-03 10:53:14,797 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-08-03 10:53:14,797 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-08-03 10:53:14,797 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-08-03 10:53:14,798 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-08-03 10:53:14,798 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-08-03 10:53:14,798 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-08-03 10:53:14,798 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-08-03 10:53:14,798 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-08-03 10:53:14,798 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-08-03 10:53:14,798 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-08-03 10:53:14,798 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-08-03 10:53:14,799 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-08-03 10:53:14,799 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-08-03 10:53:14,799 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-08-03 10:53:14,799 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-08-03 10:53:14,799 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-08-03 10:53:14,799 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-08-03 10:53:14,799 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-08-03 10:53:14,799 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-08-03 10:53:14,799 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-08-03 10:53:14,800 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-08-03 10:53:14,800 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-08-03 10:53:14,800 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-08-03 10:53:14,800 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-08-03 10:53:14,800 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-08-03 10:53:14,800 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-08-03 10:53:14,800 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-08-03 10:53:14,800 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-08-03 10:53:14,801 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-08-03 10:53:14,801 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-08-03 10:53:14,801 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-08-03 10:53:14,801 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-08-03 10:53:14,801 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-08-03 10:53:14,801 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-08-03 10:53:14,801 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-08-03 10:53:14,801 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-08-03 10:53:14,802 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-08-03 10:53:14,802 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-08-03 10:53:14,802 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-08-03 10:53:14,802 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-08-03 10:53:14,802 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-08-03 10:53:14,802 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-08-03 10:53:14,802 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-08-03 10:53:14,802 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-08-03 10:53:14,802 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-08-03 10:53:14,803 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-08-03 10:53:14,803 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-08-03 10:53:14,803 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-08-03 10:53:14,803 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-08-03 10:53:14,803 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-08-03 10:53:14,803 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-08-03 10:53:14,803 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-08-03 10:53:14,803 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-08-03 10:53:14,803 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-08-03 10:53:14,804 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-08-03 10:53:14,972 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.042560520790005, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.057245018505183584, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.042560520790005, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.17566666666666667, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.23941666666666667, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-08-03 10:53:14,972 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-08-03 10:53:14,972 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.18016534225094824, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.042560520790005, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.057245018505183584, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.042560520790005, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.17566666666666667, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.23941666666666667, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-08-03 10:53:15,363 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 534 ms to try 5000 different iterations.  Found a solution that moves 2627 regions; Going from a computed imbalance of 0.18016534225094824 to a new imbalance of 0.015435478671276428. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.022828978069128678); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.03220654442699761, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.29188888888888886, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.022828978069128678); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0125); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.043416666666666666, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-08-03 10:53:15,383 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1642441116:74 , srv1228275683:78 , srv244091914:78 , srv807559818:79 , srv387358119:80 , srv1656175095:81 , srv1434087558:82 , srv1443805417:82 , srv1508784081:82 , srv1535854609:82 , srv1769047182:82 , srv572745871:82 , srv774660227:82 , srv886704157:82 , srv1592396991:83 , srv1828516103:83 , srv1881060740:83 , srv215196900:83 , srv301876879:83 , srv433835282:83 , srv693792067:83 , srv1499717685:84 , srv1972098365:84 , srv2073014093:84 , srv291699185:84 , srv34386550:84 , srv604286228:84 , srv705437955:84 , srv727607963:84 , srv848076517:84 , srv108441073:85 , srv1245676935:85 , srv1304128190:85 , srv1489602006:85 , srv2066231690:85 , srv290848365:85 , srv372242388:85 , srv44275996:85 , srv447162285:85 , srv599078338:85 , srv671590869:85 , srv838253750:85 , srv1050707566:86 , srv1180813431:86 , srv1458565088:86 , srv1505227921:86 , srv16845875:86 , srv1762634604:86 , srv2116589747:86 , srv277257784:86 , srv575309134:86 , srv580000922:86 , srv737029930:86 , srv742684637:86 , srv779170889:86 , srv852758412:86 , srv967431480:86 , srv974668619:86 , srv993900636:86 , srv1026858756:87 , srv1028703774:87 , srv1105210159:87 , srv1271846804:87 , srv1688374829:87 , srv1765115343:87 , srv1852588998:87 , srv2000152763:87 , srv2097882808:87 , srv758075749:87 , srv810984635:87 , srv993456188:87 , srv1164466034:88 , srv1503852332:88 , srv1663625147:88 , srv177317794:88 , srv1778861160:88 , srv2092950946:88 , srv228208580:88 , srv426360577:88 , srv549160317:88 , srv704117719:88 , srv1082073941:89 , srv1481446625:89 , srv1594911125:89 , srv1719044969:89 , srv187199392:89 , srv1887783249:89 , srv1000997000:90 , srv1170191256:90 , srv1325186336:90 , srv223058564:90 , srv829328148:90 , srv850862884:90 , srv12168729:91 , srv1615011600:91 , srv1986263286:91 , srv374740469:91 , srv895012989:91 , srv942021489:93 , srv2134507838:509 }
2023-08-03 10:53:15,389 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-08-03 10:53:15,390 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv108441073=5, srv1508784081=24, srv604286228=75, srv2116589747=52, srv572745871=71, srv2097882808=51, srv447162285=69, srv1663625147=31, srv1434087558=16, srv177317794=38, srv215196900=54, srv44275996=68, srv1499717685=21, srv852758412=92, srv1180813431=9, srv301876879=61, srv693792067=77, srv779170889=85, srv1594911125=27, srv2066231690=48, srv1000997000=0, srv1164466034=7, srv1505227921=23, srv1688374829=33, srv1765115343=36, srv810984635=87, srv967431480=96, srv1271846804=13, srv16845875=32, srv886704157=93, srv1082073941=4, srv12168729=10, srv223058564=55, srv1828516103=40, srv372242388=63, srv1105210159=6, srv774660227=84, srv1304128190=14, srv1481446625=19, srv737029930=81, srv374740469=64, srv1972098365=45, srv290848365=59, srv1642441116=29, srv1986263286=46, srv1325186336=15, srv1458565088=18, srv1535854609=25, srv742684637=82, srv599078338=74, srv1028703774=2, srv758075749=83, srv993900636=99, srv1887783249=44, srv838253750=89, srv1050707566=3, srv228208580=56, srv277257784=58, srv1026858756=1, srv807559818=86, srv1656175095=30, srv187199392=42, srv2134507838=53, srv1852588998=41, srv1489602006=20, srv580000922=73, srv549160317=70, srv1228275683=11, srv1443805417=17, srv575309134=72, srv1615011600=28, srv895012989=94, srv942021489=95, srv1503852332=22, srv974668619=97, srv1245676935=12, srv993456188=98, srv34386550=62, srv2000152763=47, srv848076517=90, srv1592396991=26, srv1719044969=34, srv829328148=88, srv1881060740=43, srv704117719=78, srv1778861160=39, srv433835282=67, srv2092950946=50, srv705437955=79, srv850862884=91, srv671590869=76, srv2073014093=49, srv426360577=66, srv244091914=57, srv1762634604=35, srv727607963=80, srv1170191256=8, srv387358119=65, srv1769047182=37, srv291699185=60} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-08-03 10:53:15,416 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-08-03 10:53:15,416 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-08-03 10:53:15,416 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-08-03 10:53:15,416 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-08-03 10:53:15,416 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-08-03 10:53:15,416 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-08-03 10:53:15,416 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-08-03 10:53:15,417 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-08-03 10:53:15,417 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-08-03 10:53:15,417 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-08-03 10:53:15,417 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-08-03 10:53:15,417 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-08-03 10:53:15,417 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-08-03 10:53:15,417 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-08-03 10:53:15,417 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-08-03 10:53:15,417 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-08-03 10:53:15,417 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-08-03 10:53:15,418 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-08-03 10:53:15,418 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-08-03 10:53:15,418 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-08-03 10:53:15,418 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-08-03 10:53:15,418 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-08-03 10:53:15,418 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-08-03 10:53:15,418 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-08-03 10:53:15,418 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-08-03 10:53:15,418 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-08-03 10:53:15,418 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-08-03 10:53:15,418 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-08-03 10:53:15,419 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-08-03 10:53:15,419 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-08-03 10:53:15,419 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-08-03 10:53:15,419 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-08-03 10:53:15,419 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-08-03 10:53:15,419 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-08-03 10:53:15,419 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-08-03 10:53:15,419 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-08-03 10:53:15,419 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-08-03 10:53:15,419 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-08-03 10:53:15,420 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-08-03 10:53:15,420 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-08-03 10:53:15,420 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-08-03 10:53:15,420 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-08-03 10:53:15,420 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-08-03 10:53:15,420 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-08-03 10:53:15,420 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-08-03 10:53:15,420 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-08-03 10:53:15,420 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-08-03 10:53:15,420 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-08-03 10:53:15,421 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-08-03 10:53:15,421 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-08-03 10:53:15,421 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-08-03 10:53:15,421 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-08-03 10:53:15,421 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-08-03 10:53:15,421 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-08-03 10:53:15,421 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-08-03 10:53:15,421 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-08-03 10:53:15,421 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-08-03 10:53:15,421 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-08-03 10:53:15,421 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-08-03 10:53:15,422 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-08-03 10:53:15,422 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-08-03 10:53:15,422 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-08-03 10:53:15,422 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-08-03 10:53:15,422 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-08-03 10:53:15,422 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-08-03 10:53:15,422 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-08-03 10:53:15,422 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-08-03 10:53:15,422 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-08-03 10:53:15,422 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-08-03 10:53:15,423 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-08-03 10:53:15,423 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-08-03 10:53:15,423 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-08-03 10:53:15,423 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-08-03 10:53:15,423 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-08-03 10:53:15,423 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-08-03 10:53:15,423 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-08-03 10:53:15,423 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-08-03 10:53:15,423 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-08-03 10:53:15,423 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-08-03 10:53:15,424 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-08-03 10:53:15,424 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-08-03 10:53:15,424 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-08-03 10:53:15,424 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-08-03 10:53:15,424 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-08-03 10:53:15,424 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-08-03 10:53:15,424 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-08-03 10:53:15,424 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-08-03 10:53:15,424 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-08-03 10:53:15,424 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-08-03 10:53:15,424 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-08-03 10:53:15,425 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-08-03 10:53:15,425 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-08-03 10:53:15,425 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-08-03 10:53:15,425 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-08-03 10:53:15,425 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-08-03 10:53:15,425 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-08-03 10:53:15,425 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-08-03 10:53:15,425 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-08-03 10:53:15,425 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-08-03 10:53:15,425 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-08-03 10:53:15,426 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-08-03 10:53:15,587 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.022828978069128678); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.03220654442699761, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.022828978069128678); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0125); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.043416666666666666, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-08-03 10:53:15,587 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-08-03 10:53:15,588 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.015417084024119749, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.022828978069128678); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.03220654442699761, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.022828978069128678); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0125); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.043416666666666666, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-08-03 10:53:15,984 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 534 ms to try 5000 different iterations.  Found a solution that moves 951 regions; Going from a computed imbalance of 0.015417084024119749 to a new imbalance of 7.917203273761495E-4. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.008456073273622864); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.012023172538477988); MoveCostFunction : (multiplier=7.0, imbalance=0.10566666666666667, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.008456073273622864); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=3.333333333333333E-4); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.004333333333333333); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-08-03 10:53:15,987 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1986263286:81 , srv1615011600:82 , srv895012989:82 , srv1050707566:83 , srv1228275683:83 , srv16845875:83 , srv2000152763:83 , srv223058564:83 , srv838253750:83 , srv942021489:83 , srv1028703774:84 , srv1164466034:84 , srv1271846804:84 , srv1769047182:84 , srv1828516103:84 , srv187199392:84 , srv1887783249:84 , srv215196900:84 , srv291699185:84 , srv372242388:84 , srv44275996:84 , srv549160317:84 , srv580000922:84 , srv704117719:84 , srv737029930:84 , srv829328148:84 , srv848076517:84 , srv993900636:84 , srv1082073941:85 , srv1170191256:85 , srv12168729:85 , srv1325186336:85 , srv1434087558:85 , srv1458565088:85 , srv1481446625:85 , srv1499717685:85 , srv1505227921:85 , srv1663625147:85 , srv1719044969:85 , srv177317794:85 , srv1778861160:85 , srv1972098365:85 , srv2097882808:85 , srv228208580:85 , srv277257784:85 , srv290848365:85 , srv301876879:85 , srv374740469:85 , srv426360577:85 , srv572745871:85 , srv604286228:85 , srv742684637:85 , srv758075749:85 , srv779170889:85 , srv807559818:85 , srv852758412:85 , srv974668619:85 , srv1000997000:86 , srv1026858756:86 , srv108441073:86 , srv1180813431:86 , srv1304128190:86 , srv1443805417:86 , srv1508784081:86 , srv1535854609:86 , srv1592396991:86 , srv1594911125:86 , srv1688374829:86 , srv1765115343:86 , srv1852588998:86 , srv2066231690:86 , srv2073014093:86 , srv2116589747:86 , srv244091914:86 , srv34386550:86 , srv387358119:86 , srv599078338:86 , srv693792067:86 , srv727607963:86 , srv810984635:86 , srv1105210159:87 , srv1245676935:87 , srv1489602006:87 , srv1503852332:87 , srv1642441116:87 , srv1881060740:87 , srv2092950946:87 , srv433835282:87 , srv671590869:87 , srv993456188:87 , srv1656175095:88 , srv1762634604:88 , srv447162285:88 , srv575309134:88 , srv705437955:88 , srv774660227:88 , srv886704157:88 , srv967431480:88 , srv850862884:89 , srv2134507838:556 }
2023-08-03 10:53:15,993 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-08-03 10:53:15,994 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv108441073=5, srv1508784081=24, srv604286228=75, srv2116589747=52, srv572745871=71, srv2097882808=51, srv447162285=69, srv1663625147=31, srv1434087558=16, srv177317794=38, srv215196900=54, srv44275996=68, srv1499717685=21, srv852758412=92, srv1180813431=9, srv301876879=61, srv693792067=77, srv779170889=85, srv1594911125=27, srv2066231690=48, srv1000997000=0, srv1164466034=7, srv1505227921=23, srv1688374829=33, srv1765115343=36, srv810984635=87, srv967431480=96, srv1271846804=13, srv16845875=32, srv886704157=93, srv1082073941=4, srv12168729=10, srv223058564=55, srv1828516103=40, srv372242388=63, srv1105210159=6, srv774660227=84, srv1304128190=14, srv1481446625=19, srv737029930=81, srv374740469=64, srv1972098365=45, srv290848365=59, srv1642441116=29, srv1986263286=46, srv1325186336=15, srv1458565088=18, srv1535854609=25, srv742684637=82, srv599078338=74, srv1028703774=2, srv758075749=83, srv993900636=99, srv1887783249=44, srv838253750=89, srv1050707566=3, srv228208580=56, srv277257784=58, srv1026858756=1, srv807559818=86, srv1656175095=30, srv187199392=42, srv2134507838=53, srv1852588998=41, srv1489602006=20, srv580000922=73, srv549160317=70, srv1228275683=11, srv1443805417=17, srv575309134=72, srv1615011600=28, srv895012989=94, srv942021489=95, srv1503852332=22, srv974668619=97, srv1245676935=12, srv993456188=98, srv34386550=62, srv2000152763=47, srv848076517=90, srv1592396991=26, srv1719044969=34, srv829328148=88, srv1881060740=43, srv704117719=78, srv1778861160=39, srv433835282=67, srv2092950946=50, srv705437955=79, srv850862884=91, srv671590869=76, srv2073014093=49, srv426360577=66, srv244091914=57, srv1762634604=35, srv727607963=80, srv1170191256=8, srv387358119=65, srv1769047182=37, srv291699185=60} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-08-03 10:53:16,012 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-08-03 10:53:16,012 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-08-03 10:53:16,013 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-08-03 10:53:16,013 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-08-03 10:53:16,013 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-08-03 10:53:16,013 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-08-03 10:53:16,013 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-08-03 10:53:16,013 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-08-03 10:53:16,013 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-08-03 10:53:16,013 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-08-03 10:53:16,014 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-08-03 10:53:16,014 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-08-03 10:53:16,014 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-08-03 10:53:16,014 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-08-03 10:53:16,014 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-08-03 10:53:16,014 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-08-03 10:53:16,014 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-08-03 10:53:16,014 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-08-03 10:53:16,014 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-08-03 10:53:16,015 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-08-03 10:53:16,015 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-08-03 10:53:16,015 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-08-03 10:53:16,015 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-08-03 10:53:16,015 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-08-03 10:53:16,015 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-08-03 10:53:16,015 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-08-03 10:53:16,015 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-08-03 10:53:16,015 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-08-03 10:53:16,016 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-08-03 10:53:16,016 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-08-03 10:53:16,016 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-08-03 10:53:16,016 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-08-03 10:53:16,016 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-08-03 10:53:16,016 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-08-03 10:53:16,016 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-08-03 10:53:16,016 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-08-03 10:53:16,016 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-08-03 10:53:16,017 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-08-03 10:53:16,017 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-08-03 10:53:16,017 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-08-03 10:53:16,017 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-08-03 10:53:16,017 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-08-03 10:53:16,017 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-08-03 10:53:16,017 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-08-03 10:53:16,017 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-08-03 10:53:16,017 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-08-03 10:53:16,017 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-08-03 10:53:16,018 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-08-03 10:53:16,018 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-08-03 10:53:16,018 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-08-03 10:53:16,018 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-08-03 10:53:16,018 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-08-03 10:53:16,018 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-08-03 10:53:16,018 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-08-03 10:53:16,018 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-08-03 10:53:16,019 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-08-03 10:53:16,019 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-08-03 10:53:16,019 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-08-03 10:53:16,019 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-08-03 10:53:16,019 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-08-03 10:53:16,019 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-08-03 10:53:16,019 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-08-03 10:53:16,019 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-08-03 10:53:16,019 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-08-03 10:53:16,019 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-08-03 10:53:16,020 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-08-03 10:53:16,020 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-08-03 10:53:16,020 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-08-03 10:53:16,020 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-08-03 10:53:16,020 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-08-03 10:53:16,020 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-08-03 10:53:16,020 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-08-03 10:53:16,020 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-08-03 10:53:16,020 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-08-03 10:53:16,020 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-08-03 10:53:16,020 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-08-03 10:53:16,021 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-08-03 10:53:16,021 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-08-03 10:53:16,021 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-08-03 10:53:16,021 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-08-03 10:53:16,021 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-08-03 10:53:16,021 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-08-03 10:53:16,021 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-08-03 10:53:16,021 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-08-03 10:53:16,021 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-08-03 10:53:16,021 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-08-03 10:53:16,022 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-08-03 10:53:16,022 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-08-03 10:53:16,022 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-08-03 10:53:16,022 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-08-03 10:53:16,022 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-08-03 10:53:16,022 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-08-03 10:53:16,022 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-08-03 10:53:16,022 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-08-03 10:53:16,022 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-08-03 10:53:16,023 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-08-03 10:53:16,023 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-08-03 10:53:16,023 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-08-03 10:53:16,023 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-08-03 10:53:16,023 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-08-03 10:53:16,023 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-08-03 10:53:16,161 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.008456073273622864); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.012023172538477988); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.008456073273622864); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=3.333333333333333E-4); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.004333333333333333); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-08-03 10:53:16,161 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-08-03 10:53:16,163 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=7.850612830495413E-4, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.008456073273622864); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.012023172538477988); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.008456073273622864); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=3.333333333333333E-4); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.004333333333333333); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-08-03 10:53:16,585 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 546 ms to try 5000 different iterations.  Found a solution that moves 253 regions; Going from a computed imbalance of 7.850612830495413E-4 to a new imbalance of 2.883649288200272E-5. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=5.23782800878924E-4); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.002118805753879094); MoveCostFunction : (multiplier=7.0, imbalance=0.02811111111111111, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=5.23782800878924E-4); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.6666666666666666E-4); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-08-03 10:53:16,587 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1434087558:83 , srv1762634604:83 , srv1769047182:83 , srv2073014093:83 , srv447162285:83 , srv575309134:83 , srv850862884:83 , srv1026858756:84 , srv1105210159:84 , srv1245676935:84 , srv1271846804:84 , srv1458565088:84 , srv1481446625:84 , srv1489602006:84 , srv1503852332:84 , srv1656175095:84 , srv1663625147:84 , srv1688374829:84 , srv1765115343:84 , srv177317794:84 , srv1852588998:84 , srv228208580:84 , srv277257784:84 , srv290848365:84 , srv301876879:84 , srv387358119:84 , srv580000922:84 , srv693792067:84 , srv705437955:84 , srv727607963:84 , srv774660227:84 , srv886704157:84 , srv967431480:84 , srv993456188:84 , srv993900636:84 , srv1000997000:85 , srv1050707566:85 , srv1082073941:85 , srv1164466034:85 , srv1170191256:85 , srv1180813431:85 , srv12168729:85 , srv1228275683:85 , srv1304128190:85 , srv1325186336:85 , srv1443805417:85 , srv1499717685:85 , srv1505227921:85 , srv1508784081:85 , srv1535854609:85 , srv1592396991:85 , srv1594911125:85 , srv1642441116:85 , srv1719044969:85 , srv1778861160:85 , srv1972098365:85 , srv1986263286:85 , srv2092950946:85 , srv2097882808:85 , srv2116589747:85 , srv215196900:85 , srv244091914:85 , srv291699185:85 , srv34386550:85 , srv374740469:85 , srv426360577:85 , srv433835282:85 , srv44275996:85 , srv549160317:85 , srv572745871:85 , srv599078338:85 , srv737029930:85 , srv758075749:85 , srv807559818:85 , srv810984635:85 , srv829328148:85 , srv838253750:85 , srv848076517:85 , srv852758412:85 , srv895012989:85 , srv942021489:85 , srv974668619:85 , srv1028703774:86 , srv108441073:86 , srv1615011600:86 , srv16845875:86 , srv187199392:86 , srv1881060740:86 , srv1887783249:86 , srv2000152763:86 , srv2066231690:86 , srv223058564:86 , srv372242388:86 , srv604286228:86 , srv671590869:86 , srv704117719:86 , srv742684637:86 , srv779170889:86 , srv1828516103:87 , srv2134507838:609 }
2023-08-03 10:53:16,593 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-08-03 10:53:16,594 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv108441073=5, srv1508784081=24, srv604286228=75, srv2116589747=52, srv572745871=71, srv2097882808=51, srv447162285=69, srv1663625147=31, srv1434087558=16, srv177317794=38, srv215196900=54, srv44275996=68, srv1499717685=21, srv852758412=92, srv1180813431=9, srv301876879=61, srv693792067=77, srv779170889=85, srv1594911125=27, srv2066231690=48, srv1000997000=0, srv1164466034=7, srv1505227921=23, srv1688374829=33, srv1765115343=36, srv810984635=87, srv967431480=96, srv1271846804=13, srv16845875=32, srv886704157=93, srv1082073941=4, srv12168729=10, srv223058564=55, srv1828516103=40, srv372242388=63, srv1105210159=6, srv774660227=84, srv1304128190=14, srv1481446625=19, srv737029930=81, srv374740469=64, srv1972098365=45, srv290848365=59, srv1642441116=29, srv1986263286=46, srv1325186336=15, srv1458565088=18, srv1535854609=25, srv742684637=82, srv599078338=74, srv1028703774=2, srv758075749=83, srv993900636=99, srv1887783249=44, srv838253750=89, srv1050707566=3, srv228208580=56, srv277257784=58, srv1026858756=1, srv807559818=86, srv1656175095=30, srv187199392=42, srv2134507838=53, srv1852588998=41, srv1489602006=20, srv580000922=73, srv549160317=70, srv1228275683=11, srv1443805417=17, srv575309134=72, srv1615011600=28, srv895012989=94, srv942021489=95, srv1503852332=22, srv974668619=97, srv1245676935=12, srv993456188=98, srv34386550=62, srv2000152763=47, srv848076517=90, srv1592396991=26, srv1719044969=34, srv829328148=88, srv1881060740=43, srv704117719=78, srv1778861160=39, srv433835282=67, srv2092950946=50, srv705437955=79, srv850862884=91, srv671590869=76, srv2073014093=49, srv426360577=66, srv244091914=57, srv1762634604=35, srv727607963=80, srv1170191256=8, srv387358119=65, srv1769047182=37, srv291699185=60} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-08-03 10:53:16,611 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-08-03 10:53:16,611 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-08-03 10:53:16,612 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-08-03 10:53:16,612 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-08-03 10:53:16,612 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-08-03 10:53:16,612 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-08-03 10:53:16,612 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-08-03 10:53:16,612 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-08-03 10:53:16,612 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-08-03 10:53:16,612 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-08-03 10:53:16,612 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-08-03 10:53:16,612 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-08-03 10:53:16,612 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-08-03 10:53:16,612 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-08-03 10:53:16,613 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-08-03 10:53:16,613 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-08-03 10:53:16,613 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-08-03 10:53:16,613 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-08-03 10:53:16,613 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-08-03 10:53:16,613 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-08-03 10:53:16,613 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-08-03 10:53:16,613 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-08-03 10:53:16,613 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-08-03 10:53:16,613 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-08-03 10:53:16,613 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-08-03 10:53:16,613 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-08-03 10:53:16,614 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-08-03 10:53:16,614 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-08-03 10:53:16,614 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-08-03 10:53:16,614 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-08-03 10:53:16,614 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-08-03 10:53:16,614 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-08-03 10:53:16,614 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-08-03 10:53:16,614 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-08-03 10:53:16,615 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-08-03 10:53:16,615 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-08-03 10:53:16,615 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-08-03 10:53:16,615 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-08-03 10:53:16,615 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-08-03 10:53:16,615 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-08-03 10:53:16,615 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-08-03 10:53:16,615 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-08-03 10:53:16,615 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-08-03 10:53:16,615 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-08-03 10:53:16,616 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-08-03 10:53:16,616 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-08-03 10:53:16,616 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-08-03 10:53:16,616 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-08-03 10:53:16,616 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-08-03 10:53:16,616 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-08-03 10:53:16,616 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-08-03 10:53:16,616 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-08-03 10:53:16,616 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-08-03 10:53:16,616 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-08-03 10:53:16,616 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-08-03 10:53:16,617 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-08-03 10:53:16,617 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-08-03 10:53:16,617 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-08-03 10:53:16,617 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-08-03 10:53:16,617 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-08-03 10:53:16,617 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-08-03 10:53:16,617 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-08-03 10:53:16,617 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-08-03 10:53:16,617 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-08-03 10:53:16,617 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-08-03 10:53:16,617 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-08-03 10:53:16,617 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-08-03 10:53:16,618 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-08-03 10:53:16,618 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-08-03 10:53:16,618 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-08-03 10:53:16,618 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-08-03 10:53:16,618 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-08-03 10:53:16,619 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-08-03 10:53:16,619 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-08-03 10:53:16,619 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-08-03 10:53:16,619 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-08-03 10:53:16,619 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-08-03 10:53:16,619 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-08-03 10:53:16,619 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-08-03 10:53:16,619 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-08-03 10:53:16,619 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-08-03 10:53:16,619 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-08-03 10:53:16,620 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-08-03 10:53:16,620 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-08-03 10:53:16,620 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-08-03 10:53:16,620 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-08-03 10:53:16,620 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-08-03 10:53:16,620 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-08-03 10:53:16,620 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-08-03 10:53:16,620 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-08-03 10:53:16,620 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-08-03 10:53:16,620 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-08-03 10:53:16,621 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-08-03 10:53:16,621 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-08-03 10:53:16,621 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-08-03 10:53:16,621 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-08-03 10:53:16,621 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-08-03 10:53:16,621 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-08-03 10:53:16,621 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-08-03 10:53:16,621 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-08-03 10:53:16,621 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-08-03 10:53:16,752 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=5.23782800878924E-4); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.002118805753879094); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=5.23782800878924E-4); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.6666666666666666E-4); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-08-03 10:53:16,752 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-08-03 10:53:16,752 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=2.7064949018036475E-5, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=5.23782800878924E-4); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.002118805753879094); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=5.23782800878924E-4); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.6666666666666666E-4); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-08-03 10:53:17,067 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 433 ms to try 5000 different iterations.  Found a solution that moves 36 regions; Going from a computed imbalance of 2.7064949018036475E-5 to a new imbalance of 7.32531668408749E-6. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0015713484026367722); MoveCostFunction : (multiplier=7.0, imbalance=0.004); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-08-03 10:53:17,067 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1028703774:83 , srv1082073941:83 , srv1656175095:83 , srv1828516103:83 , srv1881060740:83 , srv2000152763:83 , srv372242388:83 , srv374740469:83 , srv671590869:83 , srv758075749:83 , srv810984635:83 , srv1000997000:84 , srv1050707566:84 , srv108441073:84 , srv1105210159:84 , srv1164466034:84 , srv1170191256:84 , srv1180813431:84 , srv12168729:84 , srv1228275683:84 , srv1245676935:84 , srv1304128190:84 , srv1325186336:84 , srv1434087558:84 , srv1443805417:84 , srv1458565088:84 , srv1481446625:84 , srv1489602006:84 , srv1499717685:84 , srv1503852332:84 , srv1505227921:84 , srv1508784081:84 , srv1535854609:84 , srv1592396991:84 , srv1594911125:84 , srv1615011600:84 , srv1642441116:84 , srv1663625147:84 , srv16845875:84 , srv1719044969:84 , srv1765115343:84 , srv177317794:84 , srv1778861160:84 , srv187199392:84 , srv1887783249:84 , srv1972098365:84 , srv1986263286:84 , srv2066231690:84 , srv2073014093:84 , srv2092950946:84 , srv2097882808:84 , srv2116589747:84 , srv215196900:84 , srv223058564:84 , srv228208580:84 , srv244091914:84 , srv277257784:84 , srv290848365:84 , srv291699185:84 , srv301876879:84 , srv34386550:84 , srv387358119:84 , srv426360577:84 , srv433835282:84 , srv44275996:84 , srv549160317:84 , srv572745871:84 , srv599078338:84 , srv604286228:84 , srv704117719:84 , srv705437955:84 , srv727607963:84 , srv737029930:84 , srv742684637:84 , srv774660227:84 , srv779170889:84 , srv807559818:84 , srv829328148:84 , srv838253750:84 , srv848076517:84 , srv850862884:84 , srv852758412:84 , srv886704157:84 , srv942021489:84 , srv967431480:84 , srv974668619:84 , srv993456188:84 , srv993900636:84 , srv1026858756:85 , srv1271846804:85 , srv1688374829:85 , srv1762634604:85 , srv1769047182:85 , srv1852588998:85 , srv447162285:85 , srv575309134:85 , srv580000922:85 , srv693792067:85 , srv895012989:85 , srv2134507838:684 }
2023-08-03 10:53:17,072 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-08-03 10:53:17,072 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv108441073=5, srv1508784081=24, srv604286228=75, srv2116589747=52, srv572745871=71, srv2097882808=51, srv447162285=69, srv1663625147=31, srv1434087558=16, srv177317794=38, srv215196900=54, srv44275996=68, srv1499717685=21, srv852758412=92, srv1180813431=9, srv301876879=61, srv693792067=77, srv779170889=85, srv1594911125=27, srv2066231690=48, srv1000997000=0, srv1164466034=7, srv1505227921=23, srv1688374829=33, srv1765115343=36, srv810984635=87, srv967431480=96, srv1271846804=13, srv16845875=32, srv886704157=93, srv1082073941=4, srv12168729=10, srv223058564=55, srv1828516103=40, srv372242388=63, srv1105210159=6, srv774660227=84, srv1304128190=14, srv1481446625=19, srv737029930=81, srv374740469=64, srv1972098365=45, srv290848365=59, srv1642441116=29, srv1986263286=46, srv1325186336=15, srv1458565088=18, srv1535854609=25, srv742684637=82, srv599078338=74, srv1028703774=2, srv758075749=83, srv993900636=99, srv1887783249=44, srv838253750=89, srv1050707566=3, srv228208580=56, srv277257784=58, srv1026858756=1, srv807559818=86, srv1656175095=30, srv187199392=42, srv2134507838=53, srv1852588998=41, srv1489602006=20, srv580000922=73, srv549160317=70, srv1228275683=11, srv1443805417=17, srv575309134=72, srv1615011600=28, srv895012989=94, srv942021489=95, srv1503852332=22, srv974668619=97, srv1245676935=12, srv993456188=98, srv34386550=62, srv2000152763=47, srv848076517=90, srv1592396991=26, srv1719044969=34, srv829328148=88, srv1881060740=43, srv704117719=78, srv1778861160=39, srv433835282=67, srv2092950946=50, srv705437955=79, srv850862884=91, srv671590869=76, srv2073014093=49, srv426360577=66, srv244091914=57, srv1762634604=35, srv727607963=80, srv1170191256=8, srv387358119=65, srv1769047182=37, srv291699185=60} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-08-03 10:53:17,096 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-08-03 10:53:17,096 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-08-03 10:53:17,097 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-08-03 10:53:17,097 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-08-03 10:53:17,097 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-08-03 10:53:17,097 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-08-03 10:53:17,097 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-08-03 10:53:17,097 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-08-03 10:53:17,097 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-08-03 10:53:17,097 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-08-03 10:53:17,097 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-08-03 10:53:17,097 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-08-03 10:53:17,097 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-08-03 10:53:17,097 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-08-03 10:53:17,097 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-08-03 10:53:17,097 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-08-03 10:53:17,098 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-08-03 10:53:17,098 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-08-03 10:53:17,098 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-08-03 10:53:17,098 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-08-03 10:53:17,098 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-08-03 10:53:17,098 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-08-03 10:53:17,098 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-08-03 10:53:17,098 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-08-03 10:53:17,098 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-08-03 10:53:17,098 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-08-03 10:53:17,098 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-08-03 10:53:17,098 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-08-03 10:53:17,098 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-08-03 10:53:17,099 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-08-03 10:53:17,099 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-08-03 10:53:17,099 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-08-03 10:53:17,099 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-08-03 10:53:17,099 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-08-03 10:53:17,099 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-08-03 10:53:17,099 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-08-03 10:53:17,099 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-08-03 10:53:17,099 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-08-03 10:53:17,099 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-08-03 10:53:17,099 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-08-03 10:53:17,099 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-08-03 10:53:17,099 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-08-03 10:53:17,100 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-08-03 10:53:17,100 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-08-03 10:53:17,100 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-08-03 10:53:17,100 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-08-03 10:53:17,100 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-08-03 10:53:17,100 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-08-03 10:53:17,100 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-08-03 10:53:17,100 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-08-03 10:53:17,100 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-08-03 10:53:17,100 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-08-03 10:53:17,100 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-08-03 10:53:17,100 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-08-03 10:53:17,100 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-08-03 10:53:17,101 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-08-03 10:53:17,101 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-08-03 10:53:17,101 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-08-03 10:53:17,101 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-08-03 10:53:17,101 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-08-03 10:53:17,101 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-08-03 10:53:17,101 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-08-03 10:53:17,101 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-08-03 10:53:17,101 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-08-03 10:53:17,101 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-08-03 10:53:17,101 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-08-03 10:53:17,101 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-08-03 10:53:17,101 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-08-03 10:53:17,102 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-08-03 10:53:17,102 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-08-03 10:53:17,102 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-08-03 10:53:17,102 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-08-03 10:53:17,102 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-08-03 10:53:17,102 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-08-03 10:53:17,102 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-08-03 10:53:17,102 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-08-03 10:53:17,102 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-08-03 10:53:17,102 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-08-03 10:53:17,102 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-08-03 10:53:17,102 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-08-03 10:53:17,102 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-08-03 10:53:17,103 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-08-03 10:53:17,103 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-08-03 10:53:17,103 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-08-03 10:53:17,103 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-08-03 10:53:17,103 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-08-03 10:53:17,103 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-08-03 10:53:17,103 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-08-03 10:53:17,103 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-08-03 10:53:17,103 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-08-03 10:53:17,103 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-08-03 10:53:17,103 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-08-03 10:53:17,103 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-08-03 10:53:17,104 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-08-03 10:53:17,104 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-08-03 10:53:17,104 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-08-03 10:53:17,104 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-08-03 10:53:17,104 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-08-03 10:53:17,104 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-08-03 10:53:17,104 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-08-03 10:53:17,104 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-08-03 10:53:17,242 INFO  [Time-limited test] balancer.StochasticLoadBalancer(381): Cluster wide - skipping load balancing because weighted average imbalance=7.073239296329447E-6 <= threshold(0.025). If you want more aggressive balancing, either lower hbase.master.balancer.stochastic.minCostNeedBalance from 0.025 or increase the relative multiplier(s) of the specific cost function(s). functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0015713484026367722); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-08-03 10:53:17,242 INFO  [Time-limited test] balancer.BalancerTestBase(570): Mock Final balance: { srv1028703774:83 , srv1082073941:83 , srv1656175095:83 , srv1828516103:83 , srv1881060740:83 , srv2000152763:83 , srv372242388:83 , srv374740469:83 , srv671590869:83 , srv758075749:83 , srv810984635:83 , srv1000997000:84 , srv1050707566:84 , srv108441073:84 , srv1105210159:84 , srv1164466034:84 , srv1170191256:84 , srv1180813431:84 , srv12168729:84 , srv1228275683:84 , srv1245676935:84 , srv1304128190:84 , srv1325186336:84 , srv1434087558:84 , srv1443805417:84 , srv1458565088:84 , srv1481446625:84 , srv1489602006:84 , srv1499717685:84 , srv1503852332:84 , srv1505227921:84 , srv1508784081:84 , srv1535854609:84 , srv1592396991:84 , srv1594911125:84 , srv1615011600:84 , srv1642441116:84 , srv1663625147:84 , srv16845875:84 , srv1719044969:84 , srv1765115343:84 , srv177317794:84 , srv1778861160:84 , srv187199392:84 , srv1887783249:84 , srv1972098365:84 , srv1986263286:84 , srv2066231690:84 , srv2073014093:84 , srv2092950946:84 , srv2097882808:84 , srv2116589747:84 , srv215196900:84 , srv223058564:84 , srv228208580:84 , srv244091914:84 , srv277257784:84 , srv290848365:84 , srv291699185:84 , srv301876879:84 , srv34386550:84 , srv387358119:84 , srv426360577:84 , srv433835282:84 , srv44275996:84 , srv549160317:84 , srv572745871:84 , srv599078338:84 , srv604286228:84 , srv704117719:84 , srv705437955:84 , srv727607963:84 , srv737029930:84 , srv742684637:84 , srv774660227:84 , srv779170889:84 , srv807559818:84 , srv829328148:84 , srv838253750:84 , srv848076517:84 , srv850862884:84 , srv852758412:84 , srv886704157:84 , srv942021489:84 , srv967431480:84 , srv974668619:84 , srv993456188:84 , srv993900636:84 , srv1026858756:85 , srv1271846804:85 , srv1688374829:85 , srv1762634604:85 , srv1769047182:85 , srv1852588998:85 , srv447162285:85 , srv575309134:85 , srv580000922:85 , srv693792067:85 , srv895012989:85 , srv2134507838:684 }
2023-08-03 10:53:17,281 INFO  [Time-limited test] hbase.ResourceChecker(175): after: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnLargeClusterWithRacks Thread=12 (was 12), OpenFileDescriptor=263 (was 263), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=281 (was 281), ProcessCount=173 (was 173), AvailableMemoryMB=1756 (was 2617)
2023-08-03 10:53:17,296 INFO  [Time-limited test] hbase.ResourceChecker(147): before: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnMidClusterWithRacks Thread=12, OpenFileDescriptor=263, MaxFileDescriptor=60000, SystemLoadAverage=281, ProcessCount=173, AvailableMemoryMB=1756
2023-08-03 10:53:17,296 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2023-08-03 10:53:17,296 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=5000, runMaxSteps=true, stepsPerRegion=800, maxRunningTime=120000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 111077.0 etc.
2023-08-03 10:53:17,308 INFO  [Time-limited test] balancer.BalancerTestBase(547): Mock Cluster : { srv1056577420:84 , srv1076010361:84 , srv1283638667:84 , srv1349667417:84 , srv1388574550:84 , srv1396562266:84 , srv1421935010:84 , srv14381371:84 , srv1440834875:84 , srv1535182844:84 , srv1565576187:84 , srv1971789252:84 , srv2067295518:84 , srv2141527110:84 , srv247174474:84 , srv352220907:84 , srv421349202:84 , srv433771637:84 , srv447824842:84 , srv549253359:84 , srv579941697:84 , srv70758682:84 , srv724980757:84 , srv768371741:84 , srv803383558:84 , srv818217023:84 , srv852442063:84 , srv907713958:84 , srv918764057:84 , srv696667457:264 } [srvr=30 rgns=2700 avg=90.0 max=90 min=90]
2023-08-03 10:53:17,310 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-08-03 10:53:17,310 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1535182844=9, srv70758682=22, srv907713958=28, srv852442063=27, srv1440834875=8, srv724980757=23, srv803383558=25, srv1396562266=5, srv549253359=19, srv1388574550=4, srv2067295518=12, srv918764057=29, srv579941697=20, srv1076010361=1, srv447824842=18, srv768371741=24, srv1565576187=10, srv696667457=21, srv1421935010=6, srv2141527110=13, srv421349202=16, srv352220907=15, srv1349667417=3, srv247174474=14, srv818217023=26, srv1056577420=0, srv1283638667=2, srv14381371=7, srv1971789252=11, srv433771637=17} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-08-03 10:53:17,324 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-08-03 10:53:17,324 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-08-03 10:53:17,325 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-08-03 10:53:17,325 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-08-03 10:53:17,325 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-08-03 10:53:17,325 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-08-03 10:53:17,325 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-08-03 10:53:17,325 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-08-03 10:53:17,325 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-08-03 10:53:17,325 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-08-03 10:53:17,325 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-08-03 10:53:17,325 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-08-03 10:53:17,325 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-08-03 10:53:17,325 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-08-03 10:53:17,325 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-08-03 10:53:17,326 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-08-03 10:53:17,326 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-08-03 10:53:17,326 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-08-03 10:53:17,326 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-08-03 10:53:17,326 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-08-03 10:53:17,326 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-08-03 10:53:17,326 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-08-03 10:53:17,326 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-08-03 10:53:17,326 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-08-03 10:53:17,326 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-08-03 10:53:17,326 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-08-03 10:53:17,326 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-08-03 10:53:17,326 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-08-03 10:53:17,327 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-08-03 10:53:17,327 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-08-03 10:53:17,327 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=10, number of hosts=30, number of racks=4
2023-08-03 10:53:17,350 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=1.0471523034486123, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-08-03 10:53:17,350 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.9912341618632784, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=1.0471523034486123, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=64800000
2023-08-03 10:55:17,331 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 120001 ms to try 5578964 different iterations.  Found a solution that moves 1852 regions; Going from a computed imbalance of 0.9912341618632784 to a new imbalance of 4.322660390073086E-5. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); MoveCostFunction : (multiplier=7.0, imbalance=0.6859259259259259, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-08-03 10:55:17,338 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1056577420:90 , srv1076010361:90 , srv1283638667:90 , srv1349667417:90 , srv1388574550:90 , srv1396562266:90 , srv1421935010:90 , srv14381371:90 , srv1440834875:90 , srv1535182844:90 , srv1565576187:90 , srv1971789252:90 , srv2067295518:90 , srv2141527110:90 , srv247174474:90 , srv352220907:90 , srv421349202:90 , srv433771637:90 , srv447824842:90 , srv549253359:90 , srv579941697:90 , srv696667457:90 , srv70758682:90 , srv724980757:90 , srv768371741:90 , srv803383558:90 , srv818217023:90 , srv852442063:90 , srv907713958:90 , srv918764057:90 }
2023-08-03 10:55:17,339 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-08-03 10:55:17,339 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1535182844=9, srv70758682=22, srv907713958=28, srv852442063=27, srv1440834875=8, srv724980757=23, srv803383558=25, srv1396562266=5, srv549253359=19, srv1388574550=4, srv2067295518=12, srv918764057=29, srv579941697=20, srv1076010361=1, srv447824842=18, srv768371741=24, srv1565576187=10, srv696667457=21, srv1421935010=6, srv2141527110=13, srv421349202=16, srv352220907=15, srv1349667417=3, srv247174474=14, srv818217023=26, srv1056577420=0, srv1283638667=2, srv14381371=7, srv1971789252=11, srv433771637=17} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-08-03 10:55:17,342 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-08-03 10:55:17,342 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-08-03 10:55:17,342 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-08-03 10:55:17,342 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-08-03 10:55:17,342 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-08-03 10:55:17,342 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-08-03 10:55:17,342 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-08-03 10:55:17,343 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-08-03 10:55:17,343 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-08-03 10:55:17,343 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-08-03 10:55:17,343 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-08-03 10:55:17,343 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-08-03 10:55:17,343 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-08-03 10:55:17,343 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-08-03 10:55:17,343 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-08-03 10:55:17,343 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-08-03 10:55:17,343 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-08-03 10:55:17,343 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-08-03 10:55:17,343 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-08-03 10:55:17,343 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-08-03 10:55:17,343 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-08-03 10:55:17,343 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-08-03 10:55:17,343 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-08-03 10:55:17,343 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-08-03 10:55:17,343 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-08-03 10:55:17,344 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-08-03 10:55:17,344 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-08-03 10:55:17,344 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-08-03 10:55:17,344 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-08-03 10:55:17,344 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-08-03 10:55:17,344 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=10, number of hosts=30, number of racks=4
2023-08-03 10:55:17,355 INFO  [Time-limited test] balancer.StochasticLoadBalancer(381): Cluster wide - skipping load balancing because weighted average imbalance=0.0 <= threshold(0.025). If you want more aggressive balancing, either lower hbase.master.balancer.stochastic.minCostNeedBalance from 0.025 or increase the relative multiplier(s) of the specific cost function(s). functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-08-03 10:55:17,355 INFO  [Time-limited test] balancer.BalancerTestBase(570): Mock Final balance: { srv1056577420:90 , srv1076010361:90 , srv1283638667:90 , srv1349667417:90 , srv1388574550:90 , srv1396562266:90 , srv1421935010:90 , srv14381371:90 , srv1440834875:90 , srv1535182844:90 , srv1565576187:90 , srv1971789252:90 , srv2067295518:90 , srv2141527110:90 , srv247174474:90 , srv352220907:90 , srv421349202:90 , srv433771637:90 , srv447824842:90 , srv549253359:90 , srv579941697:90 , srv696667457:90 , srv70758682:90 , srv724980757:90 , srv768371741:90 , srv803383558:90 , srv818217023:90 , srv852442063:90 , srv907713958:90 , srv918764057:90 }
2023-08-03 10:55:17,371 INFO  [Time-limited test] hbase.ResourceChecker(175): after: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnMidClusterWithRacks Thread=11 (was 12), OpenFileDescriptor=263 (was 263), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=227 (was 281), ProcessCount=171 (was 173), AvailableMemoryMB=1699 (was 1756)