2023-08-15 08:53:08,434 INFO  [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks timeout: 13 mins
2023-08-15 08:53:08,758 WARN  [Time-limited test] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties
2023-08-15 08:53:08,880 INFO  [Time-limited test] metrics.MetricRegistriesLoader(60): Loaded MetricRegistries class org.apache.hadoop.hbase.metrics.impl.MetricRegistriesImpl
2023-08-15 08:53:08,945 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2023-08-15 08:53:08,953 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc.
2023-08-15 08:53:08,966 INFO  [Time-limited test] hbase.ResourceChecker(147): before: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnLargeClusterWithRacks Thread=12, OpenFileDescriptor=263, MaxFileDescriptor=60000, SystemLoadAverage=303, ProcessCount=171, AvailableMemoryMB=3105
2023-08-15 08:53:08,968 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2023-08-15 08:53:08,969 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=5000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=10000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc.
2023-08-15 08:53:09,113 INFO  [Time-limited test] balancer.BalancerTestBase(547): Mock Cluster : { srv105072276:84 , srv1079416473:84 , srv1085156315:84 , srv110118546:84 , srv1111590643:84 , srv1119038117:84 , srv1128309030:84 , srv1139524039:84 , srv114259848:84 , srv1155110045:84 , srv117295650:84 , srv1179184848:84 , srv1180072723:84 , srv1182889151:84 , srv1219103892:84 , srv1222187122:84 , srv1224462976:84 , srv1296240296:84 , srv1368143824:84 , srv1386079853:84 , srv144499348:84 , srv1503717381:84 , srv1530449721:84 , srv1558747209:84 , srv1559185042:84 , srv1646443245:84 , srv1667496830:84 , srv1691087829:84 , srv1749846033:84 , srv1750826245:84 , srv1771360842:84 , srv1796658433:84 , srv1813491436:84 , srv1831432419:84 , srv1834695807:84 , srv1842941973:84 , srv1850452167:84 , srv1852576836:84 , srv1856667971:84 , srv186856466:84 , srv1907002063:84 , srv1927882417:84 , srv1937221222:84 , srv1961140441:84 , srv2005070014:84 , srv2100776745:84 , srv212740617:84 , srv2147061266:84 , srv217289336:84 , srv231286573:84 , srv237742967:84 , srv258929036:84 , srv274330623:84 , srv275388554:84 , srv305731808:84 , srv311580510:84 , srv322777778:84 , srv327421288:84 , srv384210890:84 , srv384841610:84 , srv387895928:84 , srv400477600:84 , srv41779982:84 , srv478316995:84 , srv485089275:84 , srv500490174:84 , srv520955980:84 , srv522962113:84 , srv545574950:84 , srv553398622:84 , srv592228616:84 , srv597967669:84 , srv613821516:84 , srv627876650:84 , srv646396030:84 , srv649365784:84 , srv656056086:84 , srv664050797:84 , srv674597793:84 , srv679885669:84 , srv682655580:84 , srv702103557:84 , srv713274496:84 , srv744088089:84 , srv748470772:84 , srv779229671:84 , srv8080529:84 , srv813940628:84 , srv823160860:84 , srv845897750:84 , srv850105112:84 , srv852336997:84 , srv85353690:84 , srv894785689:84 , srv909280419:84 , srv909450609:84 , srv912391248:84 , srv928184426:84 , srv929409802:84 , srv1727008807:684 } [srvr=100 rgns=9000 avg=90.0 max=90 min=90]
2023-08-15 08:53:09,122 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-08-15 08:53:09,129 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1530449721=22, srv1182889151=13, srv1128309030=6, srv1850452167=37, srv553398622=70, srv1937221222=43, srv909450609=96, srv1749846033=29, srv1852576836=38, srv2005070014=45, srv1927882417=42, srv674597793=79, srv110118546=3, srv1646443245=25, srv682655580=81, srv1368143824=18, srv258929036=52, srv327421288=58, srv1961140441=44, srv117295650=10, srv212740617=47, srv912391248=97, srv850105112=91, srv1834695807=35, srv613821516=73, srv478316995=64, srv1691087829=27, srv231286573=50, srv1296240296=17, srv1222187122=15, srv1796658433=32, srv1558747209=23, srv1119038117=5, srv1224462976=16, srv664050797=78, srv646396030=75, srv305731808=55, srv41779982=63, srv909280419=95, srv2100776745=46, srv744088089=84, srv522962113=68, srv114259848=8, srv627876650=74, srv929409802=99, srv485089275=65, srv845897750=90, srv702103557=82, srv779229671=86, srv1111590643=4, srv520955980=67, srv852336997=92, srv105072276=0, srv1085156315=2, srv813940628=88, srv1771360842=31, srv928184426=98, srv1179184848=11, srv1503717381=21, srv400477600=62, srv1813491436=33, srv2147061266=48, srv1155110045=9, srv1907002063=41, srv597967669=72, srv85353690=93, srv275388554=54, srv311580510=56, srv592228616=71, srv144499348=20, srv1842941973=36, srv274330623=53, srv384841610=60, srv1386079853=19, srv384210890=59, srv656056086=77, srv1559185042=24, srv1750826245=30, srv713274496=83, srv1079416473=1, srv545574950=69, srv500490174=66, srv8080529=87, srv1139524039=7, srv1667496830=26, srv1727008807=28, srv1219103892=14, srv894785689=94, srv237742967=51, srv1831432419=34, srv1180072723=12, srv649365784=76, srv387895928=61, srv679885669=80, srv1856667971=39, srv217289336=49, srv186856466=40, srv748470772=85, srv322777778=57, srv823160860=89} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-08-15 08:53:09,207 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-08-15 08:53:09,207 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-08-15 08:53:09,207 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-08-15 08:53:09,207 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-08-15 08:53:09,208 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-08-15 08:53:09,208 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-08-15 08:53:09,208 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-08-15 08:53:09,208 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-08-15 08:53:09,208 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-08-15 08:53:09,208 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-08-15 08:53:09,209 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-08-15 08:53:09,209 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-08-15 08:53:09,209 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-08-15 08:53:09,209 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-08-15 08:53:09,209 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-08-15 08:53:09,209 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-08-15 08:53:09,210 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-08-15 08:53:09,210 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-08-15 08:53:09,210 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-08-15 08:53:09,210 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-08-15 08:53:09,210 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-08-15 08:53:09,210 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-08-15 08:53:09,210 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-08-15 08:53:09,211 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-08-15 08:53:09,211 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-08-15 08:53:09,211 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-08-15 08:53:09,211 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-08-15 08:53:09,211 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-08-15 08:53:09,211 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-08-15 08:53:09,212 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-08-15 08:53:09,212 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-08-15 08:53:09,212 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-08-15 08:53:09,212 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-08-15 08:53:09,212 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-08-15 08:53:09,212 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-08-15 08:53:09,212 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-08-15 08:53:09,213 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-08-15 08:53:09,213 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-08-15 08:53:09,213 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-08-15 08:53:09,213 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-08-15 08:53:09,213 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-08-15 08:53:09,213 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-08-15 08:53:09,214 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-08-15 08:53:09,214 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-08-15 08:53:09,214 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-08-15 08:53:09,214 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-08-15 08:53:09,214 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-08-15 08:53:09,214 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-08-15 08:53:09,215 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-08-15 08:53:09,215 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-08-15 08:53:09,215 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-08-15 08:53:09,215 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-08-15 08:53:09,215 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-08-15 08:53:09,215 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-08-15 08:53:09,215 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-08-15 08:53:09,216 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-08-15 08:53:09,216 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-08-15 08:53:09,216 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-08-15 08:53:09,216 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-08-15 08:53:09,216 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-08-15 08:53:09,217 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-08-15 08:53:09,217 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-08-15 08:53:09,217 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-08-15 08:53:09,217 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-08-15 08:53:09,217 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-08-15 08:53:09,217 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-08-15 08:53:09,218 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-08-15 08:53:09,218 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-08-15 08:53:09,218 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-08-15 08:53:09,218 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-08-15 08:53:09,218 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-08-15 08:53:09,218 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-08-15 08:53:09,219 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-08-15 08:53:09,219 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-08-15 08:53:09,219 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-08-15 08:53:09,219 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-08-15 08:53:09,219 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-08-15 08:53:09,219 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-08-15 08:53:09,219 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-08-15 08:53:09,220 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-08-15 08:53:09,220 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-08-15 08:53:09,220 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-08-15 08:53:09,220 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-08-15 08:53:09,220 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-08-15 08:53:09,220 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-08-15 08:53:09,221 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-08-15 08:53:09,221 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-08-15 08:53:09,221 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-08-15 08:53:09,221 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-08-15 08:53:09,221 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-08-15 08:53:09,221 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-08-15 08:53:09,222 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-08-15 08:53:09,222 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-08-15 08:53:09,222 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-08-15 08:53:09,222 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-08-15 08:53:09,222 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-08-15 08:53:09,222 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-08-15 08:53:09,223 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-08-15 08:53:09,223 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-08-15 08:53:09,223 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-08-15 08:53:09,223 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-08-15 08:53:09,451 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.06666666666666667, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-08-15 08:53:09,452 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-08-15 08:53:09,452 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.9909252140407105, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.06666666666666667, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-08-15 08:53:09,814 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 557 ms to try 5000 different iterations.  Found a solution that moves 4681 regions; Going from a computed imbalance of 0.9909252140407105 to a new imbalance of 0.18023046612683288. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.039206813326873244, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0546861261251187, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.5201111111111111, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.039206813326873244, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.17525, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.24425, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-08-15 08:53:09,829 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1852576836:79 , srv1085156315:80 , srv258929036:80 , srv110118546:81 , srv1119038117:81 , srv545574950:82 , srv823160860:82 , srv1224462976:83 , srv1691087829:83 , srv217289336:83 , srv311580510:83 , srv322777778:83 , srv387895928:83 , srv779229671:83 , srv1128309030:84 , srv1750826245:84 , srv1850452167:84 , srv1937221222:84 , srv2147061266:84 , srv894785689:84 , srv1079416473:85 , srv1111590643:85 , srv1182889151:85 , srv1222187122:85 , srv1296240296:85 , srv1530449721:85 , srv1559185042:85 , srv1749846033:85 , srv1796658433:85 , srv1834695807:85 , srv186856466:85 , srv2100776745:85 , srv212740617:85 , srv237742967:85 , srv627876650:85 , srv702103557:85 , srv8080529:85 , srv909280419:85 , srv1179184848:86 , srv1368143824:86 , srv1503717381:86 , srv1558747209:86 , srv1667496830:86 , srv1842941973:86 , srv274330623:86 , srv327421288:86 , srv597967669:86 , srv646396030:86 , srv656056086:86 , srv744088089:86 , srv909450609:86 , srv912391248:86 , srv928184426:86 , srv105072276:87 , srv1155110045:87 , srv117295650:87 , srv1219103892:87 , srv1386079853:87 , srv144499348:87 , srv1646443245:87 , srv1771360842:87 , srv1813491436:87 , srv1831432419:87 , srv1907002063:87 , srv478316995:87 , srv522962113:87 , srv674597793:87 , srv852336997:87 , srv114259848:88 , srv1180072723:88 , srv231286573:88 , srv275388554:88 , srv485089275:88 , srv553398622:88 , srv592228616:88 , srv613821516:88 , srv664050797:88 , srv679885669:88 , srv813940628:88 , srv929409802:88 , srv1139524039:89 , srv2005070014:89 , srv384210890:89 , srv384841610:89 , srv400477600:89 , srv500490174:89 , srv1856667971:90 , srv41779982:90 , srv520955980:90 , srv713274496:90 , srv748470772:90 , srv305731808:91 , srv85353690:91 , srv1961140441:93 , srv850105112:93 , srv649365784:94 , srv845897750:94 , srv1927882417:95 , srv682655580:96 , srv1727008807:438 }
2023-08-15 08:53:09,835 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-08-15 08:53:09,836 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1530449721=22, srv1182889151=13, srv1128309030=6, srv1850452167=37, srv553398622=70, srv1937221222=43, srv909450609=96, srv1749846033=29, srv1852576836=38, srv2005070014=45, srv1927882417=42, srv674597793=79, srv110118546=3, srv1646443245=25, srv682655580=81, srv1368143824=18, srv258929036=52, srv327421288=58, srv1961140441=44, srv117295650=10, srv212740617=47, srv912391248=97, srv850105112=91, srv1834695807=35, srv613821516=73, srv478316995=64, srv1691087829=27, srv231286573=50, srv1296240296=17, srv1222187122=15, srv1796658433=32, srv1558747209=23, srv1119038117=5, srv1224462976=16, srv664050797=78, srv646396030=75, srv305731808=55, srv41779982=63, srv909280419=95, srv2100776745=46, srv744088089=84, srv522962113=68, srv114259848=8, srv627876650=74, srv929409802=99, srv485089275=65, srv845897750=90, srv702103557=82, srv779229671=86, srv1111590643=4, srv520955980=67, srv852336997=92, srv105072276=0, srv1085156315=2, srv813940628=88, srv1771360842=31, srv928184426=98, srv1179184848=11, srv1503717381=21, srv400477600=62, srv1813491436=33, srv2147061266=48, srv1155110045=9, srv1907002063=41, srv597967669=72, srv85353690=93, srv275388554=54, srv311580510=56, srv592228616=71, srv144499348=20, srv1842941973=36, srv274330623=53, srv384841610=60, srv1386079853=19, srv384210890=59, srv656056086=77, srv1559185042=24, srv1750826245=30, srv713274496=83, srv1079416473=1, srv545574950=69, srv500490174=66, srv8080529=87, srv1139524039=7, srv1667496830=26, srv1727008807=28, srv1219103892=14, srv894785689=94, srv237742967=51, srv1831432419=34, srv1180072723=12, srv649365784=76, srv387895928=61, srv679885669=80, srv1856667971=39, srv217289336=49, srv186856466=40, srv748470772=85, srv322777778=57, srv823160860=89} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-08-15 08:53:09,867 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-08-15 08:53:09,867 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-08-15 08:53:09,868 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-08-15 08:53:09,868 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-08-15 08:53:09,868 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-08-15 08:53:09,868 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-08-15 08:53:09,868 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-08-15 08:53:09,868 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-08-15 08:53:09,868 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-08-15 08:53:09,869 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-08-15 08:53:09,869 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-08-15 08:53:09,869 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-08-15 08:53:09,869 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-08-15 08:53:09,869 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-08-15 08:53:09,869 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-08-15 08:53:09,869 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-08-15 08:53:09,869 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-08-15 08:53:09,870 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-08-15 08:53:09,870 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-08-15 08:53:09,870 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-08-15 08:53:09,870 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-08-15 08:53:09,870 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-08-15 08:53:09,870 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-08-15 08:53:09,870 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-08-15 08:53:09,871 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-08-15 08:53:09,871 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-08-15 08:53:09,871 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-08-15 08:53:09,871 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-08-15 08:53:09,871 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-08-15 08:53:09,871 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-08-15 08:53:09,871 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-08-15 08:53:09,871 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-08-15 08:53:09,872 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-08-15 08:53:09,872 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-08-15 08:53:09,872 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-08-15 08:53:09,872 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-08-15 08:53:09,872 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-08-15 08:53:09,872 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-08-15 08:53:09,872 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-08-15 08:53:09,872 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-08-15 08:53:09,873 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-08-15 08:53:09,873 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-08-15 08:53:09,873 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-08-15 08:53:09,873 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-08-15 08:53:09,873 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-08-15 08:53:09,873 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-08-15 08:53:09,873 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-08-15 08:53:09,873 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-08-15 08:53:09,874 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-08-15 08:53:09,874 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-08-15 08:53:09,874 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-08-15 08:53:09,874 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-08-15 08:53:09,874 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-08-15 08:53:09,874 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-08-15 08:53:09,874 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-08-15 08:53:09,874 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-08-15 08:53:09,874 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-08-15 08:53:09,875 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-08-15 08:53:09,875 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-08-15 08:53:09,875 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-08-15 08:53:09,875 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-08-15 08:53:09,875 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-08-15 08:53:09,875 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-08-15 08:53:09,875 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-08-15 08:53:09,875 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-08-15 08:53:09,876 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-08-15 08:53:09,876 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-08-15 08:53:09,876 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-08-15 08:53:09,876 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-08-15 08:53:09,876 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-08-15 08:53:09,876 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-08-15 08:53:09,877 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-08-15 08:53:09,877 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-08-15 08:53:09,877 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-08-15 08:53:09,877 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-08-15 08:53:09,877 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-08-15 08:53:09,877 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-08-15 08:53:09,877 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-08-15 08:53:09,877 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-08-15 08:53:09,878 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-08-15 08:53:09,878 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-08-15 08:53:09,878 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-08-15 08:53:09,878 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-08-15 08:53:09,878 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-08-15 08:53:09,878 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-08-15 08:53:09,878 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-08-15 08:53:09,878 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-08-15 08:53:09,879 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-08-15 08:53:09,879 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-08-15 08:53:09,879 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-08-15 08:53:09,879 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-08-15 08:53:09,879 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-08-15 08:53:09,879 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-08-15 08:53:09,879 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-08-15 08:53:09,879 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-08-15 08:53:09,879 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-08-15 08:53:09,880 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-08-15 08:53:09,880 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-08-15 08:53:09,880 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-08-15 08:53:09,880 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-08-15 08:53:09,880 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-08-15 08:53:10,051 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.039206813326873244, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0546861261251187, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.039206813326873244, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.17525, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.24425, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-08-15 08:53:10,051 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-08-15 08:53:10,052 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.18019768906427466, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.039206813326873244, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0546861261251187, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.039206813326873244, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.17525, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.24425, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-08-15 08:53:10,381 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 474 ms to try 5000 different iterations.  Found a solution that moves 2581 regions; Going from a computed imbalance of 0.18019768906427466 to a new imbalance of 0.015185097146690373. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.020704634276744235); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.030594557294181198, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.2867777777777778, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.020704634276744235); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.011916666666666667); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.04666666666666667, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-08-15 08:53:10,395 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv682655580:75 , srv1927882417:78 , srv649365784:78 , srv845897750:79 , srv1856667971:80 , srv748470772:80 , srv850105112:80 , srv1961140441:81 , srv1139524039:82 , srv305731808:82 , srv400477600:82 , srv41779982:82 , srv500490174:82 , srv592228616:82 , srv813940628:82 , srv85353690:82 , srv105072276:83 , srv114259848:83 , srv1180072723:83 , srv231286573:83 , srv520955980:83 , srv553398622:83 , srv713274496:83 , srv1368143824:84 , srv1842941973:84 , srv1907002063:84 , srv384841610:84 , srv852336997:84 , srv912391248:84 , srv117295650:85 , srv1219103892:85 , srv144499348:85 , srv1646443245:85 , srv1771360842:85 , srv1796658433:85 , srv1831432419:85 , srv275388554:85 , srv478316995:85 , srv485089275:85 , srv597967669:85 , srv613821516:85 , srv656056086:85 , srv8080529:85 , srv928184426:85 , srv929409802:85 , srv1111590643:86 , srv1179184848:86 , srv1296240296:86 , srv1386079853:86 , srv1503717381:86 , srv1813491436:86 , srv1834695807:86 , srv2100776745:86 , srv212740617:86 , srv274330623:86 , srv384210890:86 , srv522962113:86 , srv646396030:86 , srv679885669:86 , srv1558747209:87 , srv1667496830:87 , srv186856466:87 , srv2005070014:87 , srv2147061266:87 , srv217289336:87 , srv237742967:87 , srv327421288:87 , srv674597793:87 , srv744088089:87 , srv909280419:87 , srv909450609:87 , srv1079416473:88 , srv1155110045:88 , srv1222187122:88 , srv1224462976:88 , srv1530449721:88 , srv1559185042:88 , srv1749846033:88 , srv1850452167:88 , srv1937221222:88 , srv387895928:88 , srv627876650:88 , srv664050797:88 , srv702103557:88 , srv894785689:88 , srv1182889151:89 , srv311580510:89 , srv322777778:89 , srv779229671:89 , srv1119038117:90 , srv1128309030:90 , srv1750826245:90 , srv545574950:90 , srv823160860:90 , srv1691087829:91 , srv258929036:91 , srv110118546:93 , srv1852576836:93 , srv1085156315:94 , srv1727008807:520 }
2023-08-15 08:53:10,399 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-08-15 08:53:10,400 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1530449721=22, srv1182889151=13, srv1128309030=6, srv1850452167=37, srv553398622=70, srv1937221222=43, srv909450609=96, srv1749846033=29, srv1852576836=38, srv2005070014=45, srv1927882417=42, srv674597793=79, srv110118546=3, srv1646443245=25, srv682655580=81, srv1368143824=18, srv258929036=52, srv327421288=58, srv1961140441=44, srv117295650=10, srv212740617=47, srv912391248=97, srv850105112=91, srv1834695807=35, srv613821516=73, srv478316995=64, srv1691087829=27, srv231286573=50, srv1296240296=17, srv1222187122=15, srv1796658433=32, srv1558747209=23, srv1119038117=5, srv1224462976=16, srv664050797=78, srv646396030=75, srv305731808=55, srv41779982=63, srv909280419=95, srv2100776745=46, srv744088089=84, srv522962113=68, srv114259848=8, srv627876650=74, srv929409802=99, srv485089275=65, srv845897750=90, srv702103557=82, srv779229671=86, srv1111590643=4, srv520955980=67, srv852336997=92, srv105072276=0, srv1085156315=2, srv813940628=88, srv1771360842=31, srv928184426=98, srv1179184848=11, srv1503717381=21, srv400477600=62, srv1813491436=33, srv2147061266=48, srv1155110045=9, srv1907002063=41, srv597967669=72, srv85353690=93, srv275388554=54, srv311580510=56, srv592228616=71, srv144499348=20, srv1842941973=36, srv274330623=53, srv384841610=60, srv1386079853=19, srv384210890=59, srv656056086=77, srv1559185042=24, srv1750826245=30, srv713274496=83, srv1079416473=1, srv545574950=69, srv500490174=66, srv8080529=87, srv1139524039=7, srv1667496830=26, srv1727008807=28, srv1219103892=14, srv894785689=94, srv237742967=51, srv1831432419=34, srv1180072723=12, srv649365784=76, srv387895928=61, srv679885669=80, srv1856667971=39, srv217289336=49, srv186856466=40, srv748470772=85, srv322777778=57, srv823160860=89} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-08-15 08:53:10,414 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-08-15 08:53:10,414 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-08-15 08:53:10,414 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-08-15 08:53:10,414 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-08-15 08:53:10,414 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-08-15 08:53:10,414 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-08-15 08:53:10,414 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-08-15 08:53:10,414 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-08-15 08:53:10,414 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-08-15 08:53:10,414 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-08-15 08:53:10,414 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-08-15 08:53:10,414 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-08-15 08:53:10,414 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-08-15 08:53:10,415 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-08-15 08:53:10,415 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-08-15 08:53:10,415 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-08-15 08:53:10,415 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-08-15 08:53:10,415 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-08-15 08:53:10,415 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-08-15 08:53:10,415 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-08-15 08:53:10,415 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-08-15 08:53:10,415 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-08-15 08:53:10,415 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-08-15 08:53:10,415 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-08-15 08:53:10,415 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-08-15 08:53:10,415 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-08-15 08:53:10,415 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-08-15 08:53:10,415 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-08-15 08:53:10,415 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-08-15 08:53:10,416 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-08-15 08:53:10,416 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-08-15 08:53:10,416 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-08-15 08:53:10,416 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-08-15 08:53:10,416 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-08-15 08:53:10,416 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-08-15 08:53:10,416 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-08-15 08:53:10,416 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-08-15 08:53:10,416 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-08-15 08:53:10,416 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-08-15 08:53:10,417 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-08-15 08:53:10,417 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-08-15 08:53:10,417 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-08-15 08:53:10,417 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-08-15 08:53:10,417 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-08-15 08:53:10,417 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-08-15 08:53:10,417 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-08-15 08:53:10,417 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-08-15 08:53:10,417 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-08-15 08:53:10,417 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-08-15 08:53:10,417 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-08-15 08:53:10,417 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-08-15 08:53:10,417 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-08-15 08:53:10,418 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-08-15 08:53:10,418 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-08-15 08:53:10,418 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-08-15 08:53:10,418 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-08-15 08:53:10,418 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-08-15 08:53:10,418 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-08-15 08:53:10,418 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-08-15 08:53:10,418 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-08-15 08:53:10,418 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-08-15 08:53:10,418 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-08-15 08:53:10,418 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-08-15 08:53:10,418 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-08-15 08:53:10,418 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-08-15 08:53:10,418 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-08-15 08:53:10,418 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-08-15 08:53:10,418 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-08-15 08:53:10,419 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-08-15 08:53:10,419 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-08-15 08:53:10,419 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-08-15 08:53:10,419 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-08-15 08:53:10,419 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-08-15 08:53:10,419 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-08-15 08:53:10,419 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-08-15 08:53:10,419 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-08-15 08:53:10,419 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-08-15 08:53:10,419 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-08-15 08:53:10,419 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-08-15 08:53:10,419 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-08-15 08:53:10,419 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-08-15 08:53:10,419 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-08-15 08:53:10,419 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-08-15 08:53:10,420 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-08-15 08:53:10,420 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-08-15 08:53:10,420 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-08-15 08:53:10,420 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-08-15 08:53:10,420 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-08-15 08:53:10,420 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-08-15 08:53:10,420 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-08-15 08:53:10,420 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-08-15 08:53:10,420 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-08-15 08:53:10,420 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-08-15 08:53:10,420 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-08-15 08:53:10,420 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-08-15 08:53:10,420 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-08-15 08:53:10,420 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-08-15 08:53:10,420 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-08-15 08:53:10,420 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-08-15 08:53:10,421 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-08-15 08:53:10,421 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-08-15 08:53:10,573 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.020704634276744235); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.030594557294181198, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.020704634276744235); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.011916666666666667); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.04666666666666667, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-08-15 08:53:10,573 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-08-15 08:53:10,573 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.015167024598418054, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.020704634276744235); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.030594557294181198, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.020704634276744235); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.011916666666666667); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.04666666666666667, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-08-15 08:53:10,863 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 416 ms to try 5000 different iterations.  Found a solution that moves 997 regions; Going from a computed imbalance of 0.015167024598418054 to a new imbalance of 8.294813324996413E-4. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.005538694953529477); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.008461970117626566); MoveCostFunction : (multiplier=7.0, imbalance=0.11077777777777778, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.005538694953529477); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=3.333333333333333E-4); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.005083333333333333); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-08-15 08:53:10,866 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv2005070014:81 , srv1155110045:82 , srv1085156315:83 , srv1182889151:83 , srv1691087829:83 , srv1750826245:83 , srv1961140441:83 , srv384210890:83 , srv664050797:83 , srv110118546:84 , srv1128309030:84 , srv1386079853:84 , srv1667496830:84 , srv1749846033:84 , srv1927882417:84 , srv327421288:84 , srv384841610:84 , srv485089275:84 , srv520955980:84 , srv613821516:84 , srv674597793:84 , srv679885669:84 , srv702103557:84 , srv713274496:84 , srv744088089:84 , srv779229671:84 , srv909450609:84 , srv1079416473:85 , srv117295650:85 , srv1179184848:85 , srv1219103892:85 , srv1222187122:85 , srv144499348:85 , srv1530449721:85 , srv1558747209:85 , srv1559185042:85 , srv1813491436:85 , srv1831432419:85 , srv1937221222:85 , srv237742967:85 , srv275388554:85 , srv305731808:85 , srv311580510:85 , srv322777778:85 , srv522962113:85 , srv545574950:85 , srv627876650:85 , srv823160860:85 , srv850105112:85 , srv85353690:85 , srv894785689:85 , srv909280419:85 , srv929409802:85 , srv1111590643:86 , srv114259848:86 , srv1180072723:86 , srv1224462976:86 , srv1296240296:86 , srv1503717381:86 , srv1646443245:86 , srv1771360842:86 , srv1852576836:86 , srv186856466:86 , srv2100776745:86 , srv212740617:86 , srv231286573:86 , srv274330623:86 , srv41779982:86 , srv478316995:86 , srv500490174:86 , srv646396030:86 , srv649365784:86 , srv656056086:86 , srv845897750:86 , srv852336997:86 , srv105072276:87 , srv1119038117:87 , srv1139524039:87 , srv1368143824:87 , srv1842941973:87 , srv1850452167:87 , srv1907002063:87 , srv2147061266:87 , srv217289336:87 , srv258929036:87 , srv387895928:87 , srv400477600:87 , srv553398622:87 , srv592228616:87 , srv597967669:87 , srv682655580:87 , srv813940628:87 , srv912391248:87 , srv928184426:87 , srv1796658433:88 , srv1834695807:88 , srv1856667971:88 , srv748470772:88 , srv8080529:88 , srv1727008807:549 }
2023-08-15 08:53:10,870 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-08-15 08:53:10,871 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1530449721=22, srv1182889151=13, srv1128309030=6, srv1850452167=37, srv553398622=70, srv1937221222=43, srv909450609=96, srv1749846033=29, srv1852576836=38, srv2005070014=45, srv1927882417=42, srv674597793=79, srv110118546=3, srv1646443245=25, srv682655580=81, srv1368143824=18, srv258929036=52, srv327421288=58, srv1961140441=44, srv117295650=10, srv212740617=47, srv912391248=97, srv850105112=91, srv1834695807=35, srv613821516=73, srv478316995=64, srv1691087829=27, srv231286573=50, srv1296240296=17, srv1222187122=15, srv1796658433=32, srv1558747209=23, srv1119038117=5, srv1224462976=16, srv664050797=78, srv646396030=75, srv305731808=55, srv41779982=63, srv909280419=95, srv2100776745=46, srv744088089=84, srv522962113=68, srv114259848=8, srv627876650=74, srv929409802=99, srv485089275=65, srv845897750=90, srv702103557=82, srv779229671=86, srv1111590643=4, srv520955980=67, srv852336997=92, srv105072276=0, srv1085156315=2, srv813940628=88, srv1771360842=31, srv928184426=98, srv1179184848=11, srv1503717381=21, srv400477600=62, srv1813491436=33, srv2147061266=48, srv1155110045=9, srv1907002063=41, srv597967669=72, srv85353690=93, srv275388554=54, srv311580510=56, srv592228616=71, srv144499348=20, srv1842941973=36, srv274330623=53, srv384841610=60, srv1386079853=19, srv384210890=59, srv656056086=77, srv1559185042=24, srv1750826245=30, srv713274496=83, srv1079416473=1, srv545574950=69, srv500490174=66, srv8080529=87, srv1139524039=7, srv1667496830=26, srv1727008807=28, srv1219103892=14, srv894785689=94, srv237742967=51, srv1831432419=34, srv1180072723=12, srv649365784=76, srv387895928=61, srv679885669=80, srv1856667971=39, srv217289336=49, srv186856466=40, srv748470772=85, srv322777778=57, srv823160860=89} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-08-15 08:53:10,888 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-08-15 08:53:10,889 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-08-15 08:53:10,889 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-08-15 08:53:10,889 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-08-15 08:53:10,889 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-08-15 08:53:10,889 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-08-15 08:53:10,889 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-08-15 08:53:10,889 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-08-15 08:53:10,889 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-08-15 08:53:10,889 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-08-15 08:53:10,889 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-08-15 08:53:10,889 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-08-15 08:53:10,889 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-08-15 08:53:10,889 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-08-15 08:53:10,889 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-08-15 08:53:10,890 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-08-15 08:53:10,890 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-08-15 08:53:10,890 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-08-15 08:53:10,890 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-08-15 08:53:10,890 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-08-15 08:53:10,890 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-08-15 08:53:10,890 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-08-15 08:53:10,890 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-08-15 08:53:10,890 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-08-15 08:53:10,890 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-08-15 08:53:10,890 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-08-15 08:53:10,890 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-08-15 08:53:10,891 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-08-15 08:53:10,891 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-08-15 08:53:10,891 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-08-15 08:53:10,891 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-08-15 08:53:10,891 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-08-15 08:53:10,891 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-08-15 08:53:10,891 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-08-15 08:53:10,891 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-08-15 08:53:10,891 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-08-15 08:53:10,892 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-08-15 08:53:10,892 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-08-15 08:53:10,892 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-08-15 08:53:10,892 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-08-15 08:53:10,892 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-08-15 08:53:10,892 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-08-15 08:53:10,892 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-08-15 08:53:10,892 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-08-15 08:53:10,893 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-08-15 08:53:10,893 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-08-15 08:53:10,893 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-08-15 08:53:10,893 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-08-15 08:53:10,893 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-08-15 08:53:10,893 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-08-15 08:53:10,893 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-08-15 08:53:10,893 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-08-15 08:53:10,893 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-08-15 08:53:10,894 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-08-15 08:53:10,894 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-08-15 08:53:10,894 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-08-15 08:53:10,894 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-08-15 08:53:10,894 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-08-15 08:53:10,894 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-08-15 08:53:10,894 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-08-15 08:53:10,894 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-08-15 08:53:10,894 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-08-15 08:53:10,894 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-08-15 08:53:10,895 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-08-15 08:53:10,895 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-08-15 08:53:10,895 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-08-15 08:53:10,895 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-08-15 08:53:10,895 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-08-15 08:53:10,895 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-08-15 08:53:10,895 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-08-15 08:53:10,895 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-08-15 08:53:10,895 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-08-15 08:53:10,896 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-08-15 08:53:10,896 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-08-15 08:53:10,896 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-08-15 08:53:10,896 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-08-15 08:53:10,896 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-08-15 08:53:10,896 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-08-15 08:53:10,896 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-08-15 08:53:10,896 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-08-15 08:53:10,896 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-08-15 08:53:10,896 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-08-15 08:53:10,897 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-08-15 08:53:10,897 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-08-15 08:53:10,897 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-08-15 08:53:10,897 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-08-15 08:53:10,897 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-08-15 08:53:10,897 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-08-15 08:53:10,897 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-08-15 08:53:10,897 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-08-15 08:53:10,897 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-08-15 08:53:10,898 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-08-15 08:53:10,898 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-08-15 08:53:10,898 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-08-15 08:53:10,898 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-08-15 08:53:10,898 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-08-15 08:53:10,898 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-08-15 08:53:10,898 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-08-15 08:53:10,898 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-08-15 08:53:10,898 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-08-15 08:53:10,898 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-08-15 08:53:11,031 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.005538694953529477); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.008461970117626566); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.005538694953529477); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=3.333333333333333E-4); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.005083333333333333); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-08-15 08:53:11,031 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-08-15 08:53:11,032 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=8.225001892886755E-4, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.005538694953529477); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.008461970117626566); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.005538694953529477); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=3.333333333333333E-4); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.005083333333333333); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-08-15 08:53:11,420 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 505 ms to try 5000 different iterations.  Found a solution that moves 252 regions; Going from a computed imbalance of 8.225001892886755E-4 to a new imbalance of 4.186856097219543E-5. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=4.994073055283275E-4); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0017082358106351274); MoveCostFunction : (multiplier=7.0, imbalance=0.028, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=4.994073055283275E-4); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=3.333333333333333E-4); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-08-15 08:53:11,421 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1503717381:83 , srv1834695807:83 , srv1850452167:83 , srv258929036:83 , srv522962113:83 , srv649365784:83 , srv845897750:83 , srv928184426:83 , srv1079416473:84 , srv1085156315:84 , srv1111590643:84 , srv1119038117:84 , srv1128309030:84 , srv1530449721:84 , srv1558747209:84 , srv1559185042:84 , srv1646443245:84 , srv1667496830:84 , srv1796658433:84 , srv1813491436:84 , srv1852576836:84 , srv1856667971:84 , srv186856466:84 , srv1907002063:84 , srv2147061266:84 , srv274330623:84 , srv275388554:84 , srv305731808:84 , srv311580510:84 , srv387895928:84 , srv400477600:84 , srv41779982:84 , srv478316995:84 , srv553398622:84 , srv597967669:84 , srv627876650:84 , srv646396030:84 , srv664050797:84 , srv674597793:84 , srv679885669:84 , srv702103557:84 , srv748470772:84 , srv8080529:84 , srv850105112:84 , srv929409802:84 , srv105072276:85 , srv110118546:85 , srv1139524039:85 , srv114259848:85 , srv1155110045:85 , srv117295650:85 , srv1179184848:85 , srv1180072723:85 , srv1182889151:85 , srv1219103892:85 , srv1222187122:85 , srv1224462976:85 , srv1296240296:85 , srv1368143824:85 , srv1386079853:85 , srv144499348:85 , srv1691087829:85 , srv1749846033:85 , srv1750826245:85 , srv1771360842:85 , srv1831432419:85 , srv1842941973:85 , srv1927882417:85 , srv1937221222:85 , srv1961140441:85 , srv2005070014:85 , srv2100776745:85 , srv212740617:85 , srv217289336:85 , srv231286573:85 , srv237742967:85 , srv327421288:85 , srv384210890:85 , srv485089275:85 , srv500490174:85 , srv520955980:85 , srv545574950:85 , srv592228616:85 , srv613821516:85 , srv656056086:85 , srv682655580:85 , srv713274496:85 , srv744088089:85 , srv813940628:85 , srv823160860:85 , srv852336997:85 , srv85353690:85 , srv894785689:85 , srv909280419:85 , srv909450609:85 , srv912391248:85 , srv322777778:86 , srv384841610:86 , srv779229671:86 , srv1727008807:635 }
2023-08-15 08:53:11,427 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-08-15 08:53:11,427 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1530449721=22, srv1182889151=13, srv1128309030=6, srv1850452167=37, srv553398622=70, srv1937221222=43, srv909450609=96, srv1749846033=29, srv1852576836=38, srv2005070014=45, srv1927882417=42, srv674597793=79, srv110118546=3, srv1646443245=25, srv682655580=81, srv1368143824=18, srv258929036=52, srv327421288=58, srv1961140441=44, srv117295650=10, srv212740617=47, srv912391248=97, srv850105112=91, srv1834695807=35, srv613821516=73, srv478316995=64, srv1691087829=27, srv231286573=50, srv1296240296=17, srv1222187122=15, srv1796658433=32, srv1558747209=23, srv1119038117=5, srv1224462976=16, srv664050797=78, srv646396030=75, srv305731808=55, srv41779982=63, srv909280419=95, srv2100776745=46, srv744088089=84, srv522962113=68, srv114259848=8, srv627876650=74, srv929409802=99, srv485089275=65, srv845897750=90, srv702103557=82, srv779229671=86, srv1111590643=4, srv520955980=67, srv852336997=92, srv105072276=0, srv1085156315=2, srv813940628=88, srv1771360842=31, srv928184426=98, srv1179184848=11, srv1503717381=21, srv400477600=62, srv1813491436=33, srv2147061266=48, srv1155110045=9, srv1907002063=41, srv597967669=72, srv85353690=93, srv275388554=54, srv311580510=56, srv592228616=71, srv144499348=20, srv1842941973=36, srv274330623=53, srv384841610=60, srv1386079853=19, srv384210890=59, srv656056086=77, srv1559185042=24, srv1750826245=30, srv713274496=83, srv1079416473=1, srv545574950=69, srv500490174=66, srv8080529=87, srv1139524039=7, srv1667496830=26, srv1727008807=28, srv1219103892=14, srv894785689=94, srv237742967=51, srv1831432419=34, srv1180072723=12, srv649365784=76, srv387895928=61, srv679885669=80, srv1856667971=39, srv217289336=49, srv186856466=40, srv748470772=85, srv322777778=57, srv823160860=89} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-08-15 08:53:11,440 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-08-15 08:53:11,441 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-08-15 08:53:11,441 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-08-15 08:53:11,441 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-08-15 08:53:11,441 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-08-15 08:53:11,441 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-08-15 08:53:11,441 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-08-15 08:53:11,441 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-08-15 08:53:11,441 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-08-15 08:53:11,441 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-08-15 08:53:11,441 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-08-15 08:53:11,441 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-08-15 08:53:11,441 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-08-15 08:53:11,441 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-08-15 08:53:11,441 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-08-15 08:53:11,442 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-08-15 08:53:11,442 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-08-15 08:53:11,442 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-08-15 08:53:11,442 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-08-15 08:53:11,442 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-08-15 08:53:11,442 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-08-15 08:53:11,442 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-08-15 08:53:11,442 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-08-15 08:53:11,442 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-08-15 08:53:11,442 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-08-15 08:53:11,442 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-08-15 08:53:11,442 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-08-15 08:53:11,442 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-08-15 08:53:11,443 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-08-15 08:53:11,443 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-08-15 08:53:11,443 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-08-15 08:53:11,443 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-08-15 08:53:11,443 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-08-15 08:53:11,443 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-08-15 08:53:11,443 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-08-15 08:53:11,443 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-08-15 08:53:11,443 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-08-15 08:53:11,443 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-08-15 08:53:11,443 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-08-15 08:53:11,444 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-08-15 08:53:11,444 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-08-15 08:53:11,444 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-08-15 08:53:11,444 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-08-15 08:53:11,444 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-08-15 08:53:11,444 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-08-15 08:53:11,444 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-08-15 08:53:11,444 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-08-15 08:53:11,444 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-08-15 08:53:11,444 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-08-15 08:53:11,444 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-08-15 08:53:11,444 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-08-15 08:53:11,445 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-08-15 08:53:11,445 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-08-15 08:53:11,445 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-08-15 08:53:11,445 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-08-15 08:53:11,445 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-08-15 08:53:11,445 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-08-15 08:53:11,445 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-08-15 08:53:11,445 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-08-15 08:53:11,445 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-08-15 08:53:11,445 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-08-15 08:53:11,445 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-08-15 08:53:11,446 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-08-15 08:53:11,446 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-08-15 08:53:11,446 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-08-15 08:53:11,446 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-08-15 08:53:11,446 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-08-15 08:53:11,446 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-08-15 08:53:11,446 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-08-15 08:53:11,447 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-08-15 08:53:11,447 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-08-15 08:53:11,447 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-08-15 08:53:11,447 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-08-15 08:53:11,447 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-08-15 08:53:11,447 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-08-15 08:53:11,447 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-08-15 08:53:11,447 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-08-15 08:53:11,447 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-08-15 08:53:11,447 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-08-15 08:53:11,448 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-08-15 08:53:11,448 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-08-15 08:53:11,448 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-08-15 08:53:11,448 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-08-15 08:53:11,448 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-08-15 08:53:11,448 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-08-15 08:53:11,448 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-08-15 08:53:11,448 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-08-15 08:53:11,448 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-08-15 08:53:11,448 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-08-15 08:53:11,448 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-08-15 08:53:11,449 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-08-15 08:53:11,449 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-08-15 08:53:11,449 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-08-15 08:53:11,449 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-08-15 08:53:11,449 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-08-15 08:53:11,449 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-08-15 08:53:11,449 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-08-15 08:53:11,449 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-08-15 08:53:11,449 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-08-15 08:53:11,449 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-08-15 08:53:11,449 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-08-15 08:53:11,576 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=4.994073055283275E-4); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0017082358106351274); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=4.994073055283275E-4); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=3.333333333333333E-4); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-08-15 08:53:11,576 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-08-15 08:53:11,577 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=4.0104019257889135E-5, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=4.994073055283275E-4); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0017082358106351274); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=4.994073055283275E-4); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=3.333333333333333E-4); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-08-15 08:53:11,834 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 368 ms to try 5000 different iterations.  Found a solution that moves 31 regions; Going from a computed imbalance of 4.0104019257889135E-5 to a new imbalance of 5.859559632984987E-6. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0012535023884839248); MoveCostFunction : (multiplier=7.0, imbalance=0.0034444444444444444); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-08-15 08:53:11,835 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv110118546:83 , srv1139524039:83 , srv1222187122:83 , srv1771360842:83 , srv322777778:83 , srv384210890:83 , srv384841610:83 , srv664050797:83 , srv682655580:83 , srv85353690:83 , srv105072276:84 , srv1079416473:84 , srv1119038117:84 , srv1128309030:84 , srv114259848:84 , srv1155110045:84 , srv117295650:84 , srv1179184848:84 , srv1180072723:84 , srv1182889151:84 , srv1219103892:84 , srv1224462976:84 , srv1296240296:84 , srv1368143824:84 , srv1386079853:84 , srv144499348:84 , srv1530449721:84 , srv1558747209:84 , srv1559185042:84 , srv1646443245:84 , srv1691087829:84 , srv1749846033:84 , srv1750826245:84 , srv1796658433:84 , srv1813491436:84 , srv1831432419:84 , srv1834695807:84 , srv1842941973:84 , srv1850452167:84 , srv1852576836:84 , srv1856667971:84 , srv186856466:84 , srv1907002063:84 , srv1927882417:84 , srv1937221222:84 , srv1961140441:84 , srv2005070014:84 , srv2100776745:84 , srv212740617:84 , srv2147061266:84 , srv217289336:84 , srv231286573:84 , srv237742967:84 , srv274330623:84 , srv275388554:84 , srv305731808:84 , srv327421288:84 , srv387895928:84 , srv400477600:84 , srv41779982:84 , srv478316995:84 , srv485089275:84 , srv500490174:84 , srv520955980:84 , srv545574950:84 , srv553398622:84 , srv592228616:84 , srv597967669:84 , srv613821516:84 , srv627876650:84 , srv646396030:84 , srv656056086:84 , srv674597793:84 , srv679885669:84 , srv713274496:84 , srv744088089:84 , srv748470772:84 , srv779229671:84 , srv8080529:84 , srv813940628:84 , srv823160860:84 , srv845897750:84 , srv850105112:84 , srv852336997:84 , srv894785689:84 , srv909280419:84 , srv909450609:84 , srv912391248:84 , srv929409802:84 , srv1085156315:85 , srv1111590643:85 , srv1503717381:85 , srv1667496830:85 , srv258929036:85 , srv311580510:85 , srv522962113:85 , srv649365784:85 , srv702103557:85 , srv928184426:85 , srv1727008807:684 }
2023-08-15 08:53:11,839 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-08-15 08:53:11,840 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1530449721=22, srv1182889151=13, srv1128309030=6, srv1850452167=37, srv553398622=70, srv1937221222=43, srv909450609=96, srv1749846033=29, srv1852576836=38, srv2005070014=45, srv1927882417=42, srv674597793=79, srv110118546=3, srv1646443245=25, srv682655580=81, srv1368143824=18, srv258929036=52, srv327421288=58, srv1961140441=44, srv117295650=10, srv212740617=47, srv912391248=97, srv850105112=91, srv1834695807=35, srv613821516=73, srv478316995=64, srv1691087829=27, srv231286573=50, srv1296240296=17, srv1222187122=15, srv1796658433=32, srv1558747209=23, srv1119038117=5, srv1224462976=16, srv664050797=78, srv646396030=75, srv305731808=55, srv41779982=63, srv909280419=95, srv2100776745=46, srv744088089=84, srv522962113=68, srv114259848=8, srv627876650=74, srv929409802=99, srv485089275=65, srv845897750=90, srv702103557=82, srv779229671=86, srv1111590643=4, srv520955980=67, srv852336997=92, srv105072276=0, srv1085156315=2, srv813940628=88, srv1771360842=31, srv928184426=98, srv1179184848=11, srv1503717381=21, srv400477600=62, srv1813491436=33, srv2147061266=48, srv1155110045=9, srv1907002063=41, srv597967669=72, srv85353690=93, srv275388554=54, srv311580510=56, srv592228616=71, srv144499348=20, srv1842941973=36, srv274330623=53, srv384841610=60, srv1386079853=19, srv384210890=59, srv656056086=77, srv1559185042=24, srv1750826245=30, srv713274496=83, srv1079416473=1, srv545574950=69, srv500490174=66, srv8080529=87, srv1139524039=7, srv1667496830=26, srv1727008807=28, srv1219103892=14, srv894785689=94, srv237742967=51, srv1831432419=34, srv1180072723=12, srv649365784=76, srv387895928=61, srv679885669=80, srv1856667971=39, srv217289336=49, srv186856466=40, srv748470772=85, srv322777778=57, srv823160860=89} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-08-15 08:53:11,857 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-08-15 08:53:11,858 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-08-15 08:53:11,858 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-08-15 08:53:11,858 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-08-15 08:53:11,858 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-08-15 08:53:11,858 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-08-15 08:53:11,858 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-08-15 08:53:11,858 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-08-15 08:53:11,858 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-08-15 08:53:11,858 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-08-15 08:53:11,858 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-08-15 08:53:11,858 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-08-15 08:53:11,859 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-08-15 08:53:11,859 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-08-15 08:53:11,859 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-08-15 08:53:11,859 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-08-15 08:53:11,859 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-08-15 08:53:11,859 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-08-15 08:53:11,859 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-08-15 08:53:11,859 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-08-15 08:53:11,859 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-08-15 08:53:11,859 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-08-15 08:53:11,859 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-08-15 08:53:11,859 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-08-15 08:53:11,859 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-08-15 08:53:11,860 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-08-15 08:53:11,860 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-08-15 08:53:11,860 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-08-15 08:53:11,860 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-08-15 08:53:11,860 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-08-15 08:53:11,860 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-08-15 08:53:11,860 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-08-15 08:53:11,860 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-08-15 08:53:11,860 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-08-15 08:53:11,860 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-08-15 08:53:11,860 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-08-15 08:53:11,860 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-08-15 08:53:11,860 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-08-15 08:53:11,861 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-08-15 08:53:11,861 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-08-15 08:53:11,861 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-08-15 08:53:11,861 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-08-15 08:53:11,861 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-08-15 08:53:11,861 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-08-15 08:53:11,861 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-08-15 08:53:11,861 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-08-15 08:53:11,861 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-08-15 08:53:11,861 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-08-15 08:53:11,861 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-08-15 08:53:11,861 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-08-15 08:53:11,861 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-08-15 08:53:11,862 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-08-15 08:53:11,862 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-08-15 08:53:11,862 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-08-15 08:53:11,862 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-08-15 08:53:11,862 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-08-15 08:53:11,862 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-08-15 08:53:11,862 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-08-15 08:53:11,862 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-08-15 08:53:11,862 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-08-15 08:53:11,862 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-08-15 08:53:11,862 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-08-15 08:53:11,862 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-08-15 08:53:11,862 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-08-15 08:53:11,863 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-08-15 08:53:11,863 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-08-15 08:53:11,863 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-08-15 08:53:11,863 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-08-15 08:53:11,863 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-08-15 08:53:11,863 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-08-15 08:53:11,863 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-08-15 08:53:11,863 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-08-15 08:53:11,863 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-08-15 08:53:11,863 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-08-15 08:53:11,863 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-08-15 08:53:11,863 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-08-15 08:53:11,863 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-08-15 08:53:11,863 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-08-15 08:53:11,864 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-08-15 08:53:11,864 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-08-15 08:53:11,864 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-08-15 08:53:11,864 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-08-15 08:53:11,864 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-08-15 08:53:11,864 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-08-15 08:53:11,864 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-08-15 08:53:11,864 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-08-15 08:53:11,864 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-08-15 08:53:11,864 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-08-15 08:53:11,864 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-08-15 08:53:11,864 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-08-15 08:53:11,864 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-08-15 08:53:11,865 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-08-15 08:53:11,865 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-08-15 08:53:11,868 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-08-15 08:53:11,868 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-08-15 08:53:11,868 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-08-15 08:53:11,868 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-08-15 08:53:11,868 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-08-15 08:53:11,869 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-08-15 08:53:11,869 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-08-15 08:53:11,869 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-08-15 08:53:12,014 INFO  [Time-limited test] balancer.StochasticLoadBalancer(381): Cluster wide - skipping load balancing because weighted average imbalance=5.642492993526674E-6 <= threshold(0.025). If you want more aggressive balancing, either lower hbase.master.balancer.stochastic.minCostNeedBalance from 0.025 or increase the relative multiplier(s) of the specific cost function(s). functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0012535023884839248); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-08-15 08:53:12,015 INFO  [Time-limited test] balancer.BalancerTestBase(570): Mock Final balance: { srv110118546:83 , srv1139524039:83 , srv1222187122:83 , srv1771360842:83 , srv322777778:83 , srv384210890:83 , srv384841610:83 , srv664050797:83 , srv682655580:83 , srv85353690:83 , srv105072276:84 , srv1079416473:84 , srv1119038117:84 , srv1128309030:84 , srv114259848:84 , srv1155110045:84 , srv117295650:84 , srv1179184848:84 , srv1180072723:84 , srv1182889151:84 , srv1219103892:84 , srv1224462976:84 , srv1296240296:84 , srv1368143824:84 , srv1386079853:84 , srv144499348:84 , srv1530449721:84 , srv1558747209:84 , srv1559185042:84 , srv1646443245:84 , srv1691087829:84 , srv1749846033:84 , srv1750826245:84 , srv1796658433:84 , srv1813491436:84 , srv1831432419:84 , srv1834695807:84 , srv1842941973:84 , srv1850452167:84 , srv1852576836:84 , srv1856667971:84 , srv186856466:84 , srv1907002063:84 , srv1927882417:84 , srv1937221222:84 , srv1961140441:84 , srv2005070014:84 , srv2100776745:84 , srv212740617:84 , srv2147061266:84 , srv217289336:84 , srv231286573:84 , srv237742967:84 , srv274330623:84 , srv275388554:84 , srv305731808:84 , srv327421288:84 , srv387895928:84 , srv400477600:84 , srv41779982:84 , srv478316995:84 , srv485089275:84 , srv500490174:84 , srv520955980:84 , srv545574950:84 , srv553398622:84 , srv592228616:84 , srv597967669:84 , srv613821516:84 , srv627876650:84 , srv646396030:84 , srv656056086:84 , srv674597793:84 , srv679885669:84 , srv713274496:84 , srv744088089:84 , srv748470772:84 , srv779229671:84 , srv8080529:84 , srv813940628:84 , srv823160860:84 , srv845897750:84 , srv850105112:84 , srv852336997:84 , srv894785689:84 , srv909280419:84 , srv909450609:84 , srv912391248:84 , srv929409802:84 , srv1085156315:85 , srv1111590643:85 , srv1503717381:85 , srv1667496830:85 , srv258929036:85 , srv311580510:85 , srv522962113:85 , srv649365784:85 , srv702103557:85 , srv928184426:85 , srv1727008807:684 }
2023-08-15 08:53:12,046 INFO  [Time-limited test] hbase.ResourceChecker(175): after: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnLargeClusterWithRacks Thread=12 (was 12), OpenFileDescriptor=263 (was 263), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=303 (was 303), ProcessCount=171 (was 171), AvailableMemoryMB=2251 (was 3105)
2023-08-15 08:53:12,054 INFO  [Time-limited test] hbase.ResourceChecker(147): before: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnMidClusterWithRacks Thread=12, OpenFileDescriptor=263, MaxFileDescriptor=60000, SystemLoadAverage=303, ProcessCount=171, AvailableMemoryMB=2250
2023-08-15 08:53:12,055 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2023-08-15 08:53:12,055 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=5000, runMaxSteps=true, stepsPerRegion=800, maxRunningTime=120000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 111077.0 etc.
2023-08-15 08:53:12,067 INFO  [Time-limited test] balancer.BalancerTestBase(547): Mock Cluster : { srv1041163973:84 , srv1062935865:84 , srv1148138536:84 , srv1184327224:84 , srv1200626161:84 , srv1279854472:84 , srv1335380836:84 , srv1620230634:84 , srv1646764244:84 , srv1652256298:84 , srv1830494913:84 , srv1883290426:84 , srv1956388078:84 , srv1960350755:84 , srv2010418312:84 , srv2043281124:84 , srv2125003224:84 , srv2140483277:84 , srv240101386:84 , srv283189271:84 , srv563927878:84 , srv610568963:84 , srv753545707:84 , srv786822971:84 , srv799339657:84 , srv915767828:84 , srv93669420:84 , srv93724180:84 , srv968685879:84 , srv1326143285:264 } [srvr=30 rgns=2700 avg=90.0 max=90 min=90]
2023-08-15 08:53:12,069 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-08-15 08:53:12,070 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1335380836=7, srv1830494913=11, srv968685879=29, srv1960350755=14, srv2125003224=17, srv240101386=19, srv2140483277=18, srv93724180=28, srv563927878=21, srv753545707=23, srv786822971=24, srv1279854472=5, srv799339657=25, srv1652256298=10, srv93669420=27, srv915767828=26, srv1646764244=9, srv1062935865=1, srv610568963=22, srv1326143285=6, srv1956388078=13, srv2010418312=15, srv2043281124=16, srv1148138536=2, srv1041163973=0, srv283189271=20, srv1200626161=4, srv1883290426=12, srv1184327224=3, srv1620230634=8} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-08-15 08:53:12,083 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-08-15 08:53:12,083 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-08-15 08:53:12,083 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-08-15 08:53:12,083 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-08-15 08:53:12,083 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-08-15 08:53:12,083 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-08-15 08:53:12,083 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-08-15 08:53:12,083 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-08-15 08:53:12,083 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-08-15 08:53:12,083 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-08-15 08:53:12,084 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-08-15 08:53:12,084 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-08-15 08:53:12,084 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-08-15 08:53:12,084 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-08-15 08:53:12,084 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-08-15 08:53:12,084 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-08-15 08:53:12,084 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-08-15 08:53:12,084 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-08-15 08:53:12,084 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-08-15 08:53:12,084 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-08-15 08:53:12,084 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-08-15 08:53:12,084 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-08-15 08:53:12,084 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-08-15 08:53:12,084 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-08-15 08:53:12,084 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-08-15 08:53:12,084 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-08-15 08:53:12,085 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-08-15 08:53:12,085 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-08-15 08:53:12,085 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-08-15 08:53:12,085 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-08-15 08:53:12,085 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=10, number of hosts=30, number of racks=4
2023-08-15 08:53:12,111 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=1.1040954678156296, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-08-15 08:53:12,111 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.9912521044684337, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=1.1040954678156296, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=64800000
2023-08-15 08:55:12,089 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 120001 ms to try 6221848 different iterations.  Found a solution that moves 1849 regions; Going from a computed imbalance of 0.9912521044684337 to a new imbalance of 4.3156582404131396E-5. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); MoveCostFunction : (multiplier=7.0, imbalance=0.6848148148148148, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-08-15 08:55:12,103 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1041163973:90 , srv1062935865:90 , srv1148138536:90 , srv1184327224:90 , srv1200626161:90 , srv1279854472:90 , srv1326143285:90 , srv1335380836:90 , srv1620230634:90 , srv1646764244:90 , srv1652256298:90 , srv1830494913:90 , srv1883290426:90 , srv1956388078:90 , srv1960350755:90 , srv2010418312:90 , srv2043281124:90 , srv2125003224:90 , srv2140483277:90 , srv240101386:90 , srv283189271:90 , srv563927878:90 , srv610568963:90 , srv753545707:90 , srv786822971:90 , srv799339657:90 , srv915767828:90 , srv93669420:90 , srv93724180:90 , srv968685879:90 }
2023-08-15 08:55:12,104 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-08-15 08:55:12,104 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1335380836=7, srv1830494913=11, srv968685879=29, srv1960350755=14, srv2125003224=17, srv240101386=19, srv2140483277=18, srv93724180=28, srv563927878=21, srv753545707=23, srv786822971=24, srv1279854472=5, srv799339657=25, srv1652256298=10, srv93669420=27, srv915767828=26, srv1646764244=9, srv1062935865=1, srv610568963=22, srv1326143285=6, srv1956388078=13, srv2010418312=15, srv2043281124=16, srv1148138536=2, srv1041163973=0, srv283189271=20, srv1200626161=4, srv1883290426=12, srv1184327224=3, srv1620230634=8} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-08-15 08:55:12,108 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-08-15 08:55:12,108 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-08-15 08:55:12,108 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-08-15 08:55:12,108 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-08-15 08:55:12,108 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-08-15 08:55:12,108 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-08-15 08:55:12,108 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-08-15 08:55:12,108 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-08-15 08:55:12,108 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-08-15 08:55:12,108 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-08-15 08:55:12,108 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-08-15 08:55:12,108 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-08-15 08:55:12,108 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-08-15 08:55:12,108 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-08-15 08:55:12,108 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-08-15 08:55:12,108 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-08-15 08:55:12,108 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-08-15 08:55:12,108 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-08-15 08:55:12,108 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-08-15 08:55:12,108 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-08-15 08:55:12,108 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-08-15 08:55:12,109 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-08-15 08:55:12,109 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-08-15 08:55:12,109 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-08-15 08:55:12,109 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-08-15 08:55:12,109 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-08-15 08:55:12,109 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-08-15 08:55:12,109 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-08-15 08:55:12,109 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-08-15 08:55:12,109 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-08-15 08:55:12,109 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=10, number of hosts=30, number of racks=4
2023-08-15 08:55:12,120 INFO  [Time-limited test] balancer.StochasticLoadBalancer(381): Cluster wide - skipping load balancing because weighted average imbalance=0.0 <= threshold(0.025). If you want more aggressive balancing, either lower hbase.master.balancer.stochastic.minCostNeedBalance from 0.025 or increase the relative multiplier(s) of the specific cost function(s). functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-08-15 08:55:12,121 INFO  [Time-limited test] balancer.BalancerTestBase(570): Mock Final balance: { srv1041163973:90 , srv1062935865:90 , srv1148138536:90 , srv1184327224:90 , srv1200626161:90 , srv1279854472:90 , srv1326143285:90 , srv1335380836:90 , srv1620230634:90 , srv1646764244:90 , srv1652256298:90 , srv1830494913:90 , srv1883290426:90 , srv1956388078:90 , srv1960350755:90 , srv2010418312:90 , srv2043281124:90 , srv2125003224:90 , srv2140483277:90 , srv240101386:90 , srv283189271:90 , srv563927878:90 , srv610568963:90 , srv753545707:90 , srv786822971:90 , srv799339657:90 , srv915767828:90 , srv93669420:90 , srv93724180:90 , srv968685879:90 }
2023-08-15 08:55:12,134 INFO  [Time-limited test] hbase.ResourceChecker(175): after: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnMidClusterWithRacks Thread=11 (was 12), OpenFileDescriptor=263 (was 263), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=254 (was 303), ProcessCount=171 (was 171), AvailableMemoryMB=2162 (was 2250)