2023-12-21 04:54:23,409 INFO  [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks timeout: 13 mins
2023-12-21 04:54:23,635 WARN  [Time-limited test] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties
2023-12-21 04:54:23,724 INFO  [Time-limited test] metrics.MetricRegistriesLoader(60): Loaded MetricRegistries class org.apache.hadoop.hbase.metrics.impl.MetricRegistriesImpl
2023-12-21 04:54:23,774 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2023-12-21 04:54:23,780 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc.
2023-12-21 04:54:23,791 INFO  [Time-limited test] hbase.ResourceChecker(147): before: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnLargeClusterWithRacks Thread=12, OpenFileDescriptor=290, MaxFileDescriptor=60000, SystemLoadAverage=106, ProcessCount=174, AvailableMemoryMB=7945
2023-12-21 04:54:23,793 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2023-12-21 04:54:23,793 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=5000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=10000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc.
2023-12-21 04:54:23,912 INFO  [Time-limited test] balancer.BalancerTestBase(547): Mock Cluster : { srv1001374467:84 , srv1032019664:84 , srv1057313018:84 , srv1133558739:84 , srv1137349539:84 , srv117454341:84 , srv1203898192:84 , srv123141673:84 , srv1241704191:84 , srv1258321831:84 , srv1260069570:84 , srv1267106723:84 , srv1270730130:84 , srv1325300193:84 , srv1423277880:84 , srv1444433202:84 , srv1451032913:84 , srv1468994715:84 , srv147451895:84 , srv1478526550:84 , srv1484183605:84 , srv1498897215:84 , srv1511942537:84 , srv1515252774:84 , srv1554595103:84 , srv1558733682:84 , srv155919002:84 , srv1566250924:84 , srv1630567888:84 , srv1660752198:84 , srv1670916976:84 , srv1685447327:84 , srv1696525780:84 , srv1718485591:84 , srv175348682:84 , srv1762542726:84 , srv1773784559:84 , srv1781870202:84 , srv178279068:84 , srv1813567493:84 , srv1817387471:84 , srv1824794036:84 , srv1829716868:84 , srv1905908540:84 , srv1906322461:84 , srv1912636511:84 , srv1925047759:84 , srv1953086637:84 , srv1985592389:84 , srv2004061414:84 , srv2011034880:84 , srv2021424822:84 , srv2021824023:84 , srv204285412:84 , srv2080363348:84 , srv208639072:84 , srv2095823300:84 , srv2105967073:84 , srv2121246158:84 , srv2123880185:84 , srv2143128257:84 , srv244792200:84 , srv257043887:84 , srv269579440:84 , srv292026153:84 , srv317545048:84 , srv38479889:84 , srv410468561:84 , srv418757187:84 , srv474228670:84 , srv494510:84 , srv552533329:84 , srv567556405:84 , srv576020963:84 , srv59962645:84 , srv603059426:84 , srv617290585:84 , srv640685718:84 , srv66148438:84 , srv671513541:84 , srv679879177:84 , srv69440729:84 , srv699412754:84 , srv699563255:84 , srv707388266:84 , srv754078796:84 , srv761297759:84 , srv773858338:84 , srv803345646:84 , srv849060954:84 , srv856947493:84 , srv858781394:84 , srv860215839:84 , srv888072014:84 , srv895848401:84 , srv924835262:84 , srv95362890:84 , srv955642588:84 , srv982431141:84 , srv257958631:684 } [srvr=100 rgns=9000 avg=90.0 max=90 min=90]
2023-12-21 04:54:23,920 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-12-21 04:54:23,925 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1444433202=15, srv1511942537=22, srv1718485591=33, srv1985592389=48, srv494510=71, srv1829716868=42, srv257958631=63, srv1468994715=17, srv208639072=55, srv1670916976=30, srv1773784559=36, srv1906322461=44, srv1566250924=27, srv567556405=73, srv117454341=5, srv66148438=79, srv773858338=88, srv2011034880=50, srv955642588=98, srv576020963=74, srv707388266=85, srv803345646=89, srv269579440=64, srv2080363348=54, srv2021824023=52, srv1696525780=32, srv2095823300=56, srv95362890=97, srv1057313018=2, srv699412754=83, srv1813567493=39, srv849060954=90, srv204285412=53, srv1685447327=31, srv617290585=77, srv1133558739=3, srv699563255=84, srv1817387471=40, srv1554595103=24, srv317545048=66, srv1498897215=21, srv860215839=93, srv1032019664=1, srv474228670=70, srv147451895=18, srv1325300193=13, srv1478526550=19, srv1558733682=25, srv175348682=34, srv1270730130=12, srv2121246158=58, srv1660752198=29, srv418757187=69, srv1762542726=35, srv1484183605=20, srv2004061414=49, srv2021424822=51, srv1001374467=0, srv924835262=96, srv640685718=78, srv410468561=68, srv1515252774=23, srv2143128257=60, srv888072014=94, srv1423277880=14, srv1267106723=11, srv257043887=62, srv982431141=99, srv856947493=91, srv761297759=87, srv292026153=65, srv679879177=81, srv1781870202=37, srv2105967073=57, srv1137349539=4, srv244792200=61, srv59962645=75, srv178279068=38, srv1912636511=45, srv1630567888=28, srv2123880185=59, srv552533329=72, srv155919002=26, srv1925047759=46, srv858781394=92, srv1824794036=41, srv1203898192=6, srv69440729=82, srv1905908540=43, srv1953086637=47, srv38479889=67, srv671513541=80, srv603059426=76, srv1241704191=8, srv1258321831=9, srv1451032913=16, srv1260069570=10, srv895848401=95, srv123141673=7, srv754078796=86} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-12-21 04:54:23,989 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-12-21 04:54:23,990 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-12-21 04:54:23,990 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-12-21 04:54:23,990 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-12-21 04:54:23,990 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-12-21 04:54:23,990 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-12-21 04:54:23,990 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-12-21 04:54:23,990 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-12-21 04:54:23,990 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-12-21 04:54:23,990 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-12-21 04:54:23,991 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-12-21 04:54:23,991 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-12-21 04:54:23,991 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-12-21 04:54:23,991 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-12-21 04:54:23,991 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-12-21 04:54:23,991 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-12-21 04:54:23,991 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-12-21 04:54:23,991 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-12-21 04:54:23,991 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-12-21 04:54:23,991 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-12-21 04:54:23,991 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-12-21 04:54:23,992 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-12-21 04:54:23,992 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-12-21 04:54:23,992 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-12-21 04:54:23,992 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-12-21 04:54:23,992 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-12-21 04:54:23,992 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-12-21 04:54:23,992 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-12-21 04:54:23,992 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-12-21 04:54:23,993 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-12-21 04:54:23,993 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-12-21 04:54:23,993 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-12-21 04:54:23,993 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-12-21 04:54:23,993 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-12-21 04:54:23,993 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-12-21 04:54:23,993 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-12-21 04:54:23,993 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-12-21 04:54:23,993 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-12-21 04:54:23,993 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-12-21 04:54:23,994 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-12-21 04:54:23,994 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-12-21 04:54:23,994 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-12-21 04:54:23,994 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-12-21 04:54:23,994 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-12-21 04:54:23,994 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-12-21 04:54:23,994 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-12-21 04:54:23,994 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-12-21 04:54:23,994 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-12-21 04:54:23,994 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-12-21 04:54:23,994 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-12-21 04:54:23,995 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-12-21 04:54:23,995 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-12-21 04:54:23,995 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-12-21 04:54:23,995 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-12-21 04:54:23,995 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-12-21 04:54:23,995 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-12-21 04:54:23,995 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-12-21 04:54:23,995 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-12-21 04:54:23,995 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-12-21 04:54:23,995 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-12-21 04:54:23,996 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-12-21 04:54:23,996 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-12-21 04:54:23,996 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-12-21 04:54:23,996 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-12-21 04:54:23,996 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-12-21 04:54:23,996 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-12-21 04:54:23,996 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-12-21 04:54:23,996 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-12-21 04:54:23,996 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-12-21 04:54:23,996 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-12-21 04:54:23,996 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-12-21 04:54:23,997 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-12-21 04:54:23,997 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-12-21 04:54:23,997 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-12-21 04:54:23,997 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-12-21 04:54:23,997 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-12-21 04:54:23,997 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-12-21 04:54:23,997 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-12-21 04:54:23,997 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-12-21 04:54:23,997 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-12-21 04:54:23,997 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-12-21 04:54:23,997 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-12-21 04:54:23,998 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-12-21 04:54:23,998 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-12-21 04:54:23,998 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-12-21 04:54:23,998 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-12-21 04:54:23,998 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-12-21 04:54:23,998 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-12-21 04:54:23,998 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-12-21 04:54:23,998 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-12-21 04:54:23,998 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-12-21 04:54:23,998 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-12-21 04:54:23,998 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-12-21 04:54:23,998 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-12-21 04:54:23,999 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-12-21 04:54:23,999 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-12-21 04:54:23,999 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-12-21 04:54:23,999 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-12-21 04:54:23,999 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-12-21 04:54:23,999 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-12-21 04:54:23,999 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-12-21 04:54:24,254 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.06666666666666667, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-12-21 04:54:24,254 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-12-21 04:54:24,255 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.9909252140407105, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.06666666666666667, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-12-21 04:54:24,603 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 586 ms to try 5000 different iterations.  Found a solution that moves 4683 regions; Going from a computed imbalance of 0.9909252140407105 to a new imbalance of 0.18209184234763753. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.04084956387388816, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.056437444885334635, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.5203333333333333, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.04084956387388816, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.17733333333333334, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.24391666666666667, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-12-21 04:54:24,612 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1773784559:81 , srv1925047759:81 , srv858781394:81 , srv924835262:81 , srv1468994715:82 , srv1554595103:82 , srv1985592389:82 , srv2080363348:82 , srv617290585:82 , srv754078796:82 , srv1325300193:83 , srv1817387471:83 , srv1829716868:83 , srv1905908540:83 , srv860215839:83 , srv1423277880:84 , srv1558733682:84 , srv2021824023:84 , srv2105967073:84 , srv699563255:84 , srv1137349539:85 , srv1511942537:85 , srv2004061414:85 , srv204285412:85 , srv2143128257:85 , srv269579440:85 , srv552533329:85 , srv66148438:85 , srv707388266:85 , srv803345646:85 , srv1057313018:86 , srv1133558739:86 , srv117454341:86 , srv1258321831:86 , srv1260069570:86 , srv1566250924:86 , srv1660752198:86 , srv1685447327:86 , srv1696525780:86 , srv175348682:86 , srv1762542726:86 , srv1824794036:86 , srv1912636511:86 , srv2011034880:86 , srv2095823300:86 , srv2121246158:86 , srv2123880185:86 , srv418757187:86 , srv603059426:86 , srv640685718:86 , srv773858338:86 , srv849060954:86 , srv856947493:86 , srv888072014:86 , srv955642588:86 , srv1001374467:87 , srv123141673:87 , srv1241704191:87 , srv1267106723:87 , srv1484183605:87 , srv155919002:87 , srv1906322461:87 , srv1953086637:87 , srv257043887:87 , srv317545048:87 , srv567556405:87 , srv59962645:87 , srv679879177:87 , srv69440729:87 , srv761297759:87 , srv95362890:87 , srv1032019664:88 , srv1270730130:88 , srv1451032913:88 , srv147451895:88 , srv1478526550:88 , srv1630567888:88 , srv1781870202:88 , srv178279068:88 , srv1813567493:88 , srv244792200:88 , srv292026153:88 , srv474228670:88 , srv576020963:88 , srv982431141:88 , srv1203898192:89 , srv1498897215:89 , srv2021424822:89 , srv895848401:89 , srv1515252774:90 , srv1718485591:90 , srv208639072:90 , srv494510:90 , srv1670916976:91 , srv38479889:91 , srv671513541:92 , srv699412754:93 , srv410468561:94 , srv1444433202:95 , srv257958631:453 }
2023-12-21 04:54:24,616 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-12-21 04:54:24,616 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1444433202=15, srv1511942537=22, srv1718485591=33, srv1985592389=48, srv494510=71, srv1829716868=42, srv257958631=63, srv1468994715=17, srv208639072=55, srv1670916976=30, srv1773784559=36, srv1906322461=44, srv1566250924=27, srv567556405=73, srv117454341=5, srv66148438=79, srv773858338=88, srv2011034880=50, srv955642588=98, srv576020963=74, srv707388266=85, srv803345646=89, srv269579440=64, srv2080363348=54, srv2021824023=52, srv1696525780=32, srv2095823300=56, srv95362890=97, srv1057313018=2, srv699412754=83, srv1813567493=39, srv849060954=90, srv204285412=53, srv1685447327=31, srv617290585=77, srv1133558739=3, srv699563255=84, srv1817387471=40, srv1554595103=24, srv317545048=66, srv1498897215=21, srv860215839=93, srv1032019664=1, srv474228670=70, srv147451895=18, srv1325300193=13, srv1478526550=19, srv1558733682=25, srv175348682=34, srv1270730130=12, srv2121246158=58, srv1660752198=29, srv418757187=69, srv1762542726=35, srv1484183605=20, srv2004061414=49, srv2021424822=51, srv1001374467=0, srv924835262=96, srv640685718=78, srv410468561=68, srv1515252774=23, srv2143128257=60, srv888072014=94, srv1423277880=14, srv1267106723=11, srv257043887=62, srv982431141=99, srv856947493=91, srv761297759=87, srv292026153=65, srv679879177=81, srv1781870202=37, srv2105967073=57, srv1137349539=4, srv244792200=61, srv59962645=75, srv178279068=38, srv1912636511=45, srv1630567888=28, srv2123880185=59, srv552533329=72, srv155919002=26, srv1925047759=46, srv858781394=92, srv1824794036=41, srv1203898192=6, srv69440729=82, srv1905908540=43, srv1953086637=47, srv38479889=67, srv671513541=80, srv603059426=76, srv1241704191=8, srv1258321831=9, srv1451032913=16, srv1260069570=10, srv895848401=95, srv123141673=7, srv754078796=86} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-12-21 04:54:24,640 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-12-21 04:54:24,640 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-12-21 04:54:24,640 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-12-21 04:54:24,640 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-12-21 04:54:24,641 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-12-21 04:54:24,641 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-12-21 04:54:24,641 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-12-21 04:54:24,641 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-12-21 04:54:24,641 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-12-21 04:54:24,641 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-12-21 04:54:24,641 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-12-21 04:54:24,641 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-12-21 04:54:24,642 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-12-21 04:54:24,642 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-12-21 04:54:24,642 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-12-21 04:54:24,642 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-12-21 04:54:24,642 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-12-21 04:54:24,642 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-12-21 04:54:24,642 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-12-21 04:54:24,642 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-12-21 04:54:24,643 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-12-21 04:54:24,643 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-12-21 04:54:24,643 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-12-21 04:54:24,643 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-12-21 04:54:24,643 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-12-21 04:54:24,643 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-12-21 04:54:24,643 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-12-21 04:54:24,643 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-12-21 04:54:24,644 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-12-21 04:54:24,644 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-12-21 04:54:24,644 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-12-21 04:54:24,644 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-12-21 04:54:24,644 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-12-21 04:54:24,644 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-12-21 04:54:24,644 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-12-21 04:54:24,644 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-12-21 04:54:24,645 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-12-21 04:54:24,645 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-12-21 04:54:24,645 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-12-21 04:54:24,645 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-12-21 04:54:24,645 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-12-21 04:54:24,645 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-12-21 04:54:24,645 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-12-21 04:54:24,645 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-12-21 04:54:24,645 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-12-21 04:54:24,646 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-12-21 04:54:24,646 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-12-21 04:54:24,646 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-12-21 04:54:24,646 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-12-21 04:54:24,646 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-12-21 04:54:24,646 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-12-21 04:54:24,646 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-12-21 04:54:24,646 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-12-21 04:54:24,647 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-12-21 04:54:24,647 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-12-21 04:54:24,647 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-12-21 04:54:24,647 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-12-21 04:54:24,647 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-12-21 04:54:24,647 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-12-21 04:54:24,647 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-12-21 04:54:24,647 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-12-21 04:54:24,647 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-12-21 04:54:24,648 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-12-21 04:54:24,648 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-12-21 04:54:24,648 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-12-21 04:54:24,648 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-12-21 04:54:24,648 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-12-21 04:54:24,648 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-12-21 04:54:24,648 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-12-21 04:54:24,648 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-12-21 04:54:24,648 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-12-21 04:54:24,649 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-12-21 04:54:24,649 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-12-21 04:54:24,649 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-12-21 04:54:24,649 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-12-21 04:54:24,649 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-12-21 04:54:24,649 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-12-21 04:54:24,649 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-12-21 04:54:24,649 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-12-21 04:54:24,650 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-12-21 04:54:24,650 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-12-21 04:54:24,650 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-12-21 04:54:24,650 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-12-21 04:54:24,650 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-12-21 04:54:24,650 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-12-21 04:54:24,650 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-12-21 04:54:24,650 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-12-21 04:54:24,650 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-12-21 04:54:24,651 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-12-21 04:54:24,651 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-12-21 04:54:24,651 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-12-21 04:54:24,651 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-12-21 04:54:24,651 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-12-21 04:54:24,651 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-12-21 04:54:24,651 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-12-21 04:54:24,651 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-12-21 04:54:24,651 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-12-21 04:54:24,652 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-12-21 04:54:24,652 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-12-21 04:54:24,652 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-12-21 04:54:24,652 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-12-21 04:54:24,774 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.04084956387388816, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.056437444885334635, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.04084956387388816, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.17733333333333334, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.24391666666666667, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-12-21 04:54:24,775 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-12-21 04:54:24,775 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.18205905128078, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.04084956387388816, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.056437444885334635, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.04084956387388816, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.17733333333333334, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.24391666666666667, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-12-21 04:54:24,964 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 286 ms to try 5000 different iterations.  Found a solution that moves 2606 regions; Going from a computed imbalance of 0.18205905128078 to a new imbalance of 0.016570948743956405. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0222681903907729); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.03508847243565277, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.28955555555555557, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0222681903907729); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.013416666666666667); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.04675, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-12-21 04:54:24,972 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1444433202:77 , srv671513541:79 , srv208639072:80 , srv38479889:81 , srv410468561:81 , srv699412754:81 , srv1203898192:82 , srv1498897215:82 , srv1515252774:82 , srv494510:82 , srv1270730130:83 , srv1451032913:83 , srv147451895:83 , srv1566250924:83 , srv1630567888:83 , srv1670916976:83 , srv1718485591:83 , srv1781870202:83 , srv2021424822:83 , srv474228670:83 , srv982431141:83 , srv1001374467:84 , srv1032019664:84 , srv1267106723:84 , srv1685447327:84 , srv178279068:84 , srv317545048:84 , srv567556405:84 , srv576020963:84 , srv761297759:84 , srv895848401:84 , srv95362890:84 , srv123141673:85 , srv1258321831:85 , srv1478526550:85 , srv1484183605:85 , srv155919002:85 , srv1660752198:85 , srv1813567493:85 , srv1906322461:85 , srv2095823300:85 , srv244792200:85 , srv640685718:85 , srv679879177:85 , srv707388266:85 , srv856947493:85 , srv1137349539:86 , srv117454341:86 , srv1241704191:86 , srv1260069570:86 , srv1423277880:86 , srv1511942537:86 , srv175348682:86 , srv1912636511:86 , srv2004061414:86 , srv204285412:86 , srv2121246158:86 , srv2123880185:86 , srv552533329:86 , srv69440729:86 , srv773858338:86 , srv803345646:86 , srv1057313018:87 , srv1133558739:87 , srv1325300193:87 , srv1762542726:87 , srv1824794036:87 , srv1953086637:87 , srv2011034880:87 , srv2105967073:87 , srv2143128257:87 , srv257043887:87 , srv418757187:87 , srv59962645:87 , srv699563255:87 , srv888072014:87 , srv955642588:87 , srv1554595103:88 , srv1558733682:88 , srv1696525780:88 , srv1905908540:88 , srv269579440:88 , srv292026153:88 , srv603059426:88 , srv2021824023:89 , srv2080363348:89 , srv849060954:89 , srv860215839:89 , srv1468994715:90 , srv1773784559:90 , srv1985592389:90 , srv617290585:90 , srv66148438:90 , srv754078796:90 , srv858781394:90 , srv924835262:90 , srv1817387471:91 , srv1829716868:91 , srv1925047759:92 , srv257958631:519 }
2023-12-21 04:54:24,978 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-12-21 04:54:24,979 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1444433202=15, srv1511942537=22, srv1718485591=33, srv1985592389=48, srv494510=71, srv1829716868=42, srv257958631=63, srv1468994715=17, srv208639072=55, srv1670916976=30, srv1773784559=36, srv1906322461=44, srv1566250924=27, srv567556405=73, srv117454341=5, srv66148438=79, srv773858338=88, srv2011034880=50, srv955642588=98, srv576020963=74, srv707388266=85, srv803345646=89, srv269579440=64, srv2080363348=54, srv2021824023=52, srv1696525780=32, srv2095823300=56, srv95362890=97, srv1057313018=2, srv699412754=83, srv1813567493=39, srv849060954=90, srv204285412=53, srv1685447327=31, srv617290585=77, srv1133558739=3, srv699563255=84, srv1817387471=40, srv1554595103=24, srv317545048=66, srv1498897215=21, srv860215839=93, srv1032019664=1, srv474228670=70, srv147451895=18, srv1325300193=13, srv1478526550=19, srv1558733682=25, srv175348682=34, srv1270730130=12, srv2121246158=58, srv1660752198=29, srv418757187=69, srv1762542726=35, srv1484183605=20, srv2004061414=49, srv2021424822=51, srv1001374467=0, srv924835262=96, srv640685718=78, srv410468561=68, srv1515252774=23, srv2143128257=60, srv888072014=94, srv1423277880=14, srv1267106723=11, srv257043887=62, srv982431141=99, srv856947493=91, srv761297759=87, srv292026153=65, srv679879177=81, srv1781870202=37, srv2105967073=57, srv1137349539=4, srv244792200=61, srv59962645=75, srv178279068=38, srv1912636511=45, srv1630567888=28, srv2123880185=59, srv552533329=72, srv155919002=26, srv1925047759=46, srv858781394=92, srv1824794036=41, srv1203898192=6, srv69440729=82, srv1905908540=43, srv1953086637=47, srv38479889=67, srv671513541=80, srv603059426=76, srv1241704191=8, srv1258321831=9, srv1451032913=16, srv1260069570=10, srv895848401=95, srv123141673=7, srv754078796=86} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-12-21 04:54:24,999 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-12-21 04:54:24,999 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-12-21 04:54:25,000 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-12-21 04:54:25,000 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-12-21 04:54:25,000 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-12-21 04:54:25,000 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-12-21 04:54:25,000 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-12-21 04:54:25,000 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-12-21 04:54:25,001 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-12-21 04:54:25,001 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-12-21 04:54:25,001 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-12-21 04:54:25,001 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-12-21 04:54:25,001 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-12-21 04:54:25,001 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-12-21 04:54:25,001 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-12-21 04:54:25,001 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-12-21 04:54:25,001 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-12-21 04:54:25,002 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-12-21 04:54:25,002 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-12-21 04:54:25,002 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-12-21 04:54:25,002 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-12-21 04:54:25,002 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-12-21 04:54:25,002 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-12-21 04:54:25,002 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-12-21 04:54:25,002 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-12-21 04:54:25,002 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-12-21 04:54:25,002 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-12-21 04:54:25,003 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-12-21 04:54:25,003 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-12-21 04:54:25,003 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-12-21 04:54:25,003 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-12-21 04:54:25,003 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-12-21 04:54:25,003 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-12-21 04:54:25,003 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-12-21 04:54:25,003 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-12-21 04:54:25,003 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-12-21 04:54:25,004 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-12-21 04:54:25,004 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-12-21 04:54:25,004 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-12-21 04:54:25,004 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-12-21 04:54:25,004 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-12-21 04:54:25,004 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-12-21 04:54:25,004 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-12-21 04:54:25,004 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-12-21 04:54:25,004 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-12-21 04:54:25,004 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-12-21 04:54:25,005 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-12-21 04:54:25,005 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-12-21 04:54:25,005 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-12-21 04:54:25,005 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-12-21 04:54:25,005 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-12-21 04:54:25,005 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-12-21 04:54:25,005 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-12-21 04:54:25,005 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-12-21 04:54:25,005 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-12-21 04:54:25,005 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-12-21 04:54:25,006 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-12-21 04:54:25,006 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-12-21 04:54:25,006 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-12-21 04:54:25,006 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-12-21 04:54:25,006 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-12-21 04:54:25,006 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-12-21 04:54:25,006 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-12-21 04:54:25,006 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-12-21 04:54:25,006 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-12-21 04:54:25,006 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-12-21 04:54:25,007 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-12-21 04:54:25,007 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-12-21 04:54:25,007 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-12-21 04:54:25,007 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-12-21 04:54:25,007 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-12-21 04:54:25,007 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-12-21 04:54:25,007 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-12-21 04:54:25,007 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-12-21 04:54:25,007 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-12-21 04:54:25,007 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-12-21 04:54:25,008 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-12-21 04:54:25,008 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-12-21 04:54:25,008 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-12-21 04:54:25,008 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-12-21 04:54:25,008 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-12-21 04:54:25,008 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-12-21 04:54:25,008 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-12-21 04:54:25,008 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-12-21 04:54:25,008 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-12-21 04:54:25,008 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-12-21 04:54:25,008 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-12-21 04:54:25,008 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-12-21 04:54:25,009 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-12-21 04:54:25,009 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-12-21 04:54:25,009 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-12-21 04:54:25,009 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-12-21 04:54:25,009 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-12-21 04:54:25,009 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-12-21 04:54:25,009 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-12-21 04:54:25,009 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-12-21 04:54:25,009 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-12-21 04:54:25,009 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-12-21 04:54:25,010 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-12-21 04:54:25,010 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-12-21 04:54:25,010 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-12-21 04:54:25,114 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0222681903907729); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.03508847243565277, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0222681903907729); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.013416666666666667); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.04675, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-12-21 04:54:25,114 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-12-21 04:54:25,114 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.016552701141942586, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0222681903907729); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.03508847243565277, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0222681903907729); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.013416666666666667); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.04675, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-12-21 04:54:25,269 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 241 ms to try 5000 different iterations.  Found a solution that moves 1022 regions; Going from a computed imbalance of 0.016552701141942586 to a new imbalance of 8.546975724711128E-4. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.006676012902388069); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.011141372931414577); MoveCostFunction : (multiplier=7.0, imbalance=0.11355555555555556, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.006676012902388069); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=4.166666666666667E-4); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.004333333333333333); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-12-21 04:54:25,271 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv292026153:81 , srv66148438:82 , srv1953086637:83 , srv410468561:83 , srv603059426:83 , srv699412754:83 , srv849060954:83 , srv895848401:83 , srv1057313018:84 , srv123141673:84 , srv1241704191:84 , srv1478526550:84 , srv1670916976:84 , srv1696525780:84 , srv1813567493:84 , srv1817387471:84 , srv1824794036:84 , srv1829716868:84 , srv1906322461:84 , srv1985592389:84 , srv2011034880:84 , srv2021824023:84 , srv2123880185:84 , srv244792200:84 , srv257043887:84 , srv38479889:84 , srv494510:84 , srv1001374467:85 , srv1032019664:85 , srv1133558739:85 , srv117454341:85 , srv1260069570:85 , srv1270730130:85 , srv1444433202:85 , srv1468994715:85 , srv1515252774:85 , srv1558733682:85 , srv1718485591:85 , srv1762542726:85 , srv178279068:85 , srv1925047759:85 , srv2095823300:85 , srv2143128257:85 , srv269579440:85 , srv418757187:85 , srv59962645:85 , srv617290585:85 , srv69440729:85 , srv773858338:85 , srv888072014:85 , srv955642588:85 , srv1203898192:86 , srv1267106723:86 , srv1451032913:86 , srv1498897215:86 , srv1511942537:86 , srv155919002:86 , srv1630567888:86 , srv1912636511:86 , srv2021424822:86 , srv204285412:86 , srv2080363348:86 , srv2105967073:86 , srv2121246158:86 , srv317545048:86 , srv576020963:86 , srv679879177:86 , srv754078796:86 , srv803345646:86 , srv856947493:86 , srv858781394:86 , srv860215839:86 , srv924835262:86 , srv982431141:86 , srv1137349539:87 , srv1258321831:87 , srv1423277880:87 , srv147451895:87 , srv1484183605:87 , srv1554595103:87 , srv1660752198:87 , srv1685447327:87 , srv175348682:87 , srv1773784559:87 , srv1781870202:87 , srv1905908540:87 , srv2004061414:87 , srv208639072:87 , srv474228670:87 , srv552533329:87 , srv567556405:87 , srv671513541:87 , srv699563255:87 , srv707388266:87 , srv761297759:87 , srv1325300193:88 , srv1566250924:88 , srv640685718:88 , srv95362890:89 , srv257958631:545 }
2023-12-21 04:54:25,274 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-12-21 04:54:25,275 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1444433202=15, srv1511942537=22, srv1718485591=33, srv1985592389=48, srv494510=71, srv1829716868=42, srv257958631=63, srv1468994715=17, srv208639072=55, srv1670916976=30, srv1773784559=36, srv1906322461=44, srv1566250924=27, srv567556405=73, srv117454341=5, srv66148438=79, srv773858338=88, srv2011034880=50, srv955642588=98, srv576020963=74, srv707388266=85, srv803345646=89, srv269579440=64, srv2080363348=54, srv2021824023=52, srv1696525780=32, srv2095823300=56, srv95362890=97, srv1057313018=2, srv699412754=83, srv1813567493=39, srv849060954=90, srv204285412=53, srv1685447327=31, srv617290585=77, srv1133558739=3, srv699563255=84, srv1817387471=40, srv1554595103=24, srv317545048=66, srv1498897215=21, srv860215839=93, srv1032019664=1, srv474228670=70, srv147451895=18, srv1325300193=13, srv1478526550=19, srv1558733682=25, srv175348682=34, srv1270730130=12, srv2121246158=58, srv1660752198=29, srv418757187=69, srv1762542726=35, srv1484183605=20, srv2004061414=49, srv2021424822=51, srv1001374467=0, srv924835262=96, srv640685718=78, srv410468561=68, srv1515252774=23, srv2143128257=60, srv888072014=94, srv1423277880=14, srv1267106723=11, srv257043887=62, srv982431141=99, srv856947493=91, srv761297759=87, srv292026153=65, srv679879177=81, srv1781870202=37, srv2105967073=57, srv1137349539=4, srv244792200=61, srv59962645=75, srv178279068=38, srv1912636511=45, srv1630567888=28, srv2123880185=59, srv552533329=72, srv155919002=26, srv1925047759=46, srv858781394=92, srv1824794036=41, srv1203898192=6, srv69440729=82, srv1905908540=43, srv1953086637=47, srv38479889=67, srv671513541=80, srv603059426=76, srv1241704191=8, srv1258321831=9, srv1451032913=16, srv1260069570=10, srv895848401=95, srv123141673=7, srv754078796=86} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-12-21 04:54:25,284 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-12-21 04:54:25,284 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-12-21 04:54:25,284 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-12-21 04:54:25,284 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-12-21 04:54:25,284 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-12-21 04:54:25,284 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-12-21 04:54:25,284 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-12-21 04:54:25,284 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-12-21 04:54:25,284 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-12-21 04:54:25,284 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-12-21 04:54:25,284 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-12-21 04:54:25,285 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-12-21 04:54:25,285 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-12-21 04:54:25,285 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-12-21 04:54:25,285 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-12-21 04:54:25,285 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-12-21 04:54:25,285 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-12-21 04:54:25,285 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-12-21 04:54:25,285 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-12-21 04:54:25,285 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-12-21 04:54:25,285 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-12-21 04:54:25,285 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-12-21 04:54:25,285 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-12-21 04:54:25,285 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-12-21 04:54:25,285 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-12-21 04:54:25,285 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-12-21 04:54:25,285 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-12-21 04:54:25,285 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-12-21 04:54:25,286 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-12-21 04:54:25,286 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-12-21 04:54:25,286 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-12-21 04:54:25,286 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-12-21 04:54:25,286 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-12-21 04:54:25,286 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-12-21 04:54:25,286 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-12-21 04:54:25,286 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-12-21 04:54:25,286 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-12-21 04:54:25,286 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-12-21 04:54:25,286 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-12-21 04:54:25,286 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-12-21 04:54:25,286 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-12-21 04:54:25,286 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-12-21 04:54:25,286 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-12-21 04:54:25,286 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-12-21 04:54:25,287 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-12-21 04:54:25,287 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-12-21 04:54:25,287 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-12-21 04:54:25,287 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-12-21 04:54:25,287 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-12-21 04:54:25,287 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-12-21 04:54:25,287 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-12-21 04:54:25,287 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-12-21 04:54:25,287 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-12-21 04:54:25,287 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-12-21 04:54:25,287 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-12-21 04:54:25,287 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-12-21 04:54:25,287 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-12-21 04:54:25,287 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-12-21 04:54:25,288 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-12-21 04:54:25,288 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-12-21 04:54:25,288 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-12-21 04:54:25,288 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-12-21 04:54:25,288 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-12-21 04:54:25,288 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-12-21 04:54:25,288 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-12-21 04:54:25,288 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-12-21 04:54:25,288 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-12-21 04:54:25,288 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-12-21 04:54:25,288 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-12-21 04:54:25,288 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-12-21 04:54:25,288 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-12-21 04:54:25,288 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-12-21 04:54:25,288 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-12-21 04:54:25,288 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-12-21 04:54:25,288 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-12-21 04:54:25,289 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-12-21 04:54:25,289 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-12-21 04:54:25,289 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-12-21 04:54:25,289 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-12-21 04:54:25,289 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-12-21 04:54:25,289 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-12-21 04:54:25,289 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-12-21 04:54:25,289 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-12-21 04:54:25,289 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-12-21 04:54:25,289 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-12-21 04:54:25,289 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-12-21 04:54:25,289 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-12-21 04:54:25,289 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-12-21 04:54:25,289 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-12-21 04:54:25,289 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-12-21 04:54:25,289 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-12-21 04:54:25,290 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-12-21 04:54:25,290 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-12-21 04:54:25,290 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-12-21 04:54:25,290 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-12-21 04:54:25,290 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-12-21 04:54:25,290 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-12-21 04:54:25,290 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-12-21 04:54:25,290 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-12-21 04:54:25,290 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-12-21 04:54:25,290 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-12-21 04:54:25,373 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.006676012902388069); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.011141372931414577); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.006676012902388069); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=4.166666666666667E-4); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.004333333333333333); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-12-21 04:54:25,373 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-12-21 04:54:25,373 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=8.475413755186483E-4, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.006676012902388069); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.011141372931414577); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.006676012902388069); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=4.166666666666667E-4); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.004333333333333333); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-12-21 04:54:25,588 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 292 ms to try 5000 different iterations.  Found a solution that moves 292 regions; Going from a computed imbalance of 8.475413755186483E-4 to a new imbalance of 5.075570326288933E-5. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=4.4668347344853864E-4); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.002010075630518424); MoveCostFunction : (multiplier=7.0, imbalance=0.03244444444444444, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=4.4668347344853864E-4); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=4.166666666666667E-4); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-12-21 04:54:25,589 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv95362890:82 , srv147451895:83 , srv1484183605:83 , srv175348682:83 , srv257043887:83 , srv59962645:83 , srv640685718:83 , srv1133558739:84 , srv1137349539:84 , srv1258321831:84 , srv1325300193:84 , srv1515252774:84 , srv155919002:84 , srv1660752198:84 , srv1670916976:84 , srv1685447327:84 , srv1696525780:84 , srv1718485591:84 , srv1762542726:84 , srv1773784559:84 , srv1781870202:84 , srv1817387471:84 , srv1829716868:84 , srv1905908540:84 , srv1912636511:84 , srv1925047759:84 , srv2004061414:84 , srv2021424822:84 , srv2121246158:84 , srv269579440:84 , srv410468561:84 , srv474228670:84 , srv552533329:84 , srv567556405:84 , srv576020963:84 , srv66148438:84 , srv671513541:84 , srv679879177:84 , srv699563255:84 , srv754078796:84 , srv761297759:84 , srv803345646:84 , srv849060954:84 , srv856947493:84 , srv860215839:84 , srv888072014:84 , srv955642588:84 , srv1032019664:85 , srv1057313018:85 , srv117454341:85 , srv1203898192:85 , srv1241704191:85 , srv1260069570:85 , srv1267106723:85 , srv1423277880:85 , srv1451032913:85 , srv1468994715:85 , srv1478526550:85 , srv1498897215:85 , srv1511942537:85 , srv1554595103:85 , srv1558733682:85 , srv1566250924:85 , srv1630567888:85 , srv178279068:85 , srv1813567493:85 , srv1824794036:85 , srv1906322461:85 , srv2021824023:85 , srv204285412:85 , srv208639072:85 , srv2105967073:85 , srv2143128257:85 , srv244792200:85 , srv292026153:85 , srv317545048:85 , srv418757187:85 , srv617290585:85 , srv69440729:85 , srv699412754:85 , srv707388266:85 , srv773858338:85 , srv858781394:85 , srv982431141:85 , srv1001374467:86 , srv123141673:86 , srv1270730130:86 , srv1444433202:86 , srv1953086637:86 , srv1985592389:86 , srv2011034880:86 , srv2080363348:86 , srv2095823300:86 , srv2123880185:86 , srv38479889:86 , srv494510:86 , srv603059426:86 , srv895848401:86 , srv924835262:86 , srv257958631:625 }
2023-12-21 04:54:25,593 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-12-21 04:54:25,593 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1444433202=15, srv1511942537=22, srv1718485591=33, srv1985592389=48, srv494510=71, srv1829716868=42, srv257958631=63, srv1468994715=17, srv208639072=55, srv1670916976=30, srv1773784559=36, srv1906322461=44, srv1566250924=27, srv567556405=73, srv117454341=5, srv66148438=79, srv773858338=88, srv2011034880=50, srv955642588=98, srv576020963=74, srv707388266=85, srv803345646=89, srv269579440=64, srv2080363348=54, srv2021824023=52, srv1696525780=32, srv2095823300=56, srv95362890=97, srv1057313018=2, srv699412754=83, srv1813567493=39, srv849060954=90, srv204285412=53, srv1685447327=31, srv617290585=77, srv1133558739=3, srv699563255=84, srv1817387471=40, srv1554595103=24, srv317545048=66, srv1498897215=21, srv860215839=93, srv1032019664=1, srv474228670=70, srv147451895=18, srv1325300193=13, srv1478526550=19, srv1558733682=25, srv175348682=34, srv1270730130=12, srv2121246158=58, srv1660752198=29, srv418757187=69, srv1762542726=35, srv1484183605=20, srv2004061414=49, srv2021424822=51, srv1001374467=0, srv924835262=96, srv640685718=78, srv410468561=68, srv1515252774=23, srv2143128257=60, srv888072014=94, srv1423277880=14, srv1267106723=11, srv257043887=62, srv982431141=99, srv856947493=91, srv761297759=87, srv292026153=65, srv679879177=81, srv1781870202=37, srv2105967073=57, srv1137349539=4, srv244792200=61, srv59962645=75, srv178279068=38, srv1912636511=45, srv1630567888=28, srv2123880185=59, srv552533329=72, srv155919002=26, srv1925047759=46, srv858781394=92, srv1824794036=41, srv1203898192=6, srv69440729=82, srv1905908540=43, srv1953086637=47, srv38479889=67, srv671513541=80, srv603059426=76, srv1241704191=8, srv1258321831=9, srv1451032913=16, srv1260069570=10, srv895848401=95, srv123141673=7, srv754078796=86} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-12-21 04:54:25,607 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-12-21 04:54:25,608 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-12-21 04:54:25,608 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-12-21 04:54:25,608 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-12-21 04:54:25,608 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-12-21 04:54:25,608 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-12-21 04:54:25,608 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-12-21 04:54:25,608 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-12-21 04:54:25,608 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-12-21 04:54:25,608 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-12-21 04:54:25,609 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-12-21 04:54:25,609 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-12-21 04:54:25,609 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-12-21 04:54:25,609 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-12-21 04:54:25,609 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-12-21 04:54:25,609 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-12-21 04:54:25,609 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-12-21 04:54:25,609 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-12-21 04:54:25,609 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-12-21 04:54:25,609 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-12-21 04:54:25,609 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-12-21 04:54:25,610 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-12-21 04:54:25,610 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-12-21 04:54:25,610 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-12-21 04:54:25,610 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-12-21 04:54:25,610 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-12-21 04:54:25,610 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-12-21 04:54:25,610 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-12-21 04:54:25,610 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-12-21 04:54:25,610 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-12-21 04:54:25,610 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-12-21 04:54:25,610 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-12-21 04:54:25,611 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-12-21 04:54:25,611 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-12-21 04:54:25,611 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-12-21 04:54:25,611 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-12-21 04:54:25,611 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-12-21 04:54:25,611 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-12-21 04:54:25,611 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-12-21 04:54:25,611 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-12-21 04:54:25,611 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-12-21 04:54:25,611 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-12-21 04:54:25,611 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-12-21 04:54:25,612 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-12-21 04:54:25,612 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-12-21 04:54:25,612 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-12-21 04:54:25,612 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-12-21 04:54:25,612 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-12-21 04:54:25,612 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-12-21 04:54:25,612 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-12-21 04:54:25,612 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-12-21 04:54:25,612 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-12-21 04:54:25,612 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-12-21 04:54:25,613 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-12-21 04:54:25,613 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-12-21 04:54:25,613 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-12-21 04:54:25,613 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-12-21 04:54:25,613 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-12-21 04:54:25,613 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-12-21 04:54:25,613 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-12-21 04:54:25,613 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-12-21 04:54:25,613 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-12-21 04:54:25,613 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-12-21 04:54:25,613 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-12-21 04:54:25,613 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-12-21 04:54:25,614 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-12-21 04:54:25,614 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-12-21 04:54:25,614 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-12-21 04:54:25,614 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-12-21 04:54:25,614 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-12-21 04:54:25,614 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-12-21 04:54:25,614 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-12-21 04:54:25,614 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-12-21 04:54:25,614 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-12-21 04:54:25,614 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-12-21 04:54:25,614 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-12-21 04:54:25,614 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-12-21 04:54:25,614 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-12-21 04:54:25,614 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-12-21 04:54:25,614 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-12-21 04:54:25,615 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-12-21 04:54:25,615 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-12-21 04:54:25,615 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-12-21 04:54:25,615 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-12-21 04:54:25,615 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-12-21 04:54:25,615 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-12-21 04:54:25,615 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-12-21 04:54:25,615 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-12-21 04:54:25,615 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-12-21 04:54:25,615 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-12-21 04:54:25,615 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-12-21 04:54:25,615 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-12-21 04:54:25,615 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-12-21 04:54:25,615 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-12-21 04:54:25,615 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-12-21 04:54:25,615 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-12-21 04:54:25,615 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-12-21 04:54:25,615 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-12-21 04:54:25,616 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-12-21 04:54:25,616 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-12-21 04:54:25,616 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-12-21 04:54:25,698 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=4.4668347344853864E-4); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.002010075630518424); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=4.4668347344853864E-4); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=4.166666666666667E-4); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-12-21 04:54:25,698 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-12-21 04:54:25,699 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=4.871107556218522E-5, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=4.4668347344853864E-4); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.002010075630518424); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=4.4668347344853864E-4); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=4.166666666666667E-4); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-12-21 04:54:25,860 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 237 ms to try 5000 different iterations.  Found a solution that moves 34 regions; Going from a computed imbalance of 4.871107556218522E-5 to a new imbalance of 7.311312384767599E-6. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0015713484026367722); MoveCostFunction : (multiplier=7.0, imbalance=0.003777777777777778); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-12-21 04:54:25,860 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1444433202:83 , srv1953086637:83 , srv2011034880:83 , srv2080363348:83 , srv418757187:83 , srv603059426:83 , srv69440729:83 , srv924835262:83 , srv1001374467:84 , srv1032019664:84 , srv1057313018:84 , srv1133558739:84 , srv1137349539:84 , srv117454341:84 , srv1203898192:84 , srv123141673:84 , srv1241704191:84 , srv1258321831:84 , srv1260069570:84 , srv1267106723:84 , srv1270730130:84 , srv1325300193:84 , srv1423277880:84 , srv1451032913:84 , srv1468994715:84 , srv1478526550:84 , srv1484183605:84 , srv1498897215:84 , srv1511942537:84 , srv1554595103:84 , srv1558733682:84 , srv155919002:84 , srv1566250924:84 , srv1630567888:84 , srv1660752198:84 , srv1670916976:84 , srv1696525780:84 , srv1718485591:84 , srv175348682:84 , srv1762542726:84 , srv1773784559:84 , srv1781870202:84 , srv178279068:84 , srv1813567493:84 , srv1817387471:84 , srv1824794036:84 , srv1829716868:84 , srv1905908540:84 , srv1912636511:84 , srv1925047759:84 , srv1985592389:84 , srv2004061414:84 , srv2021424822:84 , srv2021824023:84 , srv204285412:84 , srv208639072:84 , srv2095823300:84 , srv2105967073:84 , srv2121246158:84 , srv2123880185:84 , srv2143128257:84 , srv244792200:84 , srv269579440:84 , srv292026153:84 , srv317545048:84 , srv38479889:84 , srv410468561:84 , srv474228670:84 , srv494510:84 , srv552533329:84 , srv567556405:84 , srv576020963:84 , srv59962645:84 , srv617290585:84 , srv640685718:84 , srv671513541:84 , srv679879177:84 , srv699412754:84 , srv699563255:84 , srv707388266:84 , srv754078796:84 , srv761297759:84 , srv773858338:84 , srv849060954:84 , srv858781394:84 , srv860215839:84 , srv888072014:84 , srv895848401:84 , srv95362890:84 , srv955642588:84 , srv982431141:84 , srv147451895:85 , srv1515252774:85 , srv1685447327:85 , srv1906322461:85 , srv257043887:85 , srv66148438:85 , srv803345646:85 , srv856947493:85 , srv257958631:684 }
2023-12-21 04:54:25,866 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-12-21 04:54:25,866 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1444433202=15, srv1511942537=22, srv1718485591=33, srv1985592389=48, srv494510=71, srv1829716868=42, srv257958631=63, srv1468994715=17, srv208639072=55, srv1670916976=30, srv1773784559=36, srv1906322461=44, srv1566250924=27, srv567556405=73, srv117454341=5, srv66148438=79, srv773858338=88, srv2011034880=50, srv955642588=98, srv576020963=74, srv707388266=85, srv803345646=89, srv269579440=64, srv2080363348=54, srv2021824023=52, srv1696525780=32, srv2095823300=56, srv95362890=97, srv1057313018=2, srv699412754=83, srv1813567493=39, srv849060954=90, srv204285412=53, srv1685447327=31, srv617290585=77, srv1133558739=3, srv699563255=84, srv1817387471=40, srv1554595103=24, srv317545048=66, srv1498897215=21, srv860215839=93, srv1032019664=1, srv474228670=70, srv147451895=18, srv1325300193=13, srv1478526550=19, srv1558733682=25, srv175348682=34, srv1270730130=12, srv2121246158=58, srv1660752198=29, srv418757187=69, srv1762542726=35, srv1484183605=20, srv2004061414=49, srv2021424822=51, srv1001374467=0, srv924835262=96, srv640685718=78, srv410468561=68, srv1515252774=23, srv2143128257=60, srv888072014=94, srv1423277880=14, srv1267106723=11, srv257043887=62, srv982431141=99, srv856947493=91, srv761297759=87, srv292026153=65, srv679879177=81, srv1781870202=37, srv2105967073=57, srv1137349539=4, srv244792200=61, srv59962645=75, srv178279068=38, srv1912636511=45, srv1630567888=28, srv2123880185=59, srv552533329=72, srv155919002=26, srv1925047759=46, srv858781394=92, srv1824794036=41, srv1203898192=6, srv69440729=82, srv1905908540=43, srv1953086637=47, srv38479889=67, srv671513541=80, srv603059426=76, srv1241704191=8, srv1258321831=9, srv1451032913=16, srv1260069570=10, srv895848401=95, srv123141673=7, srv754078796=86} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-12-21 04:54:25,882 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-12-21 04:54:25,882 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-12-21 04:54:25,882 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-12-21 04:54:25,882 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-12-21 04:54:25,882 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-12-21 04:54:25,882 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-12-21 04:54:25,882 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-12-21 04:54:25,882 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-12-21 04:54:25,883 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-12-21 04:54:25,883 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-12-21 04:54:25,883 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-12-21 04:54:25,883 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-12-21 04:54:25,883 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-12-21 04:54:25,883 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-12-21 04:54:25,883 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-12-21 04:54:25,883 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-12-21 04:54:25,883 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-12-21 04:54:25,883 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-12-21 04:54:25,883 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-12-21 04:54:25,883 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-12-21 04:54:25,884 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-12-21 04:54:25,884 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-12-21 04:54:25,884 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-12-21 04:54:25,884 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-12-21 04:54:25,884 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-12-21 04:54:25,884 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-12-21 04:54:25,884 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-12-21 04:54:25,884 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-12-21 04:54:25,884 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-12-21 04:54:25,884 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-12-21 04:54:25,884 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-12-21 04:54:25,884 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-12-21 04:54:25,884 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-12-21 04:54:25,885 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-12-21 04:54:25,885 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-12-21 04:54:25,885 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-12-21 04:54:25,885 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-12-21 04:54:25,885 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-12-21 04:54:25,885 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-12-21 04:54:25,885 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-12-21 04:54:25,885 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-12-21 04:54:25,885 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-12-21 04:54:25,885 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-12-21 04:54:25,885 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-12-21 04:54:25,885 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-12-21 04:54:25,886 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-12-21 04:54:25,886 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-12-21 04:54:25,886 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-12-21 04:54:25,886 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-12-21 04:54:25,886 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-12-21 04:54:25,886 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-12-21 04:54:25,886 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-12-21 04:54:25,886 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-12-21 04:54:25,886 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-12-21 04:54:25,886 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-12-21 04:54:25,886 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-12-21 04:54:25,886 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-12-21 04:54:25,886 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-12-21 04:54:25,886 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-12-21 04:54:25,887 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-12-21 04:54:25,887 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-12-21 04:54:25,887 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-12-21 04:54:25,887 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-12-21 04:54:25,887 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-12-21 04:54:25,887 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-12-21 04:54:25,887 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-12-21 04:54:25,887 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-12-21 04:54:25,887 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-12-21 04:54:25,887 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-12-21 04:54:25,887 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-12-21 04:54:25,887 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-12-21 04:54:25,887 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-12-21 04:54:25,888 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-12-21 04:54:25,888 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-12-21 04:54:25,888 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-12-21 04:54:25,888 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-12-21 04:54:25,888 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-12-21 04:54:25,888 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-12-21 04:54:25,888 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-12-21 04:54:25,888 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-12-21 04:54:25,888 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-12-21 04:54:25,888 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-12-21 04:54:25,888 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-12-21 04:54:25,888 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-12-21 04:54:25,888 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-12-21 04:54:25,889 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-12-21 04:54:25,889 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-12-21 04:54:25,889 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-12-21 04:54:25,889 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-12-21 04:54:25,889 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-12-21 04:54:25,889 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-12-21 04:54:25,889 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-12-21 04:54:25,889 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-12-21 04:54:25,889 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-12-21 04:54:25,889 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-12-21 04:54:25,889 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-12-21 04:54:25,890 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-12-21 04:54:25,890 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-12-21 04:54:25,890 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-12-21 04:54:25,890 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-12-21 04:54:25,890 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-12-21 04:54:25,974 INFO  [Time-limited test] balancer.StochasticLoadBalancer(381): Cluster wide - skipping load balancing because weighted average imbalance=7.073239296329447E-6 <= threshold(0.025). If you want more aggressive balancing, either lower hbase.master.balancer.stochastic.minCostNeedBalance from 0.025 or increase the relative multiplier(s) of the specific cost function(s). functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0015713484026367722); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-12-21 04:54:25,975 INFO  [Time-limited test] balancer.BalancerTestBase(570): Mock Final balance: { srv1444433202:83 , srv1953086637:83 , srv2011034880:83 , srv2080363348:83 , srv418757187:83 , srv603059426:83 , srv69440729:83 , srv924835262:83 , srv1001374467:84 , srv1032019664:84 , srv1057313018:84 , srv1133558739:84 , srv1137349539:84 , srv117454341:84 , srv1203898192:84 , srv123141673:84 , srv1241704191:84 , srv1258321831:84 , srv1260069570:84 , srv1267106723:84 , srv1270730130:84 , srv1325300193:84 , srv1423277880:84 , srv1451032913:84 , srv1468994715:84 , srv1478526550:84 , srv1484183605:84 , srv1498897215:84 , srv1511942537:84 , srv1554595103:84 , srv1558733682:84 , srv155919002:84 , srv1566250924:84 , srv1630567888:84 , srv1660752198:84 , srv1670916976:84 , srv1696525780:84 , srv1718485591:84 , srv175348682:84 , srv1762542726:84 , srv1773784559:84 , srv1781870202:84 , srv178279068:84 , srv1813567493:84 , srv1817387471:84 , srv1824794036:84 , srv1829716868:84 , srv1905908540:84 , srv1912636511:84 , srv1925047759:84 , srv1985592389:84 , srv2004061414:84 , srv2021424822:84 , srv2021824023:84 , srv204285412:84 , srv208639072:84 , srv2095823300:84 , srv2105967073:84 , srv2121246158:84 , srv2123880185:84 , srv2143128257:84 , srv244792200:84 , srv269579440:84 , srv292026153:84 , srv317545048:84 , srv38479889:84 , srv410468561:84 , srv474228670:84 , srv494510:84 , srv552533329:84 , srv567556405:84 , srv576020963:84 , srv59962645:84 , srv617290585:84 , srv640685718:84 , srv671513541:84 , srv679879177:84 , srv699412754:84 , srv699563255:84 , srv707388266:84 , srv754078796:84 , srv761297759:84 , srv773858338:84 , srv849060954:84 , srv858781394:84 , srv860215839:84 , srv888072014:84 , srv895848401:84 , srv95362890:84 , srv955642588:84 , srv982431141:84 , srv147451895:85 , srv1515252774:85 , srv1685447327:85 , srv1906322461:85 , srv257043887:85 , srv66148438:85 , srv803345646:85 , srv856947493:85 , srv257958631:684 }
2023-12-21 04:54:25,994 INFO  [Time-limited test] hbase.ResourceChecker(175): after: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnLargeClusterWithRacks Thread=12 (was 12), OpenFileDescriptor=290 (was 290), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=112 (was 106) - SystemLoadAverage LEAK? -, ProcessCount=174 (was 174), AvailableMemoryMB=7453 (was 7945)
2023-12-21 04:54:26,001 INFO  [Time-limited test] hbase.ResourceChecker(147): before: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnMidClusterWithRacks Thread=12, OpenFileDescriptor=290, MaxFileDescriptor=60000, SystemLoadAverage=112, ProcessCount=174, AvailableMemoryMB=7453
2023-12-21 04:54:26,001 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2023-12-21 04:54:26,002 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=5000, runMaxSteps=true, stepsPerRegion=800, maxRunningTime=120000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 111077.0 etc.
2023-12-21 04:54:26,012 INFO  [Time-limited test] balancer.BalancerTestBase(547): Mock Cluster : { srv1036308536:84 , srv1036440998:84 , srv1085173279:84 , srv1343248958:84 , srv1362449957:84 , srv1400185090:84 , srv1404269164:84 , srv147459200:84 , srv1521688809:84 , srv1899007176:84 , srv1900206926:84 , srv258154231:84 , srv300456785:84 , srv36099644:84 , srv38198251:84 , srv428983273:84 , srv483007366:84 , srv564508348:84 , srv60896455:84 , srv619731281:84 , srv63941441:84 , srv650928623:84 , srv651670469:84 , srv697757388:84 , srv841339109:84 , srv851976830:84 , srv879812967:84 , srv915503322:84 , srv946093430:84 , srv707575493:264 } [srvr=30 rgns=2700 avg=90.0 max=90 min=90]
2023-12-21 04:54:26,014 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-12-21 04:54:26,014 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1036440998=1, srv1036308536=0, srv1404269164=6, srv1899007176=9, srv1900206926=10, srv650928623=21, srv258154231=11, srv946093430=29, srv1343248958=3, srv36099644=13, srv697757388=23, srv428983273=15, srv38198251=14, srv1085173279=2, srv1521688809=8, srv300456785=12, srv483007366=16, srv60896455=18, srv651670469=22, srv841339109=25, srv1362449957=4, srv564508348=17, srv915503322=28, srv707575493=24, srv879812967=27, srv851976830=26, srv1400185090=5, srv619731281=19, srv147459200=7, srv63941441=20} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-12-21 04:54:26,026 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-12-21 04:54:26,026 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-12-21 04:54:26,026 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-12-21 04:54:26,026 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-12-21 04:54:26,026 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-12-21 04:54:26,026 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-12-21 04:54:26,026 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-12-21 04:54:26,026 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-12-21 04:54:26,026 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-12-21 04:54:26,026 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-12-21 04:54:26,026 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-12-21 04:54:26,027 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-12-21 04:54:26,027 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-12-21 04:54:26,027 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-12-21 04:54:26,027 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-12-21 04:54:26,027 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-12-21 04:54:26,027 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-12-21 04:54:26,027 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-12-21 04:54:26,027 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-12-21 04:54:26,027 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-12-21 04:54:26,027 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-12-21 04:54:26,027 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-12-21 04:54:26,027 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-12-21 04:54:26,027 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-12-21 04:54:26,027 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-12-21 04:54:26,027 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-12-21 04:54:26,027 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-12-21 04:54:26,027 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-12-21 04:54:26,027 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-12-21 04:54:26,027 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-12-21 04:54:26,027 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=10, number of hosts=30, number of racks=4
2023-12-21 04:54:26,051 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=1.0833808136362242, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-12-21 04:54:26,052 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.9912455773485414, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=1.0833808136362242, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=64800000
2023-12-21 04:56:26,030 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 120001 ms to try 9352366 different iterations.  Found a solution that moves 1837 regions; Going from a computed imbalance of 0.9912455773485414 to a new imbalance of 4.2876496417733574E-5. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); MoveCostFunction : (multiplier=7.0, imbalance=0.6803703703703704, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-12-21 04:56:26,037 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1036308536:90 , srv1036440998:90 , srv1085173279:90 , srv1343248958:90 , srv1362449957:90 , srv1400185090:90 , srv1404269164:90 , srv147459200:90 , srv1521688809:90 , srv1899007176:90 , srv1900206926:90 , srv258154231:90 , srv300456785:90 , srv36099644:90 , srv38198251:90 , srv428983273:90 , srv483007366:90 , srv564508348:90 , srv60896455:90 , srv619731281:90 , srv63941441:90 , srv650928623:90 , srv651670469:90 , srv697757388:90 , srv707575493:90 , srv841339109:90 , srv851976830:90 , srv879812967:90 , srv915503322:90 , srv946093430:90 }
2023-12-21 04:56:26,038 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-12-21 04:56:26,038 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1036440998=1, srv1036308536=0, srv1404269164=6, srv1899007176=9, srv1900206926=10, srv650928623=21, srv258154231=11, srv946093430=29, srv1343248958=3, srv36099644=13, srv697757388=23, srv428983273=15, srv38198251=14, srv1085173279=2, srv1521688809=8, srv300456785=12, srv483007366=16, srv60896455=18, srv651670469=22, srv841339109=25, srv1362449957=4, srv564508348=17, srv915503322=28, srv707575493=24, srv879812967=27, srv851976830=26, srv1400185090=5, srv619731281=19, srv147459200=7, srv63941441=20} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-12-21 04:56:26,042 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-12-21 04:56:26,042 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-12-21 04:56:26,042 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-12-21 04:56:26,042 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-12-21 04:56:26,042 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-12-21 04:56:26,042 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-12-21 04:56:26,043 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-12-21 04:56:26,043 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-12-21 04:56:26,043 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-12-21 04:56:26,043 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-12-21 04:56:26,043 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-12-21 04:56:26,043 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-12-21 04:56:26,043 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-12-21 04:56:26,043 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-12-21 04:56:26,043 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-12-21 04:56:26,043 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-12-21 04:56:26,043 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-12-21 04:56:26,043 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-12-21 04:56:26,044 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-12-21 04:56:26,044 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-12-21 04:56:26,044 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-12-21 04:56:26,044 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-12-21 04:56:26,044 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-12-21 04:56:26,044 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-12-21 04:56:26,044 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-12-21 04:56:26,044 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-12-21 04:56:26,044 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-12-21 04:56:26,044 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-12-21 04:56:26,044 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-12-21 04:56:26,044 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-12-21 04:56:26,044 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=10, number of hosts=30, number of racks=4
2023-12-21 04:56:26,060 INFO  [Time-limited test] balancer.StochasticLoadBalancer(381): Cluster wide - skipping load balancing because weighted average imbalance=0.0 <= threshold(0.025). If you want more aggressive balancing, either lower hbase.master.balancer.stochastic.minCostNeedBalance from 0.025 or increase the relative multiplier(s) of the specific cost function(s). functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-12-21 04:56:26,060 INFO  [Time-limited test] balancer.BalancerTestBase(570): Mock Final balance: { srv1036308536:90 , srv1036440998:90 , srv1085173279:90 , srv1343248958:90 , srv1362449957:90 , srv1400185090:90 , srv1404269164:90 , srv147459200:90 , srv1521688809:90 , srv1899007176:90 , srv1900206926:90 , srv258154231:90 , srv300456785:90 , srv36099644:90 , srv38198251:90 , srv428983273:90 , srv483007366:90 , srv564508348:90 , srv60896455:90 , srv619731281:90 , srv63941441:90 , srv650928623:90 , srv651670469:90 , srv697757388:90 , srv707575493:90 , srv841339109:90 , srv851976830:90 , srv879812967:90 , srv915503322:90 , srv946093430:90 }
2023-12-21 04:56:26,073 INFO  [Time-limited test] hbase.ResourceChecker(175): after: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnMidClusterWithRacks Thread=11 (was 12), OpenFileDescriptor=290 (was 290), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=185 (was 112) - SystemLoadAverage LEAK? -, ProcessCount=174 (was 174), AvailableMemoryMB=8314 (was 7453) - AvailableMemoryMB LEAK? -